Hey everyone, I'm new here and feeling a bit confused about how to properly use readstream and writestream. Currently, I'm attempting this (using the library https://www.npmjs.com/package/csv-parse)
fs.createReadStream(path.join(__dirname,"../demofile/Customers.csv"))
.pipe(parse(options))
.on('data', function(csvrow) {
console.log(csvrow);
//do something with csvrow
output.push(csvrow);
})
.on('end',function() {
//do something wiht csvData
console.log(csvData);
});
However, I don't believe this is the correct way to utilize read and write stream with csv-parse. Can anyone suggest a better approach for using read and write in conjunction with the above code? Essentially, my goal is to read a CSV file and write it into another CSV file. The reason I am specifically looking to use read and write streams is because the file size is approximately 2GB.