ECPTextStream VS VBA-CSV-interface

The table below shows the overall performance for the read operations, you can download the test files from here. The test machine is running Win 10 Pro 64-bit, Intel® Core™ i7-4500U CPU N2600 @1.80 GHz - 2.40 GHz, 8 GB RAM.

Parse CSV/TSV through streams with the ECPTextStream class module.

To prove that we are capable to unlocks some performance limitations from traditional file processing approach, I decided to develop the CSVTextStream to gain advantage over native VBA's I/O functionalities, boosting the efficiency of text file reading up to 2 GB in size by use a buffered text stream technique. You can download the latest version from here.

This is by no means all the functionality that CSV Interface can provide. If you want to know more details, I invite you to read the documentation.

Welcome to this community, whose main objective is to serve as a help channel for CSV Interface users. Since its creation, the CSV Interface library, which came to light when it was announced in r/vba and r/excel, has been well accepted by many users around the world. Nowadays, there are NGOs and agencies with solutions programmed to facilitate the work of their collaborators. Working with CSV files, from VBA, has never been so easy.

After this publication, which details the reason why VBA Expressions turned out to be the most feasible option to solve the problem of integrating an expression evaluator with CSV Interface, it is time to address the process of integrating the evaluation capabilities and the ease with which this goal was achieved.

In spite of what I discovered, I was convinced that I could incorporate the referred library to CSV Interface, so I dedicated myself to study the methodology with which variables are handled in stdLambda. I found it difficult to understand why the variables must be passed in terms of a pre-established order ($1 refers to the first value passed as parameter of the evaluate function, $4 the fourth... and so on). Thus, the user is forced to write the expressions taking into account the order in which the values will be passed.

If you want to do something really useful, you can contribute to one of the many amazing libraries around like stdVBA (you can see the backlog here), CSV Interface or VBCorLib

The new release of CSV interface includes substantial improvements and changes to the way users interact with the tool, as well as fixing some programming bugs. What's new in the latest version?

Here are the two procedures that solve your problem in a simple way using CSV files and the CSV interface. Note that if in the column where the file name is taken there is a repeated name, the contents of the array will be appended to the existing CSV file. Here is a link with the solution and the 2 outputs after execute it.

This is a great scenario to use CSV interface. With few lines of code, all files will be made by applying a simple for loop through the rows. You just need to encode the data copy to an array and the filename generator, the CSV job will be done by the interface. Reply to this if the issue is not solved yet.

If the performance still isn't acceptable then /u/ws-garcia has a dedicated CSV parser that they've worked hard at making very high performance.