Need some help/direction reading CSV into MySQL without duplication

• Sylvan

  10 332 7.5 C#

  A collection of .NET libraries, including the fastest general-purpose CSV parser for .NET.

I maintain a couple libraries that can help with reading the data files: Sylvan.Data.Csv and Sylvan.Data.Excel. I see no reason to not allow users to provide whichever format is convenient for them.

• Sylvan.Data.Excel

  12 164 6.6 C#

  The fastest .NET library for reading Excel data files.

I maintain a couple libraries that can help with reading the data files: Sylvan.Data.Csv and Sylvan.Data.Excel. I see no reason to not allow users to provide whichever format is convenient for them.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• MySqlConnector

  8 1,352 9.2 C#

  MySQL Connector for .NET

  

Use the MySqlConnector to load the data into a temp table using the bulk copy API. Both of my libraries implement the IDataReader (DbDataReader) interface, so they can be directly used with the bulk copy APIs. Then insert into the final table from the temp table filtering out rows that are already in the final table.

Suggest a related project