DataPowerTools
Bridging the gap between IEnumerable and IDataReader for dealing with unstructured and loosely-structured data, plus fast ETL + SQL Bulk Copy. (by nh43de)
smartbulkcopy
High-Speed Bulk Copy tool to move data from one Azure SQL / SQL Server database to another. Smartly uses logical or physical partitions to maximize speed. (by Azure-Samples)
DataPowerTools | smartbulkcopy | |
---|---|---|
2 | 1 | |
8 | 55 | |
- | - | |
6.7 | 2.9 | |
3 days ago | 4 months ago | |
C# | C# | |
MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
DataPowerTools
Posts with mentions or reviews of DataPowerTools.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-22.
- Recommended patterns or tools for data/row migration between databases?
-
What do you use for Data Wrangling / ETL?
I created a lib https://github.com/nh43de/DataPowerTools for this purpose (basically a lot of extensions around IDataReader), but I haven't had the time to really maintain or document it properly. Basically, there are readers: ExcelReader, CsvReader, etc. that implement IDataReader, a standard ADO.NET interface, and then extension methods can be called on IDataReader to add/modify/transform/lookup columns. Once the (possibly transformed) IDataReader is obtained it can then be used to write the data somewhere else, or analyzed further e.g. to create a table to fit the transformed data. Currently supported destinations are Excel, Sql Server, SqlLite, Csv, or any destination that takes in an IDataReader. It's highly performant and in production in a lot of places.
smartbulkcopy
Posts with mentions or reviews of smartbulkcopy.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-22.
What are some alternatives?
When comparing DataPowerTools and smartbulkcopy you can also consider the following projects:
Dapper - Dapper - a simple object mapper for .Net
SqlDatabaseWithAzureAd - Sample Pulumi code for provisioning an Azure SQL Database with Active Directory authentication configured.
Cinchoo ETL - ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
procfwk - A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.
NETProvider - Firebird ADO.NET Data Provider