spark
azure-event-hubs
Our great sponsors
| spark | azure-event-hubs | |
|---|---|---|
| 3 | 1 | |
| 1,997 | 285 | |
| 0.6% | 0.7% | |
| 0.0 | 0.0 | |
| 12 days ago | 10 months ago | |
| C# | ||
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spark
- .NET for Apache Spark appears to be abandoned
-
Does anyone actually use ML.NET?
Re: DataFrames, that's good to know. There is the DataFrame API which is part of the Microsoft.Data.Analysis NuGet package and that's the API that the issue is tracking and shown in the sample notebook I shared. That API has no dependencies on other systems. The DataFrame you're referring to is part of the .NET for Apache Spark library which has the dependency on Apache Spark which rqeuires some initial setup.
-
What does the .NET ecosystem offer in terms of distributed data processing frameworks?
the data engineering ecosystem is new to me but my first impressions are that everything is catered toward JVM. The only somewhat promising option I've found for building a data pipeline in .NET is github.com/dotnet/spark.
azure-event-hubs
-
Cannot read events from Event Hub
I have modified the sample from here: https://github.com/Azure/azure-event-hubs/blob/master/samples/DotNet/Microsoft.Azure.EventHubs/Rbac/AzureEventHubsSDK/Program.cs
What are some alternatives?
ParquetSharp.DataFrame - ParquetSharp.DataFrame is a .NET library for reading and writing Apache Parquet files into/from .NET DataFrames, using ParquetSharp
azure-event-hubs-go - Golang client library for Azure Event Hubs https://azure.microsoft.com/services/event-hubs
dotnet-webassembly - Create, read, modify, write and execute WebAssembly (WASM) files from .NET-based applications.
mandelbrot - Microbenchmark testing Python, Numba, Mojo, Dart, C/gcc, Rust, Go, JavaScript, C#, Java, Kotlin, Pascal, Ruby, Haskell performance in Mandelbrot set generation
ML.NET - ML.NET is an open source and cross-platform machine learning framework for .NET.
extism - The framework for building with WebAssembly (wasm). Easily load wasm modules, move data, call functions, and build extensible apps.
AnyDiff - A CSharp (C#) diff library that allows you to diff two objects and get a list of the differences back.
azure-event-hubs-for-kafka - Azure Event Hubs for Apache Kafka Ecosystems
Mobius: C# API for Spark - C# and F# language binding and extensions to Apache Spark
signal-ios-db-extractor - A tool for dumping Signal history from the iOS database.
jira-issue-analysis - Jira REST client, with emphasis on 'Time in Status' analysis and reporting
JamesCook.Dev-Examples - JamesCook.Dev examples for blog readers.