spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers. (by dotnet)
Akka.net
Canonical actor model implementation for .NET with local + distributed actors in C# and F#. (by akkadotnet)
Our great sponsors
| spark | Akka.net | |
|---|---|---|
| 3 | 20 | |
| 1,997 | 4,612 | |
| 0.6% | 0.8% | |
| 0.0 | 9.3 | |
| 12 days ago | 8 days ago | |
| C# | C# | |
| MIT License | GNU General Public License v3.0 or later |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spark
Posts with mentions or reviews of spark.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-06-21.
- .NET for Apache Spark appears to be abandoned
-
Does anyone actually use ML.NET?
Re: DataFrames, that's good to know. There is the DataFrame API which is part of the Microsoft.Data.Analysis NuGet package and that's the API that the issue is tracking and shown in the sample notebook I shared. That API has no dependencies on other systems. The DataFrame you're referring to is part of the .NET for Apache Spark library which has the dependency on Apache Spark which rqeuires some initial setup.
-
What does the .NET ecosystem offer in terms of distributed data processing frameworks?
the data engineering ecosystem is new to me but my first impressions are that everything is catered toward JVM. The only somewhat promising option I've found for building a data pipeline in .NET is github.com/dotnet/spark.
Akka.net
Posts with mentions or reviews of Akka.net.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-20.
-
What is the fastest producer consumer model in C#
akka.net actors. Actors all the way! https://getakka.net
- .NET - iskustva s akka.net?
-
MassTransit with MSMQ vs RabbitMQ
If it's the former you may want to take a look at something like the actor model akka.net with persistent actors (https://getakka.net/articles/persistence/architecture.html). No need of an external message broker or mass transit (which is a wrapper over different message brokers). You could use sqllite for persisting the actors state to recover in case of a restart.
-
For .NET 6+, is there value in using NHibernate with Sprint.net or should I stick with EF Core and the usual supporting libraries?
Spring and Hibernate are the goto libraries in Java land and I suspect that's the primary motivation for your colleague's recommendations. It's quite easy to bulldoze someone less experienced with your ideas so be careful of that. I'd avoid both. They aren't bad libraries at all but they have a 'legacy' feel and it will make your application less future proof. Would a distributed system be viable? If so then I'd recommend Akka, there'a .NET port of it that's well supported and maintained.
-
Learning resource for seniors
Is akka a good alternative?
- Carl Hewitt has died [pdf]
-
Using functional extensions in production C# code?
However, I've found that sometimes, they are a little -too- functional. I'm a bit more preferential to Akka.Net's implementation of Option and Try, if only because they have good 'escape hatches' where you interrogate them in a more procedural manner.
-
Microsoft RulesEngine. Feedback from those that have used it in enterprise environments
This project is also what ultimately led to the creation of Akka.NET - I wrote an overview on how our application was built here: https://aaronstannard.com/markedup-akkadotnet/
-
Questions about network programming with C#
You may also want to take a look at queues (e.g. RabbitMQ) or even something like Akka.NET or Microsoft Orleans.
-
What does the .NET ecosystem offer in terms of distributed data processing frameworks?
From the title I immediately thought AKKA.NET or Orleans
What are some alternatives?
When comparing spark and Akka.net you can also consider the following projects:
ParquetSharp.DataFrame - ParquetSharp.DataFrame is a .NET library for reading and writing Apache Parquet files into/from .NET DataFrames, using ParquetSharp
protoactor-dotnet - Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
dotnet-webassembly - Create, read, modify, write and execute WebAssembly (WASM) files from .NET-based applications.
Orleankka - Functional API for Microsoft Orleans http://orleanscontrib.github.io/Orleankka
azure-event-hubs - ☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs
Orleans - Cloud Native application framework for .NET
ML.NET - ML.NET is an open source and cross-platform machine learning framework for .NET.
.NET port of LMAX Disruptor - Port of LMAX Disruptor to .NET
AnyDiff - A CSharp (C#) diff library that allows you to diff two objects and get a list of the differences back.
.NEXT Raft
Mobius: C# API for Spark - C# and F# language binding and extensions to Apache Spark
MBrace - MBrace Core Libraries & Runtime Foundations
spark vs ParquetSharp.DataFrame
Akka.net vs protoactor-dotnet
spark vs dotnet-webassembly
Akka.net vs Orleankka
spark vs azure-event-hubs
Akka.net vs Orleans
spark vs ML.NET
Akka.net vs .NET port of LMAX Disruptor
spark vs AnyDiff
Akka.net vs .NEXT Raft
spark vs Mobius: C# API for Spark
Akka.net vs MBrace