spark VS ML.NET

Re: DataFrames, that's good to know. There is the DataFrame API which is part of the Microsoft.Data.Analysis NuGet package and that's the API that the issue is tracking and shown in the sample notebook I shared. That API has no dependencies on other systems. The DataFrame you're referring to is part of the .NET for Apache Spark library which has the dependency on Apache Spark which rqeuires some initial setup.

the data engineering ecosystem is new to me but my first impressions are that everything is catered toward JVM. The only somewhat promising option I've found for building a data pipeline in .NET is github.com/dotnet/spark.

You can direct your question to https://github.com/dotnet/machinelearning/issues. Perhaps it is already documented.

Here I'm analyzing all projects in the src and test directories of the ML.NET repository. I chose to include these as separate paths because they represent two different groupings of projects in this repository.

Important Note: looping over repository commits takes a long time for large repositories. It took 52 minutes to analyze the ML.NET repository this code example refers to, which had 2,681 commits at the time of analysis on February 25th, 2023.

We checked the ML.NET 1.7.1 version. The source code of this project's version is available on GitHub.

machine learning? https://github.com/dotnet/machinelearning

You can follow some of our plans by taking a look at our roadmap which we'll be updating shortly to more accurately reflect the areas we're investing in.

Re: ONNX, if you run into similar issues in the future, feel free to reach out in our GitHub repo or the ONNX Runtime repo and we'd be happy to help!

Good clarification, I think using something like ML.NET could be cool but I have some experience with Blazor that might be fun to use as well, I think generally performance monitoring or optimizing systems seems interesting to me, and I'm really open to other ideas as well. Let me know if any of that helps narrow my question down!