Web-First Composable Data Pipelines (by hal9ai)

Hal9ai Alternatives

Similar projects and alternatives to hal9ai

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better hal9ai alternative or higher similarity.

Suggest an alternative to hal9ai

Reviews and mentions

Posts with mentions or reviews of hal9ai. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-10-26.
  • Mlflow, fastapi, streamlit template Project
    2 projects | reddit.com/r/learnmachinelearning | 26 Oct 2021
    We would love to help out since this is a perfect use case for https://hal9.ai; we are about to release our beta version that makes this as easy as copy-pasting code. You can find me at javier at hal9.ai to find some time to chat and give you a walkthrough of our code-to-api functionality.
  • Flask with react.js
    1 project | reddit.com/r/learnmachinelearning | 8 Oct 2021
    Hi there, would love to help you out. We are building a JavaScript + Python/R/AI service called https://hal9.ai to enable you to build React/Vue/Svelte/Angular apps against Python/R models. Want to send me an email to javier at hal9.ai to chat and help out?
  • Is BI dead? – On dismantling data's ship of Theseus
    2 projects | news.ycombinator.com | 21 Sep 2021
    Would love to hear your feedback for https://hal9.ai -- We are building an open source platform for data analysis based on reusable code blocks and a community to build and monetize their contributions. We are pretty early in our journey, launched our alpha and getting ready for our beta release, but would love to hear your thoughts. You can find me at javier at hal9.ai. Cheers!
  • Data Science with JavaScript: What we've learned so far?
    7 projects | news.ycombinator.com | 9 Sep 2021
    Author here, we can save some clicks by reposting content as comment:

    Hi there, since the beginning of this year we've been exploring how far we can take Data Science with JavaScript. As part of this journey, we started hal9.ai [1], an integrated environment to help us be more productive when analyzing data with JavaScript.

    We want to ask for your feedback, but more importantly, we want to use this post to share what we've learned so far:

    1. Visualizations: JavaScript is great at visualizing interactive data, this is probably obvious but worth mentioning nonetheless. Some of the highlights here, D3.js [2] is still a great library to perform visualizations; however, D3.js is really low level -- Kinda like TensorFlow [3], not Keras [4]. We actually went to create our own charting library to combine the flexibility of D3 with the ease-of-use of other libraries like Plotly [5]; just to find out later on that Plot.js [6] got launched as an amazing library that builds on top of D3. So we ended up integrating Plot.js as our recommended charting library.

    2. Transformations: We found out that JavaScript in combination with D3.js has a pretty decent set of data import and transformation functions; however, it comes nowhere near to Pandas [7] or dplyr [8]. After shopping around, we found out about Tidy.js [9], loved it, and adopted it. The combination of Tidy.js and D3.js and Plot.js is absolutely amazing for visualizations and data wrangling with small datasets, say 10-100K rows. We were very happy with this for a while; however, once you moved away from visualizations into data analysis, we found out 100K rows is quite restrictive, which is also slow when having 1K-10K columns. So we switched gears and started using Arquero.js [10], a columnar JS library that enabled us to process +1M rows in the browser, decent size for real-world data analysis.

    3. Modeling: We are currently exploring this space so our findings are not final, but let us share what we've found so far. TensorFlow.js [11] is absolutely amazing, it provides a native port from TensorFlow to JavaScript with support for CPU, WebGL [12], WebAssembly [13] and NodeJS [14] backends. We were able to write an LSTM [15] to do time series prediction, so far so good. However, we started hitting issues when we started to do simpler models, like a linear regression. We tried Regression.js [16] but we found it falls short, so we wrote our own script to handle single-variable regressions using TF.js and gradient descent. It actually worked quite well but exposed a flaw in this approach; basically, there is a lot of work to be done to bring many models into the web. We also found out Arquero.js does not play nicely with TF.js since well, Arquero.js does not support tensors; so we went on to explore Danfo.js [17], which integrates great with TF.js but we found out it's hard to scale transformations to +1M rows and found other rough edges. Since then, well, we started exploring Pyodide [18] and perhaps contributing to Danfo.js, or perhaps involving more server-side compute with NodeJS, but that will be a story for another time.

    So net-net, we are still super excited about exploring Data Science, Data Engineering, Visualization and Artificial Intelligence with JavaScript; but realistically, it is going to take a few years for this to mature.

    In the meantime, we think Data Science with JavaScript shines with smaller datasets and interactive visualizations; which we believe Hal9 can help you be productive at. That said, we do believe that motivated JavaScript users can help unblock themselves by adding new functionality and contributing back libraries to NPM or components to our open source project, please do reach out in Hal9's GitHub repo [19] if you wanna lend a hand!

    Alright, so call to action? Please head to hal9.ai and give it a shot! We would love to hear where you think this could be useful, what features we are missing, and any feedback you may have.

    To keep in touch, please subscribe to our weekly email at news.hal9.ai [20], contact us at [email protected], or follow us on Twitter as @hal9.ai

    Thanks for reading along!

    [1] https://hal9.ai

    7 projects | news.ycombinator.com | 9 Sep 2021
  • Hal9: Data Science with JavaScript
    4 projects | reddit.com/r/datascience | 9 Sep 2021
    Hi there, this last year I've been exploring how far we can take Data Science with JavaScript and as part of this started hal9.ai, an integrated environment to help us be more productive when analyzing data with JavaScript.
    4 projects | reddit.com/r/datascience | 9 Sep 2021
    In the meantime, we think Data Science with JavaScript shines with small datasets and interactive visualizations; which we believe Hal9 can help you be productive at. That said, we do believe there must be motivated JavaScript fans out there to unblock themselves with new functionality and contributing back to our open source project, please do reach out in Hal9's GitHub repo if you wanna lend a hand!
  • Hal9: Data Science for Web Developers
    1 project | reddit.com/r/learnwebdev | 9 Sep 2021
    Hi there! I'm a developer that spent this year building hal9.ai, a free and open source platform that helps web developers do data science, visualization and even AI with the ease of use of drag&drop, and the freedom of writing arbitrary JavaScript code.
  • I want to learn D3. I don’t want to learn Observable. Is that ok? (2019-2021)
    6 projects | news.ycombinator.com | 13 Jun 2021
    I sympathize with the comments, as a software engineer, this comment from Mike really describes my frustration with Observable's runtime:

    > Observable notebooks are like spreadsheets, where cells run automatically whenever you edit or values change. That’s not how conventional (imperative) programming languages work, so sadly you can’t simply copy-paste a whole notebook into a vanilla JavaScript application.

    However, I do think many others will prefer their reactive runtime; so this is by no means a criticism to Observable, they are doing great work. They are just not targeting JS-purists and that might be the right call.

    As a software engineer, I love D3 but don't want to be stuck with a reactive runtime that is not vanilla JavaScript.

    I got myself to build https://hal9.ai, an integrated environment to do data analysis based of JavaScript. Is not a D3 learning environment but you can certainly use it for that purpose. If someone is interested in providing feedback or helping with D3 examples, please do so at https://github.com/hal9ai/hal9ai or shoot me an email at javier at hal9.ai

  • Show HN: Hal9 – Roblox for AI
    5 projects | news.ycombinator.com | 30 May 2021
    Thanks for playing with this, really appreciate it!

    Yes, so currently our budget is low and we turn on AWS EC2 workers on demand... so most likely, "Pipeline running" triggers as we wait for about 90s for the EC2 instance to start. We should be able to keep machines on longer as we get our first few customers.

    Thanks, we do support fetching data from JSON, is there a difference with "web JSON"? XML/RSS would be nice indeed, created this issue: https://github.com/hal9ai/hal9ai/issues/4

    5 projects | news.ycombinator.com | 30 May 2021
    We believe everyone should be able to use and profit from AI, so we spent this year building Hal9, which aspires to become "Roblox for AI".

    * What is Hal9?

    Roblox is many things: A game development environment with a visual editor that makes it easy to get started but unconstrained to advanced users that want to code. Roblox is also a library of assets, and a marketplace for games.

    We are taking a similar approach, we are building a visual editor to assemble anything from simple data analysis by importing data and visualizing it with charts, to data forecasting with regressions, to complex workflows to do web-scraping and run deep learning models like LSTMs.

    However, visual editors are constrained and at some point they just don't work, so every block is backed by open source code which you can modify to your hearts' contempt using our code editor.

    In addition, you can also add new blocks and share them with others in a library of assets. We are currently using GitHub as a library of open source scripts.

    Finally, we have aspirations to help contributors profit from their work by sharing profits with them.

    * How are we building this?

    We are building everything with web technologies, let me explain why.

    First, the whole purpose of this is to make AI more accessible. Technologies like Electron allow us to easily deploy to multiple platforms and avoid having users troubleshoot system dependencies. To put it simply, web technologies allow users to get started with no additional setup.

    However, we also see the ecosystem of web technologies converging with Data Science and AI. For instance, the tensorflow.js [1] project allows users to run TensorFlow in the client and optionally train models in GPUs in NodeJS. We currently provide NodeJS infrastructure to run server-side code and hopefully GPUs as well soon.

    Another great example is webassembly, which can allow us to run Python with PyIodide [2]; same for SQL with sql.js [3], etc. We are also very excited for WebGPU [4], an initiative to bring proper GPU support to web technologies, which should make it so much easier to use proper GPUs locally.

    Momentum is growing around Data Science with libraries like tidy.js [5], danfo.js [6], and ml5.js [7]. Currently this ecosystem is a bit fragmented but we believe they will eventually come together.

    Finally, web technologies like CSS and D3.js are arguably the best platform for visualizations. We are big fans of the new ObservableHQ Plot [8] library which we are already using in Hal9.

    * Call to action

    Head to https://hal9.ai and try it out.

    You will need your desktop to interact with the embedded app at the top of our site. The app is diabled on mobile but the site should give you a good idea of how it works.

    We are looking for feedback, users and contributors.

    If you find this useful, you can download Hal9 for Windows, Mac, or use the Web version and our cloud service for $19.99/month.We are planning to use this revenue to become self-sustained and share profits with our community of developers.

    As a developer, you can download and use the development versions to contribute to the open source repo of scripts in https://github.com/hal9ai/hal9ai

    * Resources

    - Site : https://hal9.ai


Basic hal9ai repo stats
6 days ago

hal9ai/hal9ai is an open source project licensed under MIT License which is an OSI approved license.

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
Find remote JavaScript jobs at our new job board 99remotejobs.com. There are 18 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.