Similar projects and alternatives to hopsworks
Reviews and mentions
Reflections on the Lack of Adoption of Domain Specific Languages [pdf]
2 projects | news.ycombinator.com | 29 Dec 2020
We built the first open-source feature store for ML, https://github.com/logicalclocks/hopsworks , when every existing proprietary feature store (Uber Michelangelo and Bighead at AirBnb) were shouting about how their DSL for feature engineering was the future.
Fast-forward 2 years and it is clear that Data Scientists want to work with Python, not with a DSL. We based our Feature Store on a Dataframe API for Python/PySpark. The DSL can never evolve at the same rate as libraries in a general-purpose programming language. So, your DSL is great for show-casing a Feature Store, but when you need to compute embeddings or train a GAN or done any type of feature engineering that is not a simple time-window aggregation, you pull out Python (or Scala/Java). I am old enough to have seen many DSLs in different domains (GUIs, aspect-oriented programming, feature engineering) have their day in the sun only to be replaced by general-purpose programming languages due to their unmatched utility.
logicalclocks/hopsworks is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.
Are you hiring? Post a new remote job listing for free.