sparkmagic
nexus
sparkmagic | nexus | |
---|---|---|
4 | 10 | |
1,286 | 99 | |
0.4% | - | |
7.6 | 6.0 | |
3 days ago | 3 months ago | |
Python | Nim | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sparkmagic
-
Doing ML works in AWS. Need help installing cartopy
Please file an issue at https://github.com/jupyter-incubator/sparkmagic
-
Ask HN: Who's an open source maintainer/project that needs sponsorship or help?
I maintain several open source projects, most notably:
Sparkmagic (https://github.com/jupyter-incubator/sparkmagic)
Sparkmagic provides jupyter magics and kernels for working with remote Spark clusters. It's used by thousands of developers and companies like Pinterest, Amazon, more!
I've been maintaining for the past few years and would love help!
KSOPS (https://github.com/viaduct-ai/kustomize-sops)
KSOPS, or kustomize-SOPS, is a kustomize KRM exec plugin for SOPS encrypted resources. KSOPS can be used to decrypt any Kubernetes resource, but is most commonly used to decrypt encrypted Kubernetes Secrets and ConfigMaps. As a kustomize plugin, KSOPS allows you to manage, build, and apply encrypted manifests the same way you manage the rest of your Kubernetes manifests.
KSOPS is the most popular kustomize plugin and I'd love help maintaining and improving it from out GitOps fanatics.
-
Spark is lit once again
Things get a bit more complicated on interactive sessions. We've created Sparkmagic compatible REST API so that Sparkmagic kernel could communicate with Lighter the same way as it does with Apache Livy. When a user creates an interactive session Lighter server submits a custom PySpark application which contains an infinite loop which constantly checks for new commands to be executed. Each Sparkmagic command is saved on Java collection, retrieved by the PySpark application through Py4J Gateway and executed.
-
An SQL Solution for Jupyter
Jupyter would be even better if it supported the seamless combination of Python and SQL code cells.
My notebook code typically involves a data prep stage with querying a SQL database, then downloading into Python for more complex analysis, ML modelling, integration with external data sources, etc. So the notebook has a Python kernel with SQL usually as embedded """-quoted strings.
Does anyone have a solution to treating selected code cells as SQL - with SQL highlighting and tooltips - exposed as string variables to the Python code?
Sparkmagic [1] does part of this for Python/SQL/Spark interoperability, but as far as I recall, doesn't support SQL syntax highlighting.
[1] https://github.com/jupyter-incubator/sparkmagic
nexus
-
Ask HN: Who's an open source maintainer/project that needs sponsorship or help?
Nexus: https://github.com/jfilby/nexus
This is a web framework + ORM for Nim. It's in desperate need of more work to support DBs other than PostgreSQL and make the ORM more flexible. The web side also needs more work.
- Ask HN: Should I learn more languages?
-
Ask HN: Companies of one, what is your tech stack?
I use it mainly for high-performance backend engines. E.g. I'm writing an automated trading system and the trading engine is written in Nim.
I wrote a Nim web framework that has an ORM: https://github.com/jfilby/nexus. However I mainly use the ORM with the back-end engines. You could write a Django-style web app with Nexus + Nimja, but it's difficult to compete with the huge ecosystems of React and Flutter.
-
Ask HN: What is the job market like, for niche languages (Nim, crystal)?
It's not good for Nim, unfortunately. The language is great, but the community isn't that big.
If you're looking for a web framework with an ORM for Nim, check out Nexus: https://github.com/jfilby/nexus
-
Mastering Nim – now available on Amazon
There's no Discord yet, just GitHub issues. Here's an issue to track this request: https://github.com/jfilby/nexus/issues/14
I'll email you regarding what/how to help.
-
Building a personal blog using Django
Django is a great MVC framework. It might be overkill for a blog as another poster wrote, but it's still a good way to learn Django.
If you ever want to learn Nim, please consider Nexus (https://github.com/jfilby/nexus) as I'm building it to be something like Django for Nim.
- Show HN: Nexus Development Framework (Nim)
-
Show HN: Nexus Development Framework
Nexus is a Nim development framework.
https://github.com/jfilby/nexus
The aim to create a web framework similar to Django, with a built-in ORM. The view layer needs work, and is mostly built out of available libraries with Jester for routing and Nimja for templating.
-
Nexus Development Framework
Nexus Development Framework, for Nim, is now available: https://github.com/jfilby/nexus
-
Ask HN: What are some examples of elegant software?
Nim. It's just so quick and easy to write high performance code. That's why I'm writing a web framework for it, soon to be released: https://github.com/jfilby/nexus
What are some alternatives?
lighter - REST API for Apache Spark on K8S or YARN
NATS - High-Performance server for NATS.io, the cloud and edge native messaging system.
Jupyter Scala - A Scala kernel for Jupyter
src - Read-only git conversion of OpenBSD's official CVS src repository. Pull requests not accepted - send diffs to the tech@ mailing list.
Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing
Turbo Vision - A modern port of Turbo Vision 2.0, the classical framework for text-based user interfaces. Now cross-platform and with Unicode support.
nbmake - 📝 Pytest plugin for testing notebooks
Stockfish - A free and strong UCI chess engine
nbgrader - A system for assigning and grading notebooks
TiddlyWiki - A self-contained JavaScript wiki for the browser, Node.js, AWS Lambda etc.
xeus-sql - Jupyter kernel for SQL databases
Boost.Asio - Asio C++ Library