Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge. Learn more →
Top 14 JavaScript Kafka Projects
-
spec
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs. (by asyncapi)
Project mention: Comunicar microservicios con: ¿Kafka, RabbitMQ u otro? ¿Por qué? | /r/devsarg | 2023-10-25 -
I will use the KafkaJS library to achieve it quickly. Let’s just paste the code here.
-
Appwrite
Appwrite - The open-source backend cloud platform. Add Auth, Databases, Functions, and Storage to your product and build any application at any scale while using your preferred coding languages and tools.
-
Project mention: How to stream data from Mastodon public timelines to Apache Kafka with NodeJS and TypeScript | dev.to | 2023-03-22
Open producer.ts to see the code you need to send the data to an Apache Kafka topic. To work with Apache Kafka you can use one of the existing client libraries, there are several options available. This project uses node-rdkafka, which is a NodeJS wrapper for the Kafka C/C++ library. Check its GitHub repository Readme for installation steps.
-
Zenko
Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.
> Iteration speed and blazing fast automated tests.
Wholeheartedly agreed!
It is also nice to have that additional assurance of being able to self-host things (if ever necessary) and not being locked into a singular implementation. For example, that's why managed database offerings generally aren't that risky to use, given that they're built on already established projects (e.g. compatible with MySQL/MariaDB/PostgreSQL).
> When I discovered minio, I suddenly got much more confident coding against s3.
MinIO is pretty good, but licensing wise could become problematic if you don't work on something open source but ever want to run it in prod. Not really what this discussion is about, but AGPL is worth mentioning: https://github.com/minio/minio/blob/master/LICENSE
That said, thankfully S3 is so common that we have alternatives even to MinIO available, like Zenko https://www.zenko.io/ and Garage https://garagehq.deuxfleurs.fr/ both of which are good for both local development as well as hosting in whatever environments necessary.
-
-
ecars
Sample application for Lightning Web Components and Salesforce Platform runtime and compute capabilities. Part of the sample gallery. Electric car manufacturer use case. Get inspired and learn best practices.
-
-
Onboard AI
Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
-
KafkaPeek
KafkaPeek is an open-source application designed to help developers visualize, monitor, and stay up-to-date on their Kafka deployments
-
-
Project mention: Show HN: DriftDB is an open source WebSocket back end for real-time apps | news.ycombinator.com | 2023-02-03
MQTT-over-websocket does exist, and most MQTT brokers support it (Mosquito, AmazonMQ etc.). You're right about the compaction - MQTT doesn't have anything in it's protocol about compaction, and I don't know of any brokers that implement it. Having said that, you could use an MQTT-kafka bridge.
Something like Mosquito + https://github.com/nodefluent/mqtt-to-kafka-bridge + Redpanda in a docker image would work, though obv. this might be a bit overkill for most. Having said that, it does open many new avenues for interaction at scale. You pays your money...
-
And project Memphis -> https://memphis.dev/
-
Tickets-Sales-System
Tickets sales application for FIFA World Cup Qatar 22. It is a web application where users can purchase tickets for matches along with admin dashboard to view states about sold tickets. The application is built using event driven architecture along with security best practices and TDD
-
cf-url-shortener
URL Shortener Cloudflare function that uses Upstash Redis and Kafka along with https://materialize.com
Project mention: Simulating Streaming Data for Fraud Detection with Datagen CLI | dev.to | 2023-04-03Materialize Docs
-
kafka-test-helper
Utility library that simplify testing of Node.js components that interacts with Kafka broker.
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-10-25.
JavaScript Kafka related posts
- Airflow meetup in Paris
- Modern stack to build a real-time event-driven app
- Bacite recenziju nekog novog frameworka / toola kojeg ste u zadnje vrijeme počeli koristiti
- node.js limitations regarding Apache Kafka Consumers
- It is wise to deploy multiple nodejs instance in multicore CPU?
- Build a durable pub-sub with Kafka in Node.js
- Show HN: A native macOS client for Apache Kafka
-
A note from our sponsor - InfluxDB
www.influxdata.com | 1 Dec 2023
Index
What are some of the best open-source Kafka projects in JavaScript? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | spec | 3,514 |
| 2 | kafkajs | 3,451 |
| 3 | node-rdkafka | 2,022 |
| 4 | Zenko | 516 |
| 5 | kafka-connect-ui | 480 |
| 6 | ecars | 168 |
| 7 | smalllinks | 109 |
| 8 | KafkaPeek | 51 |
| 9 | twitter-network-analysis | 37 |
| 10 | mqtt-to-kafka-bridge | 33 |
| 11 | memphis-cli-old | 17 |
| 12 | Tickets-Sales-System | 10 |
| 13 | cf-url-shortener | 10 |
| 14 | kafka-test-helper | 8 |
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com