demo-scene
fast-data-dev
Our great sponsors
demo-scene | fast-data-dev | |
---|---|---|
24 | 10 | |
1,454 | 1,975 | |
1.2% | 1.0% | |
5.7 | 4.8 | |
8 days ago | 13 days ago | |
Shell | Shell | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
demo-scene
-
Confused and frustrated about Kafka
Here’s a great place to dig into things: https://developer.confluent.io
-
Getting Started as a Kafka Developer
Once you’ve decided on a language to focus on, it’s time to start filling those knowledge gaps. Don’t be discouraged by this step. We all have knowledge gaps, and filling them can be very rewarding. First, you’ll want to make sure you have a good understanding of Kafka basics. Fortunately, there are many resources to help you with this. A web search will turn up many great books and other resources. And, of course, Confluent Developer offers interactive courses ranging from introductory (Apache Kafka 101) to advanced (Kafka Internals), full documentation, and other content to help you get started.
- Any suggestions for writing a long thesis about Kafka's scalability, availability and fault-tolerance?
-
What Are Apache Kafka Consumer Group IDs?
Confluent Developer: Learn Apache Kafka through Confluent Developer tutorials, documentation, courses, blog posts, and examples.
-
Problems with the set-up
Spend some time on https://developer.confluent.io , especially https://developer.confluent.io/get-started/java/ and look at https://github.com/confluentinc/examples . Those will give really practical examples for how to set up your configs and start consuming
-
Looking For Suggestions on The Definitive Guide (V2)
FWIW you'll find a bunch of promo codes over at developer.confluent.io
-
Kafka to fetch data from another microservices
Kafka streams is a Java library built on the producer/consumer APIs designed to create event-driven microservices on top of Kafka. In general, I recommend exploring https://developer.confluent.io to learn more
-
Creating topics and console consumers using a dockerized Kafka cluster?
For example: https://github.com/confluentinc/demo-scene/tree/master/kafka-connect-zero-to-hero
-
A few starter questions: What is a good setup for learning? Is Confluent platform ok?
should I be reading a different material for a first Kafka project and working with a different kind of setup? Now, I can't be unbiased on this one ;) One of the things we're doing with Confluent Developer is to try and create a resource for people to learn Kafka from the ground up, whether they ultimately decide to pursue it on Confluent or not. The fundamentals of Kafka that you'll be learning are going to be as applicable whether you're using Apache Kafka self-managed, or Confluent, or AWS' MSK, or whatever else. Personally I'd this stage I'd use whatever setup you find easiest and least friction to your learning journey. As u/louisvell mentioned, /u/stephanemaarek's courses on Udemy are also very popular, if you wanted a "second opinion" on how to approach learning Kafka.
-
Kafka Learning Path
https://developer.confluent.io they’ve thought about this question very deeply
fast-data-dev
- FLaNK Stack Weekly 16 October 2023
-
Kafka visualization tool
I liked https://lenses.io/ Lots of capabilities but it's not free as I know.
-
A list of GUI tools for working with Apache Kafka
Lenses
- Looking For Suggestions on The Definitive Guide (V2)
-
Is there recommed UI for Kafka like RabbitMQ?
For Kafka Dev I use https://github.com/lensesio/fast-data-dev
-
Couldn't connect to Kafka broker with Kafka UI tools: Lenses and kafka-ui
Currently I'm using Lenses:https://lenses.io/ as UI tool, but while turning on kafka-start-server server.properties and launch the UI on localhost, it failed to connect:
-
Free tools to connect to multi-broker/SSL-enabled clusters & manage topics?
Oh thats sad to hear ... lenses.io is so powerful I am not sure how I would have gotten by to this point without it!
-
Kafka as message broker for new platform?
In Addition to the more critical replys from others, why Kafka still makes sense imo: - you could organist everything with custom pipeline/services at your scale. The cost of maintaining those and keep the technology up to date is growing exponentially with every new Service. Kafka offers ansinge Plattform with a couple components which need to be kept up to date. - deploying, managing and monitoring those service is also a big task and does not come for free. - unless your using Kubernetes underneath, scaling is not easy with services. - peer to peer communications of microservices should be avoided because your building a „deathstar“-like architecture where everything is linked and effectively you’ll end up with a distributed monolith. A message broker or message queue helps to avoid this, Kafka is a good tool for that. - I heard that those aws Kafka replacements are not 100% Kafka as one might expect, you should be careful there. But confluent or other providers probably offer hosted solutions on aws too. - https://lenses.io/ helped us a lot when we started with Kafka to see how everything works together, create stream processor’s with sql and easily deploy Kafka connect workers. The tool costs money though but is worth it in the end in my opinion. (Disclaimer: I don’t work for confluent or lenses, we’re running open source Kafka with strimzi and lenses)
-
[Beginner] Alternatives for starting kafka in windows 11 without wmic
https://github.com/lensesio/fast-data-dev is a really cool option for a Kafka development environment based on docker and/or kubernetes.
-
Any dev tool ideas for the issues in Kafka so it makes things easier ? It can be combining other frameworks… Planning to do for final project in my college
Yes: - https://lenses.io/ (use the Lenses box, it’s free) - https://github.com/lensesio/fast-data-dev - https://github.com/provectus/kafka-ui
What are some alternatives?
docker-kafka-kraft - Apache Kafka Docker image using Kafka Raft metadata mode (KRaft). https://hub.docker.com/r/moeenz/docker-kafka-kraft
kafka-stack-docker-compose - docker compose files to create a fully working kafka stack
cp-all-in-one - docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform
kafka-ui - Open-Source Web UI for Apache Kafka Management
examples - Apache Kafka and Confluent Platform examples and demos
kafka-rest - Confluent REST Proxy for Kafka
kafka-lag-exporter - Monitor Kafka Consumer Group Latency with Kafka Lag Exporter
console - Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
protoactor-go - Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
kafka-connect-opensky - Kafka Source Connector reading in from the OpenSky API
KafkaEsque - Kafka Development Tool