Real time Streaming Solution advice

• Apache Pulsar

  14 13,143 9.7 Java

  Apache Pulsar - distributed pub-sub messaging system

  

  Good luck with your project! Sounds challenging but very interesting, both product and engineering wise. AWS/GCP services would definitely give you a fast start, and future support for scale and processing which is great for mvp or a pilot, and I would probably start with the mentioned services as well, but from my experience and based on your performance needs, definitely around financial use case and especially stocks you will need close to a millisecond latency across your ecosystem which I think is hard to get over aws and gcp offerings. Have you tried Kafka, Pulsar, or Memphis? Learning curve would be harder, but in long term I think they will be better for the performance requirements

• memphis

  29 2,887 0.0 Go

  Memphis.dev is an intelligent, frictionless message broker. Made to enable developers to build real-time and streaming features fast.

  

  Good luck with your project! Sounds challenging but very interesting, both product and engineering wise. AWS/GCP services would definitely give you a fast start, and future support for scale and processing which is great for mvp or a pilot, and I would probably start with the mentioned services as well, but from my experience and based on your performance needs, definitely around financial use case and especially stocks you will need close to a millisecond latency across your ecosystem which I think is hard to get over aws and gcp offerings. Have you tried Kafka, Pulsar, or Memphis? Learning curve would be harder, but in long term I think they will be better for the performance requirements

• Onboard AI

  getonboard.dev

  sponsored

  Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  

• ApacheKafka

  57 24 10.0

  A curated re-sources list for awesome Apache Kafka

  Good luck with your project! Sounds challenging but very interesting, both product and engineering wise. AWS/GCP services would definitely give you a fast start, and future support for scale and processing which is great for mvp or a pilot, and I would probably start with the mentioned services as well, but from my experience and based on your performance needs, definitely around financial use case and especially stocks you will need close to a millisecond latency across your ecosystem which I think is hard to get over aws and gcp offerings. Have you tried Kafka, Pulsar, or Memphis? Learning curve would be harder, but in long term I think they will be better for the performance requirements

• FinnhubKafkaConnector

  1 1 10.0 Java

  Kafka Connect connector for OHLCV candles from Finnhub

  https://github.com/jan-cin/FinnhubKafkaConnector Someone posted this on Reddit in a diff sub. Can be a start, play around with your analysis and see if the preliminary results actually make it worth going all the way.

Suggest a related project