Rudderstack VS fx

If CDP(such as RudderStack) were a restaurant, then Data Integration is the guy that gets all raw ingrediants from different shops and makes it available to Chef that sorts and combines raw ingrediants to make a dish. The chef can't cook anything without raw ingrediamt. Similarly Data Integration is also an important component in CDP that collects customer data from various sources and them other components unify it and activate it.

More details on GitHub repository - https://github.com/rudderlabs/rudder-server

Are you RudderStack?

In bigger setups, all you want is a data collector and router so that you can feed the data into multiple destinations, depending on the use case. Analytics is just one. Example: https://www.rudderstack.com/ & https://www.rudderstack.com/replace-google-analytics-4-guide...

Check out RudderStack, a Go project to build data pipeline. Our slack is quite active. The best way to contribute is by creating a new integration with your favorite tool. You do not need to rely to too much on existing knowledge about inner workings of the project to do so, so it is beginner friendly.

Interesting. About "Redshift need google sheet sync to table", wouldn't this be more aligned with the responsibility of a CDP(such as RudderStack) as opposed to something we expext a warehouse to do?

The challenge is over. Winners have been announced. When we are ready for the next one, will announce on RudderStack GitHub repo

Super. This is amazing. Sharing your project with the community. If you get a chance, try out RudderStack to build your pipeline.

I found fx(https://github.com/uber-go/fx) to be a super simple yet versatile tool to design my application around.

All the advice in the article is still helpful, but it takes the "how do I make sure X is initialized when Y needs it" part completely out of the equation and reduces it from an N*M problem to an N problem, ie I only have to worry about how to initialize individual pieces, not about how to synchronize initialization between them.

I've used quite a few dependency injection libraries in various languages over the years (and implemented a couple myself) and the simplicity and versatility of fx makes it my favorite so far.

Some of the features: - ✅ Using Vertical Slice Architecture as a high level architecture - ✅ Using Event Driven Architecture on top of RabbitMQ Message Broker with a custom [Event Bus](pkg/messaging/bus/) - ✅ Using Event Sourcing in Audit Based services like [Orders Service](services/orders/) - ✅ Using CQRS Pattern and Mediator Patternon top of Go-MediatR library - ✅ Using Dependency Injection and Inversion of Controlon top of uber-go/fx library - ✅ Using RESTFul api with Echo framework and using swagger with swaggo/swag library - ✅ Using Postgres and EventStoreDB to write databases with fully supports transactions(ACID) - ✅ Using MongoDB and Elastic Search for read databases (NOSQL) - ✅ Using OpenTelemetry for collection Distributed Tracing with using Jaeger and Zipkin - ✅ Using OpenTelemetry for collection Metrics with using Prometheus and Grafana - ✅ Using Unit Test for testing small units with mocking dependent classes and using Mockery for mocking dependencies - ✅ Using End2End Test and Integration Test for testing features with all of their real dependeinces using docker containers (cleanup tests) and testcontainers-go library

any take on https://github.com/uber-go/fx?

I’m not sure of much that can do all of that - maybe it’s a use case for https://github.com/uber-go/fx

If I still find myself stuck/waiting, I switch over to studying more about our team's main language Go. Currently looking around at Fx ( https://github.com/uber-go/fx ). Which is interesting, though I doubt we'll actually migrate anything for it, but might make a neat lunch and learn topic.

Hello gophers, I am using https://github.com/uber-go/fx and https://github.com/rs/zerolog for logging.

Also, I like to use Uber FX for my DI stuff. You can check it out here:https://github.com/uber-go/fx

I only have private and work repos... But I use Uber fx. https://github.com/uber-go/fx

Spring Boot is notable for its dependency injection / inversion of control. The closest Go has to this is Uber's Fx which also includes some lifecycle management.

If you have such a complex and deep dependency graph, and you don't want to manually maintain it, you could use some DI library to handle that for you. Something like https://github.com/google/wire for small-medium size stuff, or https://github.com/uber-go/fx for larger scale, more enterprise projects.