confluent-kafka-python VS coinbasepro-python

Responding to popular demand, the latest 0.4.0rc0 version introduces support for Kafka stream processing using Confluent Kafka's Python library - https://github.com/confluentinc/confluent-kafka-python.

- confluent kafka library (https://github.com/confluentinc/confluent-kafka-python) uses librdkafka, and is faster that kafka-python - https://www.bytewax.io/(https://github.com/bytewax/bytewax) is another option. Handles the dirty work of exchanging data across processes for parallel stateful processing

Here are examples https://github.com/confluentinc/confluent-kafka-python

I just wanted to mention that pykafka is currently unmaintained and archived on GitHub:

https://github.com/Parsely/pykafka

pykafka was originally developed and maintained by my team at Parse.ly, but we no longer maintain it. We instead encourage folks to use confluent-kafka-python, which is what we have ourselves switched to in our production systems:

https://github.com/confluentinc/confluent-kafka-python

(pykafka was developed at a time before Confluent invested in their own Python binding. Some of the history of the project is described in this 2016 blog post[1] and our original 2015 announcement[2].)

[1]: https://blog.parse.ly/pykafka-now/

[2]: https://blog.parse.ly/announcing-pykafka-python-support-for-...

confluent-kafka

I also found that there is a library provided by confluent https://github.com/confluentinc/confluent-kafka-python which maybe helpful here. Is that right? I see a section "SSL certificates" but couldnt get much insight out of this.

ProtobugDeserializer does not allow anything but the protoBuf message type (see here):

I'd start off with some simple producer/consumer code to get an understanding of interacting with Kafka's APIs from Python - there's a Python client with some good examples of the producer and consumer as well as more complex examples.

I'm trying to set up algo trading through the Blankly Python library. I've generated my Coinbase Pro API keys, but when I try to enter them it always tells me that it failed to connect, and to check to make sure my keys are correct. I'm quite certain that they are, and I made a new set of API keys just in case something was wrong with the first set. I also cannot create an "authenticated client" as described on their readme because the cbpro library is out of date and currently incompatible with blankly.

which uses the coinbasepro-python library to perform trades https://github.com/danpaquin/coinbasepro-python

My question is, when does the order expire, if ever? The documentation is pretty sparse -- https://github.com/danpaquin/coinbasepro-python .

This is pretty trivial if you don't mind getting your feet wet scripting with cbpro.

The cbpro library for Python, for instance, makes interacting with the API very simple, then all you have to do is loop through your accounts grabbing whatever data you need.

To start, I'd say coinbase has a well documented api, (coinbase pro, the exchange, not the other one). This wrapper package was one of the first I used, I assume it's still supported: https://github.com/danpaquin/coinbasepro-python. To knock out 1 and 2 would look something like (psuedo code, don't quote this):

Yeah it does. You can set it up to deposit money it seems. Under deposit/withdraw here: https://github.com/danpaquin/coinbasepro-python it seems to suggest this. To be honest I was already thinking of doing this before I saw your comment, but if someone else would use it too then that's extra motivation. I understand where you're coming from though. I would personally prefer to set it up for myself so it deposits some money in my account every day, buys algorand, and then transfers it to my algorand wallet after a few days, without me having to think about it at all. Just out of curiosity what do you do for employment? I'm a data scientist so I'm a bit of an evangelist for learning python and if it's something that you would be interested in at all I can recommend some resources.

Not sure what language or library you're using, but try the example here: https://github.com/danpaquin/coinbasepro-python#websocketclient-methods

I’m using a Coinbase Pro API for Python to access data from the WebSocket feed. Here’s a first cut that has some debugging code left in place (along with two ways to generate the VWAP, one inefficient (the _vwap method) and one more efficient). Let’s see if py-spy reveals how much time this code uses.

If not, you can find it here: https://github.com/danpaquin/coinbasepro-python