Huginn VS twitter

I skipped to chapter 9 in the article ("Clogged"), and it looked like Pipes failed because it didn't have a large enough team or a well-defined mission. As a result they couldn't offer a super robust product that would lure in enterprise users. "You could not purchase some number of guaranteed-to-work Pipes calls per month" is the quote from the article.

The reason I think that interesting is because that's the model these days for everything from AI tokens to Monday.com seats. It makes me feel like Pipes was before its time.

That said I've been collecting different "business glue" products that are similar to Pipes. To me, like you say, they aren't as interesting, exciting and intuitive as Pipes was, but maybe it just takes a little more digging. I tried to focus on open source tools but some aren't.

- n8n io: https://n8n.io/integrations/mondaycom/

- Node-RED: https://nodered.org/ (just read about this one in this thread)

- trigger dev: trigger.dev

- automatisch.io: https://automatisch.io/docs/

- Activepieces: https://www.activepieces.com/docs/getting-started/introducti...

- Huginn: https://github.com/huginn/huginn

- budibase: https://budibase.com/

- windmill: https://www.windmill.dev/

- tooljet: https://www.tooljet.com/workflows

- Bracket: https://www.usebracket.com/pricing (just SalesForce <-> PostgreSQL)

- Zapier: zapier.com/

Anyway I hope some of these are fun!

"correct" is a value judgement that depends on lots of different things. Only you can decide which tool is correct. Here are some ideas:

- https://camel.apache.org/

- https://www.windmill.dev/

- https://github.com/huginn/huginn

Your idea about a queue (in redis, or postgres, or sqlite, etc) is also totally valid. These off-the-shelf tools I listed probably wouldn't give you a huge advantage IMO.

Huginn (https://github.com/huginn/huginn) has like some 39K stars on Github and the use cases it covered looks good.

Huginn is an another useful tool that allows you to wrangle CSS selectors and XPath nodes to create RSS feeds.

I use it quite successfully to get data out of undocumented APIs and out into RSS.

https://github.com/huginn/huginn

I know of Huginn that could be usefull depending on what you want to do.

https://github.com/huginn/huginn ??

Huginn

"not a single word about the safety implications of such a system"

Oh please. Not everything has to be regulated-to-hells before a use case is even found on this. Autonomous agents have existed for decades.

If it can automate agents like huginn[0] with natural language, I'd be very happy. Autonomous agents doesn't mean it's going to take over the world autonomously. Let's lower the fearmongering a bit.

[0]: https://github.com/huginn/huginn

Using google-apis-core 0.4.1 Using google-apis-discovery_v1 0.7.0 Using google-apis-generator 0.4.0 Using google-api-client 0.53.0 Using google-cloud-env 1.5.0 Using google-cloud-errors 1.2.0 Using google-cloud-core 1.6.0 Using google-protobuf 3.21.5 (x86_64-linux) Using googleapis-common-protos-types 1.3.0 Using grpc 1.42.0 (x86_64-linux) Using googleapis-common-protos 1.3.12 Using rly 0.2.3 Using google-gax 1.8.2 Using google-cloud-translate 2.3.0 Using haversine 0.3.0 Using httparty 0.14.0 Using hipchat 1.2.0 Using mimemagic 0.4.3 Using httmultiparty 0.3.16 Using http-cookie 1.0.3 Using http-form_data 1.0.1 Using http 2.1.0 Using huginn_agent 0.6.1 Using hypdf 1.0.10 Using jquery-rails 4.2.2 Using json 2.6.1 Using jsonpath 1.1.0 Using kgio 2.11.4 Using kramdown 2.3.1 Using libv8-node 16.10.0.0 (x86_64-linux) Using liquid 5.3.0 Using listen 3.0.8 Using systemu 2.6.4 Using macaddr 1.7.1 Using memoizable 0.4.2 Using mime-types-data 3.2021.1115 Using mime-types 3.4.1 Using mini_magick 4.11.0 Using mini_racer 0.6.2 Using mqtt 0.3.1 Using mysql2 0.5.3 Using naught 1.1.0 Using net-ftp-list 3.2.8 Using netrc 0.11.0 Using omniauth 1.9.1 Using omniauth-oauth2 1.7.2 Using omniauth-dropbox-oauth2 0.3.0 from https://github.com/huginn/omniauth-dropbox-oauth2.git Using omniauth-oauth 1.1.0 Using omniauth-evernote 1.2.1 Using omniauth-google-oauth2 0.8.2 Using omniauth-tumblr 1.2 Using omniauth-twitter 1.3.0 Using raindrops 0.20.0 Using rb-kqueue 0.2.4 Using rest-client 2.0.2 Using rturk 2.12.1 Using uuid 2.3.7 Using ruby-growl 4.1 Using rufus-scheduler 3.8.1 Using sassc 2.3.0 Using tilt 2.0.10 Using sassc-rails 2.1.2 Using sass-rails 6.0.0 Using select2-rails 3.5.9.3 Using simple_oauth 0.3.1 Using slack-notifier 1.0.0 Using spectrum-rails 1.3.4 Using tumblr_client 0.8.5 from https://github.com/albertsun/tumblr_client.git (at e046fe6@e046fe6) Using twilio-ruby 5.62.0 Using twitter 5.15.0 from https://github.com/sferik/twitter.git Using twitter-stream 0.1.15 from https://github.com/cantino/twitter-stream.git (at a80822d) Using typhoeus 1.3.1 Using uglifier 2.7.2 Using unicorn 6.1.0 Using weibo_2 0.1.7 from https://github.com/albertsun/weibo_2.git (at master@ac38d04) Using xmpp4r 0.5.6 Bundle complete! 110 Gemfile dependencies, 204 gems now installed. Gems in the groups 'test' and 'development' were not installed. Bundled gems are installed into ./vendor/bundle 2022-09-26 13:18:42,316 INFO Included extra file "/etc/supervisor/conf.d/bootstrap.conf" during parsing 2022-09-26 13:18:42,316 INFO Included extra file "/etc/supervisor/conf.d/foreman.conf" during parsing 2022-09-26 13:18:42,316 INFO Included extra file "/etc/supervisor/conf.d/mysqld.conf" during parsing 2022-09-26 13:18:42,322 INFO RPC interface 'supervisor' initialized 2022-09-26 13:18:42,322 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2022-09-26 13:18:42,322 INFO supervisord started with pid 1 2022-09-26 13:18:43,324 INFO spawned: 'stdout' with pid 574 2022-09-26 13:18:43,326 INFO spawned: 'bootstrap' with pid 575 2022-09-26 13:18:43,330 INFO success: bootstrap entered RUNNING state, process has stayed up for > than 0 seconds (startsecs) 2022-09-26 13:18:43,340 INFO exited: bootstrap (exit status 1; not expected) 2022-09-26 13:18:44,342 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)

Warning: the running version of Bundler (2.1.4) is older than the version that created the lockfile (2.3.10). We suggest you to upgrade to the version that created the lockfile by running `gem install bundler:2.3.10`. Following files may not be writable, so sudo is needed: /usr/local/bin /var/lib/gems/2.7.0 /var/lib/gems/2.7.0/build_info /var/lib/gems/2.7.0/cache /var/lib/gems/2.7.0/doc /var/lib/gems/2.7.0/extensions /var/lib/gems/2.7.0/gems /var/lib/gems/2.7.0/plugins /var/lib/gems/2.7.0/specifications The dependency tzinfo-data (>= 0) will be unused by any of the platforms Bundler is installing for. Bundler is installing for aarch64-linux, arm64-darwin, ruby, x86_64-darwin, x86_64-linux but the dependency is only for x86-mingw32, x86-mswin32, x64-mingw32. To add those platforms to the bundle, run `bundle lock --add-platform x86-mingw32 x86-mswin32 x64-mingw32`. ^Cpi@vico-pi:/misc/huginn $ /usr/bin/bundle2.7 install Warning: the running version of Bundler (2.1.4) is older than the version that created the lockfile (2.3.10). We suggest you to upgrade to the version that created the lockfile by running `gem install bundler:2.3.10`. Following files may not be writable, so sudo is needed: /usr/local/bin /var/lib/gems/2.7.0 /var/lib/gems/2.7.0/build_info /var/lib/gems/2.7.0/cache /var/lib/gems/2.7.0/doc /var/lib/gems/2.7.0/extensions /var/lib/gems/2.7.0/gems /var/lib/gems/2.7.0/plugins /var/lib/gems/2.7.0/specifications The dependency tzinfo-data (>= 0) will be unused by any of the platforms Bundler is installing for. Bundler is installing for aarch64-linux, arm64-darwin, ruby, x86_64-darwin, x86_64-linux but the dependency is only for x86-mingw32, x86-mswin32, x64-mingw32. To add those platforms to the bundle, run `bundle lock --add-platform x86-mingw32 x86-mswin32 x64-mingw32`. Fetching gem metadata from https://rubygems.org/....... Fetching https://github.com/Hirurg103/capybara_select2.git Fetching https://github.com/dsander/delayed_job_active_record.git Fetching https://github.com/dsander/dropbox-api.git Fetching https://github.com/dsander/erector.git Fetching https://github.com/huginn/omniauth-dropbox-oauth2.git Fetching https://github.com/albertsun/tumblr_client.git Fetching https://github.com/sferik/twitter.git Fetching https://github.com/cantino/twitter-stream.git Fetching https://github.com/albertsun/weibo_2.git Using rake 13.0.6 Fetching ace-rails-ap 2.0.1 Installing ace-rails-ap 2.0.1 Fetching concurrent-ruby 1.1.9 Installing concurrent-ruby 1.1.9 Fetching i18n 1.8.11 Installing i18n 1.8.11 Fetching minitest 5.15.0 Installing minitest 5.15.0 Fetching thread_safe 0.3.6 Installing thread_safe 0.3.6 Fetching tzinfo 1.2.9 Installing tzinfo 1.2.9 Fetching zeitwerk 2.5.3 Installing zeitwerk 2.5.3 Fetching activesupport 6.0.4.4 Installing activesupport 6.0.4.4 Fetching builder 3.2.4 Installing builder 3.2.4 Fetching erubi 1.10.0 Installing erubi 1.10.0 Fetching mini_portile2 2.6.1 Installing mini_portile2 2.6.1 Fetching racc 1.6.0 Installing racc 1.6.0 with native extensions Gem::Ext::BuildError: ERROR: Failed to build gem native extension. current directory: /tmp/bundler20220522-1877-mavtupracc-1.6.0/gems/racc-1.6.0/ext/racc/cparse /usr/bin/ruby2.7 -I /usr/lib/ruby/vendor_ruby -r ./siteconf20220522-1877-h8wjfl.rb extconf.rb mkmf.rb can't find header files for ruby at /usr/lib/ruby/include/ruby.h You might have to install separate package for the ruby development environment, ruby-dev or ruby-devel for example. extconf failed, exit code 1 Gem files will remain installed in /tmp/bundler20220522-1877-mavtupracc-1.6.0/gems/racc-1.6.0 for inspection. Results logged to /tmp/bundler20220522-1877-mavtupracc-1.6.0/extensions/aarch64-linux/2.7.0/racc-1.6.0/gem_make.out An error occurred while installing racc (1.6.0), and Bundler cannot continue. Make sure that `gem install racc -v '1.6.0' --source 'https://rubygems.org/'` succeeds before bundling. In Gemfile: bootstrap-kaminari-views was resolved to 0.0.5, which depends on rails was resolved to 6.0.4.4, which depends on actioncable was resolved to 6.0.4.4, which depends on actionpack was resolved to 6.0.4.4, which depends on actionview was resolved to 6.0.4.4, which depends on rails-dom-testing was resolved to 2.0.3, which depends on nokogiri was resolved to 1.12.5, which depends on racc

We will be using Twitter gem (Github) to help us in getting up and running quickly with Twitter APIs.