mongorefine VS tweets-docker-pipeline

Compare mongorefine vs tweets-docker-pipeline and see what are their differences.

mongorefine

Experimental headless data wrangling / refining tool over MongoDB, inspired by OpenRefine (by ivbeg)
data-engineering Data processing data-refinery data-wrangling MongoDB
Source Code
Suggest alternative
Edit details

tweets-docker-pipeline

Docker pipeline for streaming tweets and their sentiment score to a Slack channel (by lorenanda)
docker-compose Postgresql MongoDB Python vader textblob sentiment-analysis Slackbot data-engineering Sqlalchemy Tweepy
Source Code
lorenaciutacu.com
Suggest alternative
Edit details
InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors
mongorefine tweets-docker-pipeline
1 2
2 2
- -
10.0 0.0
over 1 year ago about 2 years ago
Python Python
MIT License MIT License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

mongorefine

Posts with mentions or reviews of mongorefine. We have used some of these posts to build our list of alternatives and similar projects.

tweets-docker-pipeline

Posts with mentions or reviews of tweets-docker-pipeline. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-02-04.
  • Building a dockerized ETL pipeline for streaming positive tweets
    2 projects | dev.to | 4 Feb 2022
    First, I created an app on Twitter and got my credentials (API key and Access Token). Then, I wrote the Python code for streaming live tweets, using tweepy with my Twitter credentials. I chose to stream the hashtag #OnThisDay (thought it would be interesting to get a daily notification of what happened years ago) and collected the tweet text and user handle.
  • Automate your data processing pipeline in 9 steps ⚙️
    8 projects | dev.to | 4 May 2021
    I was really excited, though also a bit overwhelmed by all the things I had to set up for this project. In total, I spent five days learning the tools, debugging, and building this pipeline with Python (including libraries like Tweepy, TextBlob, VADER, and SQLAlchemy), Postgres, MongoDB, Docker, and Airflow (most frustrating part...). If you're interested to see how I did this, you can check out the project on GitHub and read this blog post.

What are some alternatives?

When comparing mongorefine and tweets-docker-pipeline you can also consider the following projects:

DataEngineeringProject - Example end to end data engineering project.

twurl - OAuth-enabled curl for the Twitter API

bytewax - Python Stream Processing

vaderSentiment - VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.

redditcoins-backend - Pull reddit data from APIs and store it in local db

Airflow - Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Docker Compose - Define and run multi-container applications with Docker

PostgreSQL - Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see https://wiki.postgresql.org/wiki/Submitting_a_Patch

cryptostore - A scalable storage service for cryptocurrency data

stocksight - Stock market analyzer and predictor using Elasticsearch, Twitter, News headlines and Python natural language processing and sentiment analysis

MongoDB - The MongoDB Database

SQLAlchemy - The Database Toolkit for Python

mongorefine vs DataEngineeringProject tweets-docker-pipeline vs twurl mongorefine vs bytewax tweets-docker-pipeline vs vaderSentiment tweets-docker-pipeline vs redditcoins-backend tweets-docker-pipeline vs Airflow tweets-docker-pipeline vs Docker Compose tweets-docker-pipeline vs PostgreSQL tweets-docker-pipeline vs cryptostore tweets-docker-pipeline vs stocksight tweets-docker-pipeline vs MongoDB tweets-docker-pipeline vs SQLAlchemy