Python ElasticSearch

Open-source Python projects categorized as ElasticSearch

Top 23 Python ElasticSearch Projects

  • awesome-aws

    A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

  • haystack

    :mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

    Project mention: Llama2 and Haystack on Colab | news.ycombinator.com | 2023-07-21

    I recently conducted some experiments with Llama2 and Haystack (https://github.com/deepset-ai/haystack), the NLP/LLM framework.

    The notebook can be helpful for those trying to load Llama2 on Colab.

    1) Installed Transformers from the main branch (and other libraries)

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • sigma

    Main Sigma Rule Repository

    Project mention: Looking for feedback on a security-related project idea | /r/AskNetsec | 2023-07-05

    Idea: A free and open-source web repository of Sigma detections where users can find, contribute, and suggest edits to detections. All user contributions will go through a StackExchange-style moderation queue. Built-in conversion from Sigma to the query language of your choice.

  • dev-setup

    macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

  • elasticsearch-py

    Official Python client for Elasticsearch

    Project mention: Verify Connection to Elasticsearch (2021) | news.ycombinator.com | 2023-04-12
  • elasticsearch-dsl-py

    High level Python client for Elasticsearch

  • tubearchivist

    Your self hosted YouTube media server

    Project mention: New release: v0.4.0 | /r/TubeArchivist | 2023-08-06

    It has been some time since the last release, but v0.4.0 is finally wrapped up. This brings a wide range of fixes and changes, particularly stability improvements, with our new file system naming convention, this should solve a bunch of previously unsolvable compatibility issues. I highly recommend reading the release notes carefully, as the filesystem migration could be a breaking change if you made changes manually there: https://github.com/tubearchivist/tubearchivist/releases/tag/v0.4.0

  • Revelo Payroll

    Free Global Payroll designed for tech teams. Building a great tech team takes more than a paycheck. Zero payroll costs, get AI-driven insights to retain best talent, and delight them with amazing local benefits. 100% free and compliant.

  • nyaa

    Bittorrent software for cats

  • archivy

    Archivy is a self-hostable knowledge repository that allows you to learn and retain information in your own personal and extensible wiki.

    Project mention: Archiving an entire BBS forum | /r/DataHoarder | 2023-03-09

    Use Archivy if u want save as markdown.

  • docarray

    Represent, send, store and search multimodal data

    Project mention: DocArray – Represent, send, and store multimodal data for ML | news.ycombinator.com | 2023-04-27
  • RedELK

    Red Team's SIEM - tool for Red Teams used for tracking and alarming about Blue Team activities as well as better usability in long term operations.

    Project mention: What project ideas are there for a cybersecurity homelab? | /r/AskNetsec | 2023-06-04

    Play with RedELK for learning ELK and monitoring blue team activities - https://github.com/outflanknl/RedELK

  • rally

    Macrobenchmarking framework for Elasticsearch

    Project mention: hardware help | /r/elasticsearch | 2023-03-21

    I would say if you really want to know what your specific hardware can do you should do a real test with esrally. https://github.com/elastic/rally

  • stocksight

    Stock market analyzer and predictor using Elasticsearch, Twitter, News headlines and Python natural language processing and sentiment analysis

  • news-please

    news-please - an integrated web crawler and information extractor for news that just works

    Project mention: Data extraction from news media outlets? | /r/datasets | 2022-10-13

    Look at news-please, you can find it in GitHub. I did something similar and it was very helpful. You can hit me up with if you have any questions.

  • fapro

    Fake Protocol Server

  • VulnWhisperer

    Create actionable data from your Vulnerability Scans

  • match

    :crystal_ball: Scalable reverse image search built on Kubernetes and Elasticsearch

  • nagios-plugins

    450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

  • beir

    A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

    Project mention: Benefits of hybrid search | dev.to | 2023-08-18

    Custom datasets can also be evaluated using this method as specified in this link. This article and the associated benchmarks script can be reused to evaluate what method works best on your data.

  • Eliot

    Eliot: the logging system that tells you *why* it happened

    Project mention: Logging code mess | /r/Python | 2023-04-14

    Maybe something like eliot could work for you

  • django-elasticsearch-dsl

    This is a package that allows indexing of django models in elasticsearch with elasticsearch-dsl-py.

  • pgsync

    Postgres to Elasticsearch/OpenSearch sync (by toluaina)

  • bertsearch

    Elasticsearch with BERT for advanced document search.

  • Onboard AI

    Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-08-18.

Python ElasticSearch related posts

Index

What are some of the best open-source ElasticSearch projects in Python? This list will help you:

Project Stars
1 awesome-aws 11,731
2 haystack 10,930
3 sigma 6,739
4 dev-setup 5,981
5 elasticsearch-py 4,036
6 elasticsearch-dsl-py 3,702
7 tubearchivist 3,281
8 nyaa 3,110
9 archivy 3,039
10 docarray 2,490
11 RedELK 2,148
12 rally 1,827
13 stocksight 1,805
14 news-please 1,749
15 fapro 1,471
16 VulnWhisperer 1,316
17 match 1,227
18 nagios-plugins 1,107
19 beir 1,095
20 Eliot 1,047
21 django-elasticsearch-dsl 972
22 pgsync 930
23 bertsearch 881
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com