solr
bigquery-utils
solr | bigquery-utils | |
---|---|---|
6 | 6 | |
1,015 | 1,031 | |
2.7% | 1.0% | |
9.8 | 6.1 | |
6 days ago | 6 days ago | |
Java | Java | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
solr
- Iniciando no Elasticsearch: Conceitos básicos
-
Swirl: An open-source search engine with LLMs and ChatGPT to provide all the answers you need 🌌
Using the Galaxy UI, knowledge workers can systematically review the best results from all configured services including Apache Solr, ChatGPT, Elastic, OpenSearch, PostgreSQL, Google BigQuery, plus generic HTTP/GET/POST with configurations for premium services like Google's Programmable Search Engine, Miro and Northern Light Research.
-
Looking for software
Apache Solr can be used to index and search text-based documents. It supports a wide range of file formats including PDFs, Microsoft Office documents, and plain text files. https://solr.apache.org/
-
What do you use for site search? Custom built solution? Meilisearch? Algolia?
Solr https://solr.apache.org/
-
'google-like' search engine for files on my NAS
if so, then https://solr.apache.org/ can be a solution, though there's a bit of setup involved. oh yea, you get to write your own "search interface" too which would end up calling solr's api to find stuff.
- An alternative to Elasticsearch that runs on a few MBs of RAM
bigquery-utils
-
Swirl: An open-source search engine with LLMs and ChatGPT to provide all the answers you need 🌌
Using the Galaxy UI, knowledge workers can systematically review the best results from all configured services including Apache Solr, ChatGPT, Elastic, OpenSearch, PostgreSQL, Google BigQuery, plus generic HTTP/GET/POST with configurations for premium services like Google's Programmable Search Engine, Miro and Northern Light Research.
-
Modern data stack: scaling people and technology at FINN
Data Transformations: This phase involves modifying and integrating tables to generate new tables optimized for analytical use. Consider this example: you want to understand the purchasing behavior of customers aged between 20-30 in your online shop. This means you'll need to join product, customer, and transaction data to create a unified table for analytics. These data preparation tasks (e.g., joining fragmented data) for analysis are essentially what "Data Transformations" entail. At FINN, technologies utilized in this phase include BigQuery as a data warehouse, dbt for data transformation, and a combination of GitHub Actions and Datafold for quality assurance.
-
Running Transformations on BigQuery using dbt Cloud: step by step
Introduction In today's data-driven world, transforming raw data into valuable insights is crucial. This process, however, often involves complex tasks that demand efficiency, scalability, and reliability. Enter dbt Cloud—a powerful tool that simplifies data transformations on Google BigQuery. In this article, we'll take you through a step-by-step guide on how to run BigQuery transformations using dbt Cloud. Let's dive in!
-
Do I need a cloud computing–based data cloud company
You'll want to evaluate what BigQuery has to offer and see if it makes sense for you to move over.
-
I used ChatGPT to get an Internship
Watch the introductory videos on BigQuery on the Google Cloud Platform website (https://cloud.google.com/bigquery)
-
Wrangling BigQuery at Reddit
Within the audit logs you can find BigQueryAuditMetadata details in the protoPayload.metadataJson submessage in the Cloud Logging LogEntry message. GCP has offered several versions of BigQuery audit logs so there are both older “v1” and newer “v2” versions. The v1 logs report API invocations and live within the protoPayload.serviceData submessage while the v2 logs report resource interactions like which tables were read from and written to by a given query or which tables expired. The v2 data lives in a new field formatted as a JSON blob within the BigQueryAuditMetadata detail inside the protoPayload.metadataJson submessage. In v2 logs the older protoPayload.serviceData submessage does exist for backwards compatibility but the information is not set or used. We scrape details from the JobChange object instead. We referenced the GCP bigquery-utils Git repo for how to use INFORMATION_SCHEMA queries and audit logs queries.
What are some alternatives?
llm-integration - spring-starter, which enables semantic search, backed by OpenAI, by couple of lines
swirl-search - Swirl is an open-source search platform that uses AI to search multiple content and data sources simultaneously and return AI-ranked results. And provides summaries of your answers from searches using LLMs. It's a one-click, easy-to-use Retrieval Augmented Generation (RAG) Solution.
open-semantic-search - Open Source research tool to search, browse, analyze and explore large document collections by Semantic Search Engine and Open Source Text Mining & Text Analytics platform (Integrates ETL for document processing, OCR for images & PDF, named entity recognition for persons, organizations & locations, metadata management by thesaurus & ontologies, search user interface & search apps for fulltext search, faceted search & knowledge graph)
DataflowTemplates - Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
fess - Fess is very powerful and easily deployable Enterprise Search Server.
dataproc-templates - Dataproc templates and pipelines for solving simple in-cloud data tasks
spark-bigquery-connector - BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
orange - Cross-platform local file search engine.
appengine-java-standard - Google App Engine Standard Java runtime: Prod runtime, local devappserver, Cloud SDK Java components, GAE APIs, and GAE API emulators.
LuceneBench - Lucene Benchmark : benchmarking Lucene vs. SeekStorm
nodejs-bigquery - Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.