Show HN: SiteGPT – Create ChatGPT-like chatbots trained on your website content

• langchain

  152 56,526 10.0 Python

  Discontinued ⚡ Building applications with LLMs through composability ⚡ [Moved to: https://github.com/langchain-ai/langchain] (by hwchase17)

  

Not to go full "Dropbox in a weekend", but if you're technical enough to self-host, this is something you can build for yourself

Everyone is going straight to embeddings, but it'd be easy enough to use old school NLP summarization from NLTK (https://www.nltk.org/)

Hook that up a web scraping library like https://scrapy.org/ and get a summary of each page.

Then embed a site map in your system prompt and use langchain (https://github.com/hwchase17/langchain) to allow GPT to query for a specific page's summary.

-

The point of this isn't to say that's how OP did it, but there might be people seeing stuff like this and wondering how on earth to get into it: This is something you could build in a weekend with pretty much no understanding of AI

• NLTK

  64 13,015 8.1 Python

  NLTK Source

  

Not to go full "Dropbox in a weekend", but if you're technical enough to self-host, this is something you can build for yourself

Everyone is going straight to embeddings, but it'd be easy enough to use old school NLP summarization from NLTK (https://www.nltk.org/)

Hook that up a web scraping library like https://scrapy.org/ and get a summary of each page.

Then embed a site map in your system prompt and use langchain (https://github.com/hwchase17/langchain) to allow GPT to query for a specific page's summary.

-

The point of this isn't to say that's how OP did it, but there might be people seeing stuff like this and wondering how on earth to get into it: This is something you could build in a weekend with pretty much no understanding of AI

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Scrapy

  180 50,896 9.6 Python

  Scrapy, a fast high-level web crawling & scraping framework for Python.

  

Not to go full "Dropbox in a weekend", but if you're technical enough to self-host, this is something you can build for yourself

Everyone is going straight to embeddings, but it'd be easy enough to use old school NLP summarization from NLTK (https://www.nltk.org/)

Hook that up a web scraping library like https://scrapy.org/ and get a summary of each page.

Then embed a site map in your system prompt and use langchain (https://github.com/hwchase17/langchain) to allow GPT to query for a specific page's summary.

-

The point of this isn't to say that's how OP did it, but there might be people seeing stuff like this and wondering how on earth to get into it: This is something you could build in a weekend with pretty much no understanding of AI

• marqo

  114 4,111 9.3 Python

  Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai

  

You can get pretty far with this https://github.com/marqo-ai/marqo. Choose your LLM of choice to pair with it. Examples https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT...

• AIQA

  4 38 3.1 JavaScript

  Question and Answer in nodejs using langchain and chromadb and the OpenAI API for GPT3

You could combine this https://github.com/realrasengan/AIQA

with

this https://github.com/realrasengan/gpt4all-wrapper-js

And do it locally on your computer with just a little mod.

• gpt4all-wrapper-js

  2 40 3.6 JavaScript

  just a wrapper for gpt4all https://github.com/nomic-ai/gpt4all/ for nodejs

You could combine this https://github.com/realrasengan/AIQA

with

this https://github.com/realrasengan/gpt4all-wrapper-js

And do it locally on your computer with just a little mod.

• ask-your-stack

  4 10 4.6 TypeScript

  Ask your stack demo

  

Even better, just ask your stack

https://ask-your-stack.vercel.app/

(It uses official docs to provide answers with context)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project