Adding Web Scraping and Google Search to AWS Bedrock Agents

1. bedrock-agents-webscraper

   1 1 45 8.7 Python

   This repo provides guidance on setting up a bedrock agent to webscrape and internet search via action groups

   

   There is a web scraper example from AWS that covers this, but I wanted to make a version for NodeJS in TypeScript. I also wasn't happy with the Google search capability relying on web scraping, so I swapped it out for the Google custom search API. My solution will also be making use of the AWS CLI and Docker images to make things more consistent.

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. bedrock-agents-webscraper-js

   2 1 2 4.6 TypeScript

   

   Full code available on GitHub.

4. cheerio

   3 57 29,221 9.8 TypeScript

   The fast, flexible, and elegant library for parsing and manipulating HTML and XML.

   

   We're going to use cheerio to parse the content from websites ("web scraping").

Suggest a related project