Use Amazon Bedrock Models with OpenAI SDKs with a Serverless Proxy Endpoint - Without Fixed Cost!

This page summarizes the projects mentioned and recommended in the original post on dev.to
hardware-buttons scrape-images linkedin-bot

Nutrient - The #1 PDF SDK Library
Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.
nutrient.io
featured
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured

  1. bedrock-access-gateway

    OpenAI-Compatible RESTful APIs for Amazon Bedrock

    To fix this issue, AWS has provided the great project aws-samples/bedrock-access-gateway - It allows you to deploy an Application Load Balancer + Lambda/Fargate pair so that you can use OpenAI's official SDKs with the OpenAI-API compatibile Rest API endpoint via the environment variables OPENAI_API_BASE and OPENAI_API_KEY.

  2. Nutrient

    Nutrient - The #1 PDF SDK Library. Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.

    Nutrient logo

  3. aws-lambda-web-adapter

    Run web applications on AWS Lambda

    Also, you can use Lambda Web Adapter + Function URL (see example) to replace ALB or AWS Fargate to replace Lambda to get better performance on streaming response.

  4. aws-sam-cli

    CLI tool to build, test, debug, and deploy Serverless applications using AWS SAM

    sudo yum update -y sudo yum install -y python3.12 python3.12-pip ( cd /tmp && \ curl -L https://github.com/aws/aws-sam-cli/releases/latest/download/aws-sam-cli-linux-x86_64.zip -o aws-sam-cli-linux-x86_64.zip && \ unzip aws-sam-cli-linux-x86_64.zip -q -d sam-installation && \ sudo ./sam-installation/install ) git clone --depth=1 https://github.com/gabrielkoo/bedrock-access-gateway-function-url cd bedrock-access-gateway-function-url ./prepare_source.sh sam build sam deploy --guided

  5. bedrock-access-gateway-function-url

    OpenAI-Compatible RESTful APIs for Amazon Bedrock, modified from the original "bedrock-access-gateway" project for not using ALB, so that one could deploy and use it under a pay as you go model without fixed costs.

    sudo yum update -y sudo yum install -y python3.12 python3.12-pip ( cd /tmp && \ curl -L https://github.com/aws/aws-sam-cli/releases/latest/download/aws-sam-cli-linux-x86_64.zip -o aws-sam-cli-linux-x86_64.zip && \ unzip aws-sam-cli-linux-x86_64.zip -q -d sam-installation && \ sudo ./sam-installation/install ) git clone --depth=1 https://github.com/gabrielkoo/bedrock-access-gateway-function-url cd bedrock-access-gateway-function-url ./prepare_source.sh sam build sam deploy --guided

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Data Masking of AWS Lambda Function Logs

    3 projects | dev.to | 15 Mar 2025

  • Simplified Data Masking in AWS Lambda with Powertool

    1 project | dev.to | 3 Jan 2025

  • Managed Secure SFTP using Terraform

    2 projects | dev.to | 24 Nov 2024

  • Powertools for AWS Lambda (Python)

    1 project | news.ycombinator.com | 19 Sep 2024

  • Serverless AWS Account Watcher

    3 projects | dev.to | 2 Sep 2024
Loading...