LLM Goblet 🍷

Overview

LLM proxy application powered by AWS Chalice and LiteLLM.

Prerequisites

• Conda (preferred) or Python (version >=3.9) 🐍
• (Optional) just and jq

Getting Started

0. Install dependencies

   pip install -r requirements.txt

1. Build and deploy the application

   chalice deploy --stage dev

2. Test it out!

   curl -s -X POST `chalice url --stage dev`/images/generations \
       --user "$AWS_ACCESS_KEY_ID":"$AWS_SECRET_ACCESS_KEY" \
       --aws-sigv4 "aws:amz:$AWS_DEFAULT_REGION:execute-api" \
       -H "x-amz-security-token: $AWS_SESSION_TOKEN" \
       -H "Accept: application/json" \
       -H "Content-Type: application/json" \
       -d @assets/goblet.json | jq -r .data[0].b64_json | base64 -d > assets/goblet.jpg

But wait, there's more!

This project includes a justfile that simplifies the process of building, deploying and testing the application.

# Run 🛠️
just local
just deploy

# Check ✅
just check

# Test 🚀
just talk "What is the meaning of life?"
just embed "So long and thanks for all the fish"
just image "An astronaut riding a horse on Mars"

# Clean 🧹
just destroy

Want to learn more about just? Check out the Just Programmer's Manual 📖