BricksLLM Docker

August 28, 2023 ยท View on GitHub

This repository serves as a quick way to try out/develop BricksLLM AI gateway using the docker compose. It helps set up dependencies such as

  • Postgresql - BricksLLM uses Postgresql for storing gateway configurations.
  • Redis - It is used for caching purposes such as rating limiting and cost controlling API calls to third party LLM models.

Prerequisites

Getting started

First set up your OpenAI credential

export OPENAI_API_KEY=YOUR_OPENAI_API_KEY

Then run docker-compose

docker-compose up -d