Botastic

An AI framework for building cool things.

👀 Overview

💡 Motivation

• LLMs are fantastic for knowledge generation and reasoning as they're pre-trained on large amounts of publicly available data.
• In practice, we need LLMs to be able to reason about our own data. Fine-tuning them is often impractical. Embedding data into LLMs is a viable alternative, but requires domain expertise, and considerable effort to dealing with prompt limitations
• Botastic aims to make it easy to embed your own data into LLMs.
• Botastic also aims to provide out-of-the-box solutions to satisfy common use cases.
• It would to be easily integrated into existing systems and scalable to meet business requirements.
• We're building AI-based applications, we need Botastic to simplify the process.

🚀 Features

• 🔌 Connect to OpenAI's LLM
• 💾 Store and manage your own data as LLM's external brain
• 🌐 Restful APIs
• 💬 Conversations management to help you build dialogue interface based applications
• 🤖 Bot/Avatar management and builtin useful bots: emotion recognition, sentiment analysis, spam checker, etc. Please refer to [TBD].
• 🧩 Customize Middlewares to extend Botastic's functionality
• 💾 Store vectors in Postgres and other databases
• 📦 Better strategies to split the data and build text chunks
• 📤 Export data
• 🙋‍♂️ Support other LLMs
• 📚 Fine-tune own models

Getting Started

1. visit https://developers.pando.im/console/botastic to get your API key/secret, and create a new bot.
2. run the following command to talk to Botastic

curl --location --request POST 'https://botastic-api.pando.im/api/conversations/oneway' \
--header 'X-BOTASTIC-APPID: YOUR_BOTASTIC_APP_ID' \
--header 'Content-Type: application/json' \
--data-raw '{
  "bot_id": YOUR_BOT_ID,
  "content": "How do you view the future of blockchain, and what benefits does it have for human being? Respond as short as possible like a Zen Master.",
  "category": "plain-text"
}'

Documentation

Please refer to Guide and API Reference for more details.

Showcases

• Ask Vitalik: A digital avatar of Vitalik Buterin.
• Ask Scott Alexander: A digital avatar of Scott Alexander.
  • The author also wrote a blog post about how she built it.

Installation

Manually

Please refer to docs/install.md for manual installation.

Docker

TBD