README.md

LLamaStack.Web - Basic ASP.NET Core example

LLamaStack.Web has no heavy dependencies and no extra frameworks over bootstrap and jquery to keep the examples clean and easy to copy over to your own project

Live Demo

Live WebInterface Demo

Websockets

LLamaStack.Web uses Signalr websockets this simplifys the streaming of responses and model per connection management

Setup

You can setup Models, Prompts and Inference parameters in the appsettings.json

Models You can add multiple models to the options for quick selection in the UI, options are based on LLamaSharp ModelParams so its fully configurable

Interactive UI

Manage and interact with all your models in one sime UI interface

Live Parameters

Update inference parameters between each question/instruction