Creating a chatbot using Alpaca native and LangChain

Let's talk to an Alpaca-7B model using LangChain with a conversational chain and a memory window.

Setup and installation

Install python packages using pip. Note that you need to install HuggingFace Transformers from source (GitHub) currently.

$ pip install git+https://github.com/huggingface/transformers
$ pip install langchain
$ pip install bitsandbytes accelerate
$ pip install -q datasets loralib sentencepiece 

Model

We will load Alpaca-7B native from HuggingFace.