🌱 InferSpore 🧩

May 29, 2024 · View on GitHub

A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub.