🌱 InferSpore 🧩
May 29, 2024 · View on GitHub
A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub.
May 29, 2024 · View on GitHub
A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub.