LLamaSharp

LLamaSharp is a chat UI - A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Overview

LLamaSharp is a cross-platform library to run 🦙LLaMA model (and others) on your local device. Based on llama.cpp, inference with LLamaSharp is efficient on both CPU and GPU. With the higher-level APIs and RAG support, it's convenient to deploy LLMs (Large Language Models) in your application with LLamaSharp.

Please star the repo to show your support for this project!🤗

Documentation Console Demo Integrations & Examples Get started FAQ Contributing Join the community Star history Contributor wall of fame Map of LLamaSharp and llama.cpp versions

There are integrations for the following libraries, making it easier to develop your APP. Integrations for semantic-kernel and kernel-memory are developed in the LLamaSharp repository, while others are developed in their own repositories.

• semantic-kernel: an SDK that integrates LLMs like OpenAI, Azure OpenAI, and Hugging Face. - kernel-memory: a multi-modal AI Service specialized in the efficient indexing of datasets through custom continuous data hybrid pipelines, with support for RAG (Retrieval Augmented Generation), synthetic memory, prompt engineering, and custom semantic memory processing. - BotSharp: an open source machine learning framework for AI Bot platform builder. - Langchain: a framework for developing applications powered by language models. - MaIN.NET: simplistic approach to orchestrating agents/chats from different (llm) providers

The following examples show how to build APPs with LLamaSharp.

LLamaSharp is open-source, written primarily in C#, with 3,707 GitHub stars under the MIT license. The latest release is v0.27.0 (2026-04-26).

Key capabilities

From the project's documentation:

• Ask AI via deep-wiki
• BotSharp: an open source machine learning framework for AI Bot platform builder.
• Langchain: a framework for developing applications powered by language models.
• LLamaStack (with WPF and Web demo)
• Blazor Demo (with Model Explorer)
• LLamaWorker (ASP.NET Web API like OAI and Function Calling Support)

How it fits a local-AI stack

LLamaSharp runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related chat UIs in the directory:

• GPT4All
• Jan
• LibreChat
• LM Studio

Sources

• Source code & docs: SciSharp/LLamaSharp
• Official website: https://scisharp.github.io/LLamaSharp

Stats from GitHub, 2026-06-08.