LLMFarm

LLMFarm is a local-AI tool - llama and other large language models on iOS and MacOS offline using GGML library.

Overview

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.With LLMFarm, you can test the performance of different LLMs on iOS and macOS and find the most suitable model for your project. Based on ggml and llama.cpp by Georgi Gerganov.

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select 'llama inference' in model settings.

When creating a chat, a JSON file is generated in which you can specify additional inference options. The chat files are located in the "chats" directory. You can see all inference options here.

'llmfarm_core' has been moved to a separate repository. To build llmfarm, you need to clone this repository recursively:

• rwkv.cpp by saharNooby * Mia by byroneverson * LlamaChat by alexrozanski * swift-markdown-ui by gonzalezreal * similarity-search-kit by ZachNagengast

LLMFarm is open-source, written primarily in C, with 2,080 GitHub stars under the MIT license. The latest release is 1.4.3 (2025-01-27).

Key capabilities

From the project's documentation:

• Various sampling methods
• Metal (dont work on intel Mac)
• Model setting templates
• Restore context state
• MobileVLM 1.7B/3B models
• Temperature (temp, tok-k, top-p)

How it fits a local-AI stack

LLMFarm runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related local-AI tools in the directory:

• "algernon"
• "blinko"
• Continue
• "DigUp"

Sources

• Source code & docs: guinmoon/LLMFarm
• Official website: https://llmfarm.space

Stats from GitHub, 2026-10-30.