withcatai/node-llama-cpp

node-llama-cpp

✅ Recently maintained

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

2,197Stars

228Forks

+47-day stars

TypeScript · MIT · Last push 2026-10-20

Star history

2025-09-292026-11-02

View historical data

git clone https://github.com/withcatai/node-llama-cpp.git

Related domains do not imply feature parity. Review official documentation and licenses.

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Open-source AI agent from Nous Research that works with Claude, GPT and other models and grows with use.

Crawls and scrapes web pages into clean Markdown for AI agents and LLM pipelines.