A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Chat with your favourite LLaMA models in a native macOS app

Run LLaMA/GPT model easily and fast in C#!🤗 It's also easy to integrate LLamaSharp with semantic-kernel, unity, WPF and WebApp.

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

The TypeScript library for building multi-modal AI applications.

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

A simple "Be My Eyes" web app with a llama.cpp/llava backend

Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

llama.cpp with BakLLaVA model describes what does it see

The "vicuna-installation-guide" provides step-by-step instructions for installing and configuring Vicuna 13 and 7B

♾️ toolkit for air-gapped LLMs on consumer-grade hardware

AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.

A CLI and web UI to interact with LLMs in a Chat-style interface, with code execution capabilities.

Run any Large Language Model behind a unified API

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.

Inference Vision Transformer (ViT) in plain C/C++ with ggml