gpt4all: open-source LLM chatbots that you can run anywhere

Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ

Operating LLMs in production

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

Reference implementation of Mistral AI 7B v0.1 model.

Open-source ChatGPT equivalent experience for both open and close source LLMs, embedders, and vector databases. Supports unlimited documents, threads, and concurrent users and management all in a very clean UI.

Sparsity-aware deep learning inference runtime for CPUs

本项目旨在分享大模型相关技术原理以及实战经验。

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

RayLLM - LLMs on Ray

LLMFlows - Simple, Explicit and Transparent LLM Apps

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

LLMs as Copilots for Theorem Proving in Lean

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

irresponsible innovation. Try now at https://chat.dev/

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.