SJTU-IPADS / PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
See what the GitHub community is most excited about today.
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Simple, minimal implementation of the Mamba SSM in one file of PyTorch.
Dev tool that writes scalable apps from scratch while the developer oversees the implementation
A collective list of free APIs
🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo
Specify what you want it to build, the AI asks for clarification, and then builds it.
一个带web界面的声音克隆工具,使用�?的音色或任意声音来录制音频
Get up and running with Llama 2 and other large language models locally
Master the command line, in one page
Adds AMD FSR3 Frame Generation to games by replacing Nvidia DLSS-G Frame Generation (nvngx_dlssg).
Learn how to design systems at scale and prepare for system design interviews
Deliver web apps with confidence 🚀
Revolutionizing Database Interactions with Private LLM Technology
Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
ComfyUI related stuff and things
An open-source cross-platform alternative to AirDrop
科技爱好者周刊,每周五发布
🚂 🦀 The one-person framework for Rust for side-projects and startups
Database-backed Active Job backend
🎓 Path to a free self-taught education in Computer Science!
Reflective x64 PE/DLL Loader implemented using Dynamic Indirect Syscalls
Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
This repository contains a simple vulnerability scanner for the Terrapin attack present in the paper "Terrapin Attack: Breaking SSH Channel Integrity By Sequence Number Manipulation".
Official implementations for paper: Anydoor: zero-shot object-level image customization
A collection of Solana programs maintained by Solana Labs