An Engine-Agnostic Deep Learning Framework in Java

🛠 A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOv5, YOLOX, YOLOP, YOLOv6, YOLOR, MODNet, YOLOX, YOLOv7, YOLOv8. MNN, NCNN, TNN, ONNXRuntime.

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

OpenMMLab Model Deployment Framework

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

A cross platform OCR Library based on PaddleOCR & OnnxRuntime & OpenVINO.

Lightweight nudity detection

🥂 Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.

Robust realtime face and facial landmark tracking on CPU with Unity integration

Realtime human head pose estimation with ONNXRuntime and OpenCV.

一个使用C++编写的音频处理软件

A Redis module for serving tensors and executing deep learning graphs

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

ONNX Model Exporter for PaddlePaddle

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Refacer: One-Click Deepfake Multi-Face Swap Tool

処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)