ncnn is a high-performance neural network inference framework optimized for the mobile platform

Tengine is a lite, high performance, modular inference engine for embedded device

FeatherCNN is a high performance inference engine for convolutional neural networks.

Heterogeneous Run Time version of Caffe. Added heterogeneous capabilities to the Caffe, uses heterogeneous computing infrastructure framework to speed up Deep Learning on Arm-based heterogeneous embedded platform. It also retains all the features of the original Caffe architecture which users deploy their applications seamlessly.

SIMD (SSE) population count --- http://0x80.pl/articles/sse-popcount.html

arm neon 相关文档和指令意义

Heterogeneous Run Time version of MXNet. Added heterogeneous capabilities to the MXNet, uses heterogeneous computing infrastructure framework to speed up Deep Learning on Arm-based heterogeneous embedded platform. It also retains all the features of the original MXNet architecture which users deploy their applications seamlessly.

benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN etc.

RV: A Unified Region Vectorizer for LLVM

Heterogeneous Run Time version of TensorFlow. Added heterogeneous capabilities to the TensorFlow, uses heterogeneous computing infrastructure framework to speed up Deep Learning on Arm-based heterogeneous embedded platform. It also retains all the features of the original TensorFlow architecture which users deploy their applications seamlessly.

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

A sample tutorial android NDK app for comparing Neon Architecture for doing various Image Manipulation like Gaussian Blur.

ncnn is a high-performance neural network inference framework optimized for the mobile platform