Block or Report
Block or report 0xSage
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePinned
-
janhq/nitro
janhq/nitro PublicAn inference server on top of llama.cpp. OpenAI-compatible API, queue, & scaling. Embed a prod-ready, local inference engine in your apps. Powers Jan
-
-
janhq/nitro-tensorrt-llm
janhq/nitro-tensorrt-llm PublicForked from NVIDIA/TensorRT-LLM
Nitro is an C++ inference server on top of TensorRT-LLM. OpenAI-compatible API. Run blazing fast inference on Nvidia GPUs. Used in Jan
1,092 contributions in the last year
| Day of Week | April Apr | May May | June Jun | July Jul | August Aug | September Sep | October Oct | November Nov | December Dec | January Jan | February Feb | March Mar | |||||||||||||||||||||||||||||||||||||||||
| Sunday Sun | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Monday Mon | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Tuesday Tue | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Wednesday Wed | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Thursday Thu | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Friday Fri | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Saturday Sat | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Contribution activity
March 2024
Created 17 commits in 2 repositories
Created a pull request in janhq/jan that received 3 comments
docs: trt-llm extension guides
Describe Your Changes /providers /providers/llama-cpp /prvoiders/tensorrt-llm Please auto merge for me Fixes Issues Closes # Closes # Self Chec…
Opened 4 other pull requests in 3 repositories
janhq/jan
2
merged
-
docs: Update broken-build.mdx
This contribution was made on Mar 17
-
docs: Update broken-build.mdx
This contribution was made on Mar 15
janhq/nitro-tensorrt-llm
1
merged
-
docs: add instructions for pointing jan fe to the engine
This contribution was made on Mar 8
NVIDIA/TensorRT-LLM
1
closed
-
docs: Integrate with jan
This contribution was made on Mar 8
Reviewed 15 pull requests in 2 repositories
janhq/awesome-local-ai
8 pull requests
-
Add awsome-local-llms repository
This contribution was made on Mar 26
-
Add CrewAI
This contribution was made on Mar 26
-
Added SGLang
This contribution was made on Mar 26
-
Add wordflow
This contribution was made on Mar 26
-
docs: add llmcord.py
This contribution was made on Mar 26
-
Add AI-Mask
This contribution was made on Mar 26
-
Add LoRAX and Predibase as options to README
This contribution was made on Mar 14
-
Add some HF projects
This contribution was made on Mar 14
janhq/jan
7 pull requests
-
Update docs 14th mar
This contribution was made on Mar 14
-
Update Docs with TensorRT-LLM and other docs
This contribution was made on Mar 14
-
feat: revamp homepage
This contribution was made on Mar 13
-
docs: add about/faq
This contribution was made on Mar 13
-
docs: Update broken link and fix the slug
This contribution was made on Mar 6
-
Updated model configuration for 'Jan' to use AUTODETECT
This contribution was made on Mar 5
-
docs: Fix Dark Mode on the Hub page and Update the Navbar functionality
This contribution was made on Mar 5
Created an issue in janhq/jan that received 7 comments
bug: can't swap back to llamacpp after using trtllm
Describe the bug A clear and concise description of what the bug is. v. 0.4.8-322 windows amd ryzen with 4070 Steps to reproduce Steps to reproduce…
Opened 25 other issues in 4 repositories
janhq/jan
9
closed
7
open
-
bug: Turning off Experimental doesnt turn off Quick Ask
This contribution was made on Mar 15
-
bug/feat: Windows uninstall should delete the Jan Data Folder
This contribution was made on Mar 15
-
bug: nitro.exe doesn't download when /extension folder is deleted and recreated
This contribution was made on Mar 15
-
bug: Cannot manually import GGUF models
This contribution was made on Mar 15
-
feat: Get local API server mode to also work for Nitro-TRT-LLM
This contribution was made on Mar 15
-
bug: Quick Ask is broken for 324
This contribution was made on Mar 15
-
bug: Cannot change from one TRT model to another
This contribution was made on Mar 15
-
bug: Cannot change instructions mid-thread when using TRT-LLM
This contribution was made on Mar 15
-
bug: Quickask - Jan processes dangling in background after quitting on Windows
This contribution was made on Mar 14
-
feat: improve tensorrt-llm extension description
This contribution was made on Mar 14
-
docs: user guide to set up tensorrt-llm extension
This contribution was made on Mar 14
-
bug: vertical screen mode on windows doesn't resize well
This contribution was made on Mar 14
-
docs: adopt new guides layout
This contribution was made on Mar 13
-
feat: Host Jan distributions on CloudFlare or S3 for faster user downloads
This contribution was made on Mar 11
-
bug: Use sections for linear content
This contribution was made on Mar 6
-
bug: pin the docs nav at the top
This contribution was made on Mar 6
janhq/docs
5
open
-
docs: Community page
This contribution was made on Mar 26
-
feat: Make Jan Homepage Social Tiles a Carousel
This contribution was made on Mar 26
-
docs: new feature pages
This contribution was made on Mar 25
-
docs: Configuring AMD GPUs
This contribution was made on Mar 25
-
docs: Configuring Intel Arc GPUs
This contribution was made on Mar 25
janhq/nitro-tensorrt-llm
3
closed
-
feat: pin release on Github and possibly push to Cloudflare
This contribution was made on Mar 11
-
feat: build engine for Mistral 7b Q4 (windows only)
This contribution was made on Mar 11
-
feat: build engine for TinyLlama 1.1 (windows only)
This contribution was made on Mar 11
janhq/awesome-local-ai
1
open
-
add trt-llm to the list
This contribution was made on Mar 26






