llm-serving

Here are 8 public repositories matching this topic...

ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a toolkit of libraries (Ray AIR) for accelerating ML workloads.

Updated Jun 19, 2023
Python

mosecorg / mosec

Star

A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine

python rust machine-learning deep-learning tensorflow gpu pytorch hacktoberfest model-serving nerual-network machine-learning-platform jax mlops llm llm-serving

Updated Jun 17, 2023
Python

ray-project / ray-educational-materials

Star

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

deep-learning ray distributed-machine-learning ray-tune ray-train ray-distributed llm generative-ai ray-serve ray-data llm-serving llm-inference

Updated May 31, 2023
Jupyter Notebook

ray-project / anyscale-berkeley-ai-hackathon

Star

Ray and Anyscale for UC Berkeley AI Hackathon!

hackathon berkeley-ai ray-distributed anyscale llm llm-serving llm-inference

Updated Jun 17, 2023
Jupyter Notebook

ray-project / llms-in-prod-workshop-2023

Star

Deploy and Scale LLM-based applications

ray anyscale llm llms llm-serving llm-inference

Updated Jun 15, 2023
Jupyter Notebook

ray-project / llm-application

Star

nlp scalable-machine-learning ray-distributed anyscale llm llm-serving

Updated Jun 14, 2023
Jupyter Notebook

LoopGlitch26 / Hinglish-AI-Mentor

Sponsor

Star

Hinglish Chatbot powered by Azure Cognitive Services, Google Translate and Open AI

google azure nlp-machine-learning prompt-engineering llm-serving

Updated Jun 17, 2023
Jupyter Notebook

Stosan / commentator

Star

generative-ai llm-serving

Updated Jun 18, 2023
Python

Improve this page

Add a description, image, and links to the llm-serving topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-serving topic, visit your repo's landing page and select "manage topics."

Learn more

May	JUN	Jul
	19
2022	2023	2024