Search results

FlashAttention CUDA "no kernel image" crash on RTX 5060 Ti

Status: Open.

#3342 In huggingface/text-generation-inference;

· pauli31 opened on Dec 9, 2025

'Qwen2Model' object has no attribute 'model'

Status: Open.

#3335 In huggingface/text-generation-inference;

· Sunhill666 opened on Oct 10, 2025

How to use prefix caching

Status: Open.

#3333 In huggingface/text-generation-inference;

· Noha-Magdy opened on Sep 27, 2025

Feature request: Apple MPS flash attention for GGUF

Status: Open.

#3331 In huggingface/text-generation-inference;

· qdrddr opened on Sep 20, 2025

please use transformers latest supper gpt-oss please

Status: Open.

#3328 In huggingface/text-generation-inference;

· wang824892540 opened on Sep 12, 2025

Gemma3: CUDA error: an illegal memory access was encountered.

Status: Open.

#3321 In huggingface/text-generation-inference;

· Behnamhb opened on Sep 4, 2025

ghcr.io/huggingface/text-generation-inference:3.3.5 doesn't exist

Status: Open.

#3320 In huggingface/text-generation-inference;

· chuijh opened on Sep 3, 2025

Infinite tool call loop: <code>HuggingFaceModel</code> and <code>text-generation-inference</code>

Status: Open.

#3318 In huggingface/text-generation-inference;

· baughmann opened on Aug 31, 2025

Endpoint failed to start due to ShardFailed on hugging face inference endpoint

Status: Open.

#3317 In huggingface/text-generation-inference;

· relativity-codes opened on Aug 29, 2025

It seems no one is maintaining this project.

Status: Open.

#3316 In huggingface/text-generation-inference;

· mengxiaosen-patsnap opened on Aug 29, 2025

Support for gpt-oss-120b and gpt-oss-20b model.

Status: Open.

#3309 In huggingface/text-generation-inference;

· imran3180 opened on Aug 5, 2025

ModuleNotFoundError: No module named 'punica_sgmv'

Status: Open.

#3306 In huggingface/text-generation-inference;

· xxz7909 opened on Aug 1, 2025