Discussions

• 1 You must be logged in to vote

  🙏

  Question about weight layout

  pshung asked Mar 20, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Question Regarding Operation offload & Graph Split

  akapoor3518 started Mar 12, 2025 in General

  

  

  2
• 1 You must be logged in to vote

  💬

  Calling ggml_view_3d() on quantised tensors possibly causes alignment problems?

  jukofyork started Mar 11, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  A general question on developer beginning point

  mahdi259 asked Feb 21, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  The lifecycle of ggml tensor

  soccercheng asked Feb 11, 2025 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  GGML Shape & Strides question

  akapoor3518 started Feb 12, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  Question about unsupported operation by Backend

  akapoor3518 started Feb 4, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Kronecker product of two ggml_tensor: How to?

  stduhpf asked Jan 26, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  What is the best way to support 5d tensor (or even higher dimension)?

  randxie asked Jun 1, 2024 in Q&A · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  Would it be a bad idea to move the static inline functions used in internal asserts to the header file?

  stduhpf asked Jan 20, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Logits largely different from PyTorch

  lancelotblanchard asked Jan 5, 2025 in Q&A · Unanswered

  

  

  9
• 2 You must be logged in to vote

  🙏

  How does GGML syncing work across ggml / llama.cpp / whisper.cpp repos?

  peter277 asked Jan 11, 2025 in Q&A · Answered

  

  

  3
• 2 You must be logged in to vote

  🙏

  Need help porting PyTorch code to GGML

  tbtlr asked Jan 5, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How can I get a subset of a ggml tensor?

  mecccaaa asked Dec 26, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  🙏

  How to convert PyTorch model to gguf and how to write gguf?

  tuna2134 asked Dec 30, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  Limit build to certain quants only

  vladfaust started Dec 6, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to implement Infinite Context and Attention?

  calebnwokocha asked Nov 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to use ggml_mul_mat?

  Ucag asked Oct 30, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  I try to use ggml matmul together with pytorch. But I fail to use pytorch cudagraph to capture the matmul

  Eutenacity asked Oct 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Is there an easy way to port any PyTorch model into GGML?

  Connor56 started Sep 30, 2024 in General

  

  

  1
• 5 You must be logged in to vote

  💬

  When would you use ggml vs llama.cpp?

  lefnire started May 10, 2023 in General

  

  

  

  

  2
• 7 You must be logged in to vote

  🙌

  Huggingface GGUF Editor

  CISC started Sep 1, 2024 in Show and tell

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Can it be generated into a computational graph, and the corresponding data can be loaded when the node is traversed during the calculation?

  coolling asked Sep 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  a dumb question about safety

  teathinker started Sep 8, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  ggml_init() return nullptr error

  walker-ai asked Sep 7, 2024 in Q&A · Unanswered

  

  

  0