ggerganov ggml Discussions

Discussions

• 3 You must be logged in to vote

  💡

  Examples

  mverrilli started May 20, 2023 in Ideas

  

  

  1
• 2 You must be logged in to vote

  💡

  Custom kernels, ternary functions?

  cztomsik started May 3, 2023 in Ideas

  

  

  4
• 1 You must be logged in to vote

  💬

  How to cache partial results in graph

  iacore started May 15, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Any plans to support StarCoder?

  sfallah started May 9, 2023 in General

  

  

  2
• 2 You must be logged in to vote

  🙌

  Python bindings with Hugging Face Hub and LangChain support

  marella started May 15, 2023 in Show and tell

  

  

  0
• 3 You must be logged in to vote

  💬

  ggml VS ncnn

  khengari77 started May 11, 2023 in General

  

  

  0
• 3 You must be logged in to vote

  💬

  When would you use ggml vs llama.cpp?

  lefnire started May 10, 2023 in General

  

  

  0
• 2 You must be logged in to vote

  🙏

  Is it possible to convert pytorch to ggml?

  Dampish0 asked Apr 4, 2023 in Q&A · Answered

  

  

  

  

  3
• 4 You must be logged in to vote

  💡

  Sparsity support

  MannyKayy started Apr 2, 2023 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  rinna's Japanese GPT model support

  katsu560 started Mar 4, 2023 in General

  

  

  1
• 2 You must be logged in to vote

  🙏

  Could someone explain a bit about how this is different from post-training quantization supported by typical frameworks like torch and TF?

  awgr asked Mar 19, 2023 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  [GPT-J] How to get token embeddings ?

  ocordeiro asked Mar 7, 2023 in Q&A · Unanswered

  

  

  

  

  6