Discussions

• 1 You must be logged in to vote

  🙏

  deepcopy deepspeed partitioned state of a module

  haixpham asked Jan 17, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  AutoTP for training?

  KaiLv69 started Jan 11, 2024 in General

  

  

  1
• 2 You must be logged in to vote

  🙏

  Is ZeRO-3 compatible to tensor parallel?

  skyshine102 asked Dec 27, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  build_win.bat 报错

  songyu1980 asked Apr 15, 2023 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💬

  Can't get Deepspeed to work on Ubuntu 22.04

  AlpsAficionado started May 12, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Why the seemingly repetitive code in DeepSpeedDataLoader?

  MrCrHaM started Dec 14, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Error when calling forward() multiple times using deepspeed zero3

  powpos360 asked Sep 1, 2023 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  zero_optimization setting

  yongjer asked Dec 9, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  finer granular zero offload strategy

  chizhang118 asked Nov 28, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there any tutorial about the folder "deepspeed/elasticity"?

  Truring asked Nov 21, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Can we use deepspeed along with the tensorRT?

  debasishaimonk started Nov 14, 2023 in General

  

  

  0
• 3 You must be logged in to vote

  🙏

  Example to help understand Dynamic SplitFuse

  puddingfjz asked Nov 5, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  How much faster is deepspeed + pytorch 2.x compared to 1.x?

  zhoumengbo started Nov 5, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Deepspeed-FastGen: Missing Precision Evaluation

  m1mc asked Nov 4, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  Invalidate trace cache @ step 13: expected module xx, but got module xxx

  mrluin started Aug 3, 2023 in General

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  Need help with configuring data and tensor parallel inference

  sarathkondeti asked Sep 10, 2023 in Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  🙏

  how to use multi-gpu for training LLM

  deepankar27 asked Mar 30, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  CUDA illegal memory access error while using deepspeed.initialize

  seungyounglim asked Jul 5, 2022 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does DeepSpeed MoE support #device < #expert during inference

  iteratorlee asked Oct 27, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Is it possible to launch multi-node runs without pdsh?

  kyleliang919 asked Feb 12, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Pruning on Multiple GPU Cards (Nodes) with DeepSpeed Zero-(1,2,3)

  yiliu30 asked Oct 23, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Does DeepSpeed support tensor parallel for training?

  yiliu30 asked Oct 10, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is there anyway to test deepspeed enabled code locally?

  MiladInk asked Oct 13, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Understand torch profiler output for zero3 during fine-tuning of llama2 7B

  xwjiang2010 asked Oct 4, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  How do debug failing in deepspeed stage 3 but not stage 2

  baxelrod asked Sep 30, 2023 in Q&A · Unanswered

  

  

  0