Discussions

• 2 You must be logged in to vote

  🙏

  lora_finetune.py for continuous pretraining for DeepSeek-V3

  ghtaro asked Mar 11, 2025 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙌

  【R1 SFT Bug，loss should start from 1】

  447428054 started Feb 27, 2025 in Community | Show and tell

  

  

  0
• 1 You must be logged in to vote

  💬

  Using HybridParallelPlugin can I do [2D, 2.5D, 3D] tensor parallelism

  giriprasad51 started Feb 17, 2025 in Community | General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Does ColossalAI support Huawei Ascend hardware platform for trainning?

  zane0506 asked Feb 13, 2025 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  文档写是垃圾

  LeoMax-Xiong started Jan 20, 2025 in Community | General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Does Tensor Parallelism support current scaling mode fp8 ?

  kuozhang asked Oct 24, 2024 in Community | Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💬

  Sequence Parallelism, memory usage question

  EthanChen1234 started May 23, 2023 in Community | General

  

  

  

  

  3
• 2 You must be logged in to vote

  🙏

  boost wrapped 多个 model

  kunfei1 asked Apr 15, 2024 in Community | Q&A · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  model.save(model_path) has error when the file size exceed the 773Kb.

  howtokim asked Aug 11, 2024 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Multi-node without hosts or hostfile, using torch.distributed.launch

  casper-hansen asked May 17, 2024 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  TypeError: llama_causal_lm_forward() got an unexpected keyword argument 'shard_config'

  willy808 asked May 15, 2024 in Community | Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  解释下colossalai框架的亮点是什么，求助求助求助，跟其他框架的区别是什么

  liqwertyu started Apr 26, 2024 in Community | General

  

  

  0
• 1 You must be logged in to vote

  🖥️

  Can open-sora model be utilized to predict or generate the next frame of a video based on preceding frames?

  xuhyun11 started Apr 21, 2024 in Development | Developer Experience

  

  

  0
• 1 You must be logged in to vote

  💡

  Can open-sora model be utilized to predict or generate the next frame of a video based on preceding frames?

  xuhyun11 started Apr 21, 2024 in Community | Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  Can open-sora model be utilized to predict or generate the next frame of a video based on preceding frames?

  xuhyun11 started Apr 21, 2024 in Community | General

  

  

  1
• 1 You must be logged in to vote

  🙏

  ColossalAI VS Vllm Benchmark

  zzb610 asked Mar 26, 2024 in Community | Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  💬

  Get error when want to use Colossal-LLaMA-2

  zhpacer started Feb 20, 2024 in Community | General

  

  

  1
• 5 You must be logged in to vote

  🙏

  No module named 'colossalai._C.cpu_adam_x86'

  mackmake asked Feb 13, 2024 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to debug the ColossalAI script in PyCharm

  songyuc asked Jun 2, 2022 in Community | Q&A · Unanswered

  

  

  

  

  11
• 7 You must be logged in to vote

  🙏

  请教：ColossalAI 和 微软开源的DeepSpeed chat 的定位差异、优势是什么，谢谢

  yanni-code asked May 25, 2023 in Community | Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Example Code and instructions to reproduce the Single GPU optimization demo on GPT2 shown in the repo main page

  LCChen asked Jan 11, 2024 in Community | Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  想问个问题，falcon的注意力权重是fused_qkv的形式，用col_nn.Linear1D_Col这个函数进行切分是否正确？？？假设我的tp_size=2,会不会造成切分错误，为啥不用FusedLinear1D_Col

  laiqinghan asked Jan 4, 2024 in Community | Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  LLaMA2 70B H100 性能問題

  ShinoharaHare asked Dec 11, 2023 in Community | Q&A · Unanswered

  

  

  

  

  35
• 1 You must be logged in to vote

  💬

  支持chatglm

  galphag started Dec 21, 2023 in Community | General

  

  

  0
• 1 You must be logged in to vote

  🙏

  INFO: Found overflow. Skip step

  stephencurry-web asked Nov 29, 2023 in Community | Q&A · Unanswered

  

  

  0