JLNTV_IPD/CogVideo
4
0
Fork 0
mirror of https://github.com/THUDM/CogVideo.git synced 2025-04-05 19:41:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
415 Commits 3 Branches 1 Tag
Commit Graph

2 Commits

Author SHA1 Message Date
OleehyO
fdb9820949 feat: support DeepSpeed ZeRO-3 and optimize peak memory usage 
- Add DeepSpeed ZeRO-3 configuration support
- Optimize memory usage during training
- Rename training scripts to reflect ZeRO usage
- Update related configuration files and trainers
 2025-01-12 05:33:56 +00:00
OleehyO
caa24bdc36 feat: add SFT support with ZeRO optimization strategies 
- Add SFT (Supervised Fine-Tuning) trainers for all model variants:
  - CogVideoX I2V and T2V
  - CogVideoX-1.5 I2V and T2V
- Add DeepSpeed ZeRO configuration files:
  - ZeRO-2 with and without CPU offload
  - ZeRO-3 with and without CPU offload
- Add base accelerate config for distributed training
- Update trainer.py to support SFT training mode

This enables full-parameter fine-tuning with memory-efficient distributed training using DeepSpeed ZeRO optimization.
 2025-01-11 02:13:32 +00:00