JLNTV_IPD/CogVideo
4
0
Fork 0
mirror of https://github.com/THUDM/CogVideo.git synced 2025-10-02 05:30:02 +08:00
Code Issues Packages Projects Releases Wiki Activity
450 Commits 3 Branches 1 Tag
Commit Graph

5 Commits

Author SHA1 Message Date
Yuxuan Zhang
39c6562dc8 format 2025-03-22 15:14:06 +08:00
zR
1534bf33eb add pipeline 2025-01-12 19:27:21 +08:00
OleehyO
70c899f444 chore: update default training configurations 2025-01-12 08:50:15 +00:00
OleehyO
fdb9820949 feat: support DeepSpeed ZeRO-3 and optimize peak memory usage 
- Add DeepSpeed ZeRO-3 configuration support
- Optimize memory usage during training
- Rename training scripts to reflect ZeRO usage
- Update related configuration files and trainers
 2025-01-12 05:33:56 +00:00
OleehyO
caa24bdc36 feat: add SFT support with ZeRO optimization strategies 
- Add SFT (Supervised Fine-Tuning) trainers for all model variants:
  - CogVideoX I2V and T2V
  - CogVideoX-1.5 I2V and T2V
- Add DeepSpeed ZeRO configuration files:
  - ZeRO-2 with and without CPU offload
  - ZeRO-3 with and without CPU offload
- Add base accelerate config for distributed training
- Update trainer.py to support SFT training mode

This enables full-parameter fine-tuning with memory-efficient distributed training using DeepSpeed ZeRO optimization.
 2025-01-11 02:13:32 +00:00