35 Commits

Author SHA1 Message Date
zpeng11
fe7bccaa97
Merge 8858492f56326dce521db2c4a4b3a7323e786596 into 9ec3a60f30d228719e5ec6cd6796c5b2d888dd1a 2025-12-01 22:52:14 -08:00
ChasonJiang
92ab59c553
更细粒度的流式推理模式 (#2671)
* 更好的流式推理模式

* 清理无用代码

* modified:   GPT_SoVITS/AR/models/t2s_model.py
	modified:   GPT_SoVITS/TTS_infer_pack/TTS.py
	modified:   GPT_SoVITS/module/models.py

* modified:   GPT_SoVITS/TTS_infer_pack/TTS.py

* modified:   .gitignore
	modified:   GPT_SoVITS/AR/models/t2s_model.py
	modified:   GPT_SoVITS/TTS_infer_pack/TTS.py
	modified:   GPT_SoVITS/module/models.py

* modified:   GPT_SoVITS/AR/models/t2s_model.py
	modified:   GPT_SoVITS/TTS_infer_pack/TTS.py
	modified:   GPT_SoVITS/module/models.py
	modified:   api_v2.py

* modified:   GPT_SoVITS/TTS_infer_pack/TTS.py

* 更正拼写错误

* 支持固定chunk长度的流式推理,优化sola算法

* 修复api_v2的ogg格式传输问题
2025-11-28 21:12:41 +08:00
zpeng11
3e63595f0e feat:update kv cache to [len, head, dim] to allow linear size increasement 2025-08-26 17:03:29 -04:00
zpeng11
419909b443 failed , testing expand y 2025-08-25 21:57:36 -04:00
zpeng11
c85ee3d521 feat:successfully unified first step and following step 2025-08-25 17:57:04 -04:00
zpeng11
d413a4f5b1 run time working 2025-08-25 17:07:38 -04:00
zpeng11
26228402e3 feat:solve unified kv cache shape handling, todo: clean up upper level to unify first and following step 2025-08-25 12:06:26 -04:00
zpeng11
5982080939 feat:updated fsdecode and decoder interface 2025-08-23 17:35:21 -04:00
zpeng11
b45cbc3561 feat: sampling params working now for export, todo:fold weights clean code 2025-08-23 13:03:02 -04:00
zpeng11
9ed42daa88 feat: allow fsdec and sdec to have sampling parames 2025-08-23 12:17:04 -04:00
zpeng11
3ccd1c0ea3 fix: solved t2s ending problem, and verified infer&forward has same output under deterministic random, fixed topk to 15 2025-08-23 03:31:01 -04:00
ChasonJiang
b5a67e6247
修复gpt的loss计算问题 (#2537)
* 修复gpt的loss计算问题

* fallback tts config
2025-07-18 14:59:59 +08:00
XXXXRT666
6fdc67ca83
Fix bugs in install.sh, reduce log noise, and improve error reporting (#2464)
* Update Install.sh

* Format Code

* Delete dev null

* Update README, Support Dark Mode in CSS/JS
2025-06-17 15:21:36 +08:00
RVC-Boss
e920b31840
support sovits v2Pro v2ProPlus
support sovits v2Pro v2ProPlus
2025-06-04 15:17:05 +08:00
XXXXRT666
53cac93589
Refactor: Format Code with Ruff and Update Deprecated G2PW Link (#2255)
* ruff check --fix

* ruff format --line-length 120 --target-version py39

* Change the link for G2PW Model

* update pytorch version and colab
2025-04-07 16:42:47 +08:00
ChasonJiang
053a356ffe
修复gpt的padding mask的问题 (#2153)
* 修复gpt的padding mask的问题

* rollback tts_config
2025-03-05 17:14:43 +08:00
ChasonJiang
6dd2f72090
更改gpt并行推理时的mask策略为padding left (#2144)
* 更改gpt并行推理时的mask策略为padding left,使batch_infer更接近于naive_infer
减少冗余操作并使用torch_sdpa,以提升推理速度

* rollback tts_infer.yaml
2025-03-04 16:45:37 +08:00
wzy3650
087fd24579
fix inference issue (#2061)
Co-authored-by: wangzeyuan <wangzeyuan@agora.io>
2025-02-17 10:38:04 +08:00
wzy3650
282ae1d9b2
optimize attention calc logic (#2010)
Co-authored-by: wangzeyuan <wangzeyuan@agora.io>
2025-02-12 11:57:17 +08:00
RVC-Boss
40cd22e69d
Update t2s_model.py 2024-09-10 19:13:42 +08:00
ChasonJiang
52c50c6c81
All in one! 合并main分支和fast_inference_分支 (#1490)
* 合并main分支和fast_inference_分支

* 修复一些bug
2024-08-20 22:19:04 +08:00
RVC-Boss
3d9c37baca
Add files via upload 2024-07-08 20:52:19 +08:00
XXXXRT666
923af471d2
Update t2s_model.py (#1283)
y is None at no reference mode, and Nonetype object has no attribute shape
2024-07-08 20:51:15 +08:00
RVC-Boss
b0786f2998
double inference speed
double inference speed
2024-07-07 21:34:28 +08:00
root
4496426896 修改代码引用,淡定 2024-02-28 17:31:19 +08:00
Watchtower-Liu
013db82d7d Merge branch 'main' into inference_optin 2024-02-16 17:03:11 +08:00
Watchtower-Liu
1803729360 update_infer 2024-02-16 16:53:57 +08:00
RVC-Boss
895fde46e4
dpo改实验性勾选而非必须。勾选后batch size自动减半。
dpo改实验性勾选而非必须。勾选后batch size自动减半。
2024-02-15 20:17:44 +08:00
RVC-Boss
3bf71d3790
Update t2s_model.py 2024-02-12 16:47:43 +08:00
liufenghua
070ac9b2b2 add DPO training 2024-02-11 15:06:01 +08:00
Ναρουσέ·μ·γιουμεμί·Χινακάννα
dd1186c029
Add files via upload 2024-02-08 21:41:37 +08:00
Ναρουσέ·μ·γιουμεμί·Χινακάννα
7d1e94c8b0
Add AR Onnx Module 2024-01-25 02:31:08 +08:00
RVC-Boss
872134c846
Update t2s_model.py 2024-01-22 23:26:18 +08:00
Blaise
0d3d47f3c3 more code refactor 2024-01-16 17:14:18 +01:00
RVC-Boss
41ca6028d6
Add files via upload 2024-01-16 17:38:48 +08:00