x54-729
|
7023ea550c
|
deepspeed的save load功能
|
3 years ago |
yhcc
|
8467cb6e41
|
fix bug and make shuffle automatic
|
3 years ago |
x54-729
|
687651e35f
|
Merge remote-tracking branch 'origin/dev0.8.0' into deepspeed
|
3 years ago |
x54-729
|
9903d2eec1
|
TorchDriver的sampler加载和保存拆分为单独的函数
|
3 years ago |
x54-729
|
2d2bf421fd
|
deepspeed checkpoint相关函数(ï微未测试)
|
3 years ago |
x54-729
|
22d95be007
|
Merge branch 'dev0.8.0' into deepspeed
|
3 years ago |
x54-729
|
b60621f3d1
|
small
|
3 years ago |
x54-729
|
64da46b613
|
paddle replace_batch_sampler和check_dataloader 跟进
|
3 years ago |
x54-729
|
d26d0ad17f
|
添加选择deepspeed driver的逻辑
|
3 years ago |
x54-729
|
cbee1c6cbc
|
deepspeed test init
|
3 years ago |
x54-729
|
a39d3011e8
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
x54-729
|
dca3377129
|
ddp添加环境变量RANK的设置
|
3 years ago |
x54-729
|
1a2eb93ab4
|
deepspeed基本功能
|
3 years ago |
YWMditto
|
bb68856f85
|
添加对 overfit 多卡的测试
|
3 years ago |
yhcc
|
399065ae04
|
update overfit_batches
|
3 years ago |
YWMditto
|
a6fc5225cd
|
添加了 overfit_batches 的注释
|
3 years ago |
YWMditto
|
024fecfbf3
|
添加了 overfit 的功能
|
3 years ago |
x54-729
|
55d8738def
|
deepspeed driver init
|
3 years ago |
x54-729
|
cd0957fb5b
|
跟进paddle jittor 关于 set_dist_repro_dataloader函数中的修改
|
3 years ago |
yhcc
|
dd1c5ca035
|
修复设置了global seed的bug
|
3 years ago |
yhcc
|
7283bf27b2
|
在私有定制Sampler的情况下,多卡不替换
|
3 years ago |
YWMditto
|
70dea71cdb
|
为 ddp 在用户使用自己的sampler 和 batch sampler 是添加禁止
|
3 years ago |
yhcc
|
e4a7e64600
|
progress打印增加一种特殊yueding
|
3 years ago |
yhcc
|
0bf0dab347
|
增加一个TimerCallback用于计时
|
3 years ago |
x54-729
|
c99315f79e
|
修复新增的set_dist_repro_dataloader函数测试例在paddle情况下的问题
|
3 years ago |
yhcc
|
47b7c4e832
|
增加set_dist_repro_dataloader测试
|
3 years ago |
YWMditto
|
8d0602f5de
|
修复 torch_driver/utils/replace_sampler 的bug
|
3 years ago |
yhcc
|
08416a3a6c
|
1.修复lr_schedulder的调用时机问题;2.修复replace_sampler的初始化问题
|
3 years ago |
MorningForest
|
bd7c6abd32
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
MorningForest
|
3e2960627a
|
acc
|
3 years ago |
lxr-tech
|
8319706f02
|
finish tutorial-3456 lxr 220604
|
3 years ago |
x54-729
|
4cc8a29926
|
1.为element测试添加torch标签 2.解决torch版本导致的int张量无法对整数使用除法的问题
|
3 years ago |
yhcc
|
24092e3114
|
增加pipe相关的测试
|
3 years ago |
MorningForest
|
637919e45d
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
MorningForest
|
ec17562f20
|
修改fdl 的prepare_*_dataloader,使其支持fastnlp的dataset
|
3 years ago |
lxr-tech
|
3797f91434
|
update tutorial-3456 lxr 220603
|
3 years ago |
yhcc
|
82b06767f5
|
修复n_batches导致的bug
|
3 years ago |
MorningForest
|
745d254aa5
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
MorningForest
|
af6300e816
|
修改element,计算值转为非tensor形式
|
3 years ago |
yhcc
|
21b7b58793
|
typo fix
|
3 years ago |
yhcc
|
281ffc3b91
|
修复richcallback等在断点重训时显示进度不正确的问题
|
3 years ago |
yhcc
|
fecd82aadf
|
修改element无法与element运算的问题
|
3 years ago |
x54-729
|
f3a13ff885
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
x54-729
|
4d29524d81
|
删除初始化的种子设置函数
|
3 years ago |
x54-729
|
2303079180
|
1. 删除 FASTNLP_SEED_WORKERS 2.修改各个框架的 seed_everything 函数,使得用户可以设置种子复现训练结果 3. 修改 sampler 的 seed 参数,在为 None 时可以根据时间戳生成随机数种子
|
3 years ago |
yhcc
|
057806de7d
|
将total_batches改名为n_batches,以和n_epochs对应;增加n_batches作为Trainer的初始化参数
|
3 years ago |
lxr-tech
|
fd91dc3734
|
update tutorial-045 lxr 220602
|
3 years ago |
x54-729
|
a16a0e94f5
|
driver 在 dataloader 为空时进行警告
|
3 years ago |
x54-729
|
d43159a576
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
lxr-tech
|
2d838b8927
|
update tutorial-45 lxr 220601
|
3 years ago |