yhcc
|
057806de7d
|
将total_batches改名为n_batches,以和n_epochs对应;增加n_batches作为Trainer的初始化参数
|
3 years ago |
lxr-tech
|
fd91dc3734
|
update tutorial-045 lxr 220602
|
3 years ago |
x54-729
|
a16a0e94f5
|
driver 在 dataloader 为空时进行警告
|
3 years ago |
x54-729
|
d43159a576
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
lxr-tech
|
2d838b8927
|
update tutorial-45 lxr 220601
|
3 years ago |
lxr-tech
|
e55ca8a1d1
|
update example-12 lxr 220531
|
3 years ago |
yhcc
|
64c7ce5468
|
1.修复rich在jupyter的时候不打印的问题;2.修复若干其他bug
|
3 years ago |
x54-729
|
c6cf4da25b
|
调整部分文档格式
|
3 years ago |
x54-729
|
809b83b6c0
|
small
|
3 years ago |
x54-729
|
f1cb6f6167
|
small
|
3 years ago |
x54-729
|
79110d7c84
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
lxr-tech
|
c62f5bd2dc
|
update example-12 lxr 220530
|
3 years ago |
yhcc
|
cef9dca103
|
修复bug
|
3 years ago |
x54-729
|
edda3d3196
|
1.处理新测试例的import问题 2.将warnings.warn替换为logger.warn
|
3 years ago |
yhcc
|
6d889c8624
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
yhcc
|
004c344e4c
|
1.增加torch modules;torch models
|
3 years ago |
x54-729
|
9b0a30c8fb
|
small bug
|
3 years ago |
x54-729
|
aeeb1bc415
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
yhcc
|
639f57ad8b
|
update topk_saver.py
|
3 years ago |
x54-729
|
badd07f8f1
|
修改 ReproducibleSampler ReproducibleBatchSampler 的 num_samples 获取方式
|
3 years ago |
yh
|
1d665c9480
|
unrepeatedSampler支持chunk_split
|
3 years ago |
x54-729
|
f7b3fe6a06
|
small
|
3 years ago |
x54-729
|
e402893017
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
x54-729
|
75a3278d69
|
1. 完成JittorSingleDriver的功能,并添加测试用例 2.在Sampler中添加属性num_samplers 用于动态获取dataset的长度 3.添加便于测试断点重训的数据集 4.修改jittor其它测试的一些bug,统一ArgMaxDataset 的命名
|
3 years ago |
lxr-tech
|
ec76ba8887
|
update example-2 lxr 220528
|
3 years ago |
lxr-tech
|
19a48c7101
|
update example-12 lxr 220527
|
3 years ago |
yh
|
49e8ae2daa
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
yh
|
6903253e59
|
1.修改了发
f_rich_progress在没有bar的时候暂时关闭live;2.修改sampler获取dataset长度的方式以适配jittor
|
3 years ago |
lxr-tech
|
8f211ef8ab
|
add example-12 lxr 220526
|
3 years ago |
yh
|
1ec3337a49
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
yh
|
0be2357f46
|
优化了monitor相关callback的信息打印
|
3 years ago |
x54-729
|
a6cfc4086f
|
修改seq_len_to_mask的jittor实现及测试例中的一处传参错误
|
3 years ago |
x54-729
|
b29b002bcc
|
修改 paddle_to 中关于 device 类型的文档
|
3 years ago |
x54-729
|
999520e4b0
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
x54-729
|
28eb1a5836
|
添加了对tensor_to_numeric reduce 参数的测试
|
3 years ago |
x54-729
|
efc2675741
|
1.修改Driver.py的小部分文档;2.完善 JittorDriver JittorSingleDriver 的部分基础函数
|
3 years ago |
yh
|
7a7d75d100
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
yh
|
dcdd484eb2
|
增加seq_len_to_mask
|
3 years ago |
x54-729
|
abeb22c700
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
x54-729
|
e734d11d3b
|
transformers 添加 AutoTokenizer
|
3 years ago |
Letian Li
|
005b0e055e
|
实现 jittor driver 多卡训练 (#418)
|
3 years ago |
x54-729
|
296c1acc31
|
修复mixdataloader在torch1.6下参数不匹配的问题
|
3 years ago |
Letian Li
|
5425095cac
|
[bugfix] 修复 tests/core/controllers/_test_trainer_jittor.py,使其可以正常运行 (#415)
* 修复 tests/core/controllers/_test_trainer_jittor.py,使其可以正常运行
Trainer 并不接收 validate_dataloaders 参数,改为 evaluate_dataloaders 即可。
* jittor single driver 支持 cpu 和 gpu 的切换
|
3 years ago |
x54-729
|
da0b747b30
|
修改test_mixdataloader中的工具函数名,防止被pytest执行
|
3 years ago |
x54-729
|
756bd09d1a
|
1.删除不必要的测试标签 2.为test_mixdataloader添加torch标签
|
3 years ago |
x54-729
|
f333090149
|
1.删掉不必要的temp标签 2.为test_mixdataloader添加torch标签
|
3 years ago |
x54-729
|
b43e21960d
|
fastNLP/core/dataset/dataset.py
|
3 years ago |
yh
|
388baf589c
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
yh
|
ff50437702
|
1.修复数据处理的时候,多进程print会报错的问题;2.Trainer/Evaluator增加check_dataloader_legality
|
3 years ago |
x54-729
|
dd0e02b244
|
1.tokenization_utils_base.py中一处logger.warn改为warning_once 2. mix_modules/utils.py torch转换时添加.cpu() 3. dataset中将输出重定向到DEVNULL而不是Null
|
3 years ago |