1ac9e75c
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-13 15:37:15 +0800
3ee6fc66
添加了 on_after_optimizers_step 和 on_after_zero_grad 的callback接口 by
2022-04-13 15:37:08 +0800
c2575ab3
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-13 07:33:40 +0000
3ab93b2f
paddle driver单卡和utils的pytest测试,添加了断点重训的测试 by
2022-04-13 07:33:27 +0000
eb8d761a
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-13 14:27:08 +0800
76a1e690
little change by
2022-04-13 14:27:01 +0800
5acaeaba
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-13 05:27:09 +0000
e8d11cd5
1. 修复torch 分布式在不同版本中group参数default值不一样的问题; 2. torch修复多卡时只有batchsampler evaluate会遇到bug的问题; 3。logger增加warning_once接口;4.增加callback相关文档 by
2022-04-13 12:55:28 +0800
c61f28ce
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-12 20:48:47 +0000
8c22d0b1
修改了 Trainer.on 的错误提示 by
2022-04-12 22:47:39 +0800
a5b2ccf7
update by
2022-04-12 09:36:51 +0000
a589cb5d
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-12 09:24:16 +0000
1443065c
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-12 17:00:18 +0800
5419b6a0
填了了关闭参数匹配的逻辑;添加了 trainer 中获取 driver 参数的接口 by
2022-04-12 17:00:07 +0800
e08ae33b
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-12 08:48:16 +0000
7a68f90b
增加ClassifyF1PreRecMetric的多卡测试用例 by
2022-04-12 16:06:25 +0800
fcd51250
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-12 07:34:44 +0000
ab3b6671
Merge remote-tracking branch 'refs/remotes/origin/dev0.8.0' into dev0.8.0 by
2022-04-12 13:52:13 +0800
c7616f8b
修改ClassifyF1PreRecMetric及对应的测试用例 by
2022-04-12 13:51:54 +0800
a6ff3f8c
1. 将带有Monitor的callback都抽象为HasMonitorCallback,并由这个父类进行monitor的设置和检验的; 2.支持从Trainer中设置monitor给所有的Callback使用;3.新增EarlyStopCallback. by
2022-04-12 13:49:03 +0800
6c333b0f
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-12 11:43:33 +0800
57caf1d0
checkpoint callback 加入了 on_after_trainer_initialized 的逻辑 by
2022-04-12 11:43:26 +0800
92b00d82
修改fastnlp的dist功能 by
2022-04-12 02:19:28 +0800
00b5baf6
整理PaddleSingleDriver的部分测试例 by
2022-04-11 17:39:19 +0000
d10c6395
f_rich_progress不吃掉python prompt; evalutor在结束之后正常消失progres bar by
2022-04-11 23:11:52 +0800
2366bc32
跟进断点重训 by
2022-04-11 15:04:39 +0000
9e869088
fix conflict by
2022-04-11 14:36:23 +0000
388e426d
修改之前的错误名称引用 by
2022-04-11 22:20:21 +0800
3a3c38a4
fix conflict by
2022-04-11 14:16:39 +0000
d1a58914
修复测试例 by
2022-04-11 14:08:25 +0000
14fffcb3
新增SortedSampler和SequentialSampler by
2022-04-11 21:44:53 +0800
6323fbfd
Merge remote-tracking branch 'refs/remotes/origin/dev0.8.0' into dev0.8.0 by
2022-04-11 19:40:35 +0800
ffcf3ddc
修改测试用例unittest为pytest by
2022-04-11 19:39:53 +0800
afb87b43
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-11 18:59:04 +0800
d39fa513
修改了DDPDriver.set_dist_repro_dataloader 的逻辑 by
2022-04-11 18:58:55 +0800
b161aa6c
添加README.md by
2022-04-11 18:50:36 +0800
36149a57
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-11 18:44:31 +0800
f81d2e05
合并冲突 by
2022-04-11 18:43:30 +0800
9216c611
新增UnrepeatedSortedSampler by
2022-04-11 16:44:08 +0800
9675eae7
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-11 15:45:28 +0800
8ca17fc9
修改了断点重新sampler中的部分逻辑 by
2022-04-11 15:45:06 +0800
74dd154c
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-11 15:22:48 +0800
ea03967d
修改element的bug by
2022-04-11 15:22:40 +0800
60736758
1.增加DataSet的__setitem__方法,使得其可以直接random.shuffle(dataset); 2.优化部分log输出显示 by
2022-04-11 15:21:45 +0800
ce835212
将CheckpointCallback拆分为ModelCheckpointCallback和TrainerCheckpointCallback,修改了部分实现 by
2022-04-11 14:34:11 +0800
0a093e1c
解决rich运行的时候会隐藏cursor的问题 by
2022-04-11 00:35:52 +0800
28aabb5a
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 23:57:02 +0800
e8b6298f
完善SpanFPreRecMetric即测试 by
2022-04-10 23:56:55 +0800
96cca42a
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 23:16:01 +0800
7bd0ce0b
修改了 device 为 -1 时 的逻辑 by
2022-04-10 23:15:47 +0800
9c62e300
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 23:10:44 +0800
0cab4dc5
修改F1RecPreMetric测试用例 by
2022-04-10 23:10:35 +0800
ebfa118f
PaddleDriver的测试例调整 by
2022-04-10 15:07:52 +0000
9678c559
跟进断点重训的设置 by
2022-04-10 14:59:45 +0000
da849564
添加利用命令获取gpu数目的函数 by
2022-04-10 14:59:05 +0000
193c04c9
initialize_paddle_driver的测试例 by
2022-04-10 14:57:55 +0000
817f6d6a
修改fastnlp_torch_all_gather函数,使得它gather后的tensor都在当前device by
2022-04-10 22:28:48 +0800
e3d565b6
small by
2022-04-10 14:18:53 +0000
08ee15fa
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 12:49:38 +0000
12d3e085
增加BucketedBatchSampler的测试 by
2022-04-10 20:42:37 +0800
447e673a
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 06:55:17 +0000
79158079
paddle 分布式的测试例 by
2022-04-10 06:55:05 +0000
5ea4f75f
paddle 环境设置 by
2022-04-10 06:54:31 +0000
983c587c
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 14:36:52 +0800
20b8ca9a
实现了BucketedBatchSampler; 创建了reproducible_batch_sampler.py by
2022-04-10 14:36:47 +0800
a376eea7
重新修改了断点重训的逻辑,主要修改了 trainer.save/load 和 driver.save 和 load 函数 by
2022-04-10 12:56:49 +0800
770b2eaf
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 11:47:01 +0800
0e7961cd
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-10 00:08:24 +0800
8e4abf2a
删除了driver的replace_sampler替换为set_dist_repro_dataloader; 同时修改 driver.load/driver.save 函数 by
2022-04-10 00:08:19 +0800
680421fe
paddle分布式训练 by
2022-04-09 12:52:19 +0000
49d18f36
修复但å单卡的设备逻辑 by
2022-04-09 16:48:18 +0800
a8597602
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-09 15:28:19 +0800
929abc39
加入了 test_logger.py by
2022-04-09 15:28:13 +0800
5b54a0cd
修改Trainer的catch_KeyboardInterrupt行为,防止一直warning by
2022-04-09 14:57:06 +0800
f5f1c280
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-09 14:38:31 +0800
6ef91267
新的paddle测试数据集 by
2022-04-09 14:37:55 +0800
10db8c93
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-09 13:59:39 +0800
d03bc5ce
ddp 加入了更为详细的注释;修复了一个错误 by
2022-04-09 13:59:32 +0800
f144bc31
fleet test by
2022-04-09 13:42:30 +0800
fd3b82c5
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-08 15:28:34 +0000
4781178a
修复测试 by
2022-04-08 22:36:52 +0800
2d68c952
调整paddle_backend by
2022-04-08 22:34:17 +0800
40c0a712
移动env的位置为顶级目录 by
2022-04-08 22:29:22 +0800
e3ce8727
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by
2022-04-08 21:48:46 +0800
fe270ef6
更新 callbacks, controllers, drivers, samplers 以及 tests 中的部分内容 by
2022-04-08 21:48:29 +0800
8cf855ab
添加了metric测试用例 by
2022-04-08 21:37:12 +0800
6960eb56
添加了dataset测试用例 by
2022-04-08 21:36:41 +0800
9ed4df6f
添加了dataloaders测试用例 by
2022-04-08 21:36:12 +0800
65c621db
添加了collators测试用例 by
2022-04-08 21:35:39 +0800
41b0bae4
添加了vocabulary by
2022-04-08 21:33:58 +0800
2550c96f
添加了io模块 by
2022-04-08 21:33:24 +0800
4bb56616
添加了metrics by
2022-04-08 21:32:26 +0800
ce1b837d
添加了collators by
2022-04-08 21:31:31 +0800
69102a84
添加了dataloaders by
2022-04-08 21:30:35 +0800
6c992b31
添加了dataset模块 by
2022-04-08 21:24:15 +0800
3a580edb
提交tests/core/utils/ by
2022-04-08 12:16:05 +0000
05ca80bb
提交tests/modules/ by
2022-04-08 12:15:33 +0000
6170976b
提交tests/core/drivers/torch_paddle_driver by
2022-04-08 12:14:33 +0000
23502a07
提交tests/core/drivers/paddle_driver by
2022-04-08 12:14:20 +0000
96a565c7
提交tests/core/drivers/jittor_driver by
2022-04-08 12:14:03 +0000