hummingbird
/
fastNLP
Not watched
2
0
Fork 0
Code
Releases 13 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain

Commit Graph

  • *
  • *
  • |\
  • * |
  • | *
  • | *
  • |/
  • | *
  • | |\
  • | |/
  • |/|
  • | *
  • * |
  • |\ \
  • * | |
  • | * |
  • | * |
  • |/ /
  • * |
  • * |
  • |\ \
  • * | |
  • | * |
  • | * |
  • | * |
  • | * |
  • | * |
  • | * |
  • | * |
  • |/ /
  • * |
  • * |
  • * |
  • |\ \
  • * | |
  • | |/
  • |/|
  • | *
  • |/
  • *
  • *
  • |\
  • * |
  • | *
  • | *
  • | *
  • |/
  • *
  • |\
  • * |
  • | *
  • |/
  • *
  • *
  • |\
  • * |
  • | *
  • | *
  • | *
  • | *
  • | *
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • | *
  • | *
  • | *
  • | |\
  • | |/
  • |/|
  • | *
  • * |
  • * |
  • |\ \
  • * | |
  • | | *
  • | | *
  • | |/
  • | *
  • | *
  • | *
  • | *
  • | |\
  • | | *
  • | | |\
  • | |_|/
  • |/| |
  • | | *
  • * | |
  • |\ \ \
  • * | | |
  • | | * |
  • | | * |
  • | |/ /
  • | * |
  • | * |
  • | * |
  • | * |
  • | |\ \
  • | |/ /
  • |/| |
  • | * |
  • | * |
  • * | |
  • | * |
  • |/ /
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • * |
  • |\ \
  • * \ \
  • |\ \ \
  • | | * |
  • | |/ /
  • * | |
  • | * |
  • | |\ \
  • | * | |
  • | * | |
  • | | * |
  • | |/ /
  • |/| |
  • * | |
  • |/ /
  • | *
  • | |\
  • | |/
  • |/|
  • | *
  • * |
  • |\ \
  • * | |
  • | * |
  • | |\ \
  • | * | |
  • | * | |
  • | | * |
  • | |/ /
  • |/| |
  • | * |
  • | |\ \
  • | |/ /
  • |/| |
  • * | |
  • * | |
  • |\ \ \
  • * | | |
  • | | * |
  • | | |\ \
  • | | |/ /
  • | |/| |
  • | | * |
  • | * | |
  • | |\ \ \
  • | |/ / /
  • |/| | |
  • | * | |
  • | | * |
  • | |/ /
  • |/| |
  • a6103f63 重命名不需要pytest的测试文件 by x54-729 2022-04-30 10:51:55 +0000
  • b78cea7f Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-30 17:10:11 +0800
  • b3e0ebd7 优化了Collator by yh_cc 2022-04-30 17:10:03 +0800
  • df0651ba 删除 transformers 中的依赖包字典 by x54-729 2022-04-30 09:00:29 +0000
  • df1db253 迁移transformers ver.4.11.3的bert bart roberta gpt2和cpt模型 by x54-729 2022-04-29 16:53:02 +0000
  • 1216ac6e Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-04-30 00:22:38 +0800
  • 39e19946 accuracy修改 by MorningForest 2022-04-30 00:22:29 +0800
  • 2dc11994 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-29 22:24:55 +0800
  • d4dd85ed 新设计collator by yh_cc 2022-04-29 22:24:46 +0800
  • 29fb454c modify fastnlp_tutorial_0.py by lxr-tech 2022-04-29 22:22:28 +0800
  • ba8971fc little change by YWMditto 2022-04-29 18:19:07 +0800
  • f74b9b6b 修改所有的 validate 为 evaluate ; 移动 callback.on_train_end() by yh_cc 2022-04-28 16:27:17 +0800
  • b3bc58b0 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-28 15:12:30 +0800
  • 0043e3e8 修复LoadeBestModelCallback的bug by yh_cc 2022-04-28 15:12:21 +0800
  • f319b5bc torch ddp 的测试用例 by x54-729 2022-04-26 05:49:32 +0000
  • df109316 small by x54-729 2022-04-26 05:33:37 +0000
  • d04f49a8 修改BucketedBatchSampler batch_idx_in_epoch 的计算方式，使其在分布式条件下可以正确地反应迭代次数 by x54-729 2022-04-26 05:33:17 +0000
  • 822df062 添加函数的注释 by x54-729 2022-04-26 05:31:45 +0000
  • 705deeae small by x54-729 2022-04-26 03:35:25 +0000
  • cf65da13 paddle 单卡测试例调整 by x54-729 2022-04-25 12:58:03 +0000
  • bb10410c torch 单卡的测试例 by x54-729 2022-04-25 12:57:17 +0000
  • 6f7bbfab 增加部分关于evaluate_batch_step_fn的说明 by yh_cc 2022-04-25 19:35:49 +0800
  • 7e40d984 新增train_input_mapping 和 evaluate_input_mapping 等 by yh_cc 2022-04-25 16:47:29 +0800
  • 6ddcedaa Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-24 12:09:35 +0800
  • e85cbb06 Rich支持jupyter by yh_cc 2022-04-24 12:09:19 +0800
  • 711bbf46 修改了 trainer.load_model/load 只有单卡加载的bug by YWMditto 2022-04-23 14:44:18 +0800
  • 1ecbdc74 修复TopkSaver在CheckpointCallbackk中的bug;修改Saver对象，使得其方便被直接使用 by yh_cc 2022-04-23 00:41:12 +0800
  • b117f617 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-22 02:09:43 +0800
  • ceb30937 更新Trainer的部分文档; 更新topk_saver文档 by yh_cc 2022-04-22 02:09:30 +0800
  • c74da391 跟进paddle backend关于all_gather的改动 by x54-729 2022-04-20 10:27:09 +0000
  • fcc45dbf PaddleFleetDriver添加all_gather和broadcast_object函数 by x54-729 2022-04-20 10:17:19 +0000
  • 1c0e331b 完成fastnlp_paddle_all_gather和fastnlp_paddle_broadcast_object函数及测试例 by x54-729 2022-04-20 09:56:44 +0000
  • 6c532829 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-20 00:37:31 +0800
  • 6b4d4502 修复no_sync的bug by yh_cc 2022-04-20 00:37:19 +0800
  • 3823fc55 对 magic_argv_env_context 添加了 timeout 参数，测试函数超过一定时间后自动kill掉 by YWMditto 2022-04-20 00:16:23 +0800
  • bfa9920b bug fix by yh_cc 2022-04-19 23:08:31 +0800
  • 368c17fe Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-19 22:38:55 +0800
  • aa955130 1.merge ModelCheckPointCallback和TrainerCheckpointCallback;2.新增MoreEvaluateCallback by yh_cc 2022-04-19 22:38:35 +0800
  • 514415e9 完成了paddle fleet的save load函数测试 by x54-729 2022-04-16 15:47:18 +0000
  • cb01a661 BucketedBatchSampler的batch_id_in_epoch实现 by x54-729 2022-04-16 15:46:57 +0000
  • 77f6b63b paddle save函数适应新的sampler by x54-729 2022-04-16 08:40:16 +0000
  • 9b13fd31 small by x54-729 2022-04-16 08:39:38 +0000
  • 3dbb3677 微调 reproducible sampler 的初始化 by x54-729 2022-04-16 08:39:07 +0000
  • aa2f6785 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-04-16 07:23:18 +0000
  • d813f31f 1.删除sampler中num_consumed_samples_array，转为通过batch_size等进行换算。2.在Metric中新增all_gather_object接口，方便评测 by yh_cc 2022-04-16 15:22:44 +0800
  • 6bfdb39c 完善paddle fleet set_dist_repro_dataloader的测试例 by x54-729 2022-04-16 06:42:29 +0000
  • fcd27cfc 添加FASTNLP_NO_SYNC相关的设置 by x54-729 2022-04-16 05:50:53 +0000
  • a25a7339 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-04-16 05:40:35 +0000
  • de544707 paddle fleet set_dist_repro_dataloader的测试例 by x54-729 2022-04-16 05:40:23 +0000
  • d758a36d update metric的实现 by yh_cc 2022-04-16 12:40:29 +0800
  • 048e4092 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-16 00:33:32 +0800
  • aaa4ccc3 1.Metric的aggregate_when_get_metric默认值修改为None;将根据Evaluator中Sampelr的状态最终决定;2.增加fastnlp_bo_syn_context关闭fastnlp中的多卡同步操作 by yh_cc 2022-04-16 00:32:52 +0800
  • 32d8e274 small by x54-729 2022-04-15 16:10:10 +0000
  • 26c80d62 paddle单卡加载fp16的测试 by x54-729 2022-04-15 16:01:21 +0000
  • 8cda30c4 small by x54-729 2022-04-15 15:10:35 +0000
  • 5d1ac72e 加载fp16时同时设置auto_cast和fp16属性 by x54-729 2022-04-15 14:38:29 +0000
  • 262bc1a8 small by x54-729 2022-04-15 14:03:08 +0000
  • 8e9a47cf Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-04-15 13:48:23 +0000
  • a2956b69 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-04-15 20:04:53 +0800
  • 665d79a3 增加paddle单卡的accuracy测试用例 by MorningForest 2022-04-15 20:03:44 +0800
  • b0db3a59 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-15 19:31:58 +0800
  • 687db6d8 1.torch在保存和load的时候会考虑GradScaler的保存问题; 2.新增Torch的GradientClip和Warmpup by yh_cc 2022-04-15 19:31:46 +0800
  • 9e971553 PaddleSingleDriver的save load函数测试 by x54-729 2022-04-15 10:44:49 +0000
  • be24572b 修改paddle.distributed的import名 by x54-729 2022-04-15 10:44:25 +0000
  • 16cec4bd 删除不必要的测试文件 by x54-729 2022-04-15 09:07:35 +0000
  • cf19062f set_dist_repro_dataloader测试例的完善 by x54-729 2022-04-15 09:06:22 +0000
  • 288eb36a 断点重训 save时的逻辑修正 by x54-729 2022-04-15 09:05:44 +0000
  • cca265f9 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-04-15 08:10:19 +0000
  • d0f26c7c 将validate_step替换为evaluate_step by x54-729 2022-04-15 08:10:01 +0000
  • 8fc4fd19 small by x54-729 2022-04-15 08:05:39 +0000
  • 7c70874b 删除core.sampelrs.sampler.py；增加torch的clipgradient和warmupcallback by yh_cc 2022-04-15 16:04:43 +0800
  • 9d50e99b 修改evaluate_dataloader的报错信息 by x54-729 2022-04-15 06:57:31 +0000
  • 3ea74b52 Merge remote-tracking branch 'refs/remotes/origin/dev0.8.0' into dev0.8.0 by MorningForest 2022-04-15 14:00:39 +0800
  • f27d5326 修改部分测试用例中validate_dataloader为evaluate_dataloader by yh_cc 2022-04-15 12:30:20 +0800
  • 02e080d2 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by YWMditto 2022-04-15 00:18:27 +0800
  • 3bbf2728 little change by YWMditto 2022-04-15 00:17:50 +0800
  • f6f489dc 多卡 set_dist_repro_dataloader 的测试例 by x54-729 2022-04-14 16:17:20 +0000
  • a61f3975 little change by YWMditto 2022-04-15 00:17:01 +0800
  • 98644d2d fix conflict by x54-729 2022-04-14 16:05:53 +0000
  • b97962b8 简化paddle trainer的单卡测试例 by x54-729 2022-04-14 16:04:56 +0000
  • 5c29cd38 调整num_consumed_batches在driver save中的逻辑 by x54-729 2022-04-14 16:04:12 +0000
  • a4b2e0fa 修复若干bug by yh_cc 2022-04-15 00:01:29 +0800
  • 2924e211 删除了 driver 中的 **_step，使用 model_call 和 get_model_call_fn 来代替；删除了 driver 中的所有 dataloaders by YWMditto 2022-04-14 23:34:35 +0800
  • 4cad7f54 Merge remote-tracking branch 'refs/remotes/origin/dev0.8.0' into dev0.8.0 by MorningForest 2022-04-14 19:37:02 +0800
  • 4be26c56 修改torch fdl by MorningForest 2022-04-14 19:36:50 +0800
  • 8a0ffd62 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh_cc 2022-04-14 16:02:55 +0800
  • 16a46739 1.montior允许传入callable的对象进行选择; 2.解决Sampler中存在的循环引用问题 by yh_cc 2022-04-14 16:02:41 +0800
  • 17abdb12 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-04-14 08:01:41 +0000
  • 7c6e8b20 small by x54-729 2022-04-14 08:01:14 +0000
  • 64fa182a 修改断点重训部分逻辑 by x54-729 2022-04-14 08:01:04 +0000
  • 1452aa8f 修复了 dist 为 None 时的 set_dist_repro_dataloader 的逻辑 by YWMditto 2022-04-14 13:50:53 +0800
  • ca93fccf Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-04-13 16:57:20 +0000
  • 2f23d80c 修改了 trainer 中的 validate 的调用的逻辑 by YWMditto 2022-04-14 00:45:17 +0800
  • 8c0b0b8c Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by YWMditto 2022-04-13 19:09:34 +0800
  • b9b0b534 将 Events 修改为小写 by YWMditto 2022-04-13 19:09:27 +0800
  • 2b763138 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-04-13 09:06:13 +0000
  • d2439fe4 修复_MetricsWrapper update传参的bug by x54-729 2022-04-13 09:05:21 +0000
  • 31c6d5d0 merge by yh_cc 2022-04-13 17:05:16 +0800
  • 9d71170b 解决Trainer在断点重训的时候无法实现准确load和保存的问题 by yh_cc 2022-04-13 17:04:33 +0800
  • f87723e2 small by x54-729 2022-04-13 08:40:26 +0000