hummingbird
/
fastNLP
Not watched
2
0
Fork 0
Code
Releases 13 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain

Commit Graph

  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • | *
  • | *
  • * |
  • | *
  • | *
  • | *
  • * |
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • | *
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • * |
  • | *
  • | *
  • * |
  • |\ \
  • * | |
  • | | *
  • | * |
  • | * |
  • | * |
  • | * |
  • | | *
  • | |/
  • |/|
  • * |
  • |/
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • |\
  • * |
  • | *
  • | *
  • | *
  • |/
  • *
  • |\
  • * |
  • | *
  • | *
  • |/
  • *
  • |\
  • * |
  • | *
  • | *
  • |/
  • *
  • *
  • |\
  • * |
  • * |
  • | *
  • | *
  • |/
  • *
  • *
  • |\
  • | *
  • | *
  • | *
  • * |
  • |/
  • *
  • *
  • *
  • |\
  • | *
  • | *
  • * |
  • |/
  • *
  • |\
  • * |
  • | *
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • | *
  • |/
  • *
  • *
  • *
  • |\
  • * |
  • | *
  • | *
  • |/
  • *
  • |\
  • * |
  • | *
  • |/
  • *
  • |\
  • * |
  • | *
  • | *
  • | *
  • | |\
  • | |/
  • |/|
  • eb218f3d 调整 driver 的部分文档 by x54-729 2022-06-30 06:33:56 +0000
  • 4cdfdc77 oneflow 动态图 单卡和ddp部分及测试 by x54-729 2022-06-30 06:28:17 +0000
  • 780bf77e paddle tutorials e2-问答模型 by x54-729 2022-06-29 00:06:22 +0800
  • 40b8016e PaddleDriver 可以传入Gradscaler参数 by x54-729 2022-06-28 23:29:42 +0800
  • ad6ada24 small by x54-729 2022-06-28 23:25:12 +0800
  • 8e0d03a3 修改 Trainer torch_kwargs paddle_kwargs fairscale_kwargs 的描述 by x54-729 2022-06-28 23:24:16 +0800
  • 142fd476 修改 TorchDataLoader PaddleDataLoader set_pad 的描述 by x54-729 2022-06-28 01:06:05 +0800
  • 513a5f87 update paddle tutorial_e1 by x54-729 2022-06-27 19:08:48 +0800
  • dabb8b97 paddle tutorial 情感分析改名 by x54-729 2022-06-27 19:07:56 +0800
  • 8b1ed860 fix paddle dataset __getattr__ by x54-729 2022-06-25 21:25:22 +0800
  • 6e89cb77 Evaluator在结果为空时不会进行输出 by x54-729 2022-06-22 23:39:53 +0800
  • 9e304325 fastnlp paddle ernie 的 tutorial by x54-729 2022-06-22 23:39:33 +0800
  • 78596ea1 为 Trainer 的driver 参数增加 'auto' 选项 by x54-729 2022-06-22 16:49:03 +0800
  • eb0e563f 修复OverfitBatches被替换的问题 by yhcc 2022-06-22 16:34:41 +0800
  • 0e865d29 Merge remote-tracking branch 'origin/dev0.8.0' into deepspeed by x54-729 2022-06-20 20:53:34 +0800
  • 44d2a574 logger.warn->logger.warning by x54-729 2022-06-20 20:52:53 +0800
  • 6f9d703f logger.warn->logger.warning by x54-729 2022-06-20 20:52:04 +0800
  • a495bb93 1.修复模型会被移动到rank对应设备的问题 2.更改 deepspeed driver æ˜命名 3.为 deepspeed 添加 logging_level by x54-729 2022-06-20 20:49:17 +0800
  • de5d5597 修复fitlogcallback增加launch_time的bug by yhcc 2022-06-20 12:58:42 +0800
  • 2735d2d1 DeepSpeedDriver现在可以通过 deepspeed 命令拉起；添加了相关 trainer 的简单测试 by x54-729 2022-06-20 06:34:25 +0800
  • 8d232533 import DeepSpeedDriver by x54-729 2022-06-20 06:33:14 +0800
  • 7023ea55 deepspeed的save load功能 by x54-729 2022-06-20 02:26:34 +0800
  • 8467cb6e fix bug and make shuffle automatic by yhcc 2022-06-19 17:16:39 +0800
  • 687651e3 Merge remote-tracking branch 'origin/dev0.8.0' into deepspeed by x54-729 2022-06-18 23:05:32 +0800
  • 9903d2ee TorchDriver的sampler加载和保存拆分为单独的函数 by x54-729 2022-06-18 23:04:50 +0800
  • 2d2bf421 deepspeed checkpoint相关函数（ï微未测试） by x54-729 2022-06-18 22:28:57 +0800
  • 22d95be0 Merge branch 'dev0.8.0' into deepspeed by x54-729 2022-06-17 23:31:55 +0800
  • b60621f3 small by x54-729 2022-06-17 23:23:43 +0800
  • 64da46b6 paddle replace_batch_sampler和check_dataloader 跟进 by x54-729 2022-06-17 23:23:33 +0800
  • d26d0ad1 添加选择deepspeed driver的逻辑 by x54-729 2022-06-17 22:16:55 +0800
  • cbee1c6c deepspeed test init by x54-729 2022-06-17 22:12:38 +0800
  • a39d3011 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-06-17 21:59:04 +0800
  • dca33771 ddp添加环境变量RANK的设置 by x54-729 2022-06-17 21:58:50 +0800
  • 1a2eb93a deepspeed基本功能 by x54-729 2022-06-17 21:55:59 +0800
  • bb68856f 添加对 overfit 多卡的测试 by YWMditto 2022-06-17 00:53:13 +0800
  • 399065ae update overfit_batches by yhcc 2022-06-17 00:12:53 +0800
  • a6fc5225 添加了 overfit_batches 的注释 by YWMditto 2022-06-16 22:37:43 +0800
  • 024fecfb 添加了 overfit 的功能 by YWMditto 2022-06-16 22:30:02 +0800
  • 55d8738d deepspeed driver init by x54-729 2022-06-14 15:03:41 +0000
  • cd0957fb 跟进paddle jittor 关于 set_dist_repro_dataloader函数中的修改 by x54-729 2022-06-14 13:19:56 +0000
  • dd1c5ca0 修复设置了global seed的bug by yhcc 2022-06-13 23:15:06 +0800
  • 7283bf27 在私有定制Sampler的情况下，多卡不替换 by yhcc 2022-06-13 20:57:25 +0800
  • 70dea71c 为 ddp 在用户使用自己的sampler 和 batch sampler 是添加禁止 by YWMditto 2022-06-13 17:53:23 +0800
  • e4a7e646 progress打印增加一种特殊yueding by yhcc 2022-06-11 22:30:20 +0800
  • 0bf0dab3 增加一个TimerCallback用于计时 by yhcc 2022-06-07 14:52:09 +0800
  • c99315f7 修复新增的set_dist_repro_dataloader函数测试例在paddle情况下的问题 by x54-729 2022-06-05 23:55:38 +0000
  • 47b7c4e8 增加set_dist_repro_dataloader测试 by yhcc 2022-06-05 23:15:51 +0800
  • 8d0602f5 修复 torch_driver/utils/replace_sampler 的bug by YWMditto 2022-06-05 20:07:36 +0800
  • 08416a3a 1.修复lr_schedulder的调用时机问题;2.修复replace_sampler的初始化问题 by yhcc 2022-06-05 19:51:27 +0800
  • bd7c6abd Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-06-05 15:52:18 +0800
  • 3e296062 acc by MorningForest 2022-06-05 15:52:09 +0800
  • 8319706f finish tutorial-3456 lxr 220604 by lxr-tech 2022-06-04 21:15:44 +0800
  • 4cc8a299 1.为element测试添加torch标签 2.解决torch版本导致的int张量无法对整数使用除法的问题 by x54-729 2022-06-04 08:27:42 +0000
  • 24092e31 增加pipe相关的测试 by yhcc 2022-06-04 15:22:22 +0800
  • 637919e4 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-06-04 15:09:11 +0800
  • ec17562f 修改fdl 的prepare_*_dataloader,使其支持fastnlp的dataset by MorningForest 2022-06-04 15:08:50 +0800
  • 3797f914 update tutorial-3456 lxr 220603 by lxr-tech 2022-06-04 00:03:40 +0800
  • 82b06767 修复n_batches导致的bug by yhcc 2022-06-03 22:35:46 +0800
  • 745d254a Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-06-03 21:01:46 +0800
  • af6300e8 修改element,计算值转为非tensor形式 by MorningForest 2022-06-03 21:01:39 +0800
  • 21b7b587 typo fix by yhcc 2022-06-03 20:21:58 +0800
  • 281ffc3b 修复richcallback等在断点重训时显示进度不正确的问题 by yhcc 2022-06-03 20:09:11 +0800
  • fecd82aa 修改element无法与element运算的问题 by yhcc 2022-06-03 19:49:10 +0800
  • f3a13ff8 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-06-03 09:58:52 +0000
  • 4d29524d 删除初始化的种子设置函数 by x54-729 2022-06-03 09:54:33 +0000
  • 23030791 1. 删除 FASTNLP_SEED_WORKERS 2.修改各个框架的 seed_everything 函数，使得用户可以设置种子复现训练结果 3. 修改 sampler 的 seed 参数，在为 None 时可以根据时间戳生成随机数种子 by x54-729 2022-06-03 09:53:25 +0000
  • 057806de 将total_batches改名为n_batches，以和n_epochs对应;增加n_batches作为Trainer的初始化参数 by yhcc 2022-06-02 22:50:29 +0800
  • fd91dc37 update tutorial-045 lxr 220602 by lxr-tech 2022-06-02 22:43:48 +0800
  • a16a0e94 driver 在 dataloader 为空时进行警告 by x54-729 2022-06-01 16:19:00 +0000
  • d43159a5 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-06-01 16:11:28 +0000
  • 2d838b89 update tutorial-45 lxr 220601 by lxr-tech 2022-06-01 23:15:21 +0800
  • e55ca8a1 update example-12 lxr 220531 by lxr-tech 2022-05-31 23:25:01 +0800
  • 64c7ce54 1.修复rich在jupyter的时候不打印的问题;2.修复若干其他bug by yhcc 2022-05-31 22:29:58 +0800
  • c6cf4da2 调整部分文档格式 by x54-729 2022-05-31 09:45:25 +0000
  • 809b83b6 small by x54-729 2022-05-31 04:15:54 +0000
  • f1cb6f61 small by x54-729 2022-05-31 03:56:39 +0000
  • 79110d7c Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-31 03:47:42 +0000
  • c62f5bd2 update example-12 lxr 220530 by lxr-tech 2022-05-30 22:48:28 +0800
  • cef9dca1 修复bug by yhcc 2022-05-30 21:02:29 +0800
  • edda3d31 1.处理新测试例的import问题 2.将warnings.warn替换为logger.warn by x54-729 2022-05-30 06:44:06 +0000
  • 6d889c86 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yhcc 2022-05-29 23:19:46 +0800
  • 004c344e 1.增加torch modules；torch models by yhcc 2022-05-29 23:19:40 +0800
  • 9b0a30c8 small bug by x54-729 2022-05-29 13:51:10 +0000
  • aeeb1bc4 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-29 12:23:40 +0000
  • 639f57ad update topk_saver.py by yhcc 2022-05-29 19:25:07 +0800
  • badd07f8 修改 ReproducibleSampler ReproducibleBatchSampler 的 num_samples 获取方式 by x54-729 2022-05-29 07:04:24 +0000
  • 1d665c94 unrepeatedSampler支持chunk_split by yh 2022-05-29 14:41:59 +0800
  • f7b3fe6a small by x54-729 2022-05-29 02:04:05 +0000
  • e4028930 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-29 01:32:31 +0000
  • 75a3278d 1. 完成JittorSingleDriver的功能，并添加测试用例 2.在Sampler中添加属性num_samplers 用于动态获取dataset的长度 3.添加便于测试断点重训的数据集 4.修改jittor其它测试的一些bug，统一ArgMaxDataset 的命名 by x54-729 2022-05-29 01:32:16 +0000
  • ec76ba88 update example-2 lxr 220528 by lxr-tech 2022-05-28 17:06:57 +0800
  • 19a48c71 update example-12 lxr 220527 by lxr-tech 2022-05-27 22:47:11 +0800
  • 49e8ae2d Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-27 12:04:43 +0800
  • 6903253e 1.修改了发 f_rich_progress在没有bar的时候暂时关闭live;2.修改sampler获取dataset长度的方式以适配jittor by yh 2022-05-27 12:04:37 +0800
  • 8f211ef8 add example-12 lxr 220526 by lxr-tech 2022-05-26 21:57:44 +0800
  • 1ec3337a Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-26 16:04:02 +0800
  • 0be2357f 优化了monitor相关callback的信息打印 by yh 2022-05-26 16:03:56 +0800
  • a6cfc408 修改seq_len_to_mask的jittor实现及测试例中的一处传参错误 by x54-729 2022-05-25 17:34:32 +0000
  • b29b002b 修改 paddle_to 中关于 device 类型的文档 by x54-729 2022-05-25 17:17:58 +0000
  • 999520e4 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-25 17:14:50 +0000