yh
9fc20ac7b8
增加infer的pipeline
7 years ago
yh
0a8a76f769
冲突解决
7 years ago
yh
dc7f8ef8d4
bug fix
7 years ago
yunfan
82f4351540
add index to word processor
7 years ago
yh_cc
7df33b23ea
Merge branch 'dataset' of github.com:yhcc/fastNLP into dataset
7 years ago
FFTYYY
07fb61efdc
Update test_loss
7 years ago
FengZiYjun
e2b14ed33d
Merge remote-tracking branch 'origin/dataset' into dataset
7 years ago
FengZiYjun
5dd0f74d6d
- 添加pos_tagger API, pipeline跑通
- 修复processor的bug
- 更新core/的若干组件, 去除batch的冗余参数
- CRF有个打字错误?已修复
- 更新pos tag 训练脚本
7 years ago
yh_cc
3e50ca8a72
创建了一个测试context
7 years ago
yh_cc
de3feeaf5a
调整CWS函数的位置
7 years ago
yh_cc
752efc57fd
Merge branch 'dataset' of github.com:yhcc/fastNLP into dataset
7 years ago
yh_cc
ea1c8c1100
当前版本分词准确率已达正常分词分数
7 years ago
FengZiYjun
ec9fd32d60
improve trainer: log mean and std of model params, and sum of gradients
7 years ago
FengZiYjun
5e84ca618e
merge and update
7 years ago
FengZiYjun
cd68d78d50
Merge remote-tracking branch 'origin/dataset' into dataset
# Conflicts:
# fastNLP/api/pipeline.py
# fastNLP/api/pos_tagger.py
# fastNLP/api/processor.py
# fastNLP/modules/decoder/CRF.py
7 years ago
FengZiYjun
26e3abdf58
- 修改pos tag训练脚本,可以跑
- 在api中创建converter.py
- Pipeline添加初始化方法,方便一次性添加processors
- 删除pos_tagger.py
- 优化整体code style
7 years ago
yunfan
64a9bacbc2
fix crf
7 years ago
yh_cc
10bb2810ab
Merge branch 'dataset' of github.com:yhcc/fastNLP into dataset
7 years ago
yunfan
3ae12e2c13
fix processor
7 years ago
yh_cc
73ba3b5eec
bug fix for pipeline
7 years ago
yunfan
1806bbdbec
fix dataset
7 years ago
yunfan
b7aab90157
init parser api
7 years ago
yunfan
a6ab34fd38
fix crf
7 years ago
yh_cc
3cb98ddcf2
Sampler中增加了一个BucketSampler, CWS的训练基本可以实现
7 years ago
yh_cc
69a138eb18
修改了遇到的若干问题,增加了分词任务的一些方法
7 years ago
yh_cc
dc0124cf02
修改model到models
7 years ago
yh_cc
25a53ac5c9
修改processor适配昨天的sao操作
7 years ago
yh_cc
ae0cc9a46b
修改api.load()函数
7 years ago
xuyige
dff4cdf6a7
update API
7 years ago
yh
d818e91380
增加dataset自动创建对应的array
7 years ago
yh
217cab94d1
Merge branch 'dataset' of https://github.com/yhcc/fastNLP into dataset
7 years ago
yunfan
dd0bb0d791
add data iter
7 years ago
yh
515e4f4987
移动processor到processor.py
7 years ago
FFTYYY
1f15b52216
update readme, for requirements changed
7 years ago
FFTYYY
2cd2dae251
update loss
7 years ago
yunfan
d7e78faf4b
Merge branch 'dataset' of https://github.com/yhcc/fastNLP into dataset
7 years ago
yunfan
f90861d7a5
fix fieldarray, dataset
7 years ago
yh
89ce85b6ed
Merge branch 'dataset' of https://github.com/yhcc/fastNLP into dataset
7 years ago
yh
38aa207ea2
新增cws converter, io
7 years ago
yunfan
ff6d99bcb2
add dataset support for sampler, update batch
7 years ago
yunfan
0cbbfd5221
update dataset
7 years ago
xuyige
ba51bf4cb5
update requirements
7 years ago
FengZiYjun
12e9a93b52
Merge remote-tracking branch 'origin/dataset' into dataset
7 years ago
FengZiYjun
79105381f5
- add interfaces for pos_tagging API
- update predictor.py to remove unused methods
- update model_loader.py & model_saver.py to support entire model saving & loading
- update pos tagging training script
7 years ago
yh
1b9daa1985
新增CWS的部分功能
7 years ago
yh
fcf5af93d8
修改batch, 新增pipeline和processor的接口
7 years ago
yunfan
8fae3bc2e7
Merge branch 'dev' into dataset
7 years ago
yunfan
cf0b2c2d35
update trainer
7 years ago
yunfan
8fa50d1749
update crf
7 years ago
yunfan
9b25de3ff3
init new field
7 years ago