choosewhatulike
8a87807274
set no_grad() for test & inference, reduce memory usage
7 years ago
Yunfan Shao
762a559fab
fix bug in SeqLabelTester
7 years ago
Coet
4bc123dc16
Update issue templates
7 years ago
choosewhatulike
d6ef132207
fix test_metrics bug
7 years ago
choosewhatulike
2961afd326
remove unused file
7 years ago
Coet
0b2e2ff586
Merge pull request #23 from fastnlp/dev/ci_test
Dev/ci test
7 years ago
Coet
8a6976460a
Merge pull request #24 from fastnlp/add-code-of-conduct-1
Create CODE_OF_CONDUCT.md
7 years ago
Coet
1cd7325328
Create CODE_OF_CONDUCT.md
7 years ago
Coet
3560fb1f67
Merge pull request #22 from fastnlp/dev/ner
Dev/ner
7 years ago
FengZiYjun
380fc251f4
add code coverage
7 years ago
FengZiYjun
77b3a0c67d
fastNLP high-level interface:
- fastNLP interface for sequence labeling works
- fastNLP interface for text classification works
7 years ago
Coet
2075693273
Merge pull request #21 from fastnlp/dev/classify
Dev/classify
7 years ago
FengZiYjun
80a127cb24
merge jianghao's code
7 years ago
FengZiYjun
8e6db05339
changes to Trainer, Tester & Inference:
- rename "POSTrainer", "POSTester" to "SeqLabelTrainer", "SeqLabelTester"
- Trainer & Tester have NO relation with Action
- Inference owns independent "make_batch" & "data_forward"
- Conversion to Tensor & go into cuda are done in "make_batch"
- "make_batch" support maximum/minimum length
7 years ago
FengZiYjun
c1d7c5d7da
changes to action, trainer and tester:
- rename "POSTrainer" to "SeqLabelTrainer"
- add text classification test data
- update make_batch in Trainer and Tester
7 years ago
Yunfan Shao
cd5c1f41fb
Merge pull request #19 from choosewhatulike/master
add metrics
7 years ago
Yunfan Shao
defdfaadd2
Merge pull request #20 from choosewhatulike/fix_optim
fix optimizer
7 years ago
FengZiYjun
83f69b0e0f
Combine make_batch for Trainer and Tester
- change parameter <seq_length-->mask> in loss function defined in seq model
- Trainer & Tester have Action as default parameter, shared static methods like make_batch
- add seq_len in make_batch of Inference
- add SeqLabelInfer, a subclass of Inference
- seq_labeling.py works
7 years ago
FengZiYjun
2c0079f3d5
changes to action, trainer and tester:
- Action collects shared operations: data_forward, mode, pad, make_batch
- Trainer and Tester receives Action as a parameter
- seq_labeling works in such setting
7 years ago
Coet
8f2d5f7170
Create __init__.py
7 years ago
FengZiYjun
743a6d7547
fix bugs in preprocessor
7 years ago
choosewhatulike
c90e7b0134
Merge branch 'master' of https://github.com/choosewhatulike/fastNLP
7 years ago
choosewhatulike
c42487f987
merge master
7 years ago
choosewhatulike
a077703c99
merge master
7 years ago
choosewhatulike
1548ee7ce2
add recall, f1-score
7 years ago
Coet
2c0e931771
Merge pull request #18 from fastnlp/dev/inference
A lot of changes.
7 years ago
FengZiYjun
8e3e6d4579
changes to batch methods
- [action] add k-means bucketing, partition sequences into buckets of nearly the same length
- [trainer] print train loss every 10 steps
- [loader] cws pku loader split sequence longer than max_seq_len into several shorter sequences
7 years ago
FengZiYjun
9aad8dff6e
update
7 years ago
FengZiYjun
58120998c5
update
7 years ago
FengZiYjun
ef8ec3b9e4
add cws train script and corresponding config file
7 years ago
FengZiYjun
233e8328f7
changes to seq label model,
- [model] optimize cuda support in seq labeling model
- [test] add test data "pku" for chinese word seg
- test_tester.py and test_cws.py is OK to run!
7 years ago
FengZiYjun
e531908f40
Merge branch 'dev/inference' of https://github.com/fastnlp/fastNLP
7 years ago
FengZiYjun
242e576a30
changes to trainer, tester, preprocessor, etc.
- [tester][trainer] add cuda support
- [preprocess] fix label2index for padding label seq
- update README.md
- [test] add test_tester.py
- rename "action" to "core"
7 years ago
Yige XU
aaac041fc3
Update config_loader.py
7 years ago
choosewhatulike
215a67e7af
fix optimizer
7 years ago
choosewhatulike
2e96f7308c
fix optimizer
7 years ago
FengZiYjun
c83008add9
fastnlp.py works, see test/test_fastNLP.py for high-level API
7 years ago
choosewhatulike
febe27b5bb
Merge remote-tracking branch 'origin/master'
7 years ago
choosewhatulike
e535314753
add recall metrics
7 years ago
FengZiYjun
fe17f611b6
changes to preprocessor, trainer, inference & seq modeling
- [trainer]rename "batchify" to "make_batch" in trainer
- [trainer]pack (batch_x_pad, seq_len) into batch_x in make_batch for seq labeling, because seq length before pad is needed to make masks
- [trainer]unpack it in data_forward
- [model]shorten model definition
- [inference]build inference class. test_POS_pipeline.py is OK to infer
- [preprocessor]handle pickles in a nicer manner
- [FastNLP] add fastNLP.py as high-level API, not finished yet
7 years ago
choosewhatulike
9701ab2897
add accuracy_score; fix optimizer
7 years ago
FengZiYjun
22d900b7a3
Merge remote-tracking branch 'origin/master'
# Conflicts:
# fastNLP/modules/encoder/embedding.py
# fastNLP/modules/encoder/lstm.py
7 years ago
Coet
7c2f260a2f
Merge pull request #16 from fastnlp/feature/preprocess
add default parameters for modules, in order to decrease required params; update POSPreprocessor to return multi-level lists; add metrics.py
7 years ago
FengZiYjun
eab9473bd4
Merge branch 'feature/preprocess' of https://github.com/fastnlp/fastNLP
7 years ago
FengZiYjun
647c6c637f
edit dataset loaders to follow edited preprocessor; add unit tests for dataset loader
7 years ago
FengZiYjun
1c0eac4c82
optimize model definition of seq modeling; test_POS_pipeline ready to run
7 years ago
Yige XU
a422a4e2d6
Update preprocess.py
7 years ago
Coet
7f4e57a1c9
Update metrics.py
7 years ago
FengZiYjun
92be0722dc
add init parameters in modules; optimizer Preprocessor; add metrics.py
7 years ago
choosewhatulike
875fdc46a5
add optimizor construct function
7 years ago