FengZiYjun
2c0079f3d5
changes to action, trainer and tester:
- Action collects shared operations: data_forward, mode, pad, make_batch
- Trainer and Tester receives Action as a parameter
- seq_labeling works in such setting
7 years ago
Coet
8f2d5f7170
Create __init__.py
7 years ago
FengZiYjun
743a6d7547
fix bugs in preprocessor
7 years ago
choosewhatulike
c90e7b0134
Merge branch 'master' of https://github.com/choosewhatulike/fastNLP
7 years ago
choosewhatulike
c42487f987
merge master
7 years ago
choosewhatulike
a077703c99
merge master
7 years ago
choosewhatulike
1548ee7ce2
add recall, f1-score
7 years ago
Coet
2c0e931771
Merge pull request #18 from fastnlp/dev/inference
A lot of changes.
7 years ago
FengZiYjun
8e3e6d4579
changes to batch methods
- [action] add k-means bucketing, partition sequences into buckets of nearly the same length
- [trainer] print train loss every 10 steps
- [loader] cws pku loader split sequence longer than max_seq_len into several shorter sequences
7 years ago
FengZiYjun
9aad8dff6e
update
7 years ago
FengZiYjun
58120998c5
update
7 years ago
FengZiYjun
ef8ec3b9e4
add cws train script and corresponding config file
7 years ago
FengZiYjun
233e8328f7
changes to seq label model,
- [model] optimize cuda support in seq labeling model
- [test] add test data "pku" for chinese word seg
- test_tester.py and test_cws.py is OK to run!
7 years ago
FengZiYjun
e531908f40
Merge branch 'dev/inference' of https://github.com/fastnlp/fastNLP
7 years ago
FengZiYjun
242e576a30
changes to trainer, tester, preprocessor, etc.
- [tester][trainer] add cuda support
- [preprocess] fix label2index for padding label seq
- update README.md
- [test] add test_tester.py
- rename "action" to "core"
7 years ago
Yige XU
aaac041fc3
Update config_loader.py
7 years ago
choosewhatulike
215a67e7af
fix optimizer
7 years ago
choosewhatulike
2e96f7308c
fix optimizer
7 years ago
FengZiYjun
c83008add9
fastnlp.py works, see test/test_fastNLP.py for high-level API
7 years ago
choosewhatulike
febe27b5bb
Merge remote-tracking branch 'origin/master'
7 years ago
choosewhatulike
e535314753
add recall metrics
7 years ago
FengZiYjun
fe17f611b6
changes to preprocessor, trainer, inference & seq modeling
- [trainer]rename "batchify" to "make_batch" in trainer
- [trainer]pack (batch_x_pad, seq_len) into batch_x in make_batch for seq labeling, because seq length before pad is needed to make masks
- [trainer]unpack it in data_forward
- [model]shorten model definition
- [inference]build inference class. test_POS_pipeline.py is OK to infer
- [preprocessor]handle pickles in a nicer manner
- [FastNLP] add fastNLP.py as high-level API, not finished yet
7 years ago
choosewhatulike
9701ab2897
add accuracy_score; fix optimizer
7 years ago
FengZiYjun
22d900b7a3
Merge remote-tracking branch 'origin/master'
# Conflicts:
# fastNLP/modules/encoder/embedding.py
# fastNLP/modules/encoder/lstm.py
7 years ago
Coet
7c2f260a2f
Merge pull request #16 from fastnlp/feature/preprocess
add default parameters for modules, in order to decrease required params; update POSPreprocessor to return multi-level lists; add metrics.py
7 years ago
FengZiYjun
eab9473bd4
Merge branch 'feature/preprocess' of https://github.com/fastnlp/fastNLP
7 years ago
FengZiYjun
647c6c637f
edit dataset loaders to follow edited preprocessor; add unit tests for dataset loader
7 years ago
FengZiYjun
1c0eac4c82
optimize model definition of seq modeling; test_POS_pipeline ready to run
7 years ago
Yige XU
a422a4e2d6
Update preprocess.py
7 years ago
Coet
7f4e57a1c9
Update metrics.py
7 years ago
FengZiYjun
92be0722dc
add init parameters in modules; optimizer Preprocessor; add metrics.py
7 years ago
choosewhatulike
875fdc46a5
add optimizor construct function
7 years ago
FengZiYjun
7557e2d065
fix bugs: 1. action batchify 2. Trainer optimizer position 3. Trainer.pad
7 years ago
Coet
66d380542a
Merge pull request #14 from keezen/master
Add classification model.
7 years ago
Ke Zhen
45690d337c
merge
7 years ago
Ke Zhen
4a25bdba9c
classification
7 years ago
FengZiYjun
843b7c0e7e
To Do (save commit)
7 years ago
FengZiYjun
3d234bf5b2
add model selection (best dev) in Trainer: save the best model during validation; add Inference.
7 years ago
FengZiYjun
174ce35fc8
delete unnecessary files
7 years ago
FengZiYjun
301bbdcd1e
add accuracy in POS Tester;
optimize evaluation output in Trainer;
keep POS pipeline (loader + trainer + tester + saver) OK;
add codes borrowed from FudanParser.
7 years ago
FengZiYjun
621b79ee19
update configLoader to load hyper-parameters from file
7 years ago
FengZiYjun
08b0edaebb
Merge remote-tracking branch 'origin/master'
7 years ago
Coet
b3388684d7
Merge pull request #13 from xuyige/master
update config loader
7 years ago
Yige XU
91e02a50b5
update config loader
add ConfigSection class to save config data
7 years ago
FengZiYjun
eba1d002ca
Merge remote-tracking branch 'origin/master'
7 years ago
Coet
f8b09e80c8
Merge pull request #12 from fastnlp/dev/restructure
restructure module: 4 classes; add modules; move prototype and rename
7 years ago
FengZiYjun
2df371a0d0
Merge remote-tracking branch 'origin/master'
7 years ago
FengZiYjun
042f63aa46
codebank
7 years ago
FengZiYjun
ec165ce4ac
add model saver and loader
7 years ago
Coet
4a82b5d446
Merge pull request #11 from xuyige/master
update config loader
7 years ago