choosewhatulike
e535314753
add recall metrics
7 years ago
FengZiYjun
fe17f611b6
changes to preprocessor, trainer, inference & seq modeling
- [trainer]rename "batchify" to "make_batch" in trainer
- [trainer]pack (batch_x_pad, seq_len) into batch_x in make_batch for seq labeling, because seq length before pad is needed to make masks
- [trainer]unpack it in data_forward
- [model]shorten model definition
- [inference]build inference class. test_POS_pipeline.py is OK to infer
- [preprocessor]handle pickles in a nicer manner
- [FastNLP] add fastNLP.py as high-level API, not finished yet
7 years ago
choosewhatulike
9701ab2897
add accuracy_score; fix optimizer
7 years ago
FengZiYjun
22d900b7a3
Merge remote-tracking branch 'origin/master'
# Conflicts:
# fastNLP/modules/encoder/embedding.py
# fastNLP/modules/encoder/lstm.py
7 years ago
Coet
7c2f260a2f
Merge pull request #16 from fastnlp/feature/preprocess
add default parameters for modules, in order to decrease required params; update POSPreprocessor to return multi-level lists; add metrics.py
7 years ago
FengZiYjun
eab9473bd4
Merge branch 'feature/preprocess' of https://github.com/fastnlp/fastNLP
7 years ago
FengZiYjun
647c6c637f
edit dataset loaders to follow edited preprocessor; add unit tests for dataset loader
7 years ago
FengZiYjun
1c0eac4c82
optimize model definition of seq modeling; test_POS_pipeline ready to run
7 years ago
Yige XU
a422a4e2d6
Update preprocess.py
7 years ago
Coet
7f4e57a1c9
Update metrics.py
7 years ago
FengZiYjun
92be0722dc
add init parameters in modules; optimizer Preprocessor; add metrics.py
7 years ago
choosewhatulike
875fdc46a5
add optimizor construct function
7 years ago
FengZiYjun
7557e2d065
fix bugs: 1. action batchify 2. Trainer optimizer position 3. Trainer.pad
7 years ago
Coet
66d380542a
Merge pull request #14 from keezen/master
Add classification model.
7 years ago
Ke Zhen
45690d337c
merge
7 years ago
Ke Zhen
4a25bdba9c
classification
7 years ago
FengZiYjun
843b7c0e7e
To Do (save commit)
7 years ago
FengZiYjun
3d234bf5b2
add model selection (best dev) in Trainer: save the best model during validation; add Inference.
7 years ago
FengZiYjun
174ce35fc8
delete unnecessary files
7 years ago
FengZiYjun
301bbdcd1e
add accuracy in POS Tester;
optimize evaluation output in Trainer;
keep POS pipeline (loader + trainer + tester + saver) OK;
add codes borrowed from FudanParser.
7 years ago
FengZiYjun
621b79ee19
update configLoader to load hyper-parameters from file
7 years ago
FengZiYjun
08b0edaebb
Merge remote-tracking branch 'origin/master'
7 years ago
Coet
b3388684d7
Merge pull request #13 from xuyige/master
update config loader
7 years ago
Yige XU
91e02a50b5
update config loader
add ConfigSection class to save config data
7 years ago
FengZiYjun
eba1d002ca
Merge remote-tracking branch 'origin/master'
7 years ago
Coet
f8b09e80c8
Merge pull request #12 from fastnlp/dev/restructure
restructure module: 4 classes; add modules; move prototype and rename
7 years ago
FengZiYjun
2df371a0d0
Merge remote-tracking branch 'origin/master'
7 years ago
FengZiYjun
042f63aa46
codebank
7 years ago
FengZiYjun
ec165ce4ac
add model saver and loader
7 years ago
Coet
4a82b5d446
Merge pull request #11 from xuyige/master
update config loader
7 years ago
Yige XU
7ccec559f3
Add files via upload
7 years ago
Yige XU
7ff29877cd
Merge pull request #2 from fastnlp/master
1
7 years ago
FengZiYjun
eb66cbe6c4
restructure module: 4 classes; add modules; move prototype and rename
7 years ago
FengZiYjun
7514be6f30
- add validation loss into trainer.train
- restructure: move reproduction outside
- add evaluate in tester
7 years ago
FengZiYjun
a73087e913
refactor Tester; Tester + Trainer for seq modeling work
7 years ago
FengZiYjun
c98d5924b5
sequence labeling ready to Train!
7 years ago
FengZiYjun
83c032df5d
fix bug in CRF comments; optimize PyTorch type conversion.
7 years ago
FengZiYjun
4c9c791304
cancel restriction for base model
7 years ago
FengZiYjun
cca276b8c0
- optimize package calling from test files
- add people.txt in data_for_tests
- To do: incorrect CRF param in POS_pipeline
7 years ago
FengZiYjun
d7a8217132
finished POSTrainer
7 years ago
Yige XU
b998593bc5
Merge pull request #1 from fastnlp/master
1
7 years ago
FengZiYjun
7ea015c0f9
update trainer: loading data with _pickle; add arguments comments.
7 years ago
FengZiYjun
982503d033
optimize code style
7 years ago
Coet
67557222c0
Merge pull request #9 from xuyige/master
Add files via upload
7 years ago
Coet
623f8fa1b2
Update base_preprocess.py
7 years ago
Yige XU
9d92c95063
Add files via upload
7 years ago
FengZiYjun
ceffed6a16
update trainer: add sampling and padding in batchify, add pkl loading in prepare_input, check model loss in get_loss
7 years ago
Coet
a99895223c
Merge pull request #8 from keezen/master
rename and add kmax pooling module
7 years ago
Zhen Ke
d6187274be
Rename Conv.py to conv.py
7 years ago
Ke Zhen
7b7826544e
add kmax pooling module
7 years ago