xuyige
fc505b8de2
Merge branch 'trainer' of https://github.com/FengZiYjun/fastNLP into HEAD
7 years ago
xuyige
d8a80ad6c6
update LossBase class
7 years ago
FengZiYjun
3120cdd09a
更新embed_loader:
* 添加fast_load_embedding方法,用vocab的词索引pre-trained中的embedding
* 如果vocab有词没出现在pre-train中,从已有embedding中正态采样
Update embed_loader:
* add fast_load_embedding method, to index pre-trained embedding with words in Vocab
* If words in Vocab are not exist in pre-trained, sample them from normal distribution computed by current embeddings
7 years ago
FengZiYjun
6427e85e8f
升级Vocab:
* 增量添加单词到词典中
* lazy update: 当用到词典的时候才重新build
* 当新添加的词导致词典大小超出限制时,打印一个warning
Update Vocabulary:
* More words can be added after the building.
* Lazy update: rebuild automatically when vocab is used.
* print warning when max size is reached
7 years ago
yh
fe0f99b76b
Merge branch 'trainer' of github.com:FengZiYjun/fastNLP into trainer
7 years ago
yh
3d91f2f024
trainer迭代
7 years ago
FengZiYjun
07e227aa4d
add interface of Loss
7 years ago
FengZiYjun
6839bb91cc
Add auto type detection/conversion in FieldArray
* In init, detect content type to be Python int, float, or str.
* In append(), check type consistence.
* In init & append(), int will be cast into float if they occur together.
* Map Python type into numpy dtype
* Raise error if type detection fails.
7 years ago
FengZiYjun
da901ed5b0
* DataSet __getitem__ returns copy of Instance
* refine interface of set_target & set_input
* rename DataSet.Instance into DataSet.DataSetIter
* remove unused methods in DataSet.DataSetIter
* remove __setattr__ in DataSet; It is dangerous.
* comment adjustment
7 years ago
FengZiYjun
117b12a698
* update README.md
* remove torchvision in requirements.txt
7 years ago
yhcc
15262bda64
Merge pull request #107 from yhcc/dataset
A brand new version update (0.1.1)
7 years ago
yunfan
26a4324342
fix test
7 years ago
yunfan
04206f8099
Merge branch 'master' into dataset-res
7 years ago
yunfan
2aaa381827
refine git commits
7 years ago
yunfan
e1e0661deb
add doc comments
7 years ago
yunfan
941b88f26b
fix dataset.read_csv
7 years ago
yunfan
4f587f7561
fix trainer & dataset
7 years ago
yh
e4c1ab60a6
prepare for release
7 years ago
yh
ffc963190e
修改dataframe.read_csv
7 years ago
yh
1d8f1227d7
dataset.read_csv
7 years ago
yunfan
1c34a0b732
update trainer
7 years ago
yunfan
b78d86584c
add validate_every in trainer
7 years ago
yunfan
f3bb3cb578
update trainer, tester, example model
7 years ago
yh
a3bf647713
check code修改
7 years ago
yunfan
44e098e285
update trainer, tester, example model
7 years ago
yh
4a4b001047
trainer修改
7 years ago
yh
f7275339ff
trainer check_code调整
7 years ago
yh
d9db503b93
bug fix in trainer
7 years ago
FengZiYjun
3d66975091
* refine code comments
* refine code style
* set up unit tests for Batch, DataSet, FieldArray
* remove a lot of out-of-date unit tests, to get testing passed
7 years ago
yunfan
74a697651e
- fix Dataset & Trainer
- update CNNText model
7 years ago
FengZiYjun
c4103561a8
* fix bugs in DataSet & Instance
* add more code comments
* fix tester
* refresh code styles
7 years ago
yh
0836ce006f
尝试提供check parameter的功能
7 years ago
yunfan
92da53a65b
fix Dataset
7 years ago
FengZiYjun
837bef47dc
* add unit tests for instance, vocabulary
* remove and fix other unit tests
* add more code comments
7 years ago
yunfan
c7923c82e7
update check_args and add Dataset get_input/target_name
7 years ago
yh
ce3b002263
check code init
7 years ago
yunfan
cbf54c1918
add args check & build function
7 years ago
yunfan
5abd2bf4d5
fix dataset & instance
7 years ago
yunfan
713510f65b
update Instance
7 years ago
yunfan
68d0254187
init check_*
7 years ago
yunfan
d643a7a894
update set_target, batch's as_numpy
7 years ago
yunfan
2fe39b7813
fix log in trainer & tester
7 years ago
FengZiYjun
80884322c2
* add DataSet.split()
* delete field.py
* remove logger in all codes
* adjust arguments of Trainer
7 years ago
yh
0292350c7a
vocabulary增加方法
7 years ago
yunfan
3a42c84a47
use counter in vocab, add a load func in baseloader
7 years ago
yunfan
8ee94eb6d5
make import more friendly, Dataset support slice.
7 years ago
FengZiYjun
090f7aef5b
* fixing unit tests
7 years ago
yh
1d5bb0a3b6
bug fix“
7 years ago
yh
4149eb9c06
add apply to dataset
7 years ago
yh
8906155ca2
为api建立一个Analyzer
7 years ago