Commit Graph

cb11a1f2 - analyze codes for language model, unable to run yet - add character vocab in preprocessor - add dataset loader for language model dataset - other minor adjustments - preserve only a little example data for language model by FengZiYjun 2018-09-23 16:03:20 +0800
28a06838 1. add tests in test_fastNLP.py & test_sampler.py; increase test coverage to 81% 2. changes of names: aggregation ----> aggregator interaction ----> interactor action.py ----> sampler.py BasePreprocess ---> Preprocessor BaseTester ----> Tester BaseTrainer ----> Trainer 3. add more code comments 4. fix bugs in predictor's data_forward 5. in sampler.py, remove Bachifier, fix some codes. but not test 6. remove unused codes in other_modules.py & utils.py 7. update fastnlp.py with new config file names and code comments 8. add data examples in data_for_tests/ by FengZiYjun 2018-09-22 15:33:52 +0800
9733249b Merge pull request #82 from choosewhatulike/master by Coet 2018-09-21 10:12:47 +0800
e8cc7027 add default switch by yunfan 2018-09-20 15:11:01 +0800
40a08def Merge pull request #7 from fastnlp/master by lyhuang18 2018-09-20 10:11:14 +0800
819c8f05 fix vocab by yunfan 2018-09-19 14:49:10 +0800
9c7f3cf2 add vocabulary into preprocessor by yunfan 2018-09-18 16:43:56 +0800
3f454475 add unittest of data, fix bug by yunfan 2018-09-15 20:39:51 +0800
466f3c21 add vocabulary by yunfan 2018-09-15 19:53:48 +0800
4d66bd6b Merge pull request #81 from choosewhatulike/fixMLP by Yunfan Shao 2018-09-19 14:40:10 +0800
b44b11c4 Merge pull request #6 from fastnlp/master by lyhuang18 2018-09-18 20:52:48 +0800
1e1fbc0b Merge pull request #80 from lyhuang18/docs by Xipeng Qiu 2018-09-18 17:38:06 +0800
0b05be43 Merge pull request #79 from 2017alan/master by Xipeng Qiu 2018-09-18 17:37:36 +0800
8f60a4fa update MLP by yunfan 2018-09-18 15:57:44 +0800
9fb6711b add new modules for core/ by lyhuang 2018-09-18 13:44:19 +0800
8b859dc7 self-attention module by 2017alan 2018-09-17 22:14:01 +0800
f2850766 Merge pull request #5 from fastnlp/master by lyhuang18 2018-09-17 20:45:17 +0800
b46c4ba0 Merge pull request #76 from fastnlp/add_field_support by Xipeng Qiu 2018-09-17 20:35:36 +0800
bf5d1c34 Merge branch 'master' into add_field_support by Xipeng Qiu 2018-09-17 20:35:17 +0800
47772a88 Merge pull request #74 from 2017alan/master by Xipeng Qiu 2018-09-17 20:32:45 +0800
ef3c753e Update test_seq_label.py by Coet 2018-09-17 19:51:30 +0800
ad044ef4 fix test path to pass py.test by FengZiYjun 2018-09-16 14:16:04 +0800
f2fc98b5 add Field support in Predictor: - apply DataSet in Predictor; remove sub-predictors; add "task" argument to specify which task to predict, as how Trainer/Tester did. - remove Action class - add helper function for DataSet, to create DataSet easily - more code comments - clean up unnecessary codes - add unit tests for Batch, Predictor, Preprocessor, Trainer, Tester by FengZiYjun 2018-09-16 14:08:52 +0800
05af2e75 Introduce Fields concept to eliminate the use of different sub-trainers/sub-testers. - update LabelField's to_tensor method to support int & str single label - update preprocessor's convert_to_dataset method to support single label inputs - introduce "task" in Trainer/Tester's data_forward, Tester's evaluate and metrics methods - in cnn_text_classification.py, change the name of the argument of forward - in sequence_modeling.py, change the name of the argument of forward - minor adjustments in test codes - text_classify.py works by FengZiYjun 2018-09-15 19:23:10 +0800
5c671078 Update preprocess.py by Yige XU 2018-09-15 18:13:17 +0800
b3e8db74 add self_attention for yelp classification example. by 2017alan 2018-09-15 17:19:56 +0800
7bea4768 set encoding model utf-8,otherwise in some computer it will compile failed. by 2017alan 2018-09-15 17:18:51 +0800
a89875df add initial parameters by 2017alan 2018-09-15 17:17:22 +0800
5960aba9 change the code to do with sentence with padding tokens. by 2017alan 2018-09-15 17:16:36 +0800
c24d01d5 fix a bug in label2index dict. by 2017alan 2018-09-15 17:15:25 +0800
8c13c28f add nll loss by 2017alan 2018-09-15 17:14:55 +0800
1ebb514a Merge pull request #4 from fastnlp/master by lyhuang18 2018-09-15 17:01:11 +0800
758f0c0b Introduce Field concept to optimize data representation. - add DataSet, Instance, Field to represent data in different levels - encapsulate batching method in Batch class - modify samplers in action.py to fit Batch - preprocessor.run returns DataSet, instead of list - Use Batch in Trainer/Tester - add required_arg "task" in Trainer/Tester - remove SeqLabelTrainer/SeqLabelTester dependencies successfully. They empty classes to deprecate. - modify SeqLabeling model, add another argument in forward, in order to compute mask inside model - test\model\seq_labeling.py works by FengZiYjun 2018-09-15 16:48:59 +0800
bc04b3e7 add basic Field support by yunfan 2018-09-14 12:38:38 +0800
82502aa6 Merge pull request #69 from choosewhatulike/format by Yunfan Shao 2018-09-14 14:53:37 +0800
4dfe7aaa format test folder by yunfan 2018-09-14 12:38:38 +0800
4846cfd9 Merge pull request #68 from lyhuang18/docs by lyhuang18 2018-09-12 17:18:46 +0800
a521fdff add mathjax and update pictures by lyhuang 2018-09-12 16:57:55 +0800
a5abee80 Merge pull request #3 from fastnlp/master by lyhuang18 2018-09-10 09:19:07 +0800
4bcfc5f9 Merge pull request #65 from xuyige/test_code by Coet 2018-09-09 20:34:44 +0800
aac7982e fix a bug in config saver testing code by xuyige 2018-09-09 17:57:09 +0800
6ddf5fcd update test code for testing config saver by xuyige 2018-09-09 17:55:54 +0800
7138ff21 update config file for testing code, add more sections for testing. by xuyige 2018-09-09 17:55:30 +0800
bbb02d0c clean up the code in config saver by xuyige 2018-09-09 17:54:49 +0800
534bc675 overwrite '==' operator and '!=' operator in ConfigSection class by xuyige 2018-09-09 17:53:32 +0800
66b471c7 Merge remote-tracking branch 'origin/test_code' into test_code by xuyige 2018-09-09 16:27:04 +0800
48c1e870 fix code style of config saver by xuyige 2018-09-09 16:26:16 +0800
7567053d Merge pull request #66 from lyhuang18/test2 by Coet 2018-09-09 15:34:37 +0800
a7fa63a0 add tensorboardX by lyhuang 2018-09-09 14:11:47 +0800
6a77731d add tensorboardX by lyhuang 2018-09-09 14:08:05 +0800
be2f4aad Merge branch 'master' into test_code by Yige XU 2018-09-09 12:46:11 +0800
12f06d09 clean up code in test loader by xuyige 2018-09-09 12:39:47 +0800
7fb2bcc7 update config loader by xuyige 2018-09-09 12:36:56 +0800
7c57bc6f fix a bug for config saver by xuyige 2018-09-09 12:32:39 +0800
58ccb657 clean up codes by xuyige 2018-09-09 12:30:33 +0800
47698857 add test code for testing config saver by xuyige 2018-09-09 12:13:42 +0800
2dd2f0c8 update config file for test by xuyige 2018-09-09 12:12:16 +0800
edd9dedb add config saver by xuyige 2018-09-09 12:11:38 +0800
43c09fca Merge pull request #2 from fastnlp/master by lyhuang18 2018-09-08 16:57:45 +0800
49ad966c Merge pull request #60 from KuNyaa/master by Coet 2018-09-06 09:56:14 +0800
ee2f98fc Merge pull request #62 from fastnlp/text_classify_interface by Coet 2018-09-06 09:54:03 +0800
5309c988 Text classification interface is ready. - fix issue #58, use path.join instead of + - modify description and version in setup.py - docstring in core/ follows RestructureText format by FengZiYjun 2018-09-05 10:00:57 +0800
68b63fb0 add graph summary in _train_step by KuNya 2018-09-04 20:47:43 +0800
63c687d9 Merge pull request #54 from fastnlp/pos_tag_service by Coet 2018-09-04 11:51:33 +0800
a665ddf9 Merge pull request #56 from keezen/master by Zhen Ke 2018-09-04 11:27:02 +0800
a13b8e5c Merge branch 'master' into pos_tag_service by Coet 2018-09-04 09:25:46 +0800
baf17892 add tensorboardX for loss visualization by KuNya 2018-09-03 19:37:44 +0800
4f371446 Merge pull request #59 from lyhuang18/test2 by Xipeng Qiu 2018-09-02 21:52:07 +0800
34c78cb9 update docs by lyhuang 2018-09-02 20:08:17 +0800
292853c8 Merge branch 'master' into test2 by lyhuang 2018-09-02 17:50:16 +0800
c80ae39f Merge pull request #1 from fastnlp/master by lyhuang18 2018-09-02 17:48:56 +0800
dbf1e492 add config saver by xuyige 2018-09-02 17:40:43 +0800
961a3217 Merge pull request #55 from fastnlp/add-more-badges by Xipeng Qiu 2018-09-02 16:45:31 +0800
de896744 Merge remote-tracking branch 'upstream/master' by Ke Zhen 2018-09-02 16:42:00 +0800
d910ae3c Rewrite classification model, add intialization for conv_maxpool by Ke Zhen 2018-09-02 16:39:36 +0800
e82ec43b Update README.md by Coet 2018-09-02 15:23:13 +0800
31eac4a7 fix bug in preprocessor: reported in issue 47 by FengZiYjun 2018-09-02 14:33:23 +0800
6f59384d pass CI by FengZiYjun 2018-09-02 14:18:04 +0800
57911f77 - clean up unused codes - improve code comments - BaseLoader & its subclasses does not need a data name any more - update file tree - add setup.py by FengZiYjun 2018-09-02 13:32:57 +0800
32a036e8 [fix] drop "data" in Tester.make_batch; correct spelling of "show_metrics" [add] PeopleDailyCorpusLoader, to parse PeopleDaily Corpus [update] add CWS + POS_tag interface at FastNLP, see example in test_fastNLP.py [update] modify README.md and readme_example.py to the latest version. by FengZiYjun 2018-09-01 21:33:28 +0800
3a9b5d17 Merge pull request #52 from fastnlp/cws_service by Coet 2018-09-01 17:54:16 +0800
0430067f update by FengZiYjun 2018-08-31 11:51:56 +0800
501ffb26 optimize CWS example - see test_fastNLP.py - update interpret_word_seg_results in fastnlp.py - delete useless data to increase git clone speed by FengZiYjun 2018-08-31 11:23:40 +0800
ab55f25e Updates to Trainer/Tester/fastnlp 1. Tester has a parameter "print_every_step" to control printing. print_every_step == 0 means NO print. 2. Tester's evaluate return (list of) floats, rather than torch.cuda.tensor 3. Trainer also has a parameter "print_every_step". The same usage. 4. In training, validation steps are not shown. 5. Updates to code comments. 6. fastnlp.py is ready for CWS. test_fastNLP.py works. by FengZiYjun 2018-08-31 10:46:56 +0800
9dc32f68 Merge pull request #50 from h00Jiang/master by Yige XU 2018-08-30 14:56:59 +0800
9d6b0daa Prepare for CWS service: - specify the name of the config file and the name of corresponding section where model init params store. - fastnlp.py needs load_pickle to get dictionary size and the number of labels - other minor adjustments by FengZiYjun 2018-08-30 11:45:47 +0800
625b7269 edit fastnlp run method, get ready for CWS - change inputs of fastnlp from string to list of strings - adopt flexible outputs according to diff tasks by FengZiYjun 2018-08-29 23:26:32 +0800
b76d3d08 Merge pull request #51 from xuyige/test_code by Coet 2018-08-29 17:05:18 +0800
50b53455 check if data_dev.pkl exists by Coet 2018-08-29 17:03:26 +0800
beee8856 add test code for testing variational rnn by xuyige 2018-08-29 15:28:22 +0800
2bc54c6d add test code for testing masked rnn by xuyige 2018-08-29 15:27:59 +0800
b362a810 fix a bug in testing code by xuyige 2018-08-29 15:26:50 +0800
c7762129 fix a bug in char_language_model.py by xuyige 2018-08-29 15:26:18 +0800
650838d1 fix a bug in step() of MaskedRNNBase by xuyige 2018-08-29 15:10:43 +0800
18586c9c fix a bug (when init_emb is not None , get an error) by h00Jiang 2018-08-29 14:08:29 +0800
5a70d655 fix a bug (when restore the pickle_file , cannot restore dev.pkl) by h00Jiang 2018-08-29 14:02:24 +0800
3fde8356 docs/requirements.txt by lyhuang 2018-08-29 00:18:15 +0800
96cf0336 docs/ by lyhuang 2018-08-29 00:11:33 +0800
41c7524d docs/requirements.txt by lyhuang 2018-08-28 21:23:28 +0800
8899b44a fix a bug by xuyige 2018-08-28 17:19:10 +0800

... 21 22 23 24 25