wenmeng.zwm
231f400133
[to #43112534 ] finetune support and first case
co-contributed with 夕陌&雨泓
* add torch epoch based trainer and dis utils
* add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
* add torch mdoel base and test
* add optimizer and lrscheduler module
* add sbert for text classification example
* add task_dataset for dataset-level processor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412
3 years ago
yingda.chen
a60d675d25
[to #42322933 ]formalize test data storage
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9251871
3 years ago
yingda.chen
0260b89431
[to #42322933 ] unified output keys
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
3 years ago
wenmeng.zwm
bb57020daa
[to #42362425 ] remove add module to default group

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9229852
3 years ago
wenmeng.zwm
201922d33d
[to #42461396 ] add git-lfs support and mv test data to git-lfs
3 years ago
wenmeng.zwm
4f7928bb6e
[to #42362853 ] formalize the output of pipeline and make pipeline reusable
* format pipeline output and check it
* fix UT
* add docstr to clarify the difference between model.postprocess and pipeline.postprocess
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9051405
3 years ago
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
3 years ago
wenmeng.zwm
dd00195814
[to #42362853 ] add default model support and fix circular import
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
3 years ago
wenmeng.zwm
5e469008fd
[to #41401401 ] add preprocessor, model and pipeline
* add preprocessor module
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
* fix UT failed
* add test for Compose
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235
* add preprocessor module
* add test for Compose
* fix citest error
* fix abs class error
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* refine models and pipeline interface
* add pipeline folder structure
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
1.add preprossor model pipeline for nlp text classification
2. add corresponding test
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371
* new nlp pipeline
* format pre-commit code
* update easynlp pipeline
* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py
* update test_typeassert.py
* refactor code
1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT
* fix linter test failed
* update requirements.txt
* fix UT failed
* fix citest script to update requirements
3 years ago