Yingda Chen
e0ef60ca9b
[to #42322933 ] skip demo test by default
3 years ago
lingcai.wl
7a49fa1cc6
[to #44657982 ] add unittest for demo and demotest utils
unittest for demo service
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006180
3 years ago
yingda.chen
04bb8061e6
[to #42322933 ]move postprocess helper into utilities
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856286
3 years ago
Yingda Chen
63233c2122
Revert "[to #42322933 ]move postprocess helper into utilities"
This reverts commit 4cc0395ac5
.
3 years ago
Yingda Chen
4cc0395ac5
[to #42322933 ]move postprocess helper into utilities
3 years ago
Yingda Chen
b854303c25
[to #42322933 ] fix typo
3 years ago
wenmeng.zwm
7798a6250a
[to #43112692 ] stardarized task name and output
1. task name and output definition: [link](https://alidocs.dingtalk.com/i/nodes/KOEmgBoGwD78vd2bAry3VndLerP9b30a?nav=spaces&navQuery=spaceId%3Dnb9XJNlZxbgrOXyA&iframeQuery=utm_source%3Dportal%26utm_medium%3Dportal_space_file_tree )
2. rearrange task definition and add more outputs definition for tasks
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9585469
3 years ago
wenmeng.zwm
b3f4ac8acc
[to #43115042 ] add trainer usage doc
1. add trainer doc
2. support local configuration file for trainer
3. update nlp trainer test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9541239
3 years ago
feiwu.yfw
2c3875c0e1
[to #43299989 ] Fix msdataset
* fix msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9436292
* fix msdataset
3 years ago
wenmeng.zwm
231f400133
[to #43112534 ] finetune support and first case
co-contributed with 夕陌&雨泓
* add torch epoch based trainer and dis utils
* add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
* add torch mdoel base and test
* add optimizer and lrscheduler module
* add sbert for text classification example
* add task_dataset for dataset-level processor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412
3 years ago
yingda.chen
2e88a995ca
[to #42322933 ]support model revision
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9300163
3 years ago
yingda.chen
0260b89431
[to #42322933 ] unified output keys
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
3 years ago
feiwu.yfw
5da470fd5d
[to #42791465 , #42779255 , #42777959 , #42757844 , #42756050 , #42746916 , #42743595 , #42791863 ] fix: fix msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9174075
* fix msdataset
3 years ago
yingda.chen
6702b29e21
[to #42794773 ]rename pydataset to msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9165402
3 years ago
Yingda Chen
b6e3fd80b0
Revert "[to #42794773 ] rename pydataset to msdataset"
This reverts commit c8e2e6de0e
.
3 years ago
Yingda Chen
c8e2e6de0e
[to #42794773 ] rename pydataset to msdataset
3 years ago
yingda.chen
e7571a566f
[to #42322933 ] skip dataset test for now
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9155405
3 years ago
yingda.chen
1a0d4af55a
[to #42322933 ] test level check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
3 years ago
feiwu.yfw
b8ba35bd27
[to #42670107 ] restore pydataset test
* pydataset unitest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9132896
3 years ago
wenmeng.zwm
e288cf076e
[to #42362853 ] refactor pipeline and standardize module_name
* using get_model to validate hub path
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
3 years ago
mulin.lyh
76c6ff6329
[to #42675838 ]merge model hub code
合并model hub 代码
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
3 years ago
feiwu.yfw
c7238a470b
[to #42670107 ]pydataset fetch data from datahub
* pydataset fetch data from datahub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9060856
3 years ago
wenmeng.zwm
201922d33d
[to #42461396 ] add git-lfs support and mv test data to git-lfs
3 years ago
yingda.chen
ad8e080e37
[to #42322933 ] refactor model name
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9068994
3 years ago
wenmeng.zwm
c59833c7ee
[to #42461396 ] feat: test_level support
* add test level support
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9021354
3 years ago
yingda.chen
5786b9a0a1
[to #42322933 ]formalize image matting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
3 years ago
wenmeng.zwm
3a78e32eb2
Revert "[to #42322933 ]formalize image matting"
This reverts commit de3ea0db54
.
3 years ago
Yingda Chen
de3ea0db54
[to #42322933 ]formalize image matting
3 years ago
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
3 years ago
wenmeng.zwm
dd00195814
[to #42362853 ] add default model support and fix circular import
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
3 years ago
yingda.chen
0d840d519c
[to #42339763 ] move pydataset into maas_lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8974892
3 years ago
yingda.chen
e3b8ec3bf1
[to #42339559 ] support multiple models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8972440
* [to #42339559 ] support multiple models
3 years ago
feiwu.yfw
235880f300
[to #42339763 ] merge pydataset into maas-lib
* merge pydataset to the repo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8955999
3 years ago
yingda.chen
d6868ddffe
[to #42323743 ] retain local cached model files by default
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8963687
3 years ago
yingda.chen
f8eb699f7f
refine tests and examples
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8898823
3 years ago
yingda.chen
5995cc4607
add PyDataset support
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868644
3 years ago
wenmeng.zwm
25a2028b54
[to #41401401 ] modelhub and Trainer support
* add trainer interface
* add trainer script
* add model init support for pipelineadd pipeline tutorial and fix bugs
* add text classification evaluation to maas lib
* add quickstart and prepare env doc
* relax requirements for torch and sentencepiece
* merge release/0.1 and fix conflict
* modelhub support for model and pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
3 years ago
wenmeng.zwm
5e469008fd
[to #41401401 ] add preprocessor, model and pipeline
* add preprocessor module
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
* fix UT failed
* add test for Compose
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235
* add preprocessor module
* add test for Compose
* fix citest error
* fix abs class error
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* refine models and pipeline interface
* add pipeline folder structure
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
1.add preprossor model pipeline for nlp text classification
2. add corresponding test
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371
* new nlp pipeline
* format pre-commit code
* update easynlp pipeline
* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py
* update test_typeassert.py
* refactor code
1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT
* fix linter test failed
* update requirements.txt
* fix UT failed
* fix citest script to update requirements
3 years ago