wenmeng.zwm
201922d33d
[to #42461396 ] add git-lfs support and mv test data to git-lfs
3 years ago
zhangzhicheng.zzc
eb3209a79a
[to #42322933 ]中文分词
chinese word segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9051491
* add word segmentation
* Merge branch 'master' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib
* test with model hub
* merge with master
* update some description and test levels
* adding purge logic in test
* merge with master
* update variables definition
* generic word segmentation model as token classification model
* add output check
3 years ago
yingda.chen
ad8e080e37
[to #42322933 ] refactor model name
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9068994
3 years ago
wenmeng.zwm
4f7928bb6e
[to #42362853 ] formalize the output of pipeline and make pipeline reusable
* format pipeline output and check it
* fix UT
* add docstr to clarify the difference between model.postprocess and pipeline.postprocess
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9051405
3 years ago
zhangzhicheng.zzc
ba471d4492
[to #42322933 ]sentence-similarity
Adding the new task of sentence_similarity, in which the model is the sofa version of structbert
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9016402
* sbert-sentence-similarity
* [to #42322933 ] pip8
* merge with master for file dirs update
* add test cases
* pre-commit lint check
* remove useless file
* download models again~
* skip time consuming test case
* update for pr reviews
* merge with master
* add test level
* reset test level to env level
* [to #42322933 ] init
* [to #42322933 ] init
* adding purge logic in test
* merge with head
* change test level
* using sequence classification processor for similarity
3 years ago
lingcai.wl
d983bdfc8e
[to #42463204 ] support Pil.Image for image_captioning
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9049211
3 years ago
wenmeng.zwm
c59833c7ee
[to #42461396 ] feat: test_level support
* add test level support
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9021354
3 years ago
yingda.chen
d7112be056
[to #42510875 ]use sphinx book theme
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9042850
3 years ago
yingda.chen
5786b9a0a1
[to #42322933 ]formalize image matting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
3 years ago
wenmeng.zwm
b4fc38e1b9
[to #42461396 ] add Pillow version constraint and update hub version
1. use Pillow >= 6.2.0
2. change skip test msg for image caption
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9041194
3 years ago
wenmeng.zwm
67086e26f9
[to #42362932 ] feat: docker_support
* add dockerfile
* uninstall opencv-python-headless
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9020302
3 years ago
wenmeng.zwm
8a030ead72
[to #42362853 ] feat: rename config to configuration and remove repeated task fileds
1. rename maas_config to configuration
2. remove task field image and video, using cv instead
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9010802
3 years ago
wenmeng.zwm
3a78e32eb2
Revert "[to #42322933 ]formalize image matting"
This reverts commit de3ea0db54
.
3 years ago
Yingda Chen
de3ea0db54
[to #42322933 ]formalize image matting
3 years ago
yingda.chen
b31c86aa0e
[to #42409340 ] add hub specifier
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9005038
3 years ago
wenmeng.zwm
76bc51eadd
[to #42362853 ] support multimodel in pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8997599
3 years ago
yingda.chen
3c1ec035fd
[to #42322933 ] refine cartoon model and add model op utitlity
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8993758
3 years ago
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
3 years ago
wenmeng.zwm
dd00195814
[to #42362853 ] add default model support and fix circular import
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
3 years ago
myf272609
0f5b214ce0
[to #42322933 ] Add cv-person-image-cartoon-pipeline to maas lib
mass lib 接入人像卡通化算法
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8925552
* update
* fix style issues
* fix style issues
* fix style issues
* fix style issues
* add requirements
* fix bug
* adapt class init
* fix
* fix tf2 issue
* feat: Fix confilct, auto commit by WebIDE
* fix commit issues
* fix
3 years ago
yingda.chen
0d840d519c
[to #42339763 ] move pydataset into maas_lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8974892
3 years ago
yingda.chen
e3b8ec3bf1
[to #42339559 ] support multiple models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8972440
* [to #42339559 ] support multiple models
3 years ago
menrui.mr
68e64a90d4
[to #42322933 ] add image_caption_pipeline with OFA
1. add OFA whl for image caption pipeline
2. fix a bug in pipelines/builder.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8930942
* [to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* upload ofa for caption(with source code but not whl)
* remove data in gitignore
* append uncommitted data dir in ofa
* remove ofa_dir , use ofa.whl instead.
* update BPE
* rollback changes used in debugging.
* Merge branch 'master' into ofa/image_caption
# Conflicts:
# docs/README.md
# docs/source/conf.py
# docs/source/index.rst
# docs/source/tutorials/pipeline.md
# maas_lib/models/nlp/sequence_classification_model.py
# maas_lib/pipelines/builder.py
# maas_lib/version.py
# setup.py
# tests/pipelines/test_text_classification.py
* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.
* 1. rename test_image_captioning.py.
* format all files using pre-commit.
* add fairseq in requirements.txt
* add fairseq in requirements.txt
* change fairseq path to git repo to a whl on oss in ofa.txt.
* change module_name to 'ofa'
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/builder.py
* optim requirements for ofa / refine image_captioning.py
* uncommited change.
* feat: Fix confilct, auto commit by WebIDE
3 years ago
feiwu.yfw
235880f300
[to #42339763 ] merge pydataset into maas-lib
* merge pydataset to the repo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8955999
3 years ago
hemu.zp
8a76f40754
[to #42322933 ]Add text-generation-pipeline with Palm model.
将 Palm 中文模型接入 MaaS,添加了文本生成 pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8934393
* add text_generation model and pipeline
* fix bug
* fix bug
* add TextGenerator in pipeline
* fix bug
* update checkpoint and test inputs
* remove magic number..
* fix bug
* adjust code with AutoModel
* clear comments and tidy up the code
* move model.eval() into generator
* update master interface and lint code
* replace 'palm-text-generation' with 'palm'
* add text_generation model and pipeline
* fix bug
* fix bug
* add TextGenerator in pipeline
* fix bug
* fix conflict of pipeline.txt
* remove magic number..
* fix bug
* adjust code with AutoModel
* clear comments and tidy up the code
* move model.eval() into generator
* fix conflict
* replace 'palm-text-generation' with 'palm'
* fix conflict
* add test_run_modelhub
* update sofa version
* modify sofa version
* add test_run_with_model_name
* fix bug
3 years ago
yingda.chen
d6868ddffe
[to #42323743 ] retain local cached model files by default
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8963687
3 years ago
yingda.chen
e075ad2245
[to #42322515 ]support plain pipeline for bert
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8945177
* support plain pipeline for bert
3 years ago
wenmeng.zwm
d395e9abc2
[to #42281043 ] support kwargs in pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8949062
* support kwargs in pipeline
* update develop doc with CR instruction
3 years ago
huangjun.hj
cdacbfb476
refine pipeline doc
3 years ago
yingda.chen
f8eb699f7f
refine tests and examples
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8898823
3 years ago
wenmeng.zwm
1d01a78c2b
fix: UT error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8899458
* fix: UT error
3 years ago
yingda.chen
5995cc4607
add PyDataset support
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868644
3 years ago
wenmeng.zwm
c4bfd6cced
[to #41999503 ] refine doc and requirements for linux and mac
1. refine quick start and pipeline doc
2. remove tf pytorch easynlp from requirements
3. lazy import for torch and tensorflow
4. test successfully on linux and mac intel cpu
5. update api doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8882373
3 years ago
dongjunwei.djw
0703798fc2
fix the model evaluation error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8872484
3 years ago
wenmeng.zwm
25a2028b54
[to #41401401 ] modelhub and Trainer support
* add trainer interface
* add trainer script
* add model init support for pipelineadd pipeline tutorial and fix bugs
* add text classification evaluation to maas lib
* add quickstart and prepare env doc
* relax requirements for torch and sentencepiece
* merge release/0.1 and fix conflict
* modelhub support for model and pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
3 years ago
yingda.chen
043e498e01
refactor doc build and fix some typos
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8819462
3 years ago
wenmeng.zwm
cb416edc2a
[to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8810524
3 years ago
wenmeng.zwm
db4a8be9c5
[to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
3 years ago
Yingda Chen
3cbdcb1d3e
fix typo
3 years ago
wenmeng.zwm
5e469008fd
[to #41401401 ] add preprocessor, model and pipeline
* add preprocessor module
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
* fix UT failed
* add test for Compose
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235
* add preprocessor module
* add test for Compose
* fix citest error
* fix abs class error
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* refine models and pipeline interface
* add pipeline folder structure
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
1.add preprossor model pipeline for nlp text classification
2. add corresponding test
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371
* new nlp pipeline
* format pre-commit code
* update easynlp pipeline
* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py
* update test_typeassert.py
* refactor code
1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT
* fix linter test failed
* update requirements.txt
* fix UT failed
* fix citest script to update requirements
3 years ago
wenmeng.zwm
0a756f6a0d
[to #41402703 ] add basic modules
* add constant
* add logger module
* add registry and builder module
* add fileio module
* add requirements and setup.cfg
* add config module and tests
* add citest script
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8718998
3 years ago
wenmeng.zwm
02492e2bff
[to #41401401 ] init project
* add license
* add folder structure
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8682838
3 years ago
wenmeng.zwm
92d3f2cd7f
initial commit
3 years ago