mulin.lyh
c4fb2445d6
[to #43259593 ]feat: add list model api
添加list model查询api
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9446917
3 years ago
Yingda Chen
59879b687a
[to #42322933 ]update develop.md
3 years ago
wenmeng.zwm
231f400133
[to #43112534 ] finetune support and first case
co-contributed with 夕陌&雨泓
* add torch epoch based trainer and dis utils
* add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
* add torch mdoel base and test
* add optimizer and lrscheduler module
* add sbert for text classification example
* add task_dataset for dataset-level processor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412
3 years ago
yingda.chen
d532d45559
[to #42322933 ]unified revision control
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9319772
3 years ago
yingda.chen
8a65b0b1ff
[to #42322933 ]update docs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9316720
3 years ago
wenmeng.zwm
9f1ad5da80
fix several small problems for v0.2
* rename name of whl to modelscope
* auto install all requirements when running citest
* auto download dynamic lib for aec pipeline
* fix setup.py audio extras not set
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9297825
3 years ago
wenmeng.zwm
274cf6ffa9
[to #42362425 ] fix audio_requirement and refine quickstart, changelog doc
* make audio requirements optional
* add changelog for version v0.2
* add numpy constraint for compatibility with tensorflow1.15
* update faq
* fix nlp requiring tensorflow
* add torchvision to multimodal dependency
* bump version from 0.2.1 to 0.2.2
* add warning msg when tensorflow is not installed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9268278
3 years ago
zhangzhicheng.zzc
cf194ef6cd
[to #42322933 ] nlp preprocessor refactor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9269314
* init
* token to ids
* add model
* model forward ready
* add intent
* intent preprocessor ready
* intent success
* merge master
* test with model hub
* add flake8
* update
* update
* update
* Merge branch 'master' into nlp/space/gen
* delete file about gen
* init
* fix flake8 bug
* [to #42322933 ] init
* bug fix
* [to #42322933 ] init
* update pipeline registry info
* Merge remote-tracking branch 'origin/master' into feat/nli
* [to #42322933 ] init
* [to #42322933 ] init
* modify forward
* [to #42322933 ] init
* generation ready
* init
* Merge branch 'master' into feat/zero_shot_classification
# Conflicts:
# modelscope/preprocessors/__init__.py
* [to #42322933 ] bugfix
* [to #42322933 ] pre commit fix
* fill mask
* registry multi models on model and pipeline
* add tests
* test level >= 0
* local gen ready
* merge with master
* dialog modeling ready
* fix comments: rename and refactor AliceMindMLM; adjust pipeline
* space intent and modeling(generation) are ready
* bug fix
* add dep
* add dep
* support dst data processor
* merge with nlp/space/dst
* merge with master
* Merge remote-tracking branch 'origin' into feat/fill_mask
Conflicts:
modelscope/models/nlp/__init__.py
modelscope/pipelines/builder.py
modelscope/pipelines/outputs.py
modelscope/preprocessors/nlp.py
requirements/nlp.txt
* merge with master
* merge with master 2/2
* fix comments
* fix isort for pre-commit check
* allow params pass to pipeline's __call__ method
* Merge remote-tracking branch 'origin/master' into feat/zero_shot_classification
* merge with nli task
* merge with sentiment_classification
* merge with zero_shot_classfication
* merge with fill_mask
* merge with space
* merge with master head
* Merge remote-tracking branch 'origin' into feat/fill_mask
Conflicts:
modelscope/utils/constant.py
* fix: pipeline module_name from model_type to 'fill_mask' & fix merge bug
* unfiinished change
* fix bug
* unfinished
* unfinished
* revise modelhub dependency
* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor
* add eval() to pipeline call
* add test level
* ut run passed
* add default args
* tmp
* merge master
* all ut passed
* remove an useless enum
* revert a mis modification
* revert a mis modification
* Merge commit 'ace8af92465f7d772f035aebe98967726655f12c' into feat/nlp
* commit 'ace8af92465f7d772f035aebe98967726655f12c':
[to #42322933 ] Add cv-action-recongnition-pipeline to maas lib
[to #42463204 ] support Pil.Image for image_captioning_pipeline
[to #42670107 ] restore pydataset test
[to #42322933 ] add create if not exist and add(back) create model example Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
[to #41474818 ]fix: fix errors in task name definition
# Conflicts:
# modelscope/pipelines/builder.py
# modelscope/utils/constant.py
* Merge branch 'feat/nlp' into feat/nlp_refactor
* feat/nlp:
[to #42322933 ] Add cv-action-recongnition-pipeline to maas lib
[to #42463204 ] support Pil.Image for image_captioning_pipeline
[to #42670107 ] restore pydataset test
[to #42322933 ] add create if not exist and add(back) create model example Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
[to #41474818 ]fix: fix errors in task name definition
# Conflicts:
# modelscope/pipelines/builder.py
* fix compile bug
* refactor space
* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor
* Merge remote-tracking branch 'origin' into feat/fill_mask
* fix
* pre-commit lint
* lint file
* lint file
* lint file
* update modelhub dependency
* lint file
* ignore dst_processor temporary
* solve comment: 1. change MaskedLMModelBase to MaskedLanguageModelBase 2. remove a useless import
* recommit
* remove MaskedLanguageModel from __all__
* Merge commit '1a0d4af55a2eee69d89633874890f50eda8f8700' into feat/nlp_refactor
* commit '1a0d4af55a2eee69d89633874890f50eda8f8700':
[to #42322933 ] test level check Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
[to #42322933 ] update nlp models name in metainfo Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134657
# Conflicts:
# modelscope/metainfo.py
* update
* revert pipeline params update
* remove zeroshot
* update sequence classfication outpus
* merge with fill mask
* Merge remote-tracking branch 'origin' into feat/fill_mask
* fix
* fix flake8 warning of dst
* Merge remote-tracking branch 'origin/feat/fill_mask' into feat/nlp
* merge with master
* remove useless test.py
* Merge remote-tracking branch 'origin/master' into feat/nlp
* remove unformatted space trainer
* revise based on comment except chinease comment
* skip ci blocking
* translation pipeline
* csanmt model for translation pipeline
* update
* update
* update builder.py
* change Chinese notes of space3.0 into English
* translate chinese comment to english
* add space to metainfo
* update casnmt_translation
* update csanmt transformer
* merge with master
* update csanmt translation
* update lint
* update metainfo.py
* Update translation_pipeline.py
* Update builder.py
* fix: 1. make csanmt derived from Model 2. add kwargs to prevent from call error
* pre-commit check
* temp exclue flake8
* temp ignore translation files
* fix bug
* pre-commit passed
* fixbug
* fixbug
* revert pre commit ignorance
* pre-commit passed
* fix bug
* merge with master
* add missing setting
* merge with master
* add outputs
* modify test level
* modify chinese comment
* remove useless doc
* space outputs normalization
* Merge remote-tracking branch 'origin/master' into nlp/translation
* update translation_pipeline.py
* Merge remote-tracking branch 'origin/master' into feat/nlp
* Merge remote-tracking branch 'origin/master' into nlp/translation
* add new __init__ method
* add new __init__ method
* update output format
* Merge remote-tracking branch 'origin/master' into feat/nlp
* update output format
* merge with master
* merge with nlp/translate
* update the translation comment
* update the translation comment
* Merge branch 'nlp/translation' into feat/nlp
* Merge remote-tracking branch 'origin/master' into feat/nlp
* Merge remote-tracking branch 'origin/master' into feat/nlp
* nlp preprocessor refactor
* add get_model_type in util.hub
* update the default preprocessor args
* update the fill mask preprocessor
* bug typo fixed
3 years ago
yingda.chen
a60d675d25
[to #42322933 ]formalize test data storage
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9251871
3 years ago
yingda.chen
0260b89431
[to #42322933 ] unified output keys
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
3 years ago
huangjun.hj
31b203acfb
* [to #42322933 ] refine quick_start.md and pipeline.md
3 years ago
wenmeng.zwm
8e51a073a6
[to #42966122 ] requirements enchanment and self-host repo support
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python
example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
3 years ago
yingda.chen
6702b29e21
[to #42794773 ]rename pydataset to msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9165402
3 years ago
Yingda Chen
b6e3fd80b0
Revert "[to #42794773 ] rename pydataset to msdataset"
This reverts commit c8e2e6de0e
.
3 years ago
Yingda Chen
c8e2e6de0e
[to #42794773 ] rename pydataset to msdataset
3 years ago
jiaqi.sjq
b1490bfd7f
[to #9061073 ] feat: merge tts to master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073
* [to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* merge remote release/0.1 and fix conflict
* Merge branch 'release/0.1' into 'nls/tts'
Release/0.1
See merge request !1700968
* [Add] add tts preprocessor without requirements. finish requirements build later
* [Add] add requirements and frd submodule
* [Fix] remove models submodule
* [Add] add am module
* [Update] update am and vocoder
* [Update] remove submodule
* [Update] add models
* [Fix] fix init error
* [Fix] fix bugs with tts pipeline
* merge master
* [Update] merge from master
* remove frd subdmoule and using wheel from oss
* change scripts
* [Fix] fix bugs in am and vocoder
* [Merge] merge from master
* Merge branch 'master' into nls/tts
* [Fix] fix bugs
* [Fix] fix pep8
* Merge branch 'master' into nls/tts
* [Update] remove hparams and import configuration from kwargs
* Merge branch 'master' into nls/tts
* upgrade tf113 to tf115
* Merge branch 'nls/tts' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into nls/tts
* add multiple versions of ttsfrd
* merge master
* [Fix] fix cr comments
* Merge branch 'master' into nls/tts
* [Fix] fix cr comments 0617
* Merge branch 'master' into nls/tts
* [Fix] remove comment out codes
* [Merge] merge from master
* [Fix] fix crash for incompatible tf and pytorch version, and frd using zip file resource
* Merge branch 'master' into nls/tts
* [Add] add cuda support
3 years ago
wenmeng.zwm
201922d33d
[to #42461396 ] add git-lfs support and mv test data to git-lfs
3 years ago
wenmeng.zwm
c59833c7ee
[to #42461396 ] feat: test_level support
* add test level support
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9021354
3 years ago
yingda.chen
d7112be056
[to #42510875 ]use sphinx book theme
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9042850
3 years ago
wenmeng.zwm
67086e26f9
[to #42362932 ] feat: docker_support
* add dockerfile
* uninstall opencv-python-headless
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9020302
3 years ago
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
3 years ago
wenmeng.zwm
dd00195814
[to #42362853 ] add default model support and fix circular import
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
3 years ago
yingda.chen
0d840d519c
[to #42339763 ] move pydataset into maas_lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8974892
3 years ago
feiwu.yfw
235880f300
[to #42339763 ] merge pydataset into maas-lib
* merge pydataset to the repo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8955999
3 years ago
wenmeng.zwm
d395e9abc2
[to #42281043 ] support kwargs in pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8949062
* support kwargs in pipeline
* update develop doc with CR instruction
3 years ago
huangjun.hj
cdacbfb476
refine pipeline doc
3 years ago
yingda.chen
f8eb699f7f
refine tests and examples
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8898823
3 years ago
wenmeng.zwm
c4bfd6cced
[to #41999503 ] refine doc and requirements for linux and mac
1. refine quick start and pipeline doc
2. remove tf pytorch easynlp from requirements
3. lazy import for torch and tensorflow
4. test successfully on linux and mac intel cpu
5. update api doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8882373
3 years ago
wenmeng.zwm
25a2028b54
[to #41401401 ] modelhub and Trainer support
* add trainer interface
* add trainer script
* add model init support for pipelineadd pipeline tutorial and fix bugs
* add text classification evaluation to maas lib
* add quickstart and prepare env doc
* relax requirements for torch and sentencepiece
* merge release/0.1 and fix conflict
* modelhub support for model and pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
3 years ago
yingda.chen
043e498e01
refactor doc build and fix some typos
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8819462
3 years ago
wenmeng.zwm
cb416edc2a
[to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8810524
3 years ago
wenmeng.zwm
db4a8be9c5
[to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
3 years ago