yingda.chen
a60d675d25
[to #42322933 ]formalize test data storage
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9251871
3 years ago
zhangzhicheng.zzc
e691585e15
[to #42322933 ]添加nlp translation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9198181
3 years ago
Yingda Chen
059c8fd248
[to #42322933 ] do not run imagen on gated for now
3 years ago
xuangen.hlh
62f1e76ff8
[to #42322933 ] Add cv_imagen_text-to-image-synthesis_tiny to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9242667
3 years ago
zhangzhicheng.zzc
5b98cc1513
[to #42322933 ]新增:nli,sentiment_classification,dialog_intent,dialog_modeling
添加了,nli,sentiment_classification, dialog_intent, dialog_modeling几个pipeline。同时加入了nlp里面sequence classification一些简单的抽象。
去掉了zero_shot_classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159089
3 years ago
yingda.chen
0260b89431
[to #42322933 ] unified output keys
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
3 years ago
huangjun.hj
31b203acfb
* [to #42322933 ] refine quick_start.md and pipeline.md
3 years ago
wenmeng.zwm
bb57020daa
[to #42362425 ] remove add module to default group

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9229852
3 years ago
wenmeng.zwm
8e51a073a6
[to #42966122 ] requirements enchanment and self-host repo support
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python
example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
3 years ago
yingda.chen
9c72c06e0b
[to #42322933 ] merge hub api for model and dataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9233644
3 years ago
shichen.fsc
40cb1043b8
[to #42322933 ] add customized keywords setting for KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9200613
* [Add] add KWS code
* [Fix] fix kws warning
* [Add] add ROC for KWS
* [Update] add some code check
* [Update] refactor kws code, bug fix
* [Add] add customized keywords setting for KWS
* [Add] add data/test/audios for KWS
3 years ago
yichang.zyc
12cc394a95
[to #42322933 ] use gpu when available
ofa/caption 增加feature, 如果有gpu默认使用gpu
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9228113
3 years ago
yanheng.wyh
5fc8b3c9ab
[to #42322933 ] upate animal recognition model name
3 years ago
hemu.zp
a03106172f
[to #42322933 ] Update sofa version 1.0.4.2
更新 sofa 到 1.0.4.2 版本,解决 palm 模型无法并行的 bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9217921
3 years ago
mulin.lyh
c2ae3de640
[to #42879757 #42887254 ]fix: Repository initialize lfs after clone, add download times counter
Repository在clone后执行 git lfs install初始化lfs支持,下载技术添加到header里
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9204291
* [to #42879757 #42887254 ]fix: Repository initialize lfs after clone, add download times counter
3 years ago
mulin.lyh
0264b25a60
[to #42322933 ]modify to new ip
修改为新的服务ip
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9217420
* modify modelhub datahub to new ip, fix image-caption case bug
3 years ago
hemu.zp
fabea5604e
[to #42322933 ] Add MPLUG model
添加 MPLUG 模型的 visual question answering 任务 pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9182119
3 years ago
zhangzhicheng.zzc
576b7cffb1
[to #42322933 ] add pipeline params for preprocess and forward & zeroshot classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9180863
3 years ago
wenmeng.zwm
1cb2fa850f
[to #42362425 ] update version with 0.2.1
3 years ago
mulin.lyh
0d17eb5b39
[to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011 ]fix: bug test bugs
修复测试bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9186775
* [to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011 ]fix: test bugs
3 years ago
feiwu.yfw
5da470fd5d
[to #42791465 , #42779255 , #42777959 , #42757844 , #42756050 , #42746916 , #42743595 , #42791863 ] fix: fix msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9174075
* fix msdataset
3 years ago
bin.xue
04b7eba285
[to #42322933 ] Merge ANS pipeline into master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9178339
* refactor: move aec models to audio/aec
* refactor: move aec models to audio/aec
* refactor: move aec models to audio/aec
* refactor: move aec models to audio/aec
* feat: add unittest for ANS pipeline
* Merge branch 'master' into dev/ans
* add new SoundFile to audio dependency
* Merge branch 'master' into dev/ans
* use ANS pipeline name from metainfo
* Merge branch 'master' into dev/ans
* chore: update docstring of ANS module
* Merge branch 'master' into dev/ans
* refactor: use names from metainfo
* refactor: enable ans unittest
* refactor: add more log message in unittest
3 years ago
suluyan.sly
a7c1cd0fc9
[to #42322933 ]feat: add nlp-chinese-bert-fill-mask-pipeline to maas_lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9155437
3 years ago
yanheng.wyh
664de39b79
[to #42322933 ]animal recognation model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9126742
* animal recognation model
* update codes
* delet file
* f
* pre commits
* revise
* fix last comment
* fix comments
* fix precommit
* fix comments
* Merge remote-tracking branch 'origin' into cv/animalRecog
* fix comments
3 years ago
xixing.tj
d4692b5ada
[to #42322933 ]Merge branch 'master' into ocr/ocr_detection
修复master分支ocr_detection 单元测试bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9112290
* create ocr_detection task
* fix code check error
* fix code check error
* fix code check issue
* fix code check issue
* replace c++ nms with python version
* fix code check issue
* fix code check issue
* rename maas_lib
* merge master to ocr/ocr_detection
* add model_hub sup for ocr_detection
* fix bug
* replace c++ decoder with python version
* fix bug
* Merge branch 'master' into ocr/ocr_detection
* merge master
* fix code check
* update
* add requirements for ocr_detection
* fix model_hub fetch bug
* remove debug code
* Merge branch 'master' into ocr/ocr_detection
* add local test image for ocr_detection
* update requirements for model_hub
* Merge branch 'master' into ocr/ocr_detection
* fix bug for full case test
* remove ema for ocr_detection
* Merge branch 'master' into ocr/ocr_detection
* apply ocr_detection test case
* Merge branch 'master' into ocr/ocr_detection
* update slim dependency for ocr_detection
* add more test case for ocr_detection
* release tf graph before create
* recover ema for ocr_detection model
* fix code
* Merge branch 'master' into ocr/ocr_detection
* fix code
3 years ago
Yingda Chen
cfeac7afd8
[to #42322933 ] skip aec test
3 years ago
shichen.fsc
5386748bc4
[to #42322933 ] add some code check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9122842
* [Add] add KWS code
* [Update] check code linters and formatter
* [Update] update kws code
* Merge branch 'master' into dev/kws
* [Fix] fix kws warning
* [Add] add ROC for KWS
* [Update] add some code check
* feat: Fix confilct, auto commit by WebIDE
* feat: Fix confilct, auto commit by WebIDE
* Merge branch 'master' into dev/kws
* [Update] refactor kws code
* [Update] refactor kws code
* [Update] refactor kws code, bug fix
* [Update] refactor kws code, bug fix
3 years ago
eniac.xcw
9ff6b704b0
[to #42322933 ]add multi-modal-feature
增加中文图文特征模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9157786
* add multi-modal-feature
* 修改code review中的问题
3 years ago
yingda.chen
6702b29e21
[to #42794773 ]rename pydataset to msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9165402
3 years ago
Yingda Chen
b6e3fd80b0
Revert "[to #42794773 ] rename pydataset to msdataset"
This reverts commit c8e2e6de0e
.
3 years ago
Yingda Chen
c8e2e6de0e
[to #42794773 ] rename pydataset to msdataset
3 years ago
yingda.chen
0acbfe1663
[to #42322933 ] interface refine with doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159678
3 years ago
mulin.lyh
6991620f59
[to #42698276 ]fix: git repo operations supports, gitlab token certification support.
3 years ago
jiaqi.sjq
4a3f22259f
* Relax version requirements in audio.txt
* Fix bugs in ttsfrd which may cause text-to-speech break disappear and upgrade it to version 0.0.2
* other fix to make ut pass
3 years ago
yingda.chen
e7571a566f
[to #42322933 ] skip dataset test for now
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9155405
3 years ago
suluyan.sly
0286dd45cc
[to #42322933 ] Add nlp-structbert/veco-fill-mask-pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9069107
3 years ago
yingda.chen
1a0d4af55a
[to #42322933 ] test level check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
3 years ago
zhangzhicheng.zzc
371530ed1d
[to #42322933 ] update nlp models name in metainfo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134657
3 years ago
yongfei.zyf
ace8af9246
[to #42322933 ] Add cv-action-recongnition-pipeline to maas lib
达摩行为识别合入maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134444
3 years ago
lingcai.wl
2019315c54
[to #42463204 ] support Pil.Image for image_captioning_pipeline
3 years ago
feiwu.yfw
b8ba35bd27
[to #42670107 ] restore pydataset test
* pydataset unitest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9132896
3 years ago
yingda.chen
8400ca1fc7
[to #42322933 ] add create if not exist and add(back) create model example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
3 years ago
luoyiyun.lyy
849410e107
[to #41474818 ]fix: fix errors in task name definition
修改constant.py中task name定义的错误
- sentence-similarity重复定义
- fill-mask多加了一个空格
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9125956
* [to #41474818 ]fix: fix errors in task name definition
3 years ago
wenmeng.zwm
e288cf076e
[to #42362853 ] refactor pipeline and standardize module_name
* using get_model to validate hub path
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
3 years ago
mulin.lyh
76c6ff6329
[to #42675838 ]merge model hub code
合并model hub 代码
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
3 years ago
zhangzhicheng.zzc
7a175ee9b3
[to #42322933 ]move tts dependency to local
requirements/audio.txt
中依赖存在两个问题:
1. torch/tensorflow版本写死
2. 两个whl包是linux环境下才可安装,进而whl包安装的package要在mac上忽略的话,代码中必须把相应package放到local中引用
上面两个问题在linux环境中的测试用例是可以通过的。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9103904
* move tts dependency to local
3 years ago
xixing.tj
968e660235
[to #42322933 ] create ocr_detection task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8967432
* create ocr_detection task
* replace c++ nms with python version
* replace c++ decoder with python version
* add requirements for ocr_detection
3 years ago
yichang.zyc
a2cf3d619e
[to #42322933 ]update ofa caption model
将caption pipeline的实现从pipeline下沉到model,并拆解preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9081211
* [to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* upload ofa for caption(with source code but not whl)
* remove data in gitignore
* append uncommitted data dir in ofa
* remove ofa_dir , use ofa.whl instead.
* update BPE
* rollback changes used in debugging.
* Merge branch 'master' into ofa/image_caption
# Conflicts:
# docs/README.md
# docs/source/conf.py
# docs/source/index.rst
# docs/source/tutorials/pipeline.md
# maas_lib/models/nlp/sequence_classification_model.py
# maas_lib/pipelines/builder.py
# maas_lib/version.py
# setup.py
# tests/pipelines/test_text_classification.py
* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.
* 1. rename test_image_captioning.py.
* format all files using pre-commit.
* add fairseq in requirements.txt
* add fairseq in requirements.txt
* change fairseq path to git repo to a whl on oss in ofa.txt.
* change module_name to 'ofa'
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/builder.py
* optim requirements for ofa / refine image_captioning.py
* uncommited change.
* feat: Fix confilct, auto commit by WebIDE
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/multi_modal/__init__.py
# modelscope/pipelines/multi_modal/image_captioning.py
# tests/pipelines/test_image_captioning.py
* merge master
* merge master
* merge master
* rename
* Merge remote-tracking branch 'origin/master' into ofa/nlu
* add caption model
* Merge remote-tracking branch 'origin/master' into ofa/nlu
* update ofa caption model
* fix some typo, update unittest
* use local test image
* use local test image
* refactor, ofa -> multi_model
* merge master
* 删除 image_caption_pipeline.py
3 years ago
feiwu.yfw
c7238a470b
[to #42670107 ]pydataset fetch data from datahub
* pydataset fetch data from datahub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9060856
3 years ago
bin.xue
97a0087976
[to #42322933 ]语音使用local import避免其他任务加载torchaudio
feat: local import torchaudio
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9097950
* feat: local import torchaudio
3 years ago