luopengting
57c09cc2bd
print error level message one time when failed
Change the error level of the error message, fill the detail message
when parsing failed, like crc failed.
Save the lineage_parsing when parsing failed. Because it can save the
cached status, it will skip the failed files when reloading.
As a result, it will keep the failed lineage_parser. When the diretory
is deleted, it will be deleted. But it can help print the failed message
only one time.
5 years ago
luopengting
0f37c8135e
add cli, validation and st:
1. add cli entry
2. add more validation for hyper config
3. add validator for config dict
4. add st for optimizer config validator
5. add custom lineage for hyper config
5 years ago
luopengting
fb4c150e56
add auto-tune framework, add validation for hyper_config
5 years ago
mindspore-ci-bot
b71dce4c6c
!736 add UT for lineagemgr
Merge pull request !736 from shenghong96/ut_lineage
5 years ago
shenghong
b530318118
add UT for test_validate function
5 years ago
luopengting
51d779585c
add annotations for __init__.py
5 years ago
luopengting
f67e68897a
remove redundant code in lineagemgr
5 years ago
luopengting
b9c978830a
clean redundant code after removing lineage public APIs:
1. clean redundant code in lineage parsing and querier
2. delete get_summary_lineage()
3. modify related st and ut to use data_manager
5 years ago
luopengting
f54d57cd06
modify http_code to 400 in lineagemgr, move deprecated exceptions to tests
5 years ago
mindspore-ci-bot
ae5899ed70
!657 add filter operation 'not_in' in lineagemgr
Merge pull request !657 from luopengting/lineage_not_in
5 years ago
luopengting
1d8038f680
add filter operation 'not_in' in lineage
5 years ago
Li Hongzhang
726c0b9fda
fix the impl of get_flatten_lineage
5 years ago
luopengting
b0d3da8415
modify names of some variables and functions, modify some level of log
5 years ago
luopengting
b274c774ed
add optimizer:
1. add functions for calculating target buckets and params importances
2. add restful api for target buckets, importances and metadata
5 years ago
shenghong
24b1887502
add the function of get_lineage_table
5 years ago
Li Hongzhang
4b1524883a
remove lineage public APIs
5 years ago
luopengting
f1622f687c
update the update_time in super_llineage_obj if update_time is changed
5 years ago
luopengting
8d52598d76
modify lineage log in parsing
5 years ago
luopengting
f92e47b943
fix lineage parsing, parse next summary when there is an Exception
5 years ago
luopengting
9e6f852c5d
delete lineage cache when parse failed
5 years ago
Li Hongzhang
7ce9f9bd58
remove TrainLineage, EvalLineage and related ut/st
5 years ago
luopengting
4ba0cea84a
modify log level in lineage
5 years ago
luopengting
c72ec7733d
collect user_defined info in train and eval
5 years ago
mindspore-ci-bot
d3c72c1527
!178 lineagemgr: fix EvalLineage comments
Merge pull request !178 from kouzhenzhong/fix_comments_r0.3
5 years ago
luopengting
1917c5499a
remove invalid item in user_defined info, record valid items
5 years ago
kouzhenzhong
2987095107
lineagemgr: fix EvalLineage comments
5 years ago
luopengting
bd65d62e55
fix lineage collection for network, loss_fn and dataset path
5 years ago
luopengting
f6f80fae64
fix calculation of lineage dataset_num, get model name
5 years ago
kouzhenzhong
13030f75fc
lineage: decouple train/eval lineage with summary_writer
5 years ago
luopengting
98ec661b81
clean lineage when train lineage comes in, add st cases for lineage cache
5 years ago
mindspore-ci-bot
f379b2046f
!133 add sorting and checking for added_info
Merge pull request !133 from luopengting/lineage_added_info
5 years ago
luopengting
a139906e75
add checking for added_info, support sorting by tag
5 years ago
luopengting
665f2d680a
modify lineage parsing for multi lineage files, modify ut/st
5 years ago
luopengting
6963af9374
add lineage cache, add update method and put api, modify ut/st
5 years ago
wenkai
7e17d6ffae
refactor data manager and unify cache and data access/reload
5 years ago
mindspore-ci-bot
c79adb4dba
!85 Set operation as 'None' when it is empty or None
Merge pull request !85 from luopengting/lineage_record
5 years ago
luopengting
8f1bb3269f
set operation as None when it is empty or None
5 years ago
luopengting
32cea0e78e
add mixed type for customized
5 years ago
mindspore-ci-bot
4c22ac761d
!67 optimize comments
Merge pull request !67 from wenkai/wk0422_3
5 years ago
wenkai
0e888c0377
optimize comments
5 years ago
luopengting
009fc84d6a
add annotation and validation for device_num
5 years ago
mindspore-ci-bot
5a6d934aad
!65 add device_num for model_lineage.
Merge pull request !65 from luopengting/lineage_device_num
5 years ago
luopengting
c107297956
add device_num
5 years ago
mindspore-ci-bot
e63cc72135
!60 lineagemgr: user defined error not affect other lineage information record when not raise exception in lineage callback
Merge pull request !60 from kouzhenzhong/user_defined_bug_fix
5 years ago
kouzhenzhong
10003c2e19
lineagemgr: user defined error not affect other infos record when not raise exception in lineage callback
5 years ago
luopengting
65b0146627
fix pylint, catch Exception for parsing summary
5 years ago
luopengting
670bc72017
enhance validation for cmp operation, set user-difined' required value as False
5 years ago
mindspore-ci-bot
29753ba712
!30 merge restful api: model_lineage and dataset_lineage
Merge pull request !30 from luopengting/linkage
5 years ago
luopengting
2ddb2b9ce6
merge model_lineage and dataset_lineage, modify/add st and ut for lineage api
5 years ago
kouzhenzhong
7d4b8bfd36
lineamgr: fix user defined related comments
5 years ago