Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
Hsword
7fd3de80ce
|
4 years ago | |
|---|---|---|
| .. | ||
| README.md | 4 years ago | |
| complex_pipeline_mlp.py | 4 years ago | |
| config3.yml | 4 years ago | |
| config4.yml | 4 years ago | |
| config8.yml | 4 years ago | |
| data_model_pipeline_mlp.py | 4 years ago | |
| data_pipeline_mlp.py | 4 years ago | |
| dist_config8.yml | 4 years ago | |
| dist_data_pipeline_mlp.py | 4 years ago | |
| simple_pipeline_mlp.py | 4 years ago | |
| test_model_mlp.py | 4 years ago | |
| test_model_mlp_base.py | 4 years ago | |
README.md
Usage
- Complex Pipeline Parallel (not using heturun):
mpirun --allow-run-as-root --tag-output -np 8 python complex_pipeline_mlp.py
- Simple Pipeline Parallel:
heturun -c config8.yml python simple_pipeline_mlp.py
- Data + Pipeline Parallel:
heturun -c config8.yml python data_pipeline_mlp.py
- Multiple Machine Data + Pipeline Parallel:
heturun -c dist_config8.yml python dist_data_pipeline_mlp.py
- Test Model Parallel (the following commands should give the same results):
heturun -c config3.yml python test_model_mlp_base.py --save
heturun -c config4.yml python test_model_mlp.py --split left
heturun -c config4.yml python test_model_mlp.py --split right
heturun -c config4.yml python test_model_mlp.py --split middle
- Data + Model (+ Pipeline) Parallel:
heturun -c config8.yml python data_model_pipeline_mlp.py --split left
heturun -c config8.yml python data_model_pipeline_mlp.py --split right
heturun -c config8.yml python data_model_pipeline_mlp.py --split middle
分布式深度学习系统
Python C++ Cuda C CMake other