PKU-DAIR
/
Hetu
Not watched
1
0
Fork 0
Code
Releases 0 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
Tree: e0fd6f3fc7
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'e0fd6f3fc7'
${ noResults }
Hetu/examples/runner/parallel/README.md

1.1 kB
Raw Blame History

Usage

  • Complex Pipeline Parallel (not using heturun):
mpirun --allow-run-as-root --tag-output -np 8 python complex_pipeline_mlp.py
  • Simple Pipeline Parallel:
heturun -c config8.yml python simple_pipeline_mlp.py
  • Data + Pipeline Parallel:
heturun -c config8.yml python data_pipeline_mlp.py
  • Multiple Machine Data + Pipeline Parallel:
heturun -c dist_config8.yml python dist_data_pipeline_mlp.py
  • Test Model Parallel (the following commands should give the same results):
heturun -c config3.yml python test_model_mlp_base.py --save
heturun -c config4.yml python test_model_mlp.py --split left
heturun -c config4.yml python test_model_mlp.py --split right
heturun -c config4.yml python test_model_mlp.py --split middle
  • Data + Model (+ Pipeline) Parallel:
heturun -c config8.yml python data_model_pipeline_mlp.py --split left
heturun -c config8.yml python data_model_pipeline_mlp.py --split right
heturun -c config8.yml python data_model_pipeline_mlp.py --split middle