Files

tqchen 4c060df2f1 Squashed 'subtree/rabit/' changes from 28ca7be..d558f6f

d558f6f redefine distributed means
c8efc01 more complicated yarn script

git-subtree-dir: subtree/rabit
git-subtree-split: d558f6f550

2015-03-09 14:44:42 -07:00

rabit_demo.py

2015-03-09 13:28:38 -07:00

rabit_hadoop_streaming.py

2015-03-09 13:28:38 -07:00

rabit_mpi.py

2015-03-09 13:28:38 -07:00

rabit_tracker.py

2015-03-09 13:28:38 -07:00

rabit_yarn.py

2015-03-09 14:44:42 -07:00

README.md

2015-03-09 13:28:38 -07:00

Trackers

This folder contains tracker scripts that can be used to submit yarn jobs to different platforms, the example guidelines are in the script themselfs

Supported Platforms

Local demo: rabit_demo.py
MPI: rabit_mpi.py
Yarn (Hadoop): rabit_yarn.py
- It is also possible to submit via hadoop streaming with rabit_hadoop_streaming.py
- However, it is higly recommended to use rabit_yarn.py because this will allocate resources more precisely and fits machine learning scenarios