History

tqchen 1e56ba86d9 Squashed 'subtree/rabit/' changes from fed1683..e1ddcc2

e1ddcc2 Merge branch 'master' of ssh://github.com/dmlc/rabit
6745667 new dmlc io
c5b4610 sge scheduler change

git-subtree-dir: subtree/rabit
git-subtree-split: e1ddcc2eb70f4a3e34c6c1b67b4d9671bfe62b97

2015-04-27 15:58:57 -07:00

rabit_demo.py

Squashed 'subtree/rabit/' changes from 091634b..59e63bc

2015-03-21 00:44:31 -07:00

rabit_hadoop_streaming.py

Squashed 'subtree/rabit/' changes from 091634b..59e63bc

2015-03-21 00:44:31 -07:00

rabit_mpi.py

Squashed 'subtree/rabit/' changes from 091634b..59e63bc

2015-03-21 00:44:31 -07:00

rabit_sge.py

Squashed 'subtree/rabit/' changes from fed1683..e1ddcc2

2015-04-27 15:58:57 -07:00

rabit_tracker.py

Squashed 'subtree/rabit/' changes from 59e63bc..eb1f4a4

2015-03-26 23:33:41 -07:00

rabit_yarn.py

Squashed 'subtree/rabit/' changes from 091634b..59e63bc

2015-03-21 00:44:31 -07:00

README.md

Squashed 'subtree/rabit/' changes from 091634b..59e63bc

2015-03-21 00:44:31 -07:00

README.md

Trackers

This folder contains tracker scripts that can be used to submit yarn jobs to different platforms, the example guidelines are in the script themselfs

Supported Platforms

Local demo: rabit_demo.py
MPI: rabit_mpi.py
Yarn (Hadoop): rabit_yarn.py
- It is also possible to submit via hadoop streaming with rabit_hadoop_streaming.py
- However, it is higly recommended to use rabit_yarn.py because this will allocate resources more precisely and fits machine learning scenarios
Sun Grid engine: rabit_sge.py