Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[CI] Refactor Jenkins CI pipeline + migrate all Linux tests to Jenkins (#4401)

Browse Source 
* All Linux tests are now in Jenkins CI
* Tests are now de-coupled from builds. We can now build XGBoost with one version of CUDA/JDK and test it with another version of CUDA/JDK
* Builds (compilation) are significantly faster because 1) They use C5 instances with faster CPU cores; and 2) build environment setup is cached using Docker containers
This commit is contained in:
Philip Hyunsu Cho
2019-04-26 18:39:12 -07:00
committed by GitHub
parent 995698b0cb
commit ea850ecd20
35 changed files with 1046 additions and 585 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
tests/distributed/runtests-gpu.sh
View File

@@ -3,7 +3,6 @@
rm -f *.model*
export DMLC_SUBMIT_CLUSTER=local
export PYTHONPATH=../../python-package
submit="timeout 30 python ../../dmlc-core/tracker/dmlc-submit"
echo -e "\n ====== 1. Basic distributed-gpu test with Python: 4 workers; 1 GPU per worker ====== \n"

12
tests/distributed/runtests.sh
View File

@@ -1,9 +1,13 @@
#!/bin/bash
rm -f *.model*
export DMLC_SUBMIT_CLUSTER=local
submit="timeout 30 python ../../dmlc-core/tracker/dmlc-submit"
echo "====== 1. Basic distributed test with Python ======"
PYTHONPATH=../../python-package/ python ../../dmlc-core/tracker/dmlc-submit --cluster=local --num-workers=3\
python test_basic.py
$submit --cluster=local --num-workers=3 python test_basic.py
echo "====== 2. Regression test for issue #3402 ======"
PYTHONPATH=../../python-package/ python ../../dmlc-core/tracker/dmlc-submit --cluster=local --num-workers=2 --worker-cores=1\
python test_issue3402.py
$submit --cluster=local --num-workers=2 --worker-cores=1 python test_issue3402.py