Boris
a01df102c9
Scala 2.13 support. ( #9099 )
...
1. Updated the test logic
2. Added smoke tests for Spark examples.
3. Added integration tests for Spark with Scala 2.13
2023-05-27 19:34:02 +08:00
Bobby Wang
e8c1eb99e4
[jvm-package] Clean up the legacy gpu support tests ( #7523 )
2021-12-21 09:15:51 +08:00
Philip Hyunsu Cho
c991eb612d
[jvm-packages] Fix up build for xgboost4j-gpu, xgboost4j-spark-gpu ( #6216 )
...
* [CI] Clean up build for JVM packages
* Use correct path for saving native lib
* Fix groupId of maven-surefire-plugin
* Fix stashing of xgboost4j_jar_gpu
* [CI] Don't run xgboost4j-tester with GPU, since it doesn't use gpu_hist
2020-10-09 14:08:15 -07:00
Bobby Wang
8943eb4314
[BLOCKING] [jvm-packages] add gpu_hist and enable gpu scheduling ( #5171 )
...
* [jvm-packages] add gpu_hist tree method
* change updater hist to grow_quantile_histmaker
* add gpu scheduling
* pass correct parameters to xgboost library
* remove debug info
* add use.cuda for pom
* add CI for gpu_hist for jvm
* add gpu unit tests
* use gpu node to build jvm
* use nvidia-docker
* Add CLI interface to create_jni.py using argparse
Co-authored-by: Hyunsu Cho <chohyu01@cs.washington.edu>
2020-07-26 21:53:24 -07:00
Chen Qin
b29b8c2f34
[jvm-packages] update rabit, surface new changes to spark, add parity and failure tests ( #4966 )
...
* [phase 1] expose sets of rabit configurations to spark layer
* add back mutable import
* disable ring_mincount till https://github.com/dmlc/rabit/pull/106d
* Revert "disable ring_mincount till https://github.com/dmlc/rabit/pull/106d "
This reverts commit 65e95a98e24f5eb53c6ba9ef9b2379524258984d.
* apply latest rabit
* fix build error
* apply https://github.com/dmlc/xgboost/pull/4880
* downgrade cmake in rabit
* point to rabit with DMLC_ROOT fix
* relative path of rabit install prefix
* split rabit parameters to another trait
* misc
* misc
* Delete .classpath
* Delete .classpath
* Delete .classpath
* Update XGBoostClassifier.scala
* Update XGBoostRegressor.scala
* Update GeneralParams.scala
* Update GeneralParams.scala
* Update GeneralParams.scala
* Update GeneralParams.scala
* Delete .classpath
* Update RabitParams.scala
* Update .gitignore
* Update .gitignore
* apply rabitParams to training
* use string as rabit parameter value type
* cleanup
* add rabitEnv check
* point to dmlc/rabit
* per feedback
* update private scope
* misc
* update rabit
* add rabit_timtout, fix failing test.
* split tests
* allow build jvm with rabit mock
* pass mock failures to rabit with test
* add mock error and graceful handle rabit assertion error test
* split mvn test
* remove sign for test
* update rabit
* build jvm_packages with rabit mock
* point back to dmlc/rabit
* per feedback, update scala header
* cleanup pom
* per feedback
* try fix lint
* fix lint
* per feedback, remove bootstrap_cache
* per feedback 2
* try replace dev profile with passing mvn property
* fix build error
* remove mvn property and replace with env setting to build test jar
* per feedback
* revert copyright headlines, point to dmlc/rabit
* revert python lint
* remove multiple failure test case as retry is not enabled in spark
* Update core.py
* Update core.py
* per feedback, style fix
2019-11-01 14:21:19 -07:00
Jiaming Yuan
010b8f1428
Revert "[jvm-packages] update rabit, surface new changes to spark, add parity and failure tests ( #4876 )" ( #4965 )
...
This reverts commit 86ed01c4bbecef66e1bc4d02fb13116bd6130fae.
2019-10-18 14:02:35 -07:00
Chen Qin
86ed01c4bb
[jvm-packages] update rabit, surface new changes to spark, add parity and failure tests ( #4876 )
...
* Expose sets of rabit configurations to spark layer
2019-10-18 15:07:31 -04:00
Philip Hyunsu Cho
6ff994126a
[BLOCKING][CI] Upgrade to Spark 2.4.3 ( #4414 )
...
* [CI] Upgrade to Spark 2.4.2
* Pass Spark version to build script
* Allow multiple --build-arg in ci_build.sh
* Fix syntax
* Fix container name
* Update pom.xml
* Fix container name
* Update Jenkinsfile
* Update pom.xml
* Update Dockerfile.jvm_cross
2019-05-09 21:36:59 -07:00
Nan Zhu
37dc82c3ff
[jvm-packages] allow partial evaluation of dataframe before prediction ( #4407 )
...
* allow partial evaluation of dataframe before prediction
* resume spark test
* comments
* Run unit tests after building JVM packages
2019-04-26 21:02:40 -07:00
Philip Hyunsu Cho
ea850ecd20
[CI] Refactor Jenkins CI pipeline + migrate all Linux tests to Jenkins ( #4401 )
...
* All Linux tests are now in Jenkins CI
* Tests are now de-coupled from builds. We can now build XGBoost with one version of CUDA/JDK and test it with another version of CUDA/JDK
* Builds (compilation) are significantly faster because 1) They use C5 instances with faster CPU cores; and 2) build environment setup is cached using Docker containers
2019-04-26 18:39:12 -07:00
