Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
5,225 Commits 32 Branches 59 Tags
9b267a435e0aa1dfdff211d1a5b668538c51cd35
Commit Graph
8 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Bobby Wang 9d2832a3a3 fix potential TaskFailedListener's callback won't be called (#6612) 
there is possibility that onJobStart of TaskFailedListener won't be called, if
the job is submitted before the other thread adds addSparkListener.

detail can be found at https://github.com/dmlc/xgboost/pull/6019#issuecomment-760937628
 2021-01-21 14:20:32 +08:00
Bobby Wang 00b0ad1293 [Doc] add doc for kill_spark_context_on_worker_failure parameter (#6097) 
* [Doc] add doc for kill_spark_context_on_worker_failure parameter

* resolve comments
 2020-09-09 21:28:44 -07:00
Bobby Wang 0e2d5669f6 [jvm-packages] cancel job instead of killing SparkContext (#6019) 
* cancel job instead of killing SparkContext

This PR changes the default behavior that kills SparkContext. Instead, This PR
cancels jobs when coming across task failed. That means the SparkContext is
still alive even some exceptions happen.

* add a parameter to control if killing SparkContext

* cancel the jobs the failed task belongs to

* remove the jobId from the map when one job failed.

* resolve comments
 2020-09-02 14:20:59 -07:00
Bobby WangandHyunsu Cho 8943eb4314 [BLOCKING] [jvm-packages] add gpu_hist and enable gpu scheduling (#5171) 
* [jvm-packages] add gpu_hist tree method

* change updater hist to grow_quantile_histmaker

* add gpu scheduling

* pass correct parameters to xgboost library

* remove debug info

* add use.cuda for pom

* add CI for gpu_hist for jvm

* add gpu unit tests

* use gpu node to build jvm

* use nvidia-docker

* Add CLI interface to create_jni.py using argparse

Co-authored-by: Hyunsu Cho <chohyu01@cs.washington.edu>
 2020-07-26 21:53:24 -07:00
Bobby WangandPhilip Hyunsu Cho 730866a7bc [CI] update spark version to 3.0.0 (#5890) 
* [CI] update spark version to 3.0.0

* Update Dockerfile.jvm_cross

Co-authored-by: Philip Hyunsu Cho <chohyu01@cs.washington.edu>
 2020-07-16 00:23:44 -07:00
Bobby Wang 9f85e92602 [jvm-packages] update spark dependency to 3.0.0 (#5836) 2020-07-12 20:58:30 -07:00
Bobby Wangandfis ad826e913f [jvm-packages]add feature size for LabelPoint and DataBatch (#5303) 
* fix type error

* Validate number of features.

* resolve comments

* add feature size for LabelPoint and DataBatch

* pass the feature size to native

* move feature size validating tests into a separate suite

* resolve comments

Co-authored-by: fis <jm.yuan@outlook.com>
 2020-04-07 16:49:52 -07:00
Bobby 3e2c472944 Fix model parameter recovery (#4738) 2019-08-07 02:32:10 -04:00