Jiaming Yuan
b8c6b86792
Bump version to 1.7.5. ( #8994 )
2023-03-29 21:41:10 +08:00
Jiaming Yuan
36ad160501
Bump version to 1.7.4. ( #8805 )
2023-02-16 06:40:01 +08:00
Jiaming Yuan
dd58c2ac47
Bump version to 1.7.3. ( #8646 )
2023-01-06 17:55:51 +08:00
Jiaming Yuan
575fba651b
[backport] [CI] Fix CI with updated dependencies. ( #8631 ) ( #8635 )
2023-01-05 19:10:58 +08:00
Jiaming Yuan
62ed8b5fef
Bump release version to 1.7.2. ( #8569 )
2022-12-08 21:46:26 +08:00
Robert Maynard
9372370dda
Work with newer thrust and libcudacxx ( #8432 )
...
* Thrust 1.17 removes the experimental/pinned_allocator.
When xgboost is brought into a large project it can
be compiled against Thrust 1.17+ which don't offer
this experimental allocator.
To ensure that going forward xgboost works in all environments we provide a xgboost namespaced version of
the pinned_allocator that previously was in Thrust.
* Update gputreeshap to work with libcudacxx 1.9
2022-11-11 01:15:25 +08:00
Philip Hyunsu Cho
534c940a7e
Release 1.7.1 ( #8413 )
...
* Release 1.7.1
* Review comment
2022-11-03 15:37:54 -07:00
Hyunsu Cho
4bc59ef7c3
Release 1.7
2022-10-31 10:53:07 -07:00
Jiaming Yuan
7cf58a2c65
Make 1.7.0rc1. ( #8365 )
2022-10-20 12:01:18 +08:00
Rong Ou
668b8a0ea4
[Breaking] Switch from rabit to the collective communicator ( #8257 )
...
* Switch from rabit to the collective communicator
* fix size_t specialization
* really fix size_t
* try again
* add include
* more include
* fix lint errors
* remove rabit includes
* fix pylint error
* return dict from communicator context
* fix communicator shutdown
* fix dask test
* reset communicator mocklist
* fix distributed tests
* do not save device communicator
* fix jvm gpu tests
* add python test for federated communicator
* Update gputreeshap submodule
Co-authored-by: Hyunsu Philip Cho <chohyu01@cs.washington.edu>
2022-10-05 14:39:01 -08:00
Jiaming Yuan
f835368bcf
Mark next release as 1.7 instead of 2.0 ( #8281 )
2022-09-28 14:33:37 +08:00
Bobby Wang
8d247f0d64
[jvm-packages] fix spark-rapids compatibility issue ( #8240 )
...
* [jvm-packages] fix spark-rapids compatibility issue
spark-rapids (from 22.10) has shimmed GpuColumnVector, which means
we can't call it directly. So this PR call the UnshimmedGpuColumnVector
2022-09-22 23:31:29 +08:00
Rong Ou
7d43e74e71
JNI wrapper for the collective communicator ( #8242 )
2022-09-21 04:20:25 +08:00
dependabot[bot]
93966b0d19
Bump hadoop-common from 3.2.3 to 3.2.4 in /jvm-packages/xgboost4j-flink ( #8157 )
...
Bumps hadoop-common from 3.2.3 to 3.2.4.
---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-15 06:47:27 -08:00
Bobby Wang
a68580e2a7
[jvm-packages] fix executor crashing issue when transforming on xgboost4j-spark-gpu ( #8025 )
...
* [jvm-packages] fix executor crashing issue when transforming on xgboost4j-spark-gpu
the API XGBoosterSetParam is not thread-safe. Dring the phase of transforming,
XGBoost runs several transforming tasks at a time, and each of them will set
the "gpu_id" and "predictor" parameters, so if several tasks (multi-threads)
all XGBoosterSetParam simultaneously, it may cause the memory to be corrupted
and cause SIGSEGV.
This PR first get the booster from broadcast and set to the correct gpu_id
and predictor, and then all transforming taskes will use the same booster to
do the transforming.
2022-06-24 01:18:41 +08:00
Rong Ou
e5ec546da5
[Breaking] Remove rabit support for custom reductions and grow_local_histmaker updater ( #7992 )
2022-06-21 15:08:23 +08:00
Jiaming Yuan
bb47fd8c49
[jvm-packages] Change log level for tracker message. ( #7968 )
2022-06-09 18:15:08 +08:00
Bobby Wang
78694405a6
[jvm-packages] add jni for setting feature name and type ( #7966 )
2022-06-03 11:09:48 +08:00
Bobby Wang
545fd4548e
[jvm-packages] refactor xgboost read/write ( #7956 )
...
1. Removed the duplicated Default XGBoost read/write which is copied from
spark 2.3.x
2. Put some utils into util package
2022-06-01 11:38:49 +08:00
Yang Jiandan
27c66f12d1
set log level as ERROR for trackerProcess has some stderr output ( #7952 )
2022-05-31 22:54:38 +08:00
Bobby Wang
6275cdc486
[jvm-packages] add format option when saving a model ( #7940 )
2022-05-30 15:49:59 +08:00
Bobby Wang
fbc3d861bb
[jvm-packages] remove default parameters ( #7938 )
2022-05-28 10:31:19 +08:00
Daniel Clausen
755d9d4609
[JVM-Packages] Auto-detection of MUSL is replaced by system properties ( #7921 )
...
This PR removes auto-detection of MUSL-based Linux systems in favor of system properties the user can set to configure a specific path for a native library.
2022-05-26 10:53:15 +08:00
Bobby Wang
5ef33adf68
[jvm-packges] set the correct objective if user doesn't explicitly set it ( #7781 )
2022-05-18 14:05:18 +08:00
Bobby Wang
b41cf92dc2
[jvm-packages] move dmatrix building into rabit context for cpu pipeline ( #7908 )
2022-05-17 14:52:25 +08:00
Bobby Wang
11e46e4bc0
[Breaking][jvm-packages] make classification model be xgboost-compatible ( #7896 )
2022-05-14 15:43:05 +08:00
Bobby Wang
9fa7ed1743
[Breaking][jvm-packages] remove timeoutRequestWorkers parameter ( #7839 )
2022-05-13 16:26:25 +08:00
Michael Allman
f7db16add1
Ignore all Java exceptions when looking for Linux musl support ( #7844 )
2022-04-28 15:44:30 +08:00
Bobby Wang
a94e1b172e
[jvm-packages] Fix model compatibility ( #7845 )
2022-04-28 02:05:38 +08:00
Bobby Wang
686caad40c
[jvm-package] remove the coalesce in barrier mode ( #7846 )
2022-04-27 23:34:22 +08:00
Bobby Wang
dc2e699656
[Breaking][jvm-packages] Use barrier execution mode ( #7836 )
...
With the introduction of the barrier execution mode. we don't need to kill SparkContext when some xgboost tasks failed. Instead, Spark will handle the errors for us. So in this PR, `killSparkContextOnWorkerFailure` parameter is deleted.
2022-04-25 17:09:52 +08:00
Bobby Wang
c45665a55a
[jvm-packages] move the dmatrix building into rabit context ( #7823 )
...
This fixes the QuantileDeviceDMatrix in distributed environment.
2022-04-23 00:06:50 +08:00
Bobby Wang
2d83b2ad8f
[jvm-packages] add hostIp and python exec for rabit tracker ( #7808 )
2022-04-15 16:28:43 +08:00
dependabot[bot]
1bb1913811
Bump hadoop-common from 2.10.1 to 3.2.3 in /jvm-packages/xgboost4j-flink ( #7801 )
...
Bumps hadoop-common from 2.10.1 to 3.2.3.
---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-13 22:24:44 +08:00
Bobby Wang
3f536b5308
[jvm-packages] fix evaluation when featuresCols is used ( #7798 )
2022-04-13 12:52:50 +08:00
Bobby Wang
118192f116
[jvm-packages] xgboost4j-spark should work when featuresCols is specified ( #7789 )
2022-04-08 13:21:04 +08:00
Bobby Wang
729d227b89
[jvm-packages] remove the dep of com.fasterxml.jackson ( #7791 )
2022-04-08 13:04:34 +08:00
Bobby Wang
2454407f3a
[jvm-packages] unify setFeaturesCol API for XGBoostRegressor ( #7784 )
2022-04-05 13:35:33 +08:00
Jiaming Yuan
522636cb52
Bump version. ( #7769 )
2022-03-31 06:33:22 +08:00
Oleksandr Pryimak
f5b20286e2
[jvm-packages] Launch dev jvm image under my user ( #4676 )
...
Co-authored-by: Philip Hyunsu Cho <chohyu01@cs.washington.edu>
2022-03-23 10:39:51 -07:00
Aging
f20ffa8db3
Update JVM dev build Dockerfile and shell script ( #6792 )
...
Co-authored-by: Zhuo Yuzhen <yuzhuo@paypal.com>
2022-03-22 16:39:10 -07:00
Daniel Clausen
4dafb5fac8
[JVM-Packages] Add support for detecting musl-based Linux ( #7624 )
...
Co-authored-by: Marc Philipp <marc@gradle.com>
2022-03-14 00:37:27 +08:00
Bobby Wang
89aa8ddf52
[jvm-packages] fix the prediction issue for multi:softmax ( #7694 )
2022-02-24 01:09:45 +08:00
Bobby Wang
e3e6de5ed9
[jvm-packages] unify the set features API ( #7692 )
...
xgboost4j-spark provides 2 sets of API for setting features, one for CPU, another for GPU, which may cause confusion.
This PR removes the GPU API and adds an override CPU function setFeaturesCol to accept Array[String] parameters.
2022-02-23 03:37:25 +08:00
Bobby Wang
131858e7cb
[jvm-packages] Do not repartition when nWorker = 1 ( #7676 )
2022-02-19 21:45:54 +08:00
dependabot[bot]
87c01f49d8
Bump hadoop-common from 2.7.3 to 2.10.1 in /jvm-packages/xgboost4j-flink ( #7641 )
...
Bumps hadoop-common from 2.7.3 to 2.10.1.
---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-02-09 17:07:35 -08:00
Jiaming Yuan
ac7a36367c
[jvm-packages] Implement new save_raw in jvm-packages. ( #7570 )
...
* New `toByteArray` that accepts a parameter for format.
2022-01-19 16:00:14 +08:00
Jiaming Yuan
001503186c
Rewrite approx ( #7214 )
...
This PR rewrites the approx tree method to use codebase from hist for better performance and code sharing.
The rewrite has many benefits:
- Support for both `max_leaves` and `max_depth`.
- Support for `grow_policy`.
- Support for mono constraint.
- Support for feature weights.
- Support for easier bin configuration (`max_bin`).
- Support for categorical data.
- Faster performance for most of the datasets. (many times faster)
- Support for prediction cache.
- Significantly better performance for external memory.
- Unites the code base between approx and hist.
2022-01-10 21:15:05 +08:00
Jiaming Yuan
ed95e77752
[jvm-packages] Update JNI header. ( #7550 )
2022-01-10 14:59:40 +08:00
Bobby Wang
e8c1eb99e4
[jvm-package] Clean up the legacy gpu support tests ( #7523 )
2021-12-21 09:15:51 +08:00
