Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6,535 Commits 32 Branches 59 Tags
e4ee4e79dc1cfbb50f7ebd707b81cb77b12b3269
Commit Graph
867 Commits
Author SHA1 Message Date
Jiaming Yuan ada4a86d1c Fix dask interface with latest cupy. (#8210) 2022-09-03 03:10:43 +08:00
Rong Ou b78bc734d9 Fix dask.py lint error (#8216) 2022-09-02 16:30:01 +08:00
WeichenXu 651f0a8889 [pyspark] Fixing xgboost.spark python doc (#8200) 
Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
 2022-08-25 14:41:48 +08:00
WeichenXu d03794ce7a [pyspark] Add param validation for "objective" and "eval_metric" param, and remove invalid booster params (#8173) 
Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
 2022-08-24 15:29:43 +08:00
Jiaming Yuan 9b32e6e2dc Fix release script. (#8187) (#8195) 2022-08-23 15:08:30 +08:00
WeichenXu f4628c22a4 [pyspark] Implement SparkXGBRanker estimator (#8172) 
Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
 2022-08-23 02:35:19 +08:00
Rong Ou ad3bc0edee Allow insecure gRPC connections for federated learning (#8181) 
* Allow insecure gRPC connections for federated learning

* format
 2022-08-19 12:16:14 +08:00
WeichenXu 53d2a733b0 [pyspark] Make Xgboost estimator support using sparse matrix as optimization (#8145) 
Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
 2022-08-19 01:57:28 +08:00
Gavin ZhangandGavinZhang 40a10c217d Use make on i system (#8178) 
Co-authored-by: GavinZhang <zhanggan@cn.ibm.com>
 2022-08-18 12:55:32 +08:00
Jiaming Yuan 36e7c5364d [dask] Deterministic rank assignment. (#8018) 2022-08-11 19:17:58 +08:00
Jiaming Yuan 570f8ae4ba Use black on more Python files. (#8137) 2022-08-11 01:38:11 +08:00
Jiaming Yuan bdb291f1c2 [doc] Clarification for feature importance. (#8151) 2022-08-11 00:30:42 +08:00
Jiaming Yuan 9ae547f994 Use config_context in sklearn interface. (#8141) 2022-08-09 14:48:54 +08:00
Bobby Wang 03cc3b359c [pyspark] support a list of feature column names (#8117) 2022-08-08 17:05:27 +08:00
Jiaming Yuan d87f69215e Quantile DMatrix for CPU. (#8130) 
- Add a new `QuantileDMatrix` that works for both CPU and GPU.
- Deprecate `DeviceQuantileDMatrix`.
 2022-08-02 15:51:23 +08:00
Jiaming Yuan 2cba1d9fcc Fix compatibility with latest cupy. (#8129) 
* Fix compatibility with latest cupy.

* Freeze mypy.
 2022-08-01 15:24:42 +08:00
Jiaming Yuan 546de5efd2 [pyspark] Cleanup data processing. (#8088) 
- Use numpy stack for handling list of arrays.
- Reuse concat function from dask.
- Prepare for `QuantileDMatrix`.
- Remove unused code.
- Use iterator for prediction to avoid initializing xgboost model
 2022-07-26 15:00:52 +08:00
Jiaming Yuan 8bdea72688 [Python] Require black and isort for new Python files. (#8096) 
* [Python] Require black and isort for new Python files.

- Require black and isort for spark and dask module.

These files are relatively new and are more conform to the black formatter. We will
convert the rest of the library as we move forward.

Other libraries including dask/distributed and optuna use the same formatting style and
have a more strict standard. The black formatter is indeed quite nice, automating it can
help us unify the code style.

- Gather Python checks into a single script.
 2022-07-20 10:25:24 +08:00
WeichenXuandBobby Wang f23cc92130 [pyspark] User guide doc and tutorials (#8082) 
Co-authored-by: Bobby Wang <wbo4958@gmail.com>
 2022-07-19 22:25:14 +08:00
Bobby Wang f801d3cf15 [PySpark] change the returning model type to string from binary (#8085) 
* [PySpark] change the returning model type to string from binary

XGBoost pyspark can be can be accelerated by RAPIDS Accelerator seamlessly by
changing the returning model type from binary to string.
 2022-07-19 18:39:20 +08:00
Jiaming Yuan e28f6f6657 [doc] Integrate pyspark module into sphinx doc [skip ci] (#8066) 2022-07-17 10:46:09 +08:00
Rafail Giavrimis 579ab23b10 Check cudf lazily (#8084) 2022-07-17 09:27:43 +08:00
Bobby Wang a33f35eecf [PySpark] add gpu support for spark local mode (#8068) 2022-07-17 07:59:06 +08:00
Bobby Wang 91bb9e2cb3 [PySpark] fix raw_prediction_col parameter and minor cleanup (#8067) 2022-07-16 17:58:57 +08:00
Jiaming Yuan dae7a41baa Update Python requirement to >=3.8. (#8071) 
Additional changes:
- Use mamba for CPU test on Jenkins.
- Cleanup CPU test dependencies.
- Restore some of the modin tests
 2022-07-14 18:01:47 +08:00
WeichenXuHyunsu ChoJiaming Yuan
 		176fec8789 PySpark XGBoost integration (#8020) 
Co-authored-by: Hyunsu Cho <chohyu01@cs.washington.edu>
Co-authored-by: Jiaming Yuan <jm.yuan@outlook.com>
 2022-07-13 13:11:18 +08:00
Jiaming Yuan a5bc8e2c6a Fix mypy error with the latest dask. (#8052) 
* Fix mypy error with latest dask.

Dask is adding type hints to its codebase and as the result, checks in XGBoost can be
performed more rigorously.

- Remove compatibility with old dask version where multi lock was missing.
- Restrict input of `X` to be non-series.
- Adopt latest definition of `Delayed`.
- Avoid passing optional `host_ip`.
- Avoid deprecated `worker.nthreads`.
 2022-07-09 08:02:42 +08:00
Jiaming Yuan 701f32b227 [py-sckl] Raise import error if skl is not installed. (#8049) 2022-07-09 05:56:46 +08:00
Jiaming Yuan ff1c559084 Remove unused variable. (#8046) 2022-07-05 01:59:22 +08:00
Jiaming Yuan dcaf580476 Fix Python package source install. (#8036) 
* Copy gputreeshap.
 2022-06-29 21:45:09 +08:00
Joris LIMONIER f470ad3af9 Fix multiple typos (#8028) 
Fix 4 "graphiz" instead of "graphviz".
 2022-06-27 19:21:58 +08:00
Gavin Zhang 6426449c8b Support IBM i OS (#7920) 2022-06-02 23:38:35 +08:00
Jiaming Yuan 6b55150e80 Fix pylint errors. (#7967) 2022-06-02 18:04:46 +08:00
Gyeongjae Choi cc6d57aa0d Add minimal emscripten build support (#7954) 2022-05-30 14:11:40 +08:00
Tim Sabsch 7a039e03fe Fix incomplete type hints for verbose (#7945) 2022-05-30 12:08:24 +08:00
Jiaming Yuan d314680a15 Verify shared object version at load. (#7928) 2022-05-23 20:53:30 +08:00
Jiaming Yuan f93a727869 Address remaining mypy errors in python package. (#7914) 2022-05-18 22:46:15 +08:00
ChengyangChengyang GuJiamingy
 		806c92c80b Add Type Hints for Python Package (#7742) 
Co-authored-by: Chengyang Gu <bridgream@gmail.com>
Co-authored-by: Jiamingy <jm.yuan@outlook.com>
 2022-05-17 22:14:09 +08:00
Rong Ou 77d4a53c32 use RabitContext intead of init/finalize (#7911) 2022-05-17 12:15:41 +08:00
Rong Ouandjiamingy af907e2d0d Demo of federated learning using NVFlare (#7879) 
Co-authored-by: jiamingy <jm.yuan@outlook.com>
 2022-05-14 22:45:41 +08:00
Jiaming Yuan c8f9d4b6e6 Show libxgboost.so path in build info. (#7893) 2022-05-13 18:08:56 +08:00
Jiaming Yuan db80671d6b Fix monotone constraint with tuple input. (#7891) 2022-05-13 04:00:03 +08:00
Jiaming Yuan 8ba4722d04 Remove pyarrow workaround. (#7884) 2022-05-11 20:54:48 +08:00
Rong Ou 14ef38b834 Initial support for federated learning (#7831) 
Federated learning plugin for xgboost:
* A gRPC server to aggregate MPI-style requests (allgather, allreduce, broadcast) from federated workers.
* A Rabit engine for the federated environment.
* Integration test to simulate federated learning.

Additional followups are needed to address GPU support, better security, and privacy, etc.
 2022-05-05 21:49:22 +08:00
Jiaming Yuan ad06172c6b Refactor pandas dataframe handling. (#7843) 2022-04-26 18:53:43 +08:00
Jiaming Yuan f0f76259c9 Remove STRING_TYPES. (#7827) 2022-04-22 19:07:51 +08:00
Jiaming Yuan c70fa502a5 Expose feature_types to sklearn interface. (#7821) 2022-04-21 20:23:35 +08:00
Jiaming Yuan 52d4eda786 Deprecate use_label_encoder in XGBClassifier. (#7822) 
* Deprecate `use_label_encoder` in XGBClassifier.

* We have removed the encoder, now prepare to remove the indicator.
 2022-04-21 13:14:02 +08:00
Jiaming Yuan bcce17e688 Remove text loading in basic walk through demo. (#7753) 2022-04-01 00:59:42 +08:00
Jiaming Yuan 02dd7b6913 Remove use of distutils. (#7770) 
distutils is deprecated and replaced by other stdlib constructs.
 2022-03-31 19:03:10 +08:00