[pyspark] Make Xgboost estimator support using sparse matrix as optimization (#8145)

Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
2022-08-19 01:57:28 +08:00
parent 1703dc330f
commit 53d2a733b0
6 changed files with 318 additions and 27 deletions
--- a/tests/ci_build/conda_env/cpu_test.yml
+++ b/tests/ci_build/conda_env/cpu_test.yml
@@ -32,9 +32,10 @@ dependencies:
 - cffi
 - pyarrow
 - protobuf
- pyspark>=3.3.0
 - cloudpickle
 - shap
 - modin
 - pip:
  - datatable
+  # TODO: Replace it with pyspark>=3.4 once 3.4 released.
+  - https://ml-team-public-read.s3.us-west-2.amazonaws.com/pyspark-3.4.0.dev0.tar.gz