From 583c88bce793b0500fe92ad87ed6aa31ce7a4d48 Mon Sep 17 00:00:00 2001 From: Philip Hyunsu Cho Date: Thu, 1 Nov 2018 19:15:40 -0700 Subject: [PATCH] [jvm-packages] Require vanilla Apache Spark (#3854) --- doc/jvm/index.rst | 6 ++++-- doc/jvm/xgboost4j_spark_tutorial.rst | 8 ++++++-- 2 files changed, 10 insertions(+), 4 deletions(-) diff --git a/doc/jvm/index.rst b/doc/jvm/index.rst index 9c84a1e17..9b2415b79 100644 --- a/doc/jvm/index.rst +++ b/doc/jvm/index.rst @@ -58,9 +58,11 @@ For sbt, please add the repository and dependency in build.sbt as following: If you want to use XGBoost4J-Spark, replace ``xgboost4j`` with ``xgboost4j-spark``. -.. note:: XGBoost4J-Spark requires Spark 2.3+ +.. note:: XGBoost4J-Spark requires Apache Spark 2.3+ - XGBoost4J-Spark now requires Spark 2.3+. Latest versions of XGBoost4J-Spark uses facilities of `org.apache.spark.ml.param.shared` extensively to provide for a tight integration with Spark MLLIB framework, and these facilities are not fully available on earlier versions of Spark. + XGBoost4J-Spark now requires **Apache Spark 2.3+**. Latest versions of XGBoost4J-Spark uses facilities of `org.apache.spark.ml.param.shared` extensively to provide for a tight integration with Spark MLLIB framework, and these facilities are not fully available on earlier versions of Spark. + + Also, make sure to install Spark directly from `Apache website `_. **Upstream XGBoost is not guaranteed to work with third-party distributions of Spark, such as Cloudera Spark.** Consult appropriate third parties to obtain their distribution of XGBoost. Installation from maven repo ============================ diff --git a/doc/jvm/xgboost4j_spark_tutorial.rst b/doc/jvm/xgboost4j_spark_tutorial.rst index 835ca6833..1a5f96cf5 100644 --- a/doc/jvm/xgboost4j_spark_tutorial.rst +++ b/doc/jvm/xgboost4j_spark_tutorial.rst @@ -61,9 +61,13 @@ and then refer to the snapshot dependency by adding: next_version_num-SNAPSHOT -.. note:: XGBoost4J-Spark requires Spark 2.3+ +.. note:: XGBoost4J-Spark requires Apache Spark 2.3+ - XGBoost4J-Spark now requires Spark 2.3+. Latest versions of XGBoost4J-Spark uses facilities of `org.apache.spark.ml.param.shared` extensively to provide for a tight integration with Spark MLLIB framework, and these facilities are not fully available on earlier versions of Spark. + XGBoost4J-Spark now requires **Apache Spark 2.3+**. Latest versions of XGBoost4J-Spark uses facilities of `org.apache.spark.ml.param.shared` extensively to provide for a tight integration with Spark MLLIB framework, and these facilities are not fully available on earlier versions of Spark. + + Also, make sure to install Spark directly from `Apache website `_. **Upstream XGBoost is not guaranteed to work with third-party distributions of Spark, such as Cloudera Spark.** Consult appropriate third parties to obtain their distribution of XGBoost. + +Installation from maven repo .. note:: Use of Python in XGBoost4J-Spark