Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[BLOCKING][CI] Upgrade to Spark 2.4.3 (#4414)

Browse Source 
* [CI] Upgrade to Spark 2.4.2

* Pass Spark version to build script

* Allow multiple --build-arg in ci_build.sh

* Fix syntax

* Fix container name

* Update pom.xml

* Fix container name

* Update Jenkinsfile

* Update pom.xml

* Update Dockerfile.jvm_cross
This commit is contained in:
Philip Hyunsu Cho
2019-05-09 21:36:59 -07:00
committed by Nan Zhu
parent 18e4fc3690
commit 6ff994126a
5 changed files with 28 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
tests/ci_build/Dockerfile.jvm_cross
View File

@@ -1,5 +1,6 @@
FROM ubuntu:19.04
ARG JDK_VERSION=8
ARG SPARK_VERSION=2.4.3
# Environment
ENV DEBIAN_FRONTEND noninteractive
@@ -19,9 +20,9 @@ RUN \
tar xvf apache-maven-3.6.1-bin.tar.gz -C /opt && \
ln -s /opt/apache-maven-3.6.1/ /opt/maven && \
# Spark
wget https://archive.apache.org/dist/spark/spark-2.4.1/spark-2.4.1-bin-hadoop2.7.tgz && \
tar xvf spark-2.4.1-bin-hadoop2.7.tgz -C /opt && \
ln -s /opt/spark-2.4.1-bin-hadoop2.7 /opt/spark
wget https://archive.apache.org/dist/spark/spark-$SPARK_VERSION/spark-$SPARK_VERSION-bin-hadoop2.7.tgz && \
tar xvf spark-$SPARK_VERSION-bin-hadoop2.7.tgz -C /opt && \
ln -s /opt/spark-$SPARK_VERSION-bin-hadoop2.7 /opt/spark
ENV PATH=/opt/python/bin:/opt/spark/bin:/opt/maven/bin:$PATH