Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,102 Commits 32 Branches 59 Tags
master-rocm
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nan Zhu 4d1d5d4010 [jvm-packages] fix potential unit test suites aborted issue (#6373) 
* fix race conditio

* code cleaning

rm pom.xml-e

* clean again

* fix compilation issue

* recover

* avoid using getOrCreate

* interrupt zombie threads

* safe guard

* fix deadlock

* Update SparkParallelismTracker.scala
 2020-11-17 10:59:26 -08:00
Nan Zhu c932fb50a1 [jvm-packages]add xgboost4j-gpu/xgboost4j-spark-gpu module to facilitate release (#6136) 
* add xgboost4j-gpu/xgboost4j-spark-gpu module to facilitate release

* Update pom.xml
 2020-09-20 09:20:38 -07:00
Nan Zhu d7b45fbcaf [jvm-packages] do not use multiple jobs to make checkpoints (#5082) 
* temp

* temp

* tep

* address the comments

* fix stylistic issues

* fix

* external checkpoint
 2020-02-01 19:36:39 -08:00
Nan Zhu 6e563951af fix hanging trainings (#132) 
* fix hanging connections

* remove logging
 2020-01-27 09:12:02 -08:00
Nan Zhu fc8c9b0521 [jvm-packages] enable deterministic repartitioning when checkpoint is enabled (#4807) 
* do reparititoning in DataUtil

* keep previous behavior of partitioning without checkpoint

* deterministic repartitioning

* change
 2019-09-19 15:21:05 -07:00
Nan Zhu 0184eb5d02 [jvm-packages] Refactor XGBoost.scala to put all params processing in one place (#4815) 
* cleaning checkpoint file after a successful file

* address comments

* refactor xgboost.scala to avoid multiple changes when adding params

* consolidate params

* fix compilation issue

* fix failed test

* fix wrong name

* tyep conversion
 2019-08-28 22:41:05 -07:00
Nan Zhu 7b5cbcc846 [jvm-packages] cleaning checkpoint file after a successful training (#4754) 
* cleaning checkpoint file after a successful file

* address comments
 2019-08-14 10:57:47 -07:00
Nan Zhu d5c386ae24 Update CONTRIBUTORS.md 2019-07-24 09:38:47 -07:00
Nan Zhu 1595e3f57b upgrade version num (#4670) 
* upgrade version num

* missign changes

* fix version script

* change versions

* rm files

* Update CMakeLists.txt
 2019-07-17 15:25:35 -07:00
Nan Zhu 01b0c9047c [jvm-packages] allowing chaining prediction (#4667) 
* add test for chaining prediction

* update rabit

* Update XGBoostGeneralSuite.scala
 2019-07-17 08:50:27 -07:00
Nan Zhu dba32d54d1 shutdown for multiple times (#99) 2019-07-16 12:41:39 -07:00
Nan Zhu 3e339d9557 contribute to community doc (#4646) 
* add community doc

* update

* update
 2019-07-14 21:29:57 -07:00
Nan Zhu abffbe014e [jvm-packages] delete all constraints from spark layer about obj and eval metrics and handle error in jvm layer (#4560) 
* temp

* prediction part

* remove supported*

* add for test

* fix param name

* add rabit

* update rabit

* return value of rabit init

* eliminate compilation warnings

* update rabit

* shutdown

* update rabit again

* check sparkcontext shutdown

* fix logic

* sleep

* fix tests

* test with relaxed threshold

* create new thread each time

* stop for job quitting

* udpate rabit

* update rabit

* update rabit

* update git modules
 2019-06-27 08:47:37 -07:00
Nan Zhu fe2de6f415 [jvm-packages]fix silly bug in feature scoring (#4604) 2019-06-25 20:49:01 -07:00
Nan Zhu 65b718a5e7 return values in Init and Finalize (#96) 
* make inti function return values

* address the comments
 2019-06-25 20:05:54 -07:00
Nan Zhu fc85f776f4 allow not stop process in error (#97) 
* allow not stop process in error

* fix merge error
 2019-06-25 13:04:39 -07:00
Nan Zhu adcd8ea7c6 Update xgboost4j_spark_tutorial.rst (#4476) 2019-05-17 04:17:57 +00:00
Nan Zhu 253fdd8a42 [jvm-packages] fix the split of input (#4417) 2019-04-29 18:52:40 -07:00
Nan Zhu 37dc82c3ff [jvm-packages] allow partial evaluation of dataframe before prediction (#4407) 
* allow partial evaluation of dataframe before prediction

* resume spark test

* comments

* Run unit tests after building JVM packages
 2019-04-26 21:02:40 -07:00
Nan Zhu a429748e24 allow multi call on init (#92) 2019-04-26 18:41:02 -07:00
Nan Zhu 995698b0cb [BREAKING][jvm-packages] fix the non-zero missing value handling (#4349) 
* fix the nan and non-zero missing value handling

* fix nan handling part

* add missing value

* Update MissingValueHandlingSuite.scala

* Update MissingValueHandlingSuite.scala

* stylistic fix
 2019-04-26 11:10:33 -07:00
Nan Zhu 65db8d0626 [jvm-packages] support spark 2.4 and compatibility test with previous xgboost version (#4377) 
* bump spark version

* keep float.nan

* handle brokenly changed name/value

* add test

* add model files

* add model files

* update doc
 2019-04-17 11:33:13 -07:00
Nan Zhu ad4de0d718 [jvm-packages] handle NaN as missing value explicitly (#4309) 
* handle nan

* handle nan explicitly

* make code better and handle sparse vector in spark

* Update XGBoostGeneralSuite.scala
 2019-03-30 19:34:26 +08:00
Nan Zhu 45c89a6792 [jvm-packages] logging version number (#4271) 
* print version number

* add property file
 2019-03-21 18:24:29 +08:00
Nan Zhu 359ed9c5bc [jvm-packages] add configuration flag to control whether to cache transformed training set (#4268) 
* control whether to cache data

* uncache
 2019-03-18 10:13:28 +08:00
Nan Zhu 5f34078fba [jvm-packages] bump version for master (#4209) 
* update version

* bump version
 2019-03-04 23:12:24 -08:00
Nan Zhu 1b7405f688 [jvm-packages] fix comments in objectiveTrait (#4174) 2019-02-22 00:32:13 -08:00
Nan Zhu dc2add96c5 [jvm-packages] upgrade spark version (#4170) 2019-02-21 11:51:36 -08:00
Nan Zhu 1dac5e2410 more correct way to build node stats in distributed fast hist (#4140) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* more changes

* temp

* update

* udpate rabit

* change the histogram

* update kfactor

* sync per node stats

* temp

* update

* final

* code clean

* update rabit

* more cleanup

* fix errors

* fix failed tests

* enforce c++11

* broadcast subsampled feature correctly

* init col

* temp

* col sampling

* fix histmastrix init

* fix col sampling

* remove cout

* fix out of bound access

* fix core dump

remove core dump file

* update

* add fid

* update

* revert some changes

* temp

* temp

* pass all tests

* bring back some tests

* recover some changes

* fix lint issue

* enable monotone and interaction constraints

* don't specify default for monotone and interactions

* recover column init part

* more recovery

* fix core dumps

* code clean

* revert some changes

* fix test compilation issue

* fix lint issue

* resolve compilation issue

* fix issues of lint caused by rebase

* fix stylistic changes and change variable names

* modularize depth width

* address the comments

* fix failed tests

* wrap perf timers with class

* temp

* pass all lossguide

* pass tests

* add comments

* more changes

* use separate flow for single and tests

* add test for lossguide hist

* remove duplications

* syncing stats for only once

* recover more changes

* recover more changes

* fix root-stats

* simplify code

* remove outdated comments
 2019-02-18 13:45:30 -08:00
Nan Zhu c18a3660fa Separate Depthwidth and Lossguide growing policy in fast histogram (#4102) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* init

* more changes

* temp

* update

* udpate rabit

* change the histogram

* update kfactor

* sync per node stats

* temp

* update

* final

* code clean

* update rabit

* more cleanup

* fix errors

* fix failed tests

* enforce c++11

* broadcast subsampled feature correctly

* init col

* temp

* col sampling

* fix histmastrix init

* fix col sampling

* remove cout

* fix out of bound access

* fix core dump

remove core dump file

* disbale test temporarily

* update

* add fid

* print perf data

* update

* revert some changes

* temp

* temp

* pass all tests

* bring back some tests

* recover some changes

* fix lint issue

* enable monotone and interaction constraints

* don't specify default for monotone and interactions

* recover column init part

* more recovery

* fix core dumps

* code clean

* revert some changes

* fix test compilation issue

* fix lint issue

* resolve compilation issue

* fix issues of lint caused by rebase

* fix stylistic changes and change variable names

* use regtree internal function

* modularize depth width

* address the comments

* fix failed tests

* wrap perf timers with class

* fix lint

* fix num_leaves count

* fix indention

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.h

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.h

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* merge

* fix compilation
 2019-02-13 12:56:19 -08:00
Nan Zhu 3320a52192 [jvm-packages] force use per-group weights in spark layer (#4118) 2019-02-10 05:38:03 +08:00
Nan Zhu 05243642bb [jvm-packages] better fix for shutdown applications (#4108) 
* intentionally failed task

* throw exception

* more

* stop sparkcontext directly

* stop from another thread

* new scope

* use a new thread

* daemon threads

* don't join the killer thread

* remove injected errors

* add comments
 2019-02-07 09:02:17 -08:00
Nan Zhu 325b16bccd [jvm-packages] fix return type of setEvalSets (#4105) 2019-02-06 11:00:29 -08:00
Nan Zhu ae3bb9c2d5 Distributed Fast Histogram Algorithm (#4011) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* init

* allow hist algo

* more changes

* temp

* update

* remove hist sync

* udpate rabit

* change hist size

* change the histogram

* update kfactor

* sync per node stats

* temp

* update

* final

* code clean

* update rabit

* more cleanup

* fix errors

* fix failed tests

* enforce c++11

* fix lint issue

* broadcast subsampled feature correctly

* revert some changes

* fix lint issue

* enable monotone and interaction constraints

* don't specify default for monotone and interactions

* update docs
 2019-02-05 05:12:53 -08:00
Nan Zhu 0d0ce32908 [jvm-packages] adding logs for parameters (#4091) 2019-01-30 21:50:55 -08:00
Nan Zhu e0094d996e fix doc about max_depth (#4078) 
* fix doc

* Update doc/parameter.rst

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>
 2019-01-30 12:53:44 -08:00
Nan Zhu 773ddbcfcb [BLOCKING] fix the issue with infrequent feature (#4045) 
* fix the issue with infrequent feature

* handle exception

* use only 2 workers

* address the comments
 2019-01-06 16:01:03 -08:00
Nan Zhu e290ec9a80 [jvm-packages] fix safe execution (#4046) 2019-01-05 19:45:37 -08:00
Nan Zhu f368d0de2b [jvm-packages] fix the scalability issue of prediction (#4033) 2018-12-29 20:46:30 -08:00
Nan Zhu c055a32609 [jvm-packages]support multiple validation datasets in Spark (#3910) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* wrap iterators

* enable copartition training and validationset

* add parameters

* converge code path and have init unit test

* enable multi evals for ranking

* unit test and doc

* update example

* fix early stopping

* address the offline comments

* udpate doc

* test eval metrics

* fix compilation issue

* fix example
 2018-12-17 21:03:57 -08:00
Nan Zhu 9c4ff50e83 [jvm-packages]Fix early stopping condition (#3928) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* update version

* 0.82

* fix early stopping condition

* remove unused

* update comments

* udpate comments

* update test
 2018-11-24 00:18:07 -08:00
Nan Zhu dc2bfbfde1 [jvm-packages] update version to 0.82-SNAPSHOT (#3920) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* update version

* 0.82
 2018-11-18 16:47:48 -08:00
Nan Zhu aa48b7e903 [jvm-packages][refactor] refactor XGBoost.scala (spark) (#3904) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* wrap iterators

* remove unused code

* refactor

* fix typo
 2018-11-15 20:38:28 -08:00
Nan Zhu 5fbe230636 [jvm-packages] documenting tracker (#3831) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* documenting tracker

* Make it a separate note
 2018-10-25 18:53:46 -07:00
Nan Zhu 4ae225a08d [Blocking][jvm-packages] fix the early stopping feature (#3808) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* temp

* add method for classifier and regressor

* update tutorial

* address the comments

* update
 2018-10-23 14:53:13 -07:00
Nan Zhu 785094db53 [jvm-packages] fix issue when spark job execution thread cannot return before we execute first() (#3758) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* sparjJobThread

* update

* fix issue when spark job execution thread cannot return before we execute first()
 2018-10-05 22:20:50 -07:00
Nan Zhu 79d854c695 [jvm-packages] fix errors in example (#3719) 
* add back train method but mark as deprecated

* fix scalastyle error

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* instrumentation

* use log console

* better measurement

* fix erros in example

* update histmaker
 2018-09-22 16:39:38 -07:00
Nan Zhu aa53e9fc8d [jvm-packages] bump spark version (#3709) 2018-09-19 11:18:01 -07:00
Nan Zhu d1e75d615e [jvm-packages] Remove copy paste error in test suite (#3692) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* remove copy paste error
 2018-09-11 13:08:36 -07:00
Nan Zhu 3261002099 [jvm-packages] throw ControlThrowable instead of InterruptedException (#3632) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* interrupted exception is not rethrown
 2018-08-25 20:30:21 -07:00
Nan Zhu 4912c1f9c6 [jvm-packages] fix checkpoint save/load (#3614) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix update checkpoint func
 2018-08-21 12:34:24 -07:00
Nan Zhu 73bd590a1d [jvm-packages] add the missing scm urls (#3589) 
for some reason this part was missing in master branch????
 2018-08-14 15:05:23 -07:00
Nan Zhu 1c08b3b2ea [jvm-packages] enable predictLeaf/predictContrib/treeLimit in 0.8 (#3532) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* partial finish

* no test

* add test cases

* add test cases

* address comments

* add test for regressor

* fix typo
 2018-08-07 14:01:18 -07:00
Nan Zhu 31d1baba3d [jvm-packages] Tutorial of XGBoost4J-Spark (#3534) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* add new

* update doc

* finish Gang Scheduling

* more

* intro

* Add sections: Prediction, Model persistence and ML pipeline.

* Add XGBoost4j-Spark MLlib pipeline example

* partial finished version

* finish the doc

* adjust code

* fix the doc

* use rst

* Convert XGBoost4J-Spark tutorial to reST

* Bring XGBoost4J up to date

* add note about using hdfs

* remove duplicate file

* fix descriptions

* update doc

* Wrap HDFS/S3 export support as a note

* update

* wrap indexing_mode example in code block
 2018-08-03 21:17:50 -07:00
Nan Zhu 6cf97b4eae [jvm-packages] consider spark.task.cpus when controlling parallelism (#3530) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* consider spark.task.cpus when controlling parallelism

* fix bug

* fix conf setup

* calculate requestedCores within ParallelismController

* enforce spark.task.cpus = 1

* unify unit test case framework

* enable spark ui
 2018-07-31 06:19:45 -07:00
Nan Zhu b546321c83 [jvm-packages] the current version of xgboost does not consider missing value in prediction (#3529) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* consider missing value in prediction

* handle single prediction instance

* fix type conversion
 2018-07-30 14:16:24 -07:00
Nan Zhu b5178d3d99 [jvm-packages] a better explanation about the inconsistent issue (#3524) 2018-07-28 17:34:39 -07:00
Nan Zhu e2f09db77a [jvm-packages] minor fix for parameter name in example (#3507) 2018-07-25 19:57:40 -07:00
Nan Zhu aa90e5c6ce [jvm-packages] disable booster setup for xgboost4j-spark (#3456) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* disable booster setup in spark

* check in parameter conversion

* fix compilation issue

* update exception type
 2018-07-07 21:57:24 -07:00
Nan Zhu d062c6f61b [jvm-packages] Maven central release stuffs (#3401) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* maven central release
 2018-06-22 06:41:28 -07:00
Nan Zhu f66731181f Update 0.8 version num (#3358) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* update 0.80
 2018-06-02 07:06:01 -07:00
Nan Zhu 49b9f39818 [jvm-packages] update xgboost4j cross build script to be compatible with older glibc (#3307) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* static glibc glibc++

* update to build with glib 2.12

* remove unsupported flags

* update version number

* remove properties

* remove unnecessary command

* update poms
 2018-05-10 06:39:44 -07:00
Nan Zhu e1f57b4417 [jvm-packages] scripts to cross-build and deploy artifacts to github (#3276) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* cross building files

* update

* build with docker

* remove

* temp

* update build script

* update pom

* update

* update version

* upload build

* fix path

* update README.md

* fix compiler version to 4.8.5
 2018-04-28 07:41:30 -07:00
Nan Zhu 25b2919c44 [jvm-packages] change version of jvm to keep consistent with other pkgs (#3253) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* change version of jvm to keep consistent with other pkgs
 2018-04-19 20:48:50 -07:00
Nan Zhu d9dd485313 [jvm-packages] upgrade spark version to 2.3 (#3254) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* update default spark version to 2.3
 2018-04-19 20:15:19 -07:00
Nan Zhu 4109818b32 [jvm-packages] add back libsvm notes (#3232) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* add back libsvm notes
 2018-04-10 09:00:58 -07:00
Nan Zhu a187ed6c8f [jvm-packages] tiny fix for empty partition in predict (#3014) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* tiny fix for empty partition in predict

* further fix
 2018-01-07 08:34:18 -08:00
Nan Zhu 9747ea2acb [jvm-packages] fix the pattern in dev script and version mismatch (#3009) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix the pattern in dev script and version mismatch
 2018-01-06 06:59:38 -08:00
Nan Zhu 14c6392381 [jvm-packages] add dev script to update version and update versions (#2998) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* add dev script to update version and update versions
 2018-01-01 21:28:53 -08:00
Nan Zhu 005a4a5e47 [jvm-packages] fix numAliveCores in SparkParallelismTracker when WebUI is disabled (#2990) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* update resource files

* Update SparkParallelismTracker.scala

* remove xgboost-tracker.properties
 2017-12-29 19:22:58 -08:00
Nan Zhu 4fa917b19f Update .travis.yml (#2951) 2017-12-15 13:09:36 -08:00
Nan Zhu 1190dc62a7 Update CONTRIBUTORS.md (#2719) 2017-09-17 15:07:57 -07:00
Nan Zhu e24f25e0c6 add Qubole example (#2401) 2017-06-09 20:33:26 -07:00
Nan Zhu 96f9776ab0 Update ISSUE_TEMPLATE.md (#2308) 
* Update ISSUE_TEMPLATE.md

* Update ISSUE_TEMPLATE.md
 2017-05-18 08:49:07 -07:00
Nan Zhu a607f697e3 [jvm-packages] Disable fast histo for spark (#2296) 
* add back train method but mark as deprecated

* fix scalastyle error

* disable fast histogram in xgboost4j-spark temporarily
 2017-05-15 20:43:16 -07:00
Nan Zhu 428453f7d6 [jvm-packages] fix the persistence of XGBoostEstimator (#2265) 
* add back train method but mark as deprecated

* fix scalastyle error

* fix the persistence of XGBoostEstimator

* test persistence of a complete pipeline

* fix compilation issue

* do not allow persist custom_eval and custom_obj

* fix the failed tesl
 2017-05-08 21:58:06 -07:00
Nan Zhu 392aa6d1d3 [jvm-packages] make XGBoostModel hold BoosterParams as well (#2214) 
* add back train method but mark as deprecated

* fix scalastyle error

* make XGBoostModel hold BoosterParams as well
 2017-04-21 08:12:50 -07:00
Nan Zhu a837fa9620 [jvm-packages] rdds containing boosters should be cleaned once we got boosters to driver (#2183) 2017-04-11 06:12:49 -07:00
Nan Zhu f08077606c [jvm-packages] Clean external cache (#2181) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* small fix for cleanExternalCache
 2017-04-10 07:49:58 -07:00
Nan Zhu 8d8cbcc6db [jvm-packages] fixed several issues in unit tests (#2173) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* fix several issues in tests
 2017-04-06 06:25:23 -07:00
Nan Zhu ab13fd72bd [jvm-packages] Scala/Java interface for Fast Histogram Algorithm (#1966) 
* add back train method but mark as deprecated

* fix scalastyle error

* first commit in scala binding for fast histo

* java test

* add missed scala tests

* spark training

* add back train method but mark as deprecated

* fix scalastyle error

* local change

* first commit in scala binding for fast histo

* local change

* fix df frame test
 2017-03-04 15:37:24 -08:00
Nan Zhu ac30a0aff5 [jvm-packages][spark]Preserve num classes (#2068) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* bump spark version to 2.1

* preserve num_class issues

* fix failed test cases

* rivising

* add multi class test
 2017-03-04 14:14:31 -08:00
Nan Zhu 63aec12a13 [jvm-packages] Bump spark to 2.1 (#2046) 2017-02-19 08:29:35 -08:00
Nan Zhu 185fe1d645 [jvm-packages] use ML's para system to build the passed-in params to XGBoost (#2043) 
* add back train method but mark as deprecated

* fix scalastyle error

* use ML's para system to build the passed-in params to XGBoost

* clean
 2017-02-18 11:56:27 -08:00
Nan Zhu 965091c4bb [jvm-packages] update methods in test cases to be consistent (#1780) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* update methods in test cases to be consistent

* add blank lines

* fix
 2016-11-20 22:49:18 -05:00
Nan Zhu 5217e53156 stylistic fix (#1789) 
* stylistic fix

* try multiple repos

* fix

* fix
 2016-11-19 22:03:10 -05:00
Nan Zhu 6082184cd1 [jvm-packages] update API docs (#1713) 
* add back train method but mark as deprecated

* fix scalastyle error

* update java doc

* update
 2016-10-27 18:53:22 -07:00
Nan Zhu d321375df5 [jvm-packages] Fix mis configure of nthread (#1709) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* fix mis configuration
 2016-10-27 12:10:35 -04:00
Nan Zhu f12074d355 [jvm-packages] release blog (#1706) 2016-10-26 21:35:42 -04:00
Nan Zhu f801c22710 [jvm-packages] change class to object in examples (#1703) 
* change class to object in examples

* fix compilation error
 2016-10-26 14:54:56 -04:00
Nan Zhu 016ab89484 [jvm-packages] Parameter tuning tool for XGBoost (#1664) 2016-10-23 16:58:18 -04:00
Nan Zhu f5c776f64f [jvm-packages] add apache maven repo url and bump up default spark version to 2.0.1 (#1650) 
* add apache maven repo url and bump up default spark version to 2.0.1
 2016-10-13 08:55:03 -04:00
Nan Zhu 813a53882a [jvm-packages] deprecate Flaky test (#1662) 
* deprecate flaky test
 2016-10-13 07:21:24 -04:00
Nan Zhu b56c6097d9 [jvm-packages] add Spark and XGBoost tutorial (#1649) 
* add back train method but mark as deprecated

* add Spark and XGBoost tutorial

* fix scalastyle error
 2016-10-11 09:41:24 -07:00
Nan Zhu 1673bcbe7e [jvm-packages] separate classification and regression model and integrate with ML package (#1608) 2016-09-30 11:49:03 -04:00
Nan Zhu 37bc122c90 [jvm-packages] Robust dmatrix creation (#1613) 
* add back train method but mark as deprecated

* robust matrix creation in jvm
 2016-09-26 13:35:04 -04:00
Nan Zhu 4ad648e856 [jvm-packages] predictLeaf with Dataframe (#1576) 
* add back train method but mark as deprecated

* predictLeaf with Dataset

* fix

* fix
 2016-09-15 06:15:47 -04:00
Nan Zhu bb388cbb31 default eval func (#1574) 2016-09-14 13:26:16 -04:00
Nan Zhu fb02797e2a [jvm-packages] Integration with Spark Dataframe/Dataset (#1559) 
* bump up to scala 2.11

* framework of data frame integration

* test consistency between RDD and DataFrame

* order preservation

* test order preservation

* example code and fix makefile

* improve type checking

* improve APIs

* user docs

* work around travis CI's limitation on log length

* adjust test structure

* integrate with Spark -1 .x

* spark 2.x integration

* remove spark 1.x implementation but provide instructions on how to downgrade
 2016-09-11 15:02:58 -04:00
Nan Zhu 6dabdd33e3 [jvm-packages] bump to next version (#1535) 
* bump to next version

* fix

* fix
 2016-09-01 12:18:21 -04:00