Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,050 Commits 32 Branches 59 Tags
142bdc73ece531d8681779763e473e8df27510a9
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nan Zhu 4d1d5d4010 [jvm-packages] fix potential unit test suites aborted issue (#6373) 
* fix race conditio

* code cleaning

rm pom.xml-e

* clean again

* fix compilation issue

* recover

* avoid using getOrCreate

* interrupt zombie threads

* safe guard

* fix deadlock

* Update SparkParallelismTracker.scala
 2020-11-17 10:59:26 -08:00
Nan Zhu c932fb50a1 [jvm-packages]add xgboost4j-gpu/xgboost4j-spark-gpu module to facilitate release (#6136) 
* add xgboost4j-gpu/xgboost4j-spark-gpu module to facilitate release

* Update pom.xml
 2020-09-20 09:20:38 -07:00
Nan Zhu d7b45fbcaf [jvm-packages] do not use multiple jobs to make checkpoints (#5082) 
* temp

* temp

* tep

* address the comments

* fix stylistic issues

* fix

* external checkpoint
 2020-02-01 19:36:39 -08:00
Nan Zhu 6e563951af fix hanging trainings (#132) 
* fix hanging connections

* remove logging
 2020-01-27 09:12:02 -08:00
Nan Zhu fc8c9b0521 [jvm-packages] enable deterministic repartitioning when checkpoint is enabled (#4807) 
* do reparititoning in DataUtil

* keep previous behavior of partitioning without checkpoint

* deterministic repartitioning

* change
 2019-09-19 15:21:05 -07:00
Nan Zhu 0184eb5d02 [jvm-packages] Refactor XGBoost.scala to put all params processing in one place (#4815) 
* cleaning checkpoint file after a successful file

* address comments

* refactor xgboost.scala to avoid multiple changes when adding params

* consolidate params

* fix compilation issue

* fix failed test

* fix wrong name

* tyep conversion
 2019-08-28 22:41:05 -07:00
Nan Zhu 7b5cbcc846 [jvm-packages] cleaning checkpoint file after a successful training (#4754) 
* cleaning checkpoint file after a successful file

* address comments
 2019-08-14 10:57:47 -07:00
Nan Zhu d5c386ae24 Update CONTRIBUTORS.md 2019-07-24 09:38:47 -07:00
Nan Zhu 1595e3f57b upgrade version num (#4670) 
* upgrade version num

* missign changes

* fix version script

* change versions

* rm files

* Update CMakeLists.txt
 2019-07-17 15:25:35 -07:00
Nan Zhu 01b0c9047c [jvm-packages] allowing chaining prediction (#4667) 
* add test for chaining prediction

* update rabit

* Update XGBoostGeneralSuite.scala
 2019-07-17 08:50:27 -07:00
Nan Zhu dba32d54d1 shutdown for multiple times (#99) 2019-07-16 12:41:39 -07:00
Nan Zhu 3e339d9557 contribute to community doc (#4646) 
* add community doc

* update

* update
 2019-07-14 21:29:57 -07:00
Nan Zhu abffbe014e [jvm-packages] delete all constraints from spark layer about obj and eval metrics and handle error in jvm layer (#4560) 
* temp

* prediction part

* remove supported*

* add for test

* fix param name

* add rabit

* update rabit

* return value of rabit init

* eliminate compilation warnings

* update rabit

* shutdown

* update rabit again

* check sparkcontext shutdown

* fix logic

* sleep

* fix tests

* test with relaxed threshold

* create new thread each time

* stop for job quitting

* udpate rabit

* update rabit

* update rabit

* update git modules
 2019-06-27 08:47:37 -07:00
Nan Zhu fe2de6f415 [jvm-packages]fix silly bug in feature scoring (#4604) 2019-06-25 20:49:01 -07:00
Nan Zhu 65b718a5e7 return values in Init and Finalize (#96) 
* make inti function return values

* address the comments
 2019-06-25 20:05:54 -07:00
Nan Zhu fc85f776f4 allow not stop process in error (#97) 
* allow not stop process in error

* fix merge error
 2019-06-25 13:04:39 -07:00
Nan Zhu adcd8ea7c6 Update xgboost4j_spark_tutorial.rst (#4476) 2019-05-17 04:17:57 +00:00
Nan Zhu 253fdd8a42 [jvm-packages] fix the split of input (#4417) 2019-04-29 18:52:40 -07:00
Nan Zhu 37dc82c3ff [jvm-packages] allow partial evaluation of dataframe before prediction (#4407) 
* allow partial evaluation of dataframe before prediction

* resume spark test

* comments

* Run unit tests after building JVM packages
 2019-04-26 21:02:40 -07:00
Nan Zhu a429748e24 allow multi call on init (#92) 2019-04-26 18:41:02 -07:00
Nan Zhu 995698b0cb [BREAKING][jvm-packages] fix the non-zero missing value handling (#4349) 
* fix the nan and non-zero missing value handling

* fix nan handling part

* add missing value

* Update MissingValueHandlingSuite.scala

* Update MissingValueHandlingSuite.scala

* stylistic fix
 2019-04-26 11:10:33 -07:00
Nan Zhu 65db8d0626 [jvm-packages] support spark 2.4 and compatibility test with previous xgboost version (#4377) 
* bump spark version

* keep float.nan

* handle brokenly changed name/value

* add test

* add model files

* add model files

* update doc
 2019-04-17 11:33:13 -07:00
Nan Zhu ad4de0d718 [jvm-packages] handle NaN as missing value explicitly (#4309) 
* handle nan

* handle nan explicitly

* make code better and handle sparse vector in spark

* Update XGBoostGeneralSuite.scala
 2019-03-30 19:34:26 +08:00
Nan Zhu 45c89a6792 [jvm-packages] logging version number (#4271) 
* print version number

* add property file
 2019-03-21 18:24:29 +08:00
Nan Zhu 359ed9c5bc [jvm-packages] add configuration flag to control whether to cache transformed training set (#4268) 
* control whether to cache data

* uncache
 2019-03-18 10:13:28 +08:00
Nan Zhu 5f34078fba [jvm-packages] bump version for master (#4209) 
* update version

* bump version
 2019-03-04 23:12:24 -08:00
Nan Zhu 1b7405f688 [jvm-packages] fix comments in objectiveTrait (#4174) 2019-02-22 00:32:13 -08:00
Nan Zhu dc2add96c5 [jvm-packages] upgrade spark version (#4170) 2019-02-21 11:51:36 -08:00
Nan Zhu 1dac5e2410 more correct way to build node stats in distributed fast hist (#4140) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* more changes

* temp

* update

* udpate rabit

* change the histogram

* update kfactor

* sync per node stats

* temp

* update

* final

* code clean

* update rabit

* more cleanup

* fix errors

* fix failed tests

* enforce c++11

* broadcast subsampled feature correctly

* init col

* temp

* col sampling

* fix histmastrix init

* fix col sampling

* remove cout

* fix out of bound access

* fix core dump

remove core dump file

* update

* add fid

* update

* revert some changes

* temp

* temp

* pass all tests

* bring back some tests

* recover some changes

* fix lint issue

* enable monotone and interaction constraints

* don't specify default for monotone and interactions

* recover column init part

* more recovery

* fix core dumps

* code clean

* revert some changes

* fix test compilation issue

* fix lint issue

* resolve compilation issue

* fix issues of lint caused by rebase

* fix stylistic changes and change variable names

* modularize depth width

* address the comments

* fix failed tests

* wrap perf timers with class

* temp

* pass all lossguide

* pass tests

* add comments

* more changes

* use separate flow for single and tests

* add test for lossguide hist

* remove duplications

* syncing stats for only once

* recover more changes

* recover more changes

* fix root-stats

* simplify code

* remove outdated comments
 2019-02-18 13:45:30 -08:00
Nan Zhu c18a3660fa Separate Depthwidth and Lossguide growing policy in fast histogram (#4102) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* init

* more changes

* temp

* update

* udpate rabit

* change the histogram

* update kfactor

* sync per node stats

* temp

* update

* final

* code clean

* update rabit

* more cleanup

* fix errors

* fix failed tests

* enforce c++11

* broadcast subsampled feature correctly

* init col

* temp

* col sampling

* fix histmastrix init

* fix col sampling

* remove cout

* fix out of bound access

* fix core dump

remove core dump file

* disbale test temporarily

* update

* add fid

* print perf data

* update

* revert some changes

* temp

* temp

* pass all tests

* bring back some tests

* recover some changes

* fix lint issue

* enable monotone and interaction constraints

* don't specify default for monotone and interactions

* recover column init part

* more recovery

* fix core dumps

* code clean

* revert some changes

* fix test compilation issue

* fix lint issue

* resolve compilation issue

* fix issues of lint caused by rebase

* fix stylistic changes and change variable names

* use regtree internal function

* modularize depth width

* address the comments

* fix failed tests

* wrap perf timers with class

* fix lint

* fix num_leaves count

* fix indention

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.h

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.cc

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* Update src/tree/updater_quantile_hist.h

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>

* merge

* fix compilation
 2019-02-13 12:56:19 -08:00
Nan Zhu 3320a52192 [jvm-packages] force use per-group weights in spark layer (#4118) 2019-02-10 05:38:03 +08:00
Nan Zhu 05243642bb [jvm-packages] better fix for shutdown applications (#4108) 
* intentionally failed task

* throw exception

* more

* stop sparkcontext directly

* stop from another thread

* new scope

* use a new thread

* daemon threads

* don't join the killer thread

* remove injected errors

* add comments
 2019-02-07 09:02:17 -08:00
Nan Zhu 325b16bccd [jvm-packages] fix return type of setEvalSets (#4105) 2019-02-06 11:00:29 -08:00
Nan Zhu ae3bb9c2d5 Distributed Fast Histogram Algorithm (#4011) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* init

* allow hist algo

* more changes

* temp

* update

* remove hist sync

* udpate rabit

* change hist size

* change the histogram

* update kfactor

* sync per node stats

* temp

* update

* final

* code clean

* update rabit

* more cleanup

* fix errors

* fix failed tests

* enforce c++11

* fix lint issue

* broadcast subsampled feature correctly

* revert some changes

* fix lint issue

* enable monotone and interaction constraints

* don't specify default for monotone and interactions

* update docs
 2019-02-05 05:12:53 -08:00
Nan Zhu 0d0ce32908 [jvm-packages] adding logs for parameters (#4091) 2019-01-30 21:50:55 -08:00
Nan Zhu e0094d996e fix doc about max_depth (#4078) 
* fix doc

* Update doc/parameter.rst

Co-Authored-By: CodingCat <CodingCat@users.noreply.github.com>
 2019-01-30 12:53:44 -08:00
Nan Zhu 773ddbcfcb [BLOCKING] fix the issue with infrequent feature (#4045) 
* fix the issue with infrequent feature

* handle exception

* use only 2 workers

* address the comments
 2019-01-06 16:01:03 -08:00
Nan Zhu e290ec9a80 [jvm-packages] fix safe execution (#4046) 2019-01-05 19:45:37 -08:00
Nan Zhu f368d0de2b [jvm-packages] fix the scalability issue of prediction (#4033) 2018-12-29 20:46:30 -08:00
Nan Zhu c055a32609 [jvm-packages]support multiple validation datasets in Spark (#3910) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* wrap iterators

* enable copartition training and validationset

* add parameters

* converge code path and have init unit test

* enable multi evals for ranking

* unit test and doc

* update example

* fix early stopping

* address the offline comments

* udpate doc

* test eval metrics

* fix compilation issue

* fix example
 2018-12-17 21:03:57 -08:00
Nan Zhu 9c4ff50e83 [jvm-packages]Fix early stopping condition (#3928) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* update version

* 0.82

* fix early stopping condition

* remove unused

* update comments

* udpate comments

* update test
 2018-11-24 00:18:07 -08:00
Nan Zhu dc2bfbfde1 [jvm-packages] update version to 0.82-SNAPSHOT (#3920) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* update version

* 0.82
 2018-11-18 16:47:48 -08:00
Nan Zhu aa48b7e903 [jvm-packages][refactor] refactor XGBoost.scala (spark) (#3904) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* wrap iterators

* remove unused code

* refactor

* fix typo
 2018-11-15 20:38:28 -08:00
Nan Zhu 5fbe230636 [jvm-packages] documenting tracker (#3831) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* documenting tracker

* Make it a separate note
 2018-10-25 18:53:46 -07:00
Nan Zhu 4ae225a08d [Blocking][jvm-packages] fix the early stopping feature (#3808) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* temp

* add method for classifier and regressor

* update tutorial

* address the comments

* update
 2018-10-23 14:53:13 -07:00
Nan Zhu 785094db53 [jvm-packages] fix issue when spark job execution thread cannot return before we execute first() (#3758) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* sparjJobThread

* update

* fix issue when spark job execution thread cannot return before we execute first()
 2018-10-05 22:20:50 -07:00
Nan Zhu 79d854c695 [jvm-packages] fix errors in example (#3719) 
* add back train method but mark as deprecated

* fix scalastyle error

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix scalastyle error

* instrumentation

* use log console

* better measurement

* fix erros in example

* update histmaker
 2018-09-22 16:39:38 -07:00
Nan Zhu aa53e9fc8d [jvm-packages] bump spark version (#3709) 2018-09-19 11:18:01 -07:00
Nan Zhu d1e75d615e [jvm-packages] Remove copy paste error in test suite (#3692) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* remove copy paste error
 2018-09-11 13:08:36 -07:00
Nan Zhu 3261002099 [jvm-packages] throw ControlThrowable instead of InterruptedException (#3632) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* interrupted exception is not rethrown
 2018-08-25 20:30:21 -07:00
Nan Zhu 4912c1f9c6 [jvm-packages] fix checkpoint save/load (#3614) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix update checkpoint func
 2018-08-21 12:34:24 -07:00
Nan Zhu 73bd590a1d [jvm-packages] add the missing scm urls (#3589) 
for some reason this part was missing in master branch????
 2018-08-14 15:05:23 -07:00
Nan Zhu 1c08b3b2ea [jvm-packages] enable predictLeaf/predictContrib/treeLimit in 0.8 (#3532) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* partial finish

* no test

* add test cases

* add test cases

* address comments

* add test for regressor

* fix typo
 2018-08-07 14:01:18 -07:00
Nan Zhu 31d1baba3d [jvm-packages] Tutorial of XGBoost4J-Spark (#3534) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* add new

* update doc

* finish Gang Scheduling

* more

* intro

* Add sections: Prediction, Model persistence and ML pipeline.

* Add XGBoost4j-Spark MLlib pipeline example

* partial finished version

* finish the doc

* adjust code

* fix the doc

* use rst

* Convert XGBoost4J-Spark tutorial to reST

* Bring XGBoost4J up to date

* add note about using hdfs

* remove duplicate file

* fix descriptions

* update doc

* Wrap HDFS/S3 export support as a note

* update

* wrap indexing_mode example in code block
 2018-08-03 21:17:50 -07:00
Nan Zhu 6cf97b4eae [jvm-packages] consider spark.task.cpus when controlling parallelism (#3530) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* consider spark.task.cpus when controlling parallelism

* fix bug

* fix conf setup

* calculate requestedCores within ParallelismController

* enforce spark.task.cpus = 1

* unify unit test case framework

* enable spark ui
 2018-07-31 06:19:45 -07:00
Nan Zhu b546321c83 [jvm-packages] the current version of xgboost does not consider missing value in prediction (#3529) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* consider missing value in prediction

* handle single prediction instance

* fix type conversion
 2018-07-30 14:16:24 -07:00
Nan Zhu b5178d3d99 [jvm-packages] a better explanation about the inconsistent issue (#3524) 2018-07-28 17:34:39 -07:00
Nan Zhu e2f09db77a [jvm-packages] minor fix for parameter name in example (#3507) 2018-07-25 19:57:40 -07:00
Nan Zhu aa90e5c6ce [jvm-packages] disable booster setup for xgboost4j-spark (#3456) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* disable booster setup in spark

* check in parameter conversion

* fix compilation issue

* update exception type
 2018-07-07 21:57:24 -07:00
Nan Zhu d062c6f61b [jvm-packages] Maven central release stuffs (#3401) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* maven central release
 2018-06-22 06:41:28 -07:00
Nan Zhu f66731181f Update 0.8 version num (#3358) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* update 0.80
 2018-06-02 07:06:01 -07:00
Nan Zhu 49b9f39818 [jvm-packages] update xgboost4j cross build script to be compatible with older glibc (#3307) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* static glibc glibc++

* update to build with glib 2.12

* remove unsupported flags

* update version number

* remove properties

* remove unnecessary command

* update poms
 2018-05-10 06:39:44 -07:00
Nan Zhu e1f57b4417 [jvm-packages] scripts to cross-build and deploy artifacts to github (#3276) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* cross building files

* update

* build with docker

* remove

* temp

* update build script

* update pom

* update

* update version

* upload build

* fix path

* update README.md

* fix compiler version to 4.8.5
 2018-04-28 07:41:30 -07:00
Nan Zhu 25b2919c44 [jvm-packages] change version of jvm to keep consistent with other pkgs (#3253) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* change version of jvm to keep consistent with other pkgs
 2018-04-19 20:48:50 -07:00
Nan Zhu d9dd485313 [jvm-packages] upgrade spark version to 2.3 (#3254) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* update default spark version to 2.3
 2018-04-19 20:15:19 -07:00
Nan Zhu 4109818b32 [jvm-packages] add back libsvm notes (#3232) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* add back libsvm notes
 2018-04-10 09:00:58 -07:00
Nan Zhu a187ed6c8f [jvm-packages] tiny fix for empty partition in predict (#3014) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* tiny fix for empty partition in predict

* further fix
 2018-01-07 08:34:18 -08:00
Nan Zhu 9747ea2acb [jvm-packages] fix the pattern in dev script and version mismatch (#3009) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* fix the pattern in dev script and version mismatch
 2018-01-06 06:59:38 -08:00
Nan Zhu 14c6392381 [jvm-packages] add dev script to update version and update versions (#2998) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* add dev script to update version and update versions
 2018-01-01 21:28:53 -08:00
Nan Zhu 005a4a5e47 [jvm-packages] fix numAliveCores in SparkParallelismTracker when WebUI is disabled (#2990) 
* add back train method but mark as deprecated

* add back train method but mark as deprecated

* fix scalastyle error

* fix scalastyle error

* update resource files

* Update SparkParallelismTracker.scala

* remove xgboost-tracker.properties
 2017-12-29 19:22:58 -08:00
Nan Zhu 4fa917b19f Update .travis.yml (#2951) 2017-12-15 13:09:36 -08:00
Nan Zhu 1190dc62a7 Update CONTRIBUTORS.md (#2719) 2017-09-17 15:07:57 -07:00
Nan Zhu e24f25e0c6 add Qubole example (#2401) 2017-06-09 20:33:26 -07:00
Nan Zhu 96f9776ab0 Update ISSUE_TEMPLATE.md (#2308) 
* Update ISSUE_TEMPLATE.md

* Update ISSUE_TEMPLATE.md
 2017-05-18 08:49:07 -07:00
Nan Zhu a607f697e3 [jvm-packages] Disable fast histo for spark (#2296) 
* add back train method but mark as deprecated

* fix scalastyle error

* disable fast histogram in xgboost4j-spark temporarily
 2017-05-15 20:43:16 -07:00
Nan Zhu 428453f7d6 [jvm-packages] fix the persistence of XGBoostEstimator (#2265) 
* add back train method but mark as deprecated

* fix scalastyle error

* fix the persistence of XGBoostEstimator

* test persistence of a complete pipeline

* fix compilation issue

* do not allow persist custom_eval and custom_obj

* fix the failed tesl
 2017-05-08 21:58:06 -07:00
Nan Zhu 392aa6d1d3 [jvm-packages] make XGBoostModel hold BoosterParams as well (#2214) 
* add back train method but mark as deprecated

* fix scalastyle error

* make XGBoostModel hold BoosterParams as well
 2017-04-21 08:12:50 -07:00
Nan Zhu a837fa9620 [jvm-packages] rdds containing boosters should be cleaned once we got boosters to driver (#2183) 2017-04-11 06:12:49 -07:00
Nan Zhu f08077606c [jvm-packages] Clean external cache (#2181) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* small fix for cleanExternalCache
 2017-04-10 07:49:58 -07:00
Nan Zhu 8d8cbcc6db [jvm-packages] fixed several issues in unit tests (#2173) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* fix several issues in tests
 2017-04-06 06:25:23 -07:00
Nan Zhu ab13fd72bd [jvm-packages] Scala/Java interface for Fast Histogram Algorithm (#1966) 
* add back train method but mark as deprecated

* fix scalastyle error

* first commit in scala binding for fast histo

* java test

* add missed scala tests

* spark training

* add back train method but mark as deprecated

* fix scalastyle error

* local change

* first commit in scala binding for fast histo

* local change

* fix df frame test
 2017-03-04 15:37:24 -08:00
Nan Zhu ac30a0aff5 [jvm-packages][spark]Preserve num classes (#2068) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* bump spark version to 2.1

* preserve num_class issues

* fix failed test cases

* rivising

* add multi class test
 2017-03-04 14:14:31 -08:00
Nan Zhu 63aec12a13 [jvm-packages] Bump spark to 2.1 (#2046) 2017-02-19 08:29:35 -08:00
Nan Zhu 185fe1d645 [jvm-packages] use ML's para system to build the passed-in params to XGBoost (#2043) 
* add back train method but mark as deprecated

* fix scalastyle error

* use ML's para system to build the passed-in params to XGBoost

* clean
 2017-02-18 11:56:27 -08:00
Nan Zhu 965091c4bb [jvm-packages] update methods in test cases to be consistent (#1780) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* update methods in test cases to be consistent

* add blank lines

* fix
 2016-11-20 22:49:18 -05:00
Nan Zhu 5217e53156 stylistic fix (#1789) 
* stylistic fix

* try multiple repos

* fix

* fix
 2016-11-19 22:03:10 -05:00
Nan Zhu 6082184cd1 [jvm-packages] update API docs (#1713) 
* add back train method but mark as deprecated

* fix scalastyle error

* update java doc

* update
 2016-10-27 18:53:22 -07:00
Nan Zhu d321375df5 [jvm-packages] Fix mis configure of nthread (#1709) 
* add back train method but mark as deprecated

* fix scalastyle error

* change class to object in examples

* fix compilation error

* fix mis configuration
 2016-10-27 12:10:35 -04:00
Nan Zhu f12074d355 [jvm-packages] release blog (#1706) 2016-10-26 21:35:42 -04:00
Nan Zhu f801c22710 [jvm-packages] change class to object in examples (#1703) 
* change class to object in examples

* fix compilation error
 2016-10-26 14:54:56 -04:00
Nan Zhu 016ab89484 [jvm-packages] Parameter tuning tool for XGBoost (#1664) 2016-10-23 16:58:18 -04:00
Nan Zhu f5c776f64f [jvm-packages] add apache maven repo url and bump up default spark version to 2.0.1 (#1650) 
* add apache maven repo url and bump up default spark version to 2.0.1
 2016-10-13 08:55:03 -04:00
Nan Zhu 813a53882a [jvm-packages] deprecate Flaky test (#1662) 
* deprecate flaky test
 2016-10-13 07:21:24 -04:00
Nan Zhu b56c6097d9 [jvm-packages] add Spark and XGBoost tutorial (#1649) 
* add back train method but mark as deprecated

* add Spark and XGBoost tutorial

* fix scalastyle error
 2016-10-11 09:41:24 -07:00
Nan Zhu 1673bcbe7e [jvm-packages] separate classification and regression model and integrate with ML package (#1608) 2016-09-30 11:49:03 -04:00
Nan Zhu 37bc122c90 [jvm-packages] Robust dmatrix creation (#1613) 
* add back train method but mark as deprecated

* robust matrix creation in jvm
 2016-09-26 13:35:04 -04:00
Nan Zhu 4ad648e856 [jvm-packages] predictLeaf with Dataframe (#1576) 
* add back train method but mark as deprecated

* predictLeaf with Dataset

* fix

* fix
 2016-09-15 06:15:47 -04:00
Nan Zhu bb388cbb31 default eval func (#1574) 2016-09-14 13:26:16 -04:00
Nan Zhu fb02797e2a [jvm-packages] Integration with Spark Dataframe/Dataset (#1559) 
* bump up to scala 2.11

* framework of data frame integration

* test consistency between RDD and DataFrame

* order preservation

* test order preservation

* example code and fix makefile

* improve type checking

* improve APIs

* user docs

* work around travis CI's limitation on log length

* adjust test structure

* integrate with Spark -1 .x

* spark 2.x integration

* remove spark 1.x implementation but provide instructions on how to downgrade
 2016-09-11 15:02:58 -04:00
Nan Zhu 6dabdd33e3 [jvm-packages] bump to next version (#1535) 
* bump to next version

* fix

* fix
 2016-09-01 12:18:21 -04:00