Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,044 Commits 32 Branches 59 Tags
69fc8a632f5d6a8afc66135ad4d8f102bb4e0d47
Commit Graph
10 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yun Ni 30d10ab035 Convert handle == nullptr from SegFault to user-friendly error. (#3021) 
* Convert SegFault to user-friendly error.

* Apply the change to DMatrix API as well
 2018-06-29 06:30:26 +00:00
Yun Ni 8b2f4e2d39 [jvm-packages] Move cache files to TempDirectory and delete this directory after XGBoost job finishes (#3022) 
* [jvm-packages] Move cache files to tmp dir and delete on exit

* Delete the cache dir when watches are deleted
 2018-01-20 21:13:25 -08:00
Yun Ni 3f3f54bcad [jvm-packages] Update docs and unify the terminology (#3024) 
* [jvm-packages] Move cache files to tmp dir and delete on exit

* [jvm-packages] Update docs and unify terminology

* Address CR Comments
 2018-01-16 17:16:55 +01:00
Yun Ni 740eba42f7 [jvm-packages] Add back the overriden finalize() method for SBooster (#3011) 
* Convert SIGSEGV to XGBoostError

* Address CR Comments

* Address CR Comments
 2018-01-06 14:07:37 -08:00
Yun Ni 65fb4e3f5c [jvm-packages] Prevent dispose being called on unfinalized JBooster (#3005) 
* [jvm-packages] Prevent dispose being called twice when finalize

* Convert SIGSEGV to XGBoostError

* Avoid creating a new SBooster with the same JBooster

* Address CR Comments
 2018-01-06 09:46:52 -08:00
Yun Ni 9004ca03ca [jvm-packages] Saving models into a tmp folder every a few rounds (#2964) 
* [jvm-packages] Train Booster from an existing model

* Align Scala API with Java API

* Existing model should not load rabit checkpoint

* Address minor comments

* Implement saving temporary boosters and loading previous booster

* Add more unit tests for loadPrevBooster

* Add params to XGBoostEstimator

* (1) Move repartition out of the temp model saving loop (2) Address CR comments

* Catch a corner case of training next model with fewer rounds

* Address comments

* Refactor newly added methods into TmpBoosterManager

* Add two files which is missing in previous commit

* Rename TmpBooster to checkpoint
 2017-12-29 08:36:41 -08:00
Yun Ni b678e1711d [jvm-packages] Add SparkParallelismTracker to prevent job from hanging (#2697) 
* Add SparkParallelismTracker to prevent job from hanging

* Code review comments

* Code Review Comments

* Fix unit tests

* Changes and unit test to catch the corner case.

* Update documentations

* Small improvements

* cancalAllJobs is problematic with scalatest. Remove it

* Code Review Comments

* Check number of executor cores beforehand, and throw exeception if any core is lost.

* Address CR Comments

* Add missing class

* Fix flaky unit test

* Address CR comments

* Remove redundant param for TaskFailedListener
 2017-10-16 20:18:47 -07:00
Yun Ni 8244f6f120 Use Sudo-enabled VM which has 7.5GB memory (#2680) 2017-09-07 08:36:37 -07:00
Yun Ni f04bde05fd Add Coverage Report for Java and Python (#2667) 
* Add coverage report for java

* Add coverage report for python

* Increase memory for JVM unit tests

* Increase memory for JVM unit tests
 2017-09-05 14:46:51 -07:00
Yun Ni a00157543d Support instance weights for xgboost4j-spark (#2642) 
* Support instance weights for xgboost4j-spark

* Use 0.001 instead of 0 for weights

* Address CR comments
 2017-08-28 09:03:20 -07:00