Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,334 Commits 32 Branches 59 Tags
9c6e791e64afc8b10365ecc1ec2914dbe3b6554c
Commit Graph
361 Commits
Author SHA1 Message Date
boxdotandJiaming Yuan d268a2a463 Thread-safe prediction by making the prediction cache thread-local. (#5853) 
Co-authored-by: Jiaming Yuan <jm.yuan@outlook.com>
 2020-07-30 12:33:50 +08:00
Jiaming Yuan e4a273e1da Fix evaluate root split. (#5948) 2020-07-29 19:33:29 +08:00
Philip Hyunsu Cho ace7fd328b [R] Add a compatibility layer to load Booster object from an old RDS file (#5940) 
* [R] Add a compatibility layer to load Booster from an old RDS
* Modify QuantileHistMaker::LoadConfig() to be backward compatible with 1.1.x
* Add a big warning about compatibility in QuantileHistMaker::LoadConfig()
* Add testing suite
* Discourage use of saveRDS() in CRAN doc
 2020-07-26 00:06:49 -07:00
Jiaming Yuan a4de2f68e4 Use cudaOccupancyMaxPotentialBlockSize to calculate the block size. (#5926) 2020-07-23 14:24:42 +08:00
Philip Hyunsu Cho 4af857f95d Add explicit template specialization for portability (#5921) 
* Add explicit template specializations

* Adding Specialization for FileAdapterBatch
 2020-07-22 12:31:17 -07:00
Andy Adinets ac3f0e78dc Split Features into Groups to Compute Histograms in Shared Memory (#5795) 2020-07-07 15:04:35 +12:00
Philip Hyunsu Cho 1d22a9be1c Revert "Reorder includes. (#5749)" (#5771) 
This reverts commit d3a0efbf16.
 2020-06-09 10:29:28 -07:00
Jiaming Yuan d3a0efbf16 Reorder includes. (#5749) 
* Reorder includes.

* R.
 2020-06-03 17:30:47 +12:00
ShvetsKSSHVETS, KIRILLfis
 		cd3d14ad0e Add float32 histogram (#5624) 
* new single_precision_histogram param was added.

Co-authored-by: SHVETS, KIRILL <kirill.shvets@intel.com>
Co-authored-by: fis <jm.yuan@outlook.com>
 2020-06-03 11:24:53 +08:00
Rory Mitchell f779980f7e gpu_hist performance tweaks (#5707) 
* Remove device vectors

* Remove allreduce synchronize

* Remove double buffer
 2020-05-29 16:48:53 +12:00
Andy Adinets 646def51e0 C++14 for xgboost (#5664) 2020-05-21 12:26:40 +12:00
ShvetsKSandSHVETS, KIRILL dd01e4ba8d Distributed optimizations for 'hist' method with CPUs (#5557) 
Co-authored-by: SHVETS, KIRILL <kirill.shvets@intel.com>
 2020-05-20 06:03:03 +03:00
Jiaming Yuan 535479e69f Add JSON schema to model dump. (#5660) 2020-05-15 10:18:43 +08:00
Oleksandr Kuvshynov 4e64e2ef8e skip missing lookup if nothing is missing in CPU hist partition kernel. (#5644) 
* [xgboost] skip missing lookup if nothing is missing
 2020-05-12 05:50:08 +03:00
Rory Mitchell fcf57823b6 Reduce device synchronisation (#5631) 
* Reduce device synchronisation

* Initialise pinned memory
 2020-05-07 21:19:46 +12:00
Jiaming Yuan eaf2a00b5c Enhance nvtx support. (#5636) 2020-05-06 22:54:24 +08:00
Rory Mitchell b9649e7b8e Refactor gpu_hist split evaluation (#5610) 
* Refactor

* Rewrite evaluate splits

* Add more tests
 2020-04-30 08:58:12 +12:00
Jiaming Yuan c90457f489 Refactor the CLI. (#5574) 
* Enable parameter validation.
* Enable JSON.
* Catch `dmlc::Error`.
* Show help message.
 2020-04-26 10:56:33 +08:00
Andy Adinets 73142041b9 For histograms, opting into maximum shared memory available per block. (#5491) 2020-04-21 14:56:42 +12:00
Rory Mitchell b2827a80e1 Use non-synchronising scan (#5560) 2020-04-20 15:51:34 +12:00
Rory Mitchell d6d1035950 gpu_hist performance fixes (#5558) 
* Remove unnecessary cuda API calls

* Fix histogram memory growth
 2020-04-19 12:21:13 +12:00
Jiaming Yuan c245eb8755 Fix r interaction constraints (#5543) 
* Unify the parsing code.

* Cleanup.
 2020-04-18 06:53:51 +08:00
ShvetsKSandSHVETS, KIRILL a2d86b8e4b Optimizations for RNG in InitData kernel (#5522) 
* optimizations for subsampling in InitData

* optimizations for subsampling in InitData

Co-authored-by: SHVETS, KIRILL <kirill.shvets@intel.com>
 2020-04-16 18:24:32 +03:00
Rory Mitchell e268fb0093 Use thrust functions instead of custom functions (#5544) 2020-04-16 21:41:16 +12:00
Rory Mitchell ca4e05660e Purge device_helpers.cuh (#5534) 
* Simplifications with caching_device_vector

* Purge device helpers
 2020-04-15 21:51:56 +12:00
Jiaming Yuan 866a477319 Unify max nodes. (#5497) 2020-04-10 19:26:35 +08:00
Jiaming Yuan bd653fad4c Remove distcol updater. (#5507) 
Closes #5498.
 2020-04-10 12:52:56 +08:00
Jiaming Yuan 7d52c0b8c2 Requires setting leaf stat when expanding tree. (#5501) 
* Fix GPU Hist feature importance.
 2020-04-10 12:27:03 +08:00
Jiaming YuanandHyunsu Cho 0012f2ef93 Upgrade clang-tidy on CI. (#5469) 
* Correct all clang-tidy errors.
* Upgrade clang-tidy to 10 on CI.

Co-authored-by: Hyunsu Cho <chohyu01@cs.washington.edu>
 2020-04-05 04:42:29 +08:00
Jiaming Yuan 939973630d Accept other gradient types for split entry. (#5467) 2020-04-03 10:38:44 +08:00
ShvetsKS 27a8e36fc3 Reducing memory consumption for 'hist' method on CPU (#5334) 2020-03-28 14:45:52 +13:00
Jiaming Yuan ab7a46a1a4 Check whether current updater can modify a tree. (#5406) 
* Check whether current updater can modify a tree.

* Fix tree model JSON IO for pruned trees.
 2020-03-14 09:24:08 +08:00
Rory Mitchell b745b7acce Fix memory usage of device sketching (#5407) 2020-03-14 13:43:24 +13:00
Rory Mitchell 3ad4333b0e Partial rewrite EllpackPage (#5352) 2020-03-11 10:15:53 +13:00
Jiaming Yuan 8d06878bf9 Deterministic GPU histogram. (#5361) 
* Use pre-rounding based method to obtain reproducible floating point
  summation.
* GPU Hist for regression and classification are bit-by-bit reproducible.
* Add doc.
* Switch to thrust reduce for `node_sum_gradient`.
 2020-03-04 15:13:28 +08:00
Egor Smirnov 1b97eaf7a7 Optimized ApplySplit, BuildHist and UpdatePredictCache functions on CPU (#5244) 
* Split up sparse and dense build hist kernels.
* Add `PartitionBuilder`.
 2020-02-29 16:11:42 +08:00
Jiaming Yuan e0509b3307 Fix pruner. (#5335) 
* Honor the tree depth.
* Prevent pruning pruned node.
 2020-02-25 08:32:46 +08:00
Rory Mitchell b0ed3f0a66 Remove unnecessary DMatrix methods (#5324) 2020-02-25 12:40:39 +13:00
Jiaming Yuan 655cf17b60 Predict on Ellpack. (#5327) 
* Unify GPU prediction node.
* Add `PageExists`.
* Dispatch prediction on input data for GPU Predictor.
 2020-02-23 06:27:03 +08:00
Rong Ou e4b74c4d22 Gradient based sampling for GPU Hist (#5093) 
* Implement gradient based sampling for GPU Hist tree method.
* Add samplers and handle compacted page in GPU Hist.
 2020-02-04 10:31:27 +08:00
Egor Smirnov c67163250e Optimized BuildHist function (#5156) 2020-01-29 23:32:57 -08:00
Jiaming Yuan 7b65698187 Enforce correct data shape. (#5191) 
* Fix syncing DMatrix columns.
* notes for tree method.
* Enable feature validation for all interfaces except for jvm.
* Better tests for boosting from predictions.
* Disable validation on JVM.
 2020-01-13 15:48:17 +08:00
Egor Smirnov 7b17e76c5b Optimized EvaluateSplut function (#5138) 
* Add block based threading utilities.
 2019-12-31 18:18:42 +08:00
Jiaming Yuan 04db125699 Quick fix for memory leak in CPU Hist. (#5153) 
Closes https://github.com/dmlc/xgboost/issues/3579 .

* Don't use map.
 2019-12-31 14:05:53 +08:00
Jiaming Yuan 139ccc9902 Fix num_roots to be 1. (#5165) 2019-12-30 02:18:45 +08:00
Jiaming Yuan f3d7877802 Parameter validation (#5157) 
* Unused code.

* Split up old colmaker parameters from train param.

* Fix dart.

* Better name.
 2019-12-26 11:59:05 +08:00
Jiaming Yuan 3136185bc5 JSON configuration IO. (#5111) 
* Add saving/loading JSON configuration.
* Implement Python pickle interface with new IO routines.
* Basic tests for training continuation.
 2019-12-15 17:31:53 +08:00
Jiaming Yuan 208ab3b1ff Model IO in JSON. (#5110) 2019-12-11 11:20:40 +08:00
Jiaming Yuan e089e16e3d Pass pointer to model parameters. (#5101) 
* Pass pointer to model parameters.

This PR de-duplicates most of the model parameters except the one in
`tree_model.h`.  One difficulty is `base_score` is a model property but can be
changed at runtime by objective function.  Hence when performing model IO, we
need to save the one provided by users, instead of the one transformed by
objective.  Here we created an immutable version of `LearnerModelParam` that
represents the value of model parameter after configuration.
 2019-12-10 12:11:22 +08:00
Jiaming Yuan 1cb6bcc382 Remove dead code in colmaker. (#5105) 2019-12-10 09:32:37 +08:00