Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,333 Commits 32 Branches 59 Tags
0f145a0365d33ac0e48f2a4606c8fa1e3acd9a8d
Commit Graph
64 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Rory Mitchell 0f145a0365 Resolve GPU bug on large files (#3472) 
Remove calls to thrust copy, fix indexing bug
 2018-07-16 20:43:45 +12:00
Rory Mitchell 1b59316444 Updates for GPU CI tests (#3467) 
* Fail GPU CI after test failure

* Fix GPU linear tests

* Reduced number of GPU tests to speed up CI

* Remove static allocations of device memory

* Resolve illegal memory access for updater_fast_hist.cc

* Fix broken r tests dependency

* Update python install documentation for GPU
 2018-07-16 18:05:53 +12:00
Rory Mitchell 24fde92660 Build universal wheels using GPU CI (#3424) 2018-06-29 13:45:24 +00:00
Rory Mitchell a0a1df1aba Refactor python tests (#3410) 
* Add unit test utility

* Refactor updater tests. Add coverage for histmaker.
 2018-06-27 11:20:27 +12:00
Rory Mitchell a96039141a Dmatrix refactor stage 1 (#3301) 
* Use sparse page as singular CSR matrix representation

* Simplify dmatrix methods

* Reduce statefullness of batch iterators

* BREAKING CHANGE: Remove prob_buffer_row parameter. Users are instead recommended to sample their dataset as a preprocessing step before using XGBoost.
 2018-06-07 10:25:58 +12:00
Rory Mitchell 3f7696ff53 Cleanup old artefacts in Jenkins (#3361) 2018-06-05 15:16:37 +12:00
Rory Mitchell 3ee725e3bb Add cuda forwards compatibility (#3316) 2018-05-17 10:59:22 +12:00
Rory Mitchell f8b7686719 Add cuda 8/9.1 centos 6 builds, test GPU wheel on CPU only container. (#3309) 
* Add cuda 8/9.1 centos 6 builds, test GPU wheel on CPU only container.

* Add Google test
 2018-05-17 10:57:01 +12:00
Rory Mitchell 088bb4b27c Prevent multiclass Hessian approaching 0 (#3304) 
* Prevent Hessian in multiclass objective becoming zero

* Set default learning rate to 0.5 for "coord_descent" linear updater
 2018-05-09 20:25:51 +12:00
Rory Mitchell 90a5c4db9d Update Jenkins CI for GPU (#3294) 2018-05-04 16:50:59 +12:00
Rory Mitchell a185ddfe03 Implement GPU accelerated coordinate descent algorithm (#3178) 
* Implement GPU accelerated coordinate descent algorithm. 

* Exclude external memory tests for GPU
 2018-04-20 14:56:35 +12:00
Rory Mitchell ccf80703ef Clang-tidy static analysis (#3222) 
* Clang-tidy static analysis

* Modernise checks

* Google coding standard checks

* Identifier renaming according to Google style
 2018-04-19 18:57:13 +12:00
Rory Mitchell 443ff746e9 Fix logic in GPU predictor cache lookup (#3217) 
* Fix logic in GPU predictor cache lookup

* Add sklearn test for GPU prediction
 2018-04-04 15:08:22 +12:00
Rory Mitchell a1ec7b1716 Change reduce operation from thrust to cub. Fix for cuda 9.1 error (#3218) 
* Change reduce operation from thrust to cub. Fix for cuda 9.1 runtime error

* Unit test sum reduce
 2018-04-04 14:21:48 +12:00
Rory Mitchell 9fa45d3a9c Fix bug with gpu_predictor caching behaviour (#3177) 
* Fixes #3162
 2018-03-18 10:35:10 +13:00
Rory Mitchell 7a81c87dfa Fix incorrect minimum value in quantile generation (#3167) 2018-03-14 08:21:18 -07:00
Rory Mitchell dd82b28e20 Update GPU code with dmatrix changes (#3117) 2018-02-17 12:11:48 +13:00
Rory Mitchell 10eb05a63a Refactor linear modelling and add new coordinate descent updater (#3103) 
* Refactor linear modelling and add new coordinate descent updater

* Allow unsorted column iterator

* Add prediction cacheing to gblinear
 2018-02-17 09:17:01 +13:00
Rory Mitchell f87802f00c Fix GPU bugs (#3051) 
* Change uint to unsigned int

* Fix no root predictions bug

* Remove redundant splitting due to numerical instability
 2018-01-23 13:14:15 +13:00
Rory Mitchell 7759ab99ee Fix Google test warnings and error (#2957) 2017-12-20 00:13:56 +13:00
Rory Mitchell 1b77903eeb Fix several GPU bugs (#2916) 
* Fix #2905

* Fix gpu_exact test failures

* Fix bug in GPU prediction where multiple calls to batch prediction can produce incorrect results

* Fix GPU documentation formatting
 2017-12-04 08:27:49 +13:00
Rory Mitchell c51adb49b6 Monotone constraints for gpu_hist (#2904) 2017-11-30 10:26:19 +13:00
Rory Mitchell c55f14668e Update gpu_hist algorithm (#2901) 2017-11-27 13:44:24 +13:00
Rory Mitchell 24f527a1c0 AVX gradients (#2878) 
* AVX gradients

* Add google test for AVX

* Create fallback implementation, remove fma instruction

* Improved accuracy of AVX exp function
 2017-11-27 08:56:01 +13:00
Rory Mitchell 40c6e2f0c8 Improved gpu_hist_experimental algorithm (#2866) 
- Implement colsampling, subsampling for gpu_hist_experimental

 - Optimised multi-GPU implementation for gpu_hist_experimental

 - Make nccl optional

 - Add Volta architecture flag

 - Optimise RegLossObj

 - Add timing utilities for debug verbose mode

 - Bump required cuda version to 8.0
 2017-11-11 13:58:40 +13:00
Rory Mitchell 16c63f30d0 Fix MultiIndex detection (breaks for latest pandas==0.21.0). (#2872) 2017-11-11 11:12:23 +13:00
Rory Mitchell d9d5293cdb Add warnings for large labels when using GPU histogram algorithms (#2834) 2017-10-26 17:31:10 +13:00
Rory Mitchell 13e7a2cff0 Various bug fixes (#2825) 
* Fatal error if GPU algorithm selected without GPU support compiled

* Resolve type conversion warnings

* Fix gpu unit test failure

* Fix compressed iterator edge case

* Fix python unit test failures due to flake8 update on pip
 2017-10-25 14:45:01 +13:00
Rory Mitchell 4cb2f7598b -Add experimental GPU algorithm for lossguided mode (#2755) 
-Improved GPU algorithm unit tests
-Removed some thrust code to improve compile times
 2017-10-01 00:18:35 +13:00
Rory Mitchell 55ba362154 Fix cuda 9.0 compilation (#2718) 2017-09-17 17:13:11 +12:00
Rory Mitchell 9c85903f0b Add GPU documentation (#2695) 
* Add GPU documentation

* Update Python GPU tests
 2017-09-10 19:42:46 +12:00
Rory Mitchell e6a9063344 Integer gradient summation for GPU histogram algorithm. (#2681) 2017-09-08 15:07:29 +12:00
Rory Mitchell 15267eedf2 [GPU-Plugin] Major refactor 2 (#2664) 
* Change cmake option

* Move source files

* Move google tests

* Move python tests

* Move benchmarks

* Move documentation

* Remove makefile support

* Fix test run

* Move GPU tests
 2017-09-08 09:57:16 +12:00
Rory Mitchell 19a53814ce [GPU-Plugin] Major refactor (#2644) 
* Removal of redundant code/files.
* Removal of exact namespace in GPU plugin
* Revert double precision histograms to single precision for performance on Maxwell/Kepler
 2017-08-30 10:53:52 +12:00
Rory Mitchell 70071fc38c Fix demo typo (#2632) 2017-08-23 17:21:51 +02:00
Rory Mitchell 332b26df95 Update GPU acceleration demo (#2617) 
* Update GPU acceleration demo

* Fix parameter formatting
 2017-08-19 21:27:48 +12:00
Rory Mitchell 5661a67d20 Add parallel sort for MSVC (#2609) 2017-08-17 17:14:39 +12:00
Rory Mitchell ef23e424f1 [GPU-Plugin] Add GPU accelerated prediction (#2593) 
* [GPU-Plugin] Add GPU accelerated prediction

* Improve allocation message

* Update documentation

* Resolve linker error for predictor

* Add unit tests
 2017-08-16 12:31:59 +12:00
Rory Mitchell 71e5e622b1 Update cub submodule again (fixes GPU build) (#2599) 2017-08-13 22:14:40 +12:00
Rory Mitchell ac2d0d0ac5 Updated cub submodule reference (#2597) 2017-08-12 23:00:56 -07:00
Rory Mitchell eda9e180f0 [GPU-Plugin] Various fixes (#2579) 
* Fix test large

* Add check for max_depth 0

* Update readme

* Add LBS specialisation for dense data

* Add bst_gpair_precise

* Temporarily disable accuracy tests on test_large.py

* Solve unused variable compiler warning

* Fix max_bin > 1024 error
 2017-08-05 22:16:23 +12:00
Rory Mitchell 0e06d1805d [WIP] Extract prediction into separate interface (#2531) 
* [WIP] Extract prediction into separate interface

* Add copyright, fix linter errors

* Add predictor to amalgamation

* Fix documentation

* Move prediction cache into predictor, add GBTreeModel

* Updated predictor doc comments
 2017-07-28 17:01:03 -07:00
Rory Mitchell 56550ff3f1 Fix pylint (#2537) 2017-07-21 11:41:56 +12:00
Rory Mitchell c85bf9859e [GPU-Plugin] Improved load balancing search (#2521) 2017-07-17 11:50:57 +12:00
Rory Mitchell 530f01e21c [GPU-Plugin] Add load balancing search to gpu_hist. Add compressed iterator. (#2504) 2017-07-11 22:36:39 +12:00
Rory Mitchell 6bfc472bec Update nccl (#2494) 2017-07-07 12:36:26 +12:00
Rory Mitchell e939192978 Cmake improvements (#2487) 
* Cmake improvements
* Add google test to cmake
 2017-07-06 18:05:11 +12:00
Rory Mitchell ed8bc4521e [GPU-Plugin] Resolve double compilation issue (#2479) 2017-07-03 13:29:10 +12:00
Rory Mitchell 5f1b0bb386 [GPU-Plugin] Unify gpu_gpair/bst_gpair. Refactor. (#2477) 2017-07-01 17:31:13 +12:00
Rory Mitchell 48f3003302 [GPU-Plugin] Change GPU plugin to use tree_method parameter, bump cmake version to 3.5 for GPU plugin, add compute architecture 3.5, remove unused cmake files (#2455) 2017-06-29 16:19:45 +12:00
Rory Mitchell 0e48f87529 [GPU-Plugin] Make node_idx type 32 bit for hist algo. Set default n_gpus to 1. (#2445) 2017-06-23 18:26:45 +12:00
Rory Mitchell 1899f9e744 [GPU-Plugin] Add basic continuous integration for GPU plugin. (#2431) 2017-06-22 10:15:28 -04:00
Rory Mitchell 6bf968efe6 [GPU Plugin] Fast histogram speed improvements. Updated benchmarks. (#2258) 2017-05-08 09:21:38 -07:00
Rory Mitchell 8ab5d4611c [GPU-Plugin] (#2227) 
* Add fast histogram algorithm
* Fix Linux build
* Add 'gpu_id' parameter
 2017-04-25 16:37:10 -07:00
Rory Mitchell a33fa05bda GPU Plugin: Bug fix #2048 (#2155) 2017-03-29 10:10:57 -07:00
Rory Mitchell 1957e6fb4d Fix cmake build for linux. Update GPU benchmarks. (#1904) 2016-12-23 09:18:56 +01:00
Rory Mitchell b49b339183 GPU Plugin: Add subsample, colsample_bytree, colsample_bylevel (#1895) 2016-12-22 16:30:36 +01:00
Rory Mitchell d943720883 GPU Plugin: Add bosch demo, update build instructions (#1872) 2016-12-15 07:57:27 +01:00
RAMitchell 2b6aa7736f Add benchmarks, fix GCC build (#1848) 2016-12-08 18:59:10 +01:00
RAMitchell be2f28ec08 Update build instructions, improve memory usage (#1811) 2016-11-25 09:43:22 -08:00
RAMitchell e3a7f85f15 GPU plug-in improvements + basic Windows continuous integration (#1752) 
* GPU Plugin: Reduce memory, improve performance, fix gcc compiler bug, add
out of memory exceptions

* Add basic Windows continuous integration for cmake VS2013, VS2015
 2016-11-10 12:34:09 -08:00
RAMitchell ac41845d4b Add GPU accelerated tree construction plugin (#1679) 2016-10-20 20:14:47 -07:00
RAMitchell f8d23b97be Add build instructions for Visual Studio 2013 (#1327) 2016-07-03 21:30:50 -07:00
RAMitchell 93196eb811 cmake build system (#1314) 
* Changed c api to compile under MSVC

* Include functional.h header for MSVC

* Add cmake build
 2016-07-02 19:07:35 -07:00