Deterministic data partitioning for external memory (#6317)

* Make external memory data partitioning deterministic. * Change the meaning of `page_size` from bytes to number of rows. * Design a data pool. * Note for external memory. * Enable unity build on Windows CI. * Force garbage collect on test.
2020-11-11 06:11:06 +08:00
parent 9564886d9f
commit 43efadea2e
15 changed files with 334 additions and 88 deletions
--- a/amalgamation/xgboost-all0.cc
+++ b/amalgamation/xgboost-all0.cc
@@ -44,6 +44,7 @@

 #if DMLC_ENABLE_STD_THREAD
 #include "../src/data/sparse_page_dmatrix.cc"
+#include "../src/data/sparse_page_source.cc"
 #endif

 // trees