Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
466 Commits 32 Branches 59 Tags
a8f00cc4a59d84d4bc1c916c2b684315e0d60fd7
Commit Graph
54 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
nachocano aebb7998a3 updating doc 2015-01-16 00:45:04 -08:00
nachocano b87da8fe9a small typo 2015-01-15 10:52:39 -08:00
nachocano 7d67f6f26d removing section 2015-01-15 01:24:04 -08:00
nachocano 34c8253ad6 Merge branch 'master' of https://github.com/tqchen/allreduce 2015-01-15 01:22:21 -08:00
nachocano 86e61ad6a5 adding changes suggested by Tianqi 2015-01-15 01:21:40 -08:00
nachocano f79e5fc041 adding more stuff 2015-01-13 01:00:58 -08:00
nachocano 95c6d7398f adding more stuff 2015-01-13 00:59:20 -08:00
nachocano 5c7967e863 adding link 2015-01-13 00:49:57 -08:00
nachocano 54e2f7e90d adding wrapper section 2015-01-13 00:48:37 -08:00
nachocano 48c42bf189 fixing stuff 2015-01-13 00:18:46 -08:00
nachocano 92c94176c1 adding some changes to kmeans 2015-01-13 00:13:05 -08:00
nachocano 8dd94461e1 guide 2015-01-12 00:24:46 -08:00
nachocano 9e04ab62fb adding breaks 2015-01-12 00:23:42 -08:00
nachocano 9907bafa1d fix 2015-01-12 00:20:43 -08:00
nachocano 30f3971bee adding more description to toolkit 2015-01-12 00:14:40 -08:00
nachocano d269cb9c50 guide stuff 2015-01-11 01:43:32 -08:00
nachocano 2d97833f48 slightly change 2015-01-11 01:35:04 -08:00
nachocano eef79067a8 more cosmetic stuff 2015-01-11 01:31:10 -08:00
nachocano aea4c10847 cosmetic changes to tutorial 2015-01-11 01:07:51 -08:00
nachocano 20b03e781c to run all executables 2014-12-06 15:37:09 -08:00
nachocano fcf2f0a03d to stderr 2014-12-06 15:22:29 -08:00
nachocano cd8ab469ff Merge branch 'master' of https://github.com/tqchen/allreduce 2014-12-06 15:14:19 -08:00
nachocano 659b9cd517 changing number of repetitions 2014-12-06 15:14:14 -08:00
nachocano 9ed59e71f6 speed runner 2014-12-06 12:09:40 -08:00
nachocano e0053c62e1 adding executable 2014-12-06 12:05:08 -08:00
nachocano 8f0d7d1d3e changing to -ho not to conflict with help 2014-12-06 12:01:05 -08:00
nachocano 771891491c Merge branch 'master' of https://github.com/tqchen/allreduce 2014-12-06 11:59:22 -08:00
nachocano f203d13efc speed runner 2014-12-06 11:59:16 -08:00
nachocano 14e400226a submit mpi to include machine file 2014-12-06 11:33:05 -08:00
nachocano 67b68ceae6 adding timing 2014-12-05 16:00:47 -08:00
nachocano 54eb5623cb worked on my machine !!! finally 2014-12-05 15:24:00 -08:00
nachocano d9c22e54de closer, but still does not work... stays in map 100%. I think an exception is being thrown 2014-12-05 13:28:42 -08:00
nachocano bb7d6814a7 creating initial version of hadoop submit script. Not working. 
Not sure how to get the master uri and port. I believe I cannot do it before I launch the job.

Updating the name from submit_job to submit_job_mpi
 2014-12-05 03:27:02 -08:00
nachocano e00fb99e7b cosmetic 2014-12-04 19:02:11 -08:00
nachocano e9a3f5169e cosmetic changes 2014-12-04 18:02:07 -08:00
nachocano 7d314fef78 open for writing 2014-12-03 21:58:58 -08:00
nachocano dece767084 Revert "open for writing" 
This reverts commit 63bf9c7995.
 2014-12-03 21:58:33 -08:00
nachocano 63bf9c7995 open for writing 2014-12-03 21:58:17 -08:00
nachocano e3a95b2d1a Merge branch 'master' of https://github.com/tqchen/allreduce 2014-12-03 15:39:05 -08:00
nachocano 5c23b94069 updating kmeans based on Tianqi feedback. More efficient now 2014-12-03 15:38:58 -08:00
nachocano 55c2a5dc83 Merge branch 'master' of https://github.com/tqchen/allreduce 2014-12-03 14:21:42 -08:00
nachocano 1d0d5bb141 kmeans seems to be working.. not restarting anything though 2014-12-03 14:21:10 -08:00
nachocano 20b51cc9ce cleaner 2014-12-03 01:44:34 -08:00
nachocano 56aad86231 adding incomplete kmeans. 
I'm having a problem with the broadcast, and still need to implement the logic
 2014-12-03 01:16:13 -08:00
nachocano 8cb5b68cb6 Merge branch 'master' of https://github.com/tqchen/allreduce 2014-12-02 11:28:27 -08:00
nachocano e4abca9494 changing report folder to doc 2014-12-02 11:28:20 -08:00
nachocano 2fab05c83e adding some design goals. 2014-12-02 11:07:07 -08:00
nachocano 40f7ee1cab adding simple image 2014-12-02 01:49:54 -08:00
nachocano 2c166d7a3a adding some initial skeleton of the report. 2014-12-02 01:19:36 -08:00
nachocano a8128493c2 execute it like this: ./test.sh 4 4000 testcase0.conf ./ 
Now we are passing the folder where the round instances are saved.
The problem is that calling utils::Check or utils::Assert on 1 or 2 nodes, shutdowns all of them. Only those should be shutdown and this will work. There maybe some other mechanism to shutdown a particular node. Tianqi?
 2014-11-28 01:48:26 -08:00
nachocano faed8285cd execute it like ./test.sh 4 4000 testcase0.conf to obtain a successful execution 
updating mock. It now wraps the calls to sync and reads config from configuration file.
I believe it's better not to use the preprocessor directive, i.e. not to put any test code in the engine_tcp. I just call the mock in the test_allreduce file. It's a file purely for testing purposes, so it's fine to use the mock there.
 2014-11-28 00:16:35 -08:00
nachocano 21f3f3eec4 adding const to variable to comply with google code convention... 
may need to change more stuff though. Taint what else do you mean? Spaces, tabs, names?
 2014-11-27 17:03:31 -08:00
nachocano c565104491 adding some references to mock inside TEST preprocessor directive. 
It shouldn't be an assert because it shutdowns the process. Instead should check on the value and return some sort of error, so that we can recover.
The mock contains queues, indexed by the rank of the process. For each node, you can configure the behavior you expect (success or failure for now) when you call any of the methods (AllReduce, Broadcast, LoadCheckPoint and CheckPoint)... If you call several times AllReduce, the outputs will pop from the queue, i.e., first you can retrieve a success, then a failure and so on.
Pretty basic for now, need to tune it better
 2014-11-26 17:24:29 -08:00
nachocano 54fcff189f dummy mock for now 2014-11-26 16:37:23 -08:00