Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[Breaking][jvm-packages] remove timeoutRequestWorkers parameter (#7839)

Browse Source
This commit is contained in:
Bobby Wang
2022-05-13 16:26:25 +08:00
committed by GitHub
parent 11d65fcb21
commit 9fa7ed1743
6 changed files with 7 additions and 39 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
jvm-packages/xgboost4j-example/src/main/scala/ml/dmlc/xgboost4j/scala/example/spark/SparkTraining.scala
View File

@@ -1,5 +1,5 @@
/*
Copyright (c) 2014 by Contributors
Copyright (c) 2014-2022 by Contributors
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -62,11 +62,12 @@ object SparkTraining {
val Array(train, eval1, eval2, test) = xgbInput.randomSplit(Array(0.6, 0.2, 0.1, 0.1))
/**
* setup "timeout_request_workers" -> 60000L to make this application if it cannot get enough resources
* to get 2 workers within 60000 ms
* setup spark.scheduler.barrier.maxConcurrentTasksCheck.interval and
* spark.scheduler.barrier.maxConcurrentTasksCheck.maxFailures to make this application
* if it cannot get enough resources to get 2 workers within interval * maxFailures s
*
* setup "checkpoint_path" -> "/checkpoints" and "checkpoint_interval" -> 2 to save checkpoint for every
* two iterations
* setup "checkpoint_path" -> "/checkpoints" and "checkpoint_interval" -> 2 to save
* checkpoint for every two iterations
*/
val xgbParam = Map("eta" -> 0.1f,
"max_depth" -> 2,