add linear readme
This commit is contained in:
parent
6a1167611c
commit
1133628c01
@ -4,11 +4,22 @@ Linear and Logistic Regression
|
|||||||
* Local Example: [run-linear.sh](run-linear.sh)
|
* Local Example: [run-linear.sh](run-linear.sh)
|
||||||
* Runnig on YARN: [run-yarn.sh](run-yarn.sh)
|
* Runnig on YARN: [run-yarn.sh](run-yarn.sh)
|
||||||
- You will need to have YARN
|
- You will need to have YARN
|
||||||
- Modify ```../make/config.mk``` to set USE_HDFS=1
|
- Modify ```../make/config.mk``` to set USE_HDFS=1 to compile with HDFS support
|
||||||
- Run build.sh on [../../yarn](../../yarn) on to build yarn jar file
|
- Run build.sh on [../../yarn](../../yarn) on to build yarn jar file
|
||||||
|
|
||||||
|
Multi-Threading Optimization
|
||||||
|
====
|
||||||
|
* The code can be multi-threaded, we encourage you to use it
|
||||||
|
- Simply add ```nthread=k``` where k is the number of threads you want to use
|
||||||
|
* If you submit with YARN
|
||||||
|
- Use ```--vcores``` and ```-mem``` to request CPU and memory resources
|
||||||
|
- Some scheduler in YARN do not honor CPU request, you can request more memory to grab a more working slot
|
||||||
|
* Usually multi-threading improves speed in general
|
||||||
|
- You can use less workers and assign more resources to each of worker
|
||||||
|
- This means less communication overhead and faster
|
||||||
|
|
||||||
Parameters
|
Parameters
|
||||||
===
|
====
|
||||||
All the parameters can be set by param=value
|
All the parameters can be set by param=value
|
||||||
|
|
||||||
#### Important Parameters
|
#### Important Parameters
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user