Hendrik/xgboost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update NVFlare demo to work with the latest release (#8576)

Browse Source
This commit is contained in:
Rong Ou 2022-12-08 10:48:20 -08:00 committed by GitHub
parent ffee35e0f0
commit 0caf2be684
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 16 additions and 17 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

19
demo/nvflare/README.md
View File

@ -8,10 +8,9 @@ This directory contains a demo of Federated Learning using
To run the demo, first build XGBoost with the federated learning plugin enabled (see the To run the demo, first build XGBoost with the federated learning plugin enabled (see the
[README](../../plugin/federated/README.md)). [README](../../plugin/federated/README.md)).
Install NVFlare (note that currently NVFlare only supports Python 3.8; for NVFlare 2.1.2 we also Install NVFlare (note that currently NVFlare only supports Python 3.8):
need to pin the protobuf package to 3.20.x to avoid protoc errors):
```shell ```shell
pip install nvflare protobuf==3.20.1 pip install nvflare
``` ```
Prepare the data: Prepare the data:
@ -21,22 +20,22 @@ Prepare the data:
Start the NVFlare federated server: Start the NVFlare federated server:
```shell ```shell
./poc/server/startup/start.sh /tmp/nvflare/poc/server/startup/start.sh
``` ```
In another terminal, start the first worker: In another terminal, start the first worker:
```shell ```shell
./poc/site-1/startup/start.sh /tmp/nvflare/poc/site-1/startup/start.sh
``` ```
And the second worker: And the second worker:
```shell ```shell
./poc/site-2/startup/start.sh /tmp/nvflare/poc/site-2/startup/start.sh
``` ```
Then start the admin CLI, using `admin/admin` as username/password: Then start the admin CLI:
```shell ```shell
./poc/admin/startup/fl_admin.sh /tmp/nvflare/poc/admin/startup/fl_admin.sh
``` ```
In the admin CLI, run the following command: In the admin CLI, run the following command:
@ -45,10 +44,10 @@ submit_job hello-xgboost
``` ```
Once the training finishes, the model file should be written into Once the training finishes, the model file should be written into
`./poc/site-1/run_1/test.model.json` and `./poc/site-2/run_1/test.model.json` `/tmp/nvlfare/poc/site-1/run_1/test.model.json` and `/tmp/nvflare/poc/site-2/run_1/test.model.json`
respectively. respectively.
Finally, shutdown everything from the admin CLI: Finally, shutdown everything from the admin CLI, using `admin` as password:
```shell ```shell
shutdown client shutdown client
shutdown server shutdown server

14
demo/nvflare/prepare_data.sh
View File

@ -14,12 +14,12 @@ openssl req -x509 -newkey rsa:2048 -days 7 -nodes -keyout client-key.pem -out cl
split -n l/${world_size} --numeric-suffixes=1 -a 1 ../data/agaricus.txt.train agaricus.txt.train-site- split -n l/${world_size} --numeric-suffixes=1 -a 1 ../data/agaricus.txt.train agaricus.txt.train-site-
split -n l/${world_size} --numeric-suffixes=1 -a 1 ../data/agaricus.txt.test agaricus.txt.test-site- split -n l/${world_size} --numeric-suffixes=1 -a 1 ../data/agaricus.txt.test agaricus.txt.test-site-
poc -n 2 nvflare poc -n 2 --prepare
mkdir -p poc/admin/transfer/hello-xgboost mkdir -p /tmp/nvflare/poc/admin/transfer/hello-xgboost
cp -fr config custom poc/admin/transfer/hello-xgboost cp -fr config custom /tmp/nvflare/poc/admin/transfer/hello-xgboost
cp server-*.pem client-cert.pem poc/server/ cp server-*.pem client-cert.pem /tmp/nvflare/poc/server/
for id in $(eval echo "{1..$world_size}"); do for id in $(eval echo "{1..$world_size}"); do
cp server-cert.pem client-*.pem poc/site-"$id"/ cp server-cert.pem client-*.pem /tmp/nvflare/poc/site-"$id"/
cp agaricus.txt.train-site-"$id" poc/site-"$id"/agaricus.txt.train cp agaricus.txt.train-site-"$id" /tmp/nvflare/poc/site-"$id"/agaricus.txt.train
cp agaricus.txt.test-site-"$id" poc/site-"$id"/agaricus.txt.test cp agaricus.txt.test-site-"$id" /tmp/nvflare/poc/site-"$id"/agaricus.txt.test
done done