14ef38b834
Federated learning plugin for xgboost: * A gRPC server to aggregate MPI-style requests (allgather, allreduce, broadcast) from federated workers. * A Rabit engine for the federated environment. * Integration test to simulate federated learning. Additional followups are needed to address GPU support, better security, and privacy, etc.
18 lines
638 B
Bash
Executable File
18 lines
638 B
Bash
Executable File
#!/bin/bash
|
|
|
|
set -e
|
|
|
|
rm -f ./*.model* ./agaricus* ./*.pem
|
|
|
|
world_size=3
|
|
|
|
# Generate server and client certificates.
|
|
openssl req -x509 -newkey rsa:2048 -days 7 -nodes -keyout server-key.pem -out server-cert.pem -subj "/C=US/CN=localhost"
|
|
openssl req -x509 -newkey rsa:2048 -days 7 -nodes -keyout client-key.pem -out client-cert.pem -subj "/C=US/CN=localhost"
|
|
|
|
# Split train and test files manually to simulate a federated environment.
|
|
split -n l/${world_size} -d ../../demo/data/agaricus.txt.train agaricus.txt.train-
|
|
split -n l/${world_size} -d ../../demo/data/agaricus.txt.test agaricus.txt.test-
|
|
|
|
python test_federated.py ${world_size}
|