Federated Learning on myDRE with VANTAGE6

Federated Learning on myDRE with VANTAGE6

VANTAGE6

An open source privacy preserving Federated Learning Infrastructure for Secure Insight Exchange.


ARCHITECTURE

VANTAGE6 uses a client-server model, which is shown in the figure below. In this scenario, the researcher can pose a question and using the preferred programming language, send it as a task (also known as computation request) to the (central) server through function calls. The server is in charge of processing the task as well as of handling administrative functions such as authentication and authorization. The requested algorithm is delivered as a Docker image to the nodes, which have access to their own (local) data. When the algorithm has reached a solution, it is transmitted via the server to the researcher. A more detailed explanation of these components is given as follows. Here for more details on How it Works. 



VANTAGE6 in myDRE

By following these 10  steps, you should be able to set up VANTAGE6 and get it working within myDRE's platform.
  1. Access your workspace in myDRE
    1. https://mydre.org/
  2. Domain allowlisting
    1. Add the necessary domains that you will find in the attachment in myDRE’s workspace for VANTAGE6
  3. Virtual Machine
    1. In the myDRE workspace, deploy a GPU Linux VM. 
    2. Make sure your VM has sudo rights, so you can install the necessary software and tools.
  4. Upload attachment
    1. Upload the following files to your myDRE workspace for more efficient working:
      1. install-node-mydre-root.sh
      2. install-node-mydre-user.sh
      3. installation-input.env
      4. default.yaml
  5. Run the Root Installation Script
    1. First, make sure you have root access in your VM
    2. Execute the install-node-mydre-root.sh
    3. This will install the following:
      1. Python3.10 (via Deadsnakes PPA)
        1. VANTAGE6 requires at least version 3.9, but upgrading to 3.10 is recommended for better compatibility.
      2. Docker
        1. VANTAGE6 runs inside Docker containers.
      3. NVIDIA GPU drivers (optional)
      4. Proxy configuration for Docker
        1. There is a placeholder section for configuring proxy settings for Docker, but it is not fully implemented in the script. You are advised to refer to Docker’s documentation to configure this manually.
      5. User configuration for Docker
    4. Rebot the VM
  6. Troubleshooting
    1. Verify the python version
      1. python3.10 --version
    2. If Python 3.10 or other dependencies are missing, make sure to install them manually. If the installation fails due to a proxy issue, check your proxy configuration.
    3. For domain access issues, verify that the required domains are allowed in the workspace settings.
  7. Run the User Installation Script
    1. After the root script finishes, run the install-node-mydre-user.sh as a non-root user:
      1. chmod +x install-node-mydre-user.sh (to make it executable)
      2. ./install-node-mydre-user.sh
    2. This script will:
      1. Create a Python virtual environment for Vantage6.
      2. Install Vantage6 inside this environment.
  8. Configuration Settings for VANTAGE6
    1. After the installation, you’ll need to configure the API key, server URL, and other settings.
    2. Activate the environment:
      1. source ~/vantage6-venv/bin/activate
    3. Create a new node using the following command
      1. vnode new --user
    4. This command launches a wizard where you need to configure the node using the details in the default.yaml file you uploaded.
  9. Update Configuration File (default.yaml)
    1. Once the node wizard is completed, update your configuration from default.yam
  10. Run the Node
    1. Once the configuration is updated, you can start the Vantage6 node:
      1. vnode start --user --name default
    2. Check if the node is running properly:
      1. vnode list

Next Steps

  1. Once the node is running, you can further configure it based on your project’s needs (e.g., adding algorithms or building Docker images).
  2. If you’re setting up VANTAGE6 for multiple users, ensure proper configuration of users and environments.

SUPPORT & COMMUNITY

  1. General overview of the infrastructure: https://vantage6.ai/
  2. Documentation: https://docs.vantage6.ai/en/main/
  3. Githib repository: https://github.com/IKNL/VANTAGE6

    • Related Articles

    • myDRE-Learning

      The myDRE-Learning platform expands your knowledge on a wide range of topics, from the basics of myDRE to Virtual Machines, Workspaces, Rroles, Costs and much more. Accessibility is at the heart of our platform. You can learn at your own pace and on ...

    • Why is my support.mydre.org account different from my @mydre.org account?

      We get this question regularly now and here is why: Your @mydre.org account may look like an e-mail address, but it is not. It has no e-mail functionality and it is strictly your username on the mydre.org platform. For support.mydre.org however, you ...

    • Seminar FlowerAI x myDRE

      16th of September 2024, at 15:00 UTC (17:00 CET, 16:00 LON, 11:00 NY) Federated Learning and Analytics with Flower through myDRE workspaces Flower Labs and anDREa will be hosting an online seminar to demonstrate how to use the Flower framework for ...

    • myDRE - why

      Why myDRE was created in <1.5 minutes For more information From organization perspective anDREa FAQ From user perspective myDRE Or contact a colleague: Pascalle Broer

    • EMC myDRE Community Event

      Click to sign up for Erasmus MC myDRE Community Event on 13th of October 12:00-13:00