User Tools

Site Tools


ace_cluster_setup

Optum cluster

1. Get GCP VMs:

 a. optum-master (8 vCPUs, 170 GB memory)
 b. 2x optum-slave (4 vCPUs, 125 GB memory)

2. Run on each VM:

 mkdir /mnt/gcs-bucket
 sudo chmod 777 /mnt/gcs-bucket/
 export GCSFUSE_REPO=gcsfuse-`lsb_release -c -s`
 echo "deb http://packages.cloud.google.com/apt $GCSFUSE_REPO main" | sudo tee /etc/apt/sources.list.d/gcsfuse.list
 curl https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo apt-key add -
 sudo apt-get update
 sudo apt-get install gcsfuse
 sudo usermod -a -G fuse $USER
 gsutil cp gs://ace-deploy/optum-?.tar.gz .
 tar xvf optum-?.tar.gz
 crontab -e
   @reboot /home/podalv/init.sh && /home/podalv/startup.sh
 ./init.sh
 

3. Run on master:

 update slaves.dat with the current IP addresses of slave VMs
ace_cluster_setup.txt · Last modified: 2021/04/22 14:37 by podalv