-
Notifications
You must be signed in to change notification settings - Fork 3
Quickstart
Michael Sevilla edited this page Dec 21, 2017
·
21 revisions
Build image and push it to the cloud:
git clone https://github.com/michaelsevilla/cudele-popper.git ~/
cd ~/cudele-popper/experiments/baseline-osds
docker/build.sh
Deploy Cloudlab nodes using the CephFS Profile and push keys when they finish deploying:
cd ~/cudele-popper/experiments/baseline/docker/cloudlab/
export CLOUDLAB_NODES="c220g1-030612.wisc.cloudlab.us [...] c220g1-030603.wisc.cloudlab.us"
./pushkeys.sh
Log into the head node and configure experiment:
sudo vim /etc/ssh/ssh_config
for i in `seq 0 24`; do ssh node-$i "sudo hostname node-$i; hostname"; done
sudo chown -R msevilla:cephfs-PG0 /tmp/*
mv /tmp/cudele-popper/ .
git config --global user.email "mikesevilla3@gmail.com"; git config --global user.name "Michael Sevilla"; git config --global core.editor vim
cd ~/cudele-popper/; git checkout revision; git submodule update --init --recursive
ifconfig | grep -B2 "10\.1\.1"
vim vars.yml
./teardown.sh; ./run.sh
Make sure all OSDs have SSDs:
docker run -it --rm --net host -v /users/msevilla/.ssh:/root/.ssh -v /tmp/cudele-popper/experiments/baseline-creates:/popper -v /tmp/cudele-popper/ansible/ceph:/root -v /tmp/cudele-popper/ansible/srl:/popper/ansible/roles/srl -w /root -v /tmp/cudele-popper/experiments/baseline-creates/ansible/group_vars/:/root/group_vars -v /tmp/cudele-popper/experiments/baseline-creates/hosts:/etc/ansible/hosts -v /tmp/cudele-popper/experiments/baseline-creates/ansible/ansible.cfg:/etc/ansible/ansible.cfg -e ANSIBLE_CONFIG=/etc/ansible/ansible.cfg -v /tmp/cudele-popper/experiments/baseline-creates/ansible/ceph.yml:/root/ceph.yml -v /tmp/cudele-popper/experiments/baseline-creates/ansible/monitor.yml:/root/monitor.yml -v /tmp/cudele-popper/experiments/baseline-creates/ansible/workloads:/workloads --entrypoint=ansible michaelsevilla/ansible -e @/popper/vars.yml -e @/popper/ansible/vars.yml -i /etc/ansible/hosts osds -m shell -a "sudo fdisk -l 2>>/dev/null | grep Disk | grep sdc"
The updates need more room, so we can store them on the extra disk:
sudo mkfs.ext4 /dev/sdc
sudo mkdir /mnt/ssd; sudo mount /dev/sdc /mnt/ssd
sudo mv /tmp/cudele-popper/ /mnt/ssd/cudele-popper