PRAGMA Cloud Testbed site setup
Description: Setting up a node (with or without ENT) and registering the node to the PRAGMA Cloud Scheduler. Possibly start a virtual cluster via cloud scheduler.
1. Install and configure Rocks cluster frontend on a ZOTAC server.
Using USB CD/DVD drive and a CD with Rocks 6.2 kernel ISO image install a cluster frontend. See the Rocks Users Guide for installation instructions:
For the section “Install and configure your frontend” you wil need the following info for your host (given to you):
- IP address
- Fully qualified domain name
- Gateway IP
- DNS IP
- for the “ksdevice” please use “eth1”
During the frontend install (you will be led to this screen) choose the following rolls:
- kvm (this is responsible for virtualization)
Kernel roll is on a CD, the rest of the rolls are installed over the network. See section 3.5 of the install guide.
Enable Public web access to your frontend (see guide).
2. Register your physical host with the PRAGMA Cloud Scheduler
Login at Cloud Scheduler with your team user name and a password and register your physical host as a site. For an example registration see Responsibilities -> Resources link. You will need to create a new resource. Info to edit:
* Resource name * Resource Permisisons (use automatically granted) * Resource administrator (PRAGMA 31 students)
then click on “Add Resource” button.
In a new window provide information about Additional Attributes. Most values can be kept as the defaults that are presented in the example registration. Values to update:
* Available CPUS (use 2) * Available Gb Memory (use 2) * Leave ENT-enable as "no". You can update this attribute later after configuriung ENT. * Provide correct Latitude ad Longigtude for your location.
3. Install pragma_boot on the node
- Follow instructions in this link. When you come to the step of downloading virtual images, instead of emailing cloud admin use images from the USB drive given to you.
The USB drive contains the repository with two virtual cluster images. You will use centos image for pragma boot. When a USB is inserted it will be automatically mounted as
/media/<hash-string>Recreated the repository from USB on your host :
mkdir -p /state/partition1/vm-images cp /media/<hash-string>/state/partition1/vcdb.txt /state/partition1/vm-images mkdir -p /state/partition1/vm-images/centos7 cp /media/<hash-string>/state/partition1/centos7.xml /state/partition1/vm-images/centos7 /bin/cp --sparse=alwyas /media/<hash-string>/state/partition1/centos7-fe.img /state/partition1/vm-images/centos7
- Test your configuration using instructions in this link
Start Virtual cluster using centos7 image:
pragma boot centos7 0 loglevel=DEBUG
4. Install and configure Open vSwitch on Rocks frontend
Follow instructions on Installing Rocks6.2 cluster with Open vSwitch Roll You will be able to execute the instructions for the physical frontend. Execute all instructions in sections untill you reach section Add physical link connecting to the Open vSwitch. Skip this section and the Sync the config sections and instead execute :
rocks sync config rocks sync host network YOUR-HOST
Setup GRE link on the physical frontend.
Execute command below. Note, XXX.XXX.XXX.XXX is a controller IP address, YYY.YYY.YYY.A is an IP addresss you will give to your physical host and YYY.YYY.YYY.1 is the interface on the controller host (these addresses are given to you):
ovs-vsctl add-port br0 gre-naist -- set interface gre-naist type=gre options:remote_ip=XXX.XXX.XXX.XXX ovs-vsctl add-port br0 tap0 -- set Interface tap0 type=internal ifconfig tap0 YYY.YYY.YYY.A netmask 255.255.0.0 up ping YYY.YYY.YYY.A (ping your own address) ping YYY.YYY.YYY.1 (ping interface on the remote controller)
Configuration for Virtual Cluster
Verify that the virtual hosts are down by running this command (the output should list “nostate” for STATUS):
rocks list host vm status=1
If the status shows “active” stop the virtual frontend with:
rocks stop host vm YOUR-FE
Add interfaces to your virtual cluster nodes. For a virtual frontend (named YOUR-VF):
rocks add host interface YOUR-VF ovs subnet=openflow mac=`rocks report vm nextmac` rocks sync config YOUR-VF
Setting up interfaces on Virtual cluster
Start up your virtual frontend :
rocks start host vm YOUR-VF
When the virtual frontend is up and running, ssh on the virtual frontend and execute the following commands. Substitute network name, subnet, netmask and the host IP with the values for your network. The network name can be your choice, but subnet, netmask and the host IP must be coming from ENT operators (given to you):
yum install net-tools
The above will install
Find a new interface (not eth0, eth1, or lo), for example
ifconfig ens5 YYY.YYY.YYY.B netmask 255.255.0.0 ifconfig -a ping YYY.YYY.YYY.B (ping your virtual frontend interface) ping YYY.YYY.YYY.1 (ping interface on remote controller) ping YYY.YYY.YYY.A (ping interface on your physical frontend)
- If successfull, login at Cloud Scheduler and update your registered resource ENT-enabled attribute.