Configure Open Telekom Cloud for Cloud Bursting

Create the necessary components in Open Telekom Cloud (OTC) that are required for cloud bursting and then create a cloud bursting scenario.

Before you can begin creating the components necessary for cloud bursting, you must create and activate an OTC Cloud account.

Obtain the OTC Administrator Credentials

Get the credentials for the OTC administrative user account so that you can later use this information to create a cloud account in Control.

You must already have signed up for an OTC account.
When subscribing to OTC, an administrative user account that has permissions for all system operations is automatically created. Use this user account to add an OTC cloud account to Control. Reset the password for this account when the password is unknown.
Note: Alternately, you can create a new user and give the user administrative privileges by setting its User Group to "admin".
  1. Login to the OTC Console.
  2. Click Service List.

    Service List
    Figure 1. Service List
  3. Under Management & Deployment, click Identity and Access Management.
  4. Click Users from the menu located on the left-hand side of the web page.
    A list of users is displayed.
  5. Click located next to a username to display the user's details.
    The user account listed as an "admin" is the account to use to create the cloud account in Control.
    User Details Figure 2. User Details
  6. If you do not know the password for the admin user account, click Set Credentials.

    Set Password
    Figure 3. Set Password
    1. Enable Set manually.
    2. For Password, enter a password for the user account.
    3. For Confirm Password, enter the password a second time.
    4. Click OK.
      You may have to confirm the password change either by email or by a SMS text.

Add an OTC Account

Add an existing OTC Cloud account to Control so that you can create a cloud bursting scenario.

  1. Login to Control.
  2. Click the Cloud tab.
  3. Click Cloud from the Infrastructure menu located on the left-hand side of the web page.
  4. Click .
  5. Enter the following to add a cloud account:
    1. For Account name, enter any name for the cloud account.
      The name can be anything meaningful to your organization, e.g., orange_cloudaccount.
    2. For Auth (IAM) URL, enter: https://iam.eu-de.otc.t-systems.com/v3.
    3. For Domain name, enter the OTC Domain Name you used to login to the OTC console.
    4. For Username, enter a username that is an OTC administrator.
    5. For Password, enter the password for the OTC administrator.
  6. Click Create Account.

Check OTC Account Service Quotas

View your OTC account resource usage and limits.

Quotas are used to limit the number of resources available to users. It is important to ensure you are not exceeding your quota while setting up the resources for cloud bursting. If the existing resource quota cannot meet your service requirements, you can submit a work order to increase your quota. Once your application is approved, your resource quota is updated accordingly and you will be sent a notification.

  1. Login to the OTC Console.
  2. Click .

    View Quotas
    Figure 4. View Quotas
    Information about resources usage and availability is displayed.

    Resource Quotas
    Figure 5. Resource Quotas

Create a Virtual Private Cloud

Create a Virtual Private Cloud (VPC) so that you can perform cloud bursting.

OTC documentation for creating a VPC can be found at: Creating a VPC and Regions.
  1. Login to the OTC Console.
  2. Click Service List.

    OTC Service List
    Figure 6. OTC Service List
  3. Under Network, click Virtual Private Cloud.
  4. Click + Create VPC.
  5. In the Basic Information section:
    1. For Region, select a region.

      Regions
      Figure 7. Regions

      A region is a geographical areas and can comprise one or more availability zones (AZs). A region is completely isolated from other regions. Only AZs in the same region can communicate with one another through an internal network.

    2. For Name, enter a name for the VPC.
    3. For CIDR Block, enter an address range for the network using CIDR notation.
  6. In the Subnet Settings section:
    1. For Subnet Name, enter a name for the subnet.
    2. For CIDR, enter an address range for the subnet using CIDR notation.
    3. For Advanced Settings, click Default.
  7. Click Create Now.
  8. Once the VPC is created, click Back to VPC List.
  9. Click Security Group located on the left-hand side of the web page.
  10. Click + Create Security Group.
  11. For Name, enter a name for the Security Group.
  12. For Description, enter a suitable description.
  13. Click OK.
    The security group rules are displayed.
  14. Click the Inbound tab.
  15. Click Add Rule.
    1. For Protocol/Application, select TCP.
    2. For Port, enter 22.
    3. For Source, select IP Address. and enter 0.0.0.0/0.
    4. Click OK.

Creating a Virtual Machine

Create a Elastic Cloud Server (ECS) using a public image provided by OTC for cloud bursting.

You must have already created a Virtual Private Network with a subnet and assigned a Security Group. If you do not have this information, see Create a Virtual Private Cloud.

OTC documentation for creating an ECS (virtual machine) can be found at Create an ECS.

  1. Login to the OTC Console.
  2. Click Service List.

    OTC Service List
    Figure 8. OTC Service List
  3. Under Computing, click Elastic Cloud Server.
  4. Click Key Pair from the menu located on the left-hand side of the web page.
  5. Click + Create Key Pair.
  6. For Name, enter a name for the key pair.
  7. Click OK.
  8. Save the key pair (.pem) file to your local disk in a secure location.
    The information in this .pem file is used later to SSH into the VM.
  9. Click OK to confirm that you have downloaded the key pair file.
  10. Click Elastic Cloud Server from the menu located on the left-hand side of the web page.
  11. Click Create ECS.
  12. For Region, select the same region that was chosen for the previously created VPC.

    Regions
    Figure 9. Regions
  13. For AZ (Availability Zone), select an availability zone.
  14. In the Specifications section:
    1. Choose an ECS type category:
      • General-purpose
      • Dedicated general-purpose
      • Memory-optimized
      • Large-memory
      • High-performance
      • Disk-intensive
      • GPU-accelerated
    2. For ECS type, choose one of the flavors based on the needs of your site.
  15. In the Image section:
    1. Click Public image.
    2. Select CentOS as the operating system.
    3. Select Standard_CentOS7_latest(4GB) for the OS version.
  16. In the Disk section, select your system disk requirements.
  17. In the VPC section:
    1. For VPC, select the VPC you created for cloud bursting.
      The NIC information is automatically populated.
    2. For Security Group, select the security group you created for cloud bursting.
    3. For EIP, click Automatically assign
    4. For Bandwidth, specify it as 5 Mbit/s.
  18. For Login Mode, select Key Pair.
  19. For Key Pair, select the key pair file you generated earlier.
  20. For Advanced Settings, click Do not configure.
  21. For ECS Name, enter a name for the virtual machine.
  22. For Quantity, specify 1.
  23. Click Create Now.
  24. Review the specifications.
  25. Click Submit.
  26. Click Back to ECS List.
    It may take some time to create the virtual machine. Once the ECS is created it is displayed in the ECS list.

Installing and Configuring the PBS MoM on the VM

Install the PBS MoM on the virtual machine and configure the VM per your site's environment.

Log into the VM using the default user "root" and the .pem generated during the creation of the VM.

A startup script is provided during the creation of the bursting scenario. This script is ran after a cloud node is burst and is used to set up the system environment so that nodes burst in the cloud can communicate with the PBS Server. A service specifically designed for cloud instance initialization is cloud-init and is utilized by Control when booting cloud nodes, therefore it must be installed on the VM. For more information about installing cloud-init, refer to the Cloudinit Documentation.

  1. Login to the OTC Console.
  2. Click Service List.

    OTC Service List
    Figure 10. OTC Service List
  3. Under Computing, click Elastic Cloud Server.
  4. Copy the Public IP address (External IP) of the ECS.

    VM IP Address
    Figure 11. VM IP Address
  5. Login to your site's PBS Server.
  6. SSH into the VM using the default user "root", the .pem file you generated when creating the VM and the External IP assigned to the VM.
    ssh -i /path/my-key-pair.pem root@IPV4PublicIP
    where /path/my-key-pair.pem is the path to the .pem file downloaded while creating the virtual machine and IPV4PublicIP is the public IP address of the virtual machine.
  7. Copy the PBS Professional installation package to the VM.
  8. Using the PBS Professional Installation and Upgrade Guide, install and configure the PBS Professional MOM.
  9. Configure the VM for your site's environment such as mounting file systems, connecting it to the authentication service, installing any applications, etc.
  10. Install cloud-init.
  11. Connect the VM to your PBS Professional server and submit a job to ensure it is working as expected.

Create an OS Image

Create an image of the virtual machine configured per your site's requirements.

You must have already created a ECS (virtual machine), installed the PBS MoM on the ECS and configured it per your site's environment.

OTC documentation can be found at Creating a Linux Private Image.

  1. Login to the OTC Console.
  2. Click Service List.

    OTC Service List
    Figure 12. OTC Service List
  3. Under Computing, click Image Management Service.
  4. Click + Create System Disk Image.
    1. For Region, select the same region that was chosen for the previously created VPC and ECS.

      Regions
      Figure 13. Regions
    2. For Source, click Server.
    3. For Server Type, click ECS.
    4. For ECS, select the virtual machine created for cloud bursting.
      Tip: If the virtual machine is not stopped, then stop it.
    5. Click OK when prompted to verify that certain operations have been performed on the ECS.
      You do not need to configure or optimize the ECS.
    1. For Name, enter a name for the virtual machine.
  5. Click Create Now.
  6. Review the specifications.
  7. Click Submit.
  8. Click Back to Image List.
    The time required for creating an image varies depending on the image file size. Generally, it takes about 20 minutes to create an image. The image is successfully created when its image status changes to Normal.
    Note: Do not perform any operation on the selected ECS or its associated resources during image creation.
You can now delete the virtual machine so that you are no longer charged for it.

Create an OTC Cloud Bursting Scenario

Create an OTC bursting scenario so that PBS execution nodes can be burst in the cloud.

Open a browser window and login to the OTC Console. Open a second browser window and login to Control.

A startup script is provided during the creation of the bursting scenario. This script is ran after a cloud node is burst and is used to set up the system environment so that nodes burst in the cloud can communicate with the PBS Server. Use a cloud-init script for the startup script. For more information about writing cloud-init scripts, refer to the Cloudinit Documentation and Cloud Bursting Startup Script.

  1. Navigate to the Control browser window.
  2. Click the Cloud tab.
  3. Click Bursting from the Infrastructure menu located on the left-hand side of the web page.
  4. Click Add Bursting Scenario.
  5. Enter information about the bursting scenario such as name, cloud provider, cloud account, and geographic location.
    1. For Name, enter a name for the cloud bursting scenario.
    2. For Description, enter a description.
    3. For Cloud Account, choose a previously created OTC cloud account from the list.
    4. For Region, select the same region that was chosen for the previously created VM and VPC.
  6. Click Next.

Enter information about the OTC resources necessary to burst in the cloud.

  1. For Domain name, provide the domain name of your organization for the cloud bursting network.
    altair.com, burst.altair.com
  2. For Hostname prefix, enter a prefix for the names of the burst nodes.
    If "node" is entered , the cloud bursting nodes will be available to PBS Professional as node1, node2, node3, etc.
  3. Navigate to the cloud provider browser window.
  4. Click Service List.

    OTC Service List
    Figure 14. OTC Service List
  5. Under Network, click Virtual Private Cloud.
  6. Click Virtual Private Cloud from the menu located on the left-hand side of the web page.
  7. Click the name of the VPC you created for cloud bursting.
  8. Click the name of the VPC's subnet.
  9. Copy the Subnet ID.
  10. Navigate to the Control browser window.
  11. For Subnet ID, paste the subnet's ID copied from the OTC console.
  12. Navigate to the cloud provider browser window.
  13. Click Security Group from the menu located on the left-hand side of the web page.
  14. Click the name of the security group you created for the VPC.
  15. Copy the ID of the security group.
  16. Navigate to the Control browser window.
  17. For Security Group, paste the security group's ID you copied from the OTC console.
  18. Navigate to the cloud provider browser window.
  19. Click Service List.

    OTC Service List
    Figure 15. OTC Service List
  20. Under Computing, click Image Management Service.
  21. Click the Private Images tab.
  22. Click the name of the VM image you created for cloud bursting.
  23. Copy the Image ID of the image.
  24. Navigate to the Control browser window.
  25. For OS Image URI, paste the image ID you copied from the OTC console.
  26. Enable Add public IP to VMs if you need to connect to the cloud bursting nodes from the internet.
    It is recommended to leave this disabled.
  27. For Cloud-init script, click Browse, browse for the startup script file and select it.
    This script will run after a cloud node is burst.
  28. Add public SSH keys for any users that you want to have access to the burst nodes:
    1. Login to the PBS Professional Server.
    2. Copy the public SSH key for the user.
      Public key files are usually stored in /.ssh in the user's home directory.
    3. Navigate to the Control browser window.
    4. Click Add to add the public key.
    5. For Public SSH keys, paste the public SSH key.
    6. Repeat steps a through e to add additional public SSH keys.
    The public keys are copied to each burst node for secure connectivity.
  29. For Idle time before unbursting, enter the minimum time that a cloud node can be idle before it is unburst.

    It is expressed as an integer whose units are in seconds.

  30. For Tags, enter a key-value pair to add a label to the cloud node and press ENTER.
    A tag is a label that is assigned to a cloud node. Tags enable cloud nodes to be categorized in different ways, for example, by purpose, owner, or environment.
    The key-value pair must be entered as key:value. The key must be less than 36 characters and the value must be less than 43 characters. The length of both the key + value should be less than 80 characters. Valid values are alphanumeric, dash (-) and an underscore ( _ ).
    Once the tag is added, it will appear within its own bubble.

    Key-Value Tag
    Figure 16. Key-Value Tag
  31. Repeat the previous step to add more tags.

    Additional Tags
    Figure 17. Additional Tags
    Tip: To remove a tag click on the 'x' located within the tag bubble.
  32. Click Next.
  33. Select the instance types to enable for the bursting scenario by clicking the Enabled checkbox located to the far right of the instance type name.
    If an attempt is made to burst nodes with a disabled instance type, the node is not burst and the below message is displayed in the PBS Server logs (if bursting through PBS), the Cloud logs and through the Cloud component user interface.
    TYPE is not enabled

    Where TYPE is the instance type used when attempting to burst the node.

    Tip: Deselect an instance type by disabling the Enabled checkbox.
  34. Click Instantiate scenario.
Once the scenario created, it is recommended to Add a Token and Add Quotas and Alerts. When adding a token, an API key is generated that is required for bursting. Quotas define bursting limits such as the maximum number of cloud nodes to burst.