AWS Spot Pricing

Use AWS Spot Instances to request spare computing capacity for up to 90% off the On-Demand price. Spot pricing is available for Azure and AWS. GCP has preemptible which is the same process except there is no bid price.

AWS Spot Pricing Overview

A description of spot pricing and information on implementing it.

Note: Spot pricing is only available with Control 2019.1 or later and PBS Professional 19.2.1 or later.

What is Spot Pricing

Amazon EC2 Spot Instances offer spare compute capacity available in the AWS cloud at steep discounts compared to On-Demand instances. Spot Instances can be interrupted by AWS with two minutes of notification when AWS needs the capacity back. AWS can interrupt your Spot Instance when the Spot price exceeds your maximum price, when the demand for Spot Instances rises, or when the supply of Spot Instances decreases.

The recommendation is to avoid running critical or long running jobs on spot instances as jobs may be killed when spot instances are preempted.

Implementing AWS Spot Pricing

Create an AWS bursting scenario. Once the bursting scenario is created, select the bursting scenario and edit the instance types. A list of machine types are displayed that can be enabled for spot pricing:


Spot Instances
Figure 1. Spot Instances
Instance type name
Name of the instance type (machine type, shapes or flavors) as defined by the cloud provider.
Core
Number of CPUs available for this instance type.
Mem
Amount of RAM available for this instance type.
GPU
Number of GPUs available for this instance type.
Price
On-demand price. With On-Demand instances, you pay for compute capacity by per hour or per second depending on which instances you run. No longer-term commitments or upfront payments are needed. You can increase or decrease your compute capacity depending on the demands of your application and only pay the specified per hourly rates for the instance you use.
Current Spot Price
Currently, available spot price. With spot instances, you pay the spot price that's in effect for the time period your instances are running. Spot instance prices are set by Amazon EC2 and adjust gradually based on long-term trends in supply and demand for Spot instance capacity. Spot instances allow you to request spare Amazon EC2 computing capacity for up to 90% off the On-Demand price.
Max Spot Price
Maximum amount that your site is willing to pay to continue using the spot instance. Once this price is exceeded the spot instance can be interrupted by AWS with two minutes of notification.
Spot enabled
Use this checkbox to enable spot pricing for an instance type.

Choose which instance types that you want for spot pricing and enter a maximum price that you are willing to pay to continue using the spot instance.

A scenario must be added to the cloud bursting hook configuration file for every instance type selected for spot pricing and the scenario must be enabled as preemptible.

"preemptable": true

Cloud Bursting Hook Scenario Example

Two instance types are selected for spot pricing:

Add the following scenario to the cloud bursting hook configuration file:

"aws_scenario_1": {
            "api_key": "API-KEY-HERE",
            "cloud_default_image": "<CloudDefaultImage>",
            "cloud_max_instances": 20,
            "max_nodes_per_burst":50,
            "cloud_node_wait_timeout":180,
            "preemptable": true
        }

Choose Spot Instances

Choose instance types for spot pricing and set the maximum spot price.

Before you can choose instances for spot pricing you must have created an AWS bursting scenario.
  1. Login to Control.
  2. Click the Cloud tab.
  3. Click Bursting from the Infrastructure menu located on the left-hand side of the web page.
  4. Select an AWS bursting scenario by clicking its name.
  5. Click Cloud.
  6. Scroll to the Instance types section.
  7. Click Edit Instances.
    Available Instance types are listed in a table. The table can be sorted in ascending and descending order by clicking on the name of the column. The table can also be filtered by Instance type name using the search column directly under the column name.

    Spot Instances
    Figure 2. Spot Instances
  8. Select an instance type for spot pricing by enabling Spot enabled to the far right of the instance type name.
    Tip: To disable spot pricing for an instance type, disable Spot enabled.
  9. For Max Spot Price, enter a maximum spot price that you are willing to pay for the instance type.
  10. Repeat steps 8 through 9 to choose additional instance types for spot pricing.
  11. Click Save.