Azure Automation & Hybrid Cloud Management: Automating deployment of a VM in Amazon Web Services

During our Cloud Roadshow events where I presented on Azure Automation there were a number of questions around whether Azure Automation was intended only for Azure. Fortunately, I had a demo lined up which I’m going to talk about in this blog post, but the key answer is that Azure Automation is not only for Azure, it’s for on-premises resources AND for managing hybrid cloud environments as well! So, for example, if you are an Amazon Web Services (AWS) customer then Azure Automation is for you too!

Objectives

In this post I’ll talk about how you can leverage Azure Automation to provision a VM in AWS and give that VM a specific name – which in the AWS world is referred to as “tagging” the VM.

Assumptions

For the purposes of this post I’m assuming you have an Azure Automation account already set up and that you have an AWS subscription as well.

For more information on setting up an Azure Automation account, check out our documentation page.

Preparation: Storing your AWS credentials

Note: This blogpost leverages root access keys which is not an AWS security best practice, please refer to this article how to setup an IAM user

For Azure Automation to “talk” to AWS, you will need to retrieve your AWS credentials and store them as assets in Azure Automation.

When you are logged into the AWS portal, click on the little triangle under your name and click on Security Credentials.

  AWS security credential

Click Access Keys.

AWS Access Keys

Copy your access key and secret access key (optionally download your key file to store it somewhere safe).

Create AWS access keys

AWS Assets in Azure Automation

In the previous step you have copied and saved your AWS Access Key ID and Secret Access Key. We are going to store them now in Azure Automation.

Navigate to your Automation Account and select Assets - Credentials and add a new credential and name it AWScred.

image

Provide an optional description and make sure that you enter your Access ID in the User name field and your Secret Access Key in the field which is labeled Password. Save your AWS credentials.

Amazon Web Services PowerShell Module

Our VM provisioning runbook will leverage the AWS PowerShell module to do its work. The AWS PowerShell module ships on PowerShell Gallery and can easily be added to an Automation account via the Deploy to Azure Automation button.

AWS PS Module import to AA

When you click on Deploy to Azure Automation it will take to the Azure login page and after you have provided your credentials you will see the following screen.

Import AWS Module wizard

Select a new or existing Automation Account. Please note that there is no dropdown box for an existing account, so make sure that you do not make typos and that the region and resource group for your Automation account are correct. Go through the other steps to complete the configuration and then click on Create.

If you navigate to your selected Automation Account and navigate to Assets - Modules, you now can see the AWS module with 1427 activities, awesome!

Note: Importing a PowerShell module into Azure Automation consists of two steps:

  1. Importing the module
  2. Extracting the cmdlets

The activities will not show up until the module has completely finished importing and extracting the cmdlets which can take a few minutes.

Provision AWS VM runbook

Now that we have all prerequisites in place it’s time to author our runbook which will provision a VM in AWS. We will also showcase that you can leverage a native PowerShell script in Azure Automation instead of PowerShell Workflow.

More information about the differences between native PowerShell and PowerShell workflow can be found here. Information about graphical runbook authoring can be found here.

The PowerShell script for our runbook can be downloaded from the PowerShell Gallery.

You can download the script by opening a PowerShell session and typing in: Save-Script -Name New-AwsVM -Path <path>

When you have saved the PowerShell script you can add it to Azure Automation as a runbook by doing the following:

Under your Automation Account, click Runbooks and select Add a runbook. Select Quick Create (Create a new runbook), provide a name for your runbook and under Runbook type select PowerShell. Then click on Create.

Create AWS runbook

When the runbook editor opens copy and paste the PowerShell script into the runbook authoring area.

image

Please note the following when using the downloaded PowerShell script:

  • The runbook contains a number of default parameter values as mentioned in the #ToDo section. Please evaluate all default values and update where necessary.
  • Make sure that have you stored your AWS credentials under Assets, called AWScred.
  • The region which you will be using will be dependent of your AWS subscription. In the AWS portal where you have also looked up your security credentials, click on the arrow next to your Account to verify your region.

AWS region

  • Figure out which region you need to provide in your runbook. For example, my region is US West (Oregon) which translates to us-west-2.

AWS regions

  • You can get a list of image names when you use PowerShell ISE, import the module, authenticate against AWS by replacing Get-AutomationPSCredential in your ISE environment with $AwsCred = Get-Credential. This will prompt you for credentials and you can provide your Access Key ID and Secret Access Key as username and password. See the sample below:
 #Sample to get the AWS VM available images
#Please provide the path where you have downloaded the AWS PowerShell module
Import-Module AWSPowerShell
$AWSRegion = "us-west-2"
$AwsCred = Get-Credential
$AwsAccessKeyId = $AwsCred.UserName
$AwsSecretKey = $AwsCred.GetNetworkCredential().Password

# Set up the environment to access AWS
Set-AWSCredentials -AccessKey $AwsAccessKeyId -SecretKey $AwsSecretKey -StoreAs AWSProfile
Set-DefaultAWSRegion -Region $AWSRegion

Get-EC2ImageByName -ProfileName AWSProfile 

That will you get you this output:

Get AWS images

Copy and paste the image name of your liking in an automation variable as referenced in the runbook as $InstanceType. Since I’m using a free AWS tier I have selected t2.micro in my runbook.

Learn more about Amazon EC2 instance types here.

Testing the provision AWS VM runbook

Preflight checklist:

  • Assets for authenticating against AWS have been created and has been named AWScred
  • The AWS PowerShell module has been imported in Azure Automation
  • A new runbook has been created and parameter values have been verified and updated where necessary
  • Log verbose records and optionally Log progress records under the runbook settings have been set to On

Let’s start our new runbook by providing a VMname.

Start New-AwsVM runbook

Since we have enabled Log verbose records and Log progress records we can see our output Streams under All Logs.

Stream output

Let’s check in AWS:

AWS console deployed VM

Nice!

With this blog post I have provided an example of how Azure Automation can be used to manage hybrid clouds, such as by creating a VM in Amazon Web Services and applying a custom tag to give it a name.

Happy automating and until next time!

Tiander.