{"id":80565,"date":"2016-11-09T00:01:33","date_gmt":"2016-11-09T08:01:33","guid":{"rendered":"https:\/\/blogs.technet.microsoft.com\/heyscriptingguy\/?p=80565"},"modified":"2019-02-18T09:10:22","modified_gmt":"2019-02-18T16:10:22","slug":"part-3-use-azure-automation-dsc-to-configure-linux-and-execute-powershell-scripts","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/scripting\/part-3-use-azure-automation-dsc-to-configure-linux-and-execute-powershell-scripts\/","title":{"rendered":"Part 3 \u2013 Use Azure Automation DSC to Configure Linux and execute PowerShell scripts"},"content":{"rendered":"

Summary<\/strong>: Learn how to configure and use PowerShell, Bash, and DSC with Linux.<\/p>\n

Hi, my name is Stefan Roth (Blog: http:\/\/stefanroth.net<\/a> \/ Twitter: @stefanroth_net<\/a>), and I am a Cloud and Datacenter MVP. In my last post of this three-part series, I would like to show you how we are able to hook up the previously installed Linux system to Azure Automation desired state configuration (DSC), deploy a DSC configuration, and apply it to our Linux system. What we are actually going to do is create a cronjob on Linux via Azure Automation DSC. This cronjob will run a PowerShell script on Linux every five minutes to send the current connected users to Azure Log Analytics HTTP Data Collector API<\/a>.<\/p>\n

The first step is to hook up our system to Azure Automation DSC. Simply run the following script on the Linux system.<\/p>\n

\/opt\/microsoft\/dsc\/Scripts\/Register.py <PRIMARY ACCESS KEY> <URL><\/code><\/p>\n

This script will configure the local machine\u2019s Local Configuration Manager (LCM) and also register on Azure Automation DSC. You find the primary access key and the URL\u00a0in the Azure portal.<\/p>\n

\"The<\/a><\/p>\n

After you ran the script on the Linux system, you should get an output like in this screenshot.<\/p>\n

\"Output<\/a><\/p>\n

Of course, you will see your registered server in the Azure portal as well.<\/p>\n

\"The<\/a><\/p>\n

The first step has been done. The next step will supply the actual DSC configuration script, which we will run from Azure Automation DSC. Before we actually can do that, we need to upload the nx<\/em> DSC module, which contains the script resource.<\/p>\n

First, download the module to your Windows computer, for example,\u00a0C:\\Temp. Use the Save-Module<\/strong> cmdlet to download and save the module locally. Next, just ZIP the nx<\/em> module folder to a file nx.zip<\/em>.<\/p>\n

\"Use<\/a><\/p>\n

Azure Automation needs the module in the ZIP format to successfully install<\/a> the module<\/span>. Then, upload the ZIP file to Azure Automation.\u00a0This screenshot provides the steps.<\/p>\n

\"Upload<\/a><\/p>\n

After few minutes the module will appear as a listed module.<\/p>\n

\"The<\/a><\/p>\n

If you don\u2019t upload this module and you try to compile a DSC configuration, the compilation will fail and shoot an exception.<\/p>\n

\"Demonstration<\/a><\/p>\n

At this moment, we are ready to upload the actual DSC configuration file, which will create the cronjob. A cronjob is similar to a scheduled job in Windows. This specific cronjob will run every five\u00a0minutes and run a script,\u00a0\/tmp\/Send-Login.ps1<\/em>, which we will create in an upcoming step. The TestScript<\/code> part checks if the cronjob has been created.\u00a0If not, it will execute the SetScript<\/code> section which will add the cronjob. What’s interesting here is that we are actually using the PowerShell binary to\u00a0execute a native PowerShell script on Linux.<\/p>\n

DSC_CronJob.ps1<\/em><\/p>\n

# DSC configuration CronJob\nconfiguration CronJob\n{<\/code><\/p>\n

# Import the DSC module nx\nImport-DSCResource -Module nx<\/code><\/p>\n

# Node name or IP\nnode centos.localdomain\n{<\/code><\/p>\n

# Use the nxScript resource to create a cronjob.\nnxScript CronJob{<\/code><\/p>\n

GetScript = @\"<\/code><\/p>\n

#!\/bin\/bash\ncrontab -l | grep -q \"powershell -c \/tmp\/Send-Login.ps1\" && echo 'Job exists' || echo 'Job does not exist'\n\"@<\/code><\/p>\n

SetScript = @\"<\/code><\/p>\n

#!\/bin\/bash\n(crontab -l | grep -v -F \"powershell -c \/tmp\/Send-Login.ps1\" ; echo \"*\/5 * * * * powershell -c \/tmp\/Send-Login.ps1\" ) | crontab\n\"@<\/code><\/p>\n

TestScript = @'<\/code><\/p>\n

#!\/bin\/bash\ncrontab -l | grep -q \"powershell -c \/tmp\/Send-Login.ps1\" && exit 0 || exit 1\n'@<\/code><\/p>\n

}<\/code><\/p>\n

}<\/code><\/p>\n

}<\/code><\/p>\n

Within the Azure portal, go to DSC Configuration<\/strong>\u00a0> Add a configuration<\/strong>, provide the configuration file, and then click OK<\/strong>.<\/p>\n

\"Provide<\/a><\/p>\n

Remember, we just provided the PowerShell script code.\u00a0Next, we need to create the MOF file from\u00a0this code.\u00a0To generate the MOF file, simply select the DSC configuration, and select Compile<\/strong>.<\/p>\n

\"Click<\/a><\/p>\n

The compilation job starts and deploys the file to the DSC pull server. It takes a couple of minutes for the job to finish.<\/p>\n

\"Progress<\/a><\/p>\n

After completion, go to DSC Nodes<\/strong>, select your node, and then click Assign node configuration<\/strong>. This step assigns the DSC configuration to the Linux machine.<\/p>\n

\"Assigning<\/a><\/p>\n

Make sure you will see the proper Node configuration and the status.<\/p>\n

\"The<\/a><\/p>\n

After your next configuration update cycle, the DSC configuration will be applied to your Linux system.<\/p>\n

\"The<\/a><\/p>\n

If you want to check whether\u00a0the DSC configuration has been applied, sign in to your Linux server as root, and type crontab -l<\/strong>,<\/em> which will display the configured cronjob.<\/p>\n

\"Display<\/a><\/p>\n

The last step is to create the Send-Login.ps1<\/em> PowerShell script in the \/tmp <\/em>directory. I use vi editor to create the file and copy the code. These are the steps to\u00a0create the PowerShell script:<\/p>\n

    \n
  1. vi \/tmp\/Send-Login.ps1 (launches an empty file called Send-Login.ps1)<\/li>\n
  2. Type i<\/strong> (for inserting text)<\/li>\n
  3. Paste the Send-Login.ps1<\/em> script below<\/li>\n
  4. Type Esc-Key<\/strong> (changing vi editor mode)<\/li>\n
  5. Type :<\/strong><\/li>\n
  6. Type wq!<\/strong> (write and quite)<\/li>\n<\/ol>\n

    If you are connected via Windows Bash to your Linux system (which I recommend), it will look similar to this screenshot.<\/p>\n

    \"Windows<\/a><\/p>\n

    As a next step, make the script executable.<\/p>\n

    chmod +x \/tmp\/Send-Login.ps1<\/code><\/p>\n

    \"Making<\/a><\/p>\n

    The Send-Login.ps1<\/em> script is based on a script from Log Analytics HTTP Data Collector API documentation<\/a> . I actually added just an additional function Get-UserData<\/strong>.<\/p>\n

    The Get-UserData<\/strong> function returns the current logged in user from Linux by using the who<\/strong> command (it is a Linux command, not a PowerShell command!). Here is a sample output of the who<\/strong> command.<\/p>\n

    \"Sample<\/a><\/p>\n

    The output of the who<\/strong> command is assigned to $Logins<\/strong> variable. Next, for each logged in user the user name, terminal (pseudo terminal or pts) where the user is signed in, the sign-in date\/time, and from which device the user is logged in is extracted. For each login, a PowerShell custom object is created. The last line of code converts the login object array to plain JSON output.<\/p>\n

    # Get logged-in user and create a custom object\nFunction Get-UserData\n{<\/code><\/p>\n

    # Use who command from Linux to get logged in users\n$Logins = who\n$Users = @()\nForEach ($Login in $Logins)\n{<\/code><\/p>\n

    # Extract the data for each login, sample data looks like \"root\u00a0\u00a0\u00a0\u00a0 pts\/1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 2016-09-21 22:46 (192.168.32.11)\"\n$Login -match '([a-z][a-z]+)\\s+(.*\\d)\\s+(\\d{4}-\\d{2}-\\d{2}\\s+\\d*:\\d*)\\s+(.*)' | Out-Null\n# Create a collection of custom objects for each user\n$Users += New-Object -TypeName PSObject -Property @{<\/code><\/p>\n

    Name\u00a0\u00a0\u00a0\u00a0 = $Matches[1]\nTerminal = $Matches[2]\nDate\u00a0\u00a0\u00a0\u00a0 = '{0:MM\/dd\/yyyy hh:mm:ss}' -f [DateTime]$Matches[3]\nDevice\u00a0\u00a0 = ($Matches[4]).replace('(','').replace(')','')<\/code><\/p>\n

    }<\/code><\/p>\n

    }<\/code><\/p>\n

    return $Users<\/code><\/p>\n

    }<\/code><\/p>\n

    # Convert the $users collection into JSON\n$Json = Get-UserData | ConvertTo-Json<\/code><\/p>\n

    If the script is executed it will send the user JSON data (user login data) to Log Analytics HTTP Data Collector API<\/a>.<\/p>\n

    #####################################################################################<\/p>\n

    Send-Login.ps1<\/em><\/p>\n

    # Replace with your Workspace ID\n$CustomerId = [YOUR WORKSPACE ID]<\/code><\/p>\n

    # Replace with your Primary Key\n$SharedKey = [YOUR PRIMARY KEY FROM YOUR OMS WORKSPACE]<\/code><\/p>\n

    # Specify the name of the record type that you'll be creating\n$LogType = 'LinuxLogin'<\/code><\/p>\n

    # Specify a time in the format YYYY-MM-DDThh:mm:ssZ to specify a created time for the records\n$TimeStampField = ''<\/code><\/p>\n

    # Create the function to create the authorization signature\nFunction Build-Signature ($CustomerId, $SharedKey, $Date, $ContentLength, $Method, $ContentType, $Resource)\n{<\/code><\/p>\n

    $xHeaders = \"x-ms-date:\" + $Date\n$StringToHash = $Method + \"`n\" + $ContentLength + \"`n\" + $ContentType + \"`n\" + $xHeaders + \"`n\" + $Resource<\/code><\/p>\n

    $BytesToHash = [Text.Encoding]::UTF8.GetBytes($StringToHash)\n$KeyBytes = [Convert]::FromBase64String($SharedKey)<\/code><\/p>\n

    $Sha256 = New-Object System.Security.Cryptography.HMACSHA256\n$Sha256.Key = $KeyBytes\n$CalculatedHash = $Sha256.ComputeHash($BytesToHash)\n$EncodedHash = [Convert]::ToBase64String($CalculatedHash)\n$Authorization = 'SharedKey {0}:{1}' -f $CustomerId,$EncodedHash\nreturn $Authorization<\/code><\/p>\n

    }\n# Create the function to create and post the request\nFunction Post-OMSData($CustomerId, $SharedKey, $Body, $LogType)\n{<\/code><\/p>\n

    $Method = \"POST\"\n$ContentType = \"application\/json\"\n$Resource = \"\/api\/logs\"\n$Rfc1123date = [DateTime]::UtcNow.ToString(\"r\")\n$ContentLength = $Body.Length\n$Signature = Build-Signature `\n-customerId $CustomerId `\n-sharedKey $SharedKey `\n-date $Rfc1123date `\n-contentLength $ContentLength `\n-fileName $FileName `\n-method $Method `\n-contentType $ContentType `\n-resource $Resource\n$uri = \"https:\/\/\" + $CustomerId + \".ods.opinsights.azure.com\" + $Resource + \"?api-version=2016-04-01\"<\/code><\/p>\n

    $Headers = @{<\/code><\/p>\n

    \"Authorization\" = $Signature;\n\"Log-Type\" = $LogType;\n\"x-ms-date\" = $Rfc1123date;\n\"time-generated-field\" = $TimeStampField;<\/code><\/p>\n

    }<\/code><\/p>\n

    $Response = Invoke-WebRequest -Uri $uri -Method $Method -ContentType $ContentType -Headers\n$Headers -Body $Body -UseBasicParsing\nreturn $Response.StatusCode<\/code><\/p>\n

    }\n# Get logged-in user and create a custom object\nFunction Get-UserData\n{<\/code><\/p>\n

    # Use who command from Linux to get logged in users\n$Logins = who\n$Users = @()\nForEach ($Login in $Logins)\n{<\/code><\/p>\n

    # Extract the data for each login, sample data looks like \"root\u00a0\u00a0\u00a0\u00a0 pts\/1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 2016-09-21 22:46 (192.168.32.11)\"\n$Login -match '([a-z][a-z]+)\\s+(.*\\d)\\s+(\\d{4}-\\d{2}-\\d{2}\\s+\\d*:\\d*)\\s+(.*)' | Out-Null\n# Create a collection of custom objects for each user\n$Users += New-Object -TypeName PSObject -Property @{<\/code><\/p>\n

    Name\u00a0\u00a0\u00a0\u00a0 = $Matches[1]\nTerminal = $Matches[2]\nDate\u00a0\u00a0\u00a0\u00a0 = '{0:MM\/dd\/yyyy hh:mm:ss}' -f [DateTime]$Matches[3]\nDevice\u00a0\u00a0 = ($Matches[4]).replace('(','').replace(')','')<\/code><\/p>\n

    }<\/code><\/p>\n

    }<\/code><\/p>\n

    return $Users<\/code><\/p>\n

    }<\/code><\/p>\n

    # Convert the $users collection into JSON\n$Json = Get-UserData | ConvertTo-Json<\/code><\/p>\n

    # Submit the data to the API endpoint\nPost-OMSData -customerId $CustomerId -sharedKey $SharedKey -body ([System.Text.Encoding]::UTF8.GetBytes($Json)) -logType $LogType\n#####################################################################################<\/code><\/p>\n

    Finally, we have everything set up and just need to wait for the scheduled job to run. If everything works correctly, you should see the results in the LinuxLogin_CL<\/em> custom log or whatever name you have configured in the script ($LogType<\/strong>).<\/p>\n

    When the script fires, it takes about 2-3 minutes for the data to appear in OMS Log Search. In this case, we run a search query * Type=LinuxLogin_CL<\/em>, and see the results immediately.<\/p>\n

    \"Results<\/a><\/p>\n

    Of course, now you could start to play with this data and run some queries on it. For example, here we are able to see when a new user (hacker) connected, from which system, and at which time.<\/p>\n

    \"Results<\/a><\/p>\n

    Another advanced way to\u00a0display the data would be to use OMS View Designer to build some nice dashboards.<\/p>\n

    Summary<\/u><\/strong>: In this post, we connected the Linux server to Azure Automation DSC. Then, we assigned a DSC configuration, which will run some Bash commands to create a cronjob on Linux. This cronjob executes a PowerShell script on Linux (yes, native PowerShell code!) to send the current connected users to OMS via Azure Log Analytics HTTP Data Collector API<\/a>. <\/span><\/p>\n

    I am fascinated how I am able to use Linux native command and use it together with PowerShell and vice versa. When you run a command on Linux, the output is just a string.\u00a0With \u00a0PowerShell on board, you can\u00a0convert the output from Bash commands to objects \u2013 PowerShell objects. Working with objects unleashes all the power there is in PowerShell and more.<\/p>\n

    This example is not meant for a production-ready scenario. Instead, it gives you an idea which direction Microsoft is taking. It gives you an idea how we are able to mix Microsoft and Linux\/Open Source technologies to take the best from both worlds to achieve our goal in less time and have some real fun.<\/p>\n

    Thank you, Stefan.<\/p>\n

    I invite you to follow me on Twitter<\/a> and Facebook<\/a>. If you have any questions, send email to me at scripter@microsoft.com<\/a>, or post your questions on the Official Scripting Guys Forum<\/a>. Also, check out my Microsoft Operations Management Suite Blog<\/a>. Until next time, peace.<\/p>\n

    Ed Wilson<\/strong>\nMicrosoft Scripting Guy<\/p>\n

    \n
    \n
    \n
    \n
    \n
    \n

     <\/p>\n<\/div>\n<\/article>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    Summary: Learn how to configure and use PowerShell, Bash, and DSC with Linux. Hi, my name is Stefan Roth (Blog: http:\/\/stefanroth.net \/ Twitter: @stefanroth_net), and I am a Cloud and Datacenter MVP. In my last post of this three-part series, I would like to show you how we are able to hook up the previously […]<\/p>\n","protected":false},"author":596,"featured_media":87096,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[568,641],"tags":[698,56,3,699,45],"class_list":["post-80565","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-hey-scripting-guy","category-windows-powershell","tag-bash","tag-guest-blogger","tag-scripting-guy","tag-stefan-roth","tag-windows-powershell"],"acf":[],"blog_post_summary":"

    Summary: Learn how to configure and use PowerShell, Bash, and DSC with Linux. Hi, my name is Stefan Roth (Blog: http:\/\/stefanroth.net \/ Twitter: @stefanroth_net), and I am a Cloud and Datacenter MVP. In my last post of this three-part series, I would like to show you how we are able to hook up the previously […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/posts\/80565","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/users\/596"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/comments?post=80565"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/posts\/80565\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/media\/87096"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/media?parent=80565"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/categories?post=80565"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/scripting\/wp-json\/wp\/v2\/tags?post=80565"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}