{"id":954,"date":"2020-04-30T19:47:47","date_gmt":"2020-05-01T02:47:47","guid":{"rendered":"http:\/\/blog.nillsf.com\/?p=954"},"modified":"2020-04-30T19:47:55","modified_gmt":"2020-05-01T02:47:55","slug":"using-azure-resource-graph-to-optimize-your-scripts","status":"publish","type":"post","link":"https:\/\/blog.nillsf.com\/index.php\/2020\/04\/30\/using-azure-resource-graph-to-optimize-your-scripts\/","title":{"rendered":"Using Azure Resource Graph to optimize your scripts"},"content":{"rendered":"\n

I had to get some data out of a large Azure environment yesterday. What I needed was a quick way to get all machines of a certain size. Typically, I would have used Azure Powershell or Azure CLI to get this done. Create a loop over all resource groups, get all the resources in the resource group, and then just increment a counter.<\/p>\n\n\n\n

There is a better to do this. Using the Azure Resource Graph, you can write queries to your Azure resources and get very quick results without the need to loop over resources. Using the Azure Resource Graph, you write queries in KQL, the same language as you use for Log Analytics and Azure Data Explorer.<\/p>\n\n\n\n

Let me quickly introduce the Azure Resource Graph, and then also show you how you can use it from Azure PowerShell to optimize your scripts. The benefit of doing this would be that you do less Azure ARM queries, meaning you have less risk of being throttled.<\/p>\n\n\n\n

What is Azure Resource Graph<\/h2>\n\n\n\n

The Azure Resource Graph is an Azure service that allows you to query resources using the KQL language cross-subscription. The graph lives outside of the ARM API, hence querying this graph doesn’t incur additional ARM throttles (the graph has it’s own throttles). The biggest benefit of using the resource graph is that you have the ability to query resources by all of their attributes, meaning for example machine sizes, disk types, status etc. and build complex queries.<\/p>\n\n\n\n

The graph is available in the Azure portal, as well as through the Azure CLI and Azure PowerShell. Let me show you a quick demo of the resource graph in the portal. To see the graph explorer, you can look for resource graph in the Azure search bar.<\/p>\n\n\n\n

\"\"
Looking for resource graph shows you the resource graph explorer.<\/figcaption><\/figure>\n\n\n\n

This will open the graph explorer. Here, you can write your queries and see the results.<\/p>\n\n\n\n

\"\"
The graph explorer in the portal<\/figcaption><\/figure>\n\n\n\n

As a first query, we can get all resources and take just 10 out of them:<\/p>\n\n\n\n

resources\n| take 10<\/code><\/pre>\n\n\n\n
\"\"
Taking top 10 out of the resources<\/figcaption><\/figure>\n\n\n\n
We can then make more interesting queries. Like counting the total amount of disks in a subscription:<\/p>\n\n\n\n
resources\n| where type =~ 'Microsoft.Compute\/disks'\n| count<\/code><\/pre>\n\n\n\n
\"\"
Counting the amount of disks in my subscription<\/figcaption><\/figure>\n\n\n\n
What interests me most, are the disks that aren’t attached to a VM. The reason this is interesting, is that I have scripts that delete all these disks. Getting all those disks as a single query, will optimize my daily clean up scripts. <\/p>\n\n\n\n
resources\n| where type =~ 'Microsoft.Compute\/disks'\n| where isnull(parse_json(managedBy))<\/code><\/pre>\n\n\n\n
Which will return unattached disks:<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Which we can then use in a PowerShell script:<\/p>\n\n\n\n
Editing PowerShell scripts to leverage Azure Resource Graph<\/h2>\n\n\n\n
Let me show you one of the scripts I run daily (using Azure Automation) to delete any unattached disks and NICs:<\/p>\n\n\n\n
#Get all ARM resources from all resource groups\n$rgs = Get-AzureRmResourceGroup \nforeach ($rg in $rgs){\n    $disks = get-azurermdisk -ResourceGroupName $rg.ResourceGroupName \n    foreach($disk in $disks){\n        if($null -eq $disk.ManagedBy){\n            Remove-AzureRmDisk -ResourceGroupName $rg.ResourceGroupName -DiskName $disk.name -asjob -Force\n            Start-Sleep -s 1\n        }\n    }\n    $nics = Get-AzureRmNetworkInterface -ResourceGroupName $rg.ResourceGroupName\n    foreach($nic in $nics){\n        Remove-AzureRmNetworkInterface -ResourceGroupName $rg.ResourceGroupName -Name $nic.name -force -AsJob\n        $nic.name\n        Start-Sleep -s 1\n    }\n}<\/code><\/pre>\n\n\n\n
As you can see, this script loops over every resource group, and for every resource group loops over all disks and NICs. Another sort of issue<\/em> with this script is that it is using the older AzureRM PowerShell, and this might be a good opportunity to update this to AZ PowerShell.<\/p>\n\n\n\n
Let’s first loop over the disks, which we can do using this way:<\/p>\n\n\n\n
$subid = \"d19dddf3-9520-4226-a313-ae8ee08675e5\"\n$query = \"resources | where type =~ 'Microsoft.Compute\/disks' | where isnull(parse_json(managedBy))\"\n$disks =  Search-AzGraph -Subscription $subid -Query $query\nforeach ($disk in $disks){\n    Remove-AzResource -ResourceId $disk.id -force\n    start-sleep 1\n}<\/code><\/pre>\n\n\n\n
As you can see in the script above, we are no longer looping over all resource groups and getting all the disks. We simply query for all disks that are not attached to a VM, and then loop over that small amount of disks and delete them. I do put a sleep in there, because I noticed in the past that sending too many deletes simultaneously can cause some errors.<\/p>\n\n\n\n
We can do something very similar for the NICs:<\/p>\n\n\n\n
$query = \"resources | where type =~ 'Microsoft.Network\/networkInterfaces' | where isnull(parse_json(properties.virtualMachine ))\"\n$subid = \"d19dddf3-9520-4226-a313-ae8ee08675e5\"\n$nics=  Search-AzGraph -Subscription $subid -Query $query\nforeach ($nic in $nics){\n    Remove-AzResource -ResourceId $nic.id -force \n    start-sleep 1\n}<\/code><\/pre>\n\n\n\n
This will delete all NICs that are not attached to a VM. NICs don’t carry a cost, but since I tend to create\/delete VMs regularly, I prefer to have some automation clean up after me.<\/p>\n\n\n\n
As you can see, both parts of the script don’t query all resource groups and don’t loop over all resources. This has the benefit that the script will run faster, and I won’t trigger any throttles on the ARM API.<\/p>\n\n\n\n
Summary<\/h2>\n\n\n\n
And that is the Azure Resource Graph. It’s useful to query all your resources and get a view on your environment. You can additionally use the resource graph to optimize some of your scripts to run faster and more optimally.<\/p>\n\n\n\n
What use cases do you have to use the Azure Resource Graph?<\/p>\n","protected":false},"excerpt":{"rendered":"
I had to get some data out of a large Azure environment yesterday. What I needed was a quick way to get all machines of a certain size. Typically, I would have used Azure Powershell or Azure CLI to get this done. Create a loop over all resource groups, get all the resources in the […]<\/p>\n","protected":false},"author":1,"featured_media":958,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[2,4,41],"tags":[112,110,111],"class_list":["post-954","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-azure","category-management","category-windows","tag-powershell","tag-resource-graph","tag-scripting"],"jetpack_featured_media_url":"https:\/\/nillsfblog.blob.core.windows.net\/media\/2020\/04\/image-25.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/posts\/954","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/comments?post=954"}],"version-history":[{"count":2,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/posts\/954\/revisions"}],"predecessor-version":[{"id":961,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/posts\/954\/revisions\/961"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/media\/958"}],"wp:attachment":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/media?parent=954"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/categories?post=954"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/tags?post=954"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}