Grouping and Filtering Your Billing Data

Grouping and Filtering Your Billing Data

#380580

You can use the various filtering options to define the scope of billing line items, on which to base your report, in all of the Cloud Cost Intelligence reports.

You can then save this set of options as a named report to view regularly, as data is collected and the reports are updated. You can create multiple filtered reports and save them for easy review.

Once you have selected the desired filter set, you need to save the resulting report as these settings are not retained when you exit the Cloud Cost Intelligence module. The selected group, period and date range are retained for each user session. i.e. if you log out and then return at some later date, these settings are saved. If another user accesses the Cloud Cost Intelligence module, their settings will be applied.

The options at the top of the console allow you to group your data.

Note: Only the timing granularity to view the data (View by) and the Period options are applicable to the Reserved Instance Utilization Report.

Grouping and Filtering Options

Grouping the data set allows you to break down your billing information and select only the data of interest so you can review spending specifically for these items. It allows you to drill down and investigate your billing data using your specific criteria.

Grouping options are displayed along the top of the table or chart. Not all reports have grouping options. Filtering options are shown along the left side of the report.

When viewing the cost navigator reports, the grouping and filtering options vary depending on whether you are viewing AWS or Azure billing data.

Options for both platforms are described in the sections below:

Grouping

Filtering

Breadcrumbs

The displayed billing data is based on the selected grouping and filtering options at the top and left side of the page. If filtering has been enabled, you will see the selected filter setting as "breadcrumbs" at the top of the report.

For some reports, you can disable a filter by clicking the x at the end of the item, from this bar.

Options for RIs and Reservations

Grouping and filtering options also vary for the AWS Reserved Instances and Azure Reservations reports. See the following topics for the various reports:

AWS Show Options

The options in this box are specific to AWS and are not displayed for Azure. Use these options to select how you want to view your AWS cost data.

  • Blended Cost—AWS calculates blended costs as the BlendedRate multiplied by the UsageAmount of that service. The Blended rates are the averaged rates of the Reserved Instances and On-Demand Instances that are used by your accounts in an AWS Organizations.
  • Unblended Cost—AWS calculates Unblended costs as the UnblendedRate multiplied by the UsageAmount for that service. For line items that have an RI discount applied to them, the UnblendedRate is zero. Line items with an RI discount have a UsageType of Discounted Usage.

The above listed options are all AWS line items and are not unique to Densify or to the Cloud Cost Intelligence module. Refer to AWS Billing and Cost Management website for details of all the above options.

Group By Options

When grouping by user-defined tags you must already have enabled tagging on your AWS or Azure billing data in order for the appropriate attributes to be set on the incoming billing data.

Tagging AWS Instances

By default, AWS billing data properties are populated from the resource tags, with the same name (and case), that you have applied in AWS. For example, the “Business Unit” attribute is populated from the “Business Unit” resource tag.

Refer to the following AWS pages for details on defining the resource tags and assigning them to your billing data:

Once your instances have been tagged, then contact your Cloud Advisor for details on configuring the required settings within Densify.

AWS Grouping Options

You have the option to group your data by one of the following AWS properties in the Cost Navigator reports:

  • API Operation—Provides a break down by API operations you have performed. i.e. CreateOperation, RunInstances.
  • Charge Frequency—Provides a break down by billing frequency. i.e. hourly, daily.
  • Charge Type—Provides a break down by the type of charges included in your bill. i.e. usage, taxes, additional fees.
  • Linked Account—Provides a break down by the linked account number or account alias.
  • Payer Account—Provides a break down by the payer account number.
  • When there are multiple accounts, you can filter by the account name or number. The available options are based on how you configured the AWS IAM user account used for data collection. For example, if you have a payer account for accounting purposes, you can filter on one or more of the accounts linked to the payer account. See Creating Connections from the Payer Account.

  • Region—Cloud region from which guests are hosted. The available options are determined by the selected cloud provider.
  • Service —Provides a break down by the type of service, such as storage, data transfer, elastic compute, etc. The available options are defined by the selected cloud provider.
  • Usage Type—Provides a break down by the type of usage, such as LoadBalancer Usage, EBS: VolumeUsage.
  • Usage Unit—Provides a break down by the type of usage unit, such as GB-Hrs.
  • You can also group your data by user-defined tags, such as Application, Business Unit, Cost Center. When configuring the cost and usage report for billing data collection, you must include resource IDs.

Azure Grouping Options

You have the option to group your Azure data by one of the following properties in the Cost Navigator reports:

  • Charge Frequency—Provides a break down by billing frequency. i.e. hourly, daily.
  • Charge Type—Provides a break down by the type of charges included in your bill. i.e. usage, taxes, additional fees.
  • Meter—Provides a break down by the type of usage, such as vCores, LRS Data Stores, eDTUs.
  • Region—Cloud region from which guests are hosted. The available options are determined by the selected cloud provider.
  • Resource Group—Provides a break down by resource groups. The resource groups include all the resources for a user-defined solution, or only those resources that a user wants to manage as a group.
  • Resource Provider—Provides a break down by providers in use in your subscription. i.e. Microsoft.ServiceBus, Microsoft.ClassicStorage.
  • Service—Provides a break down by the type of service, such as Service Bus, Load Balancer, Storage.
  • Service Tier—Provides a break down by service tier, Virtual Machines: A Series Windows, Virtual Machines: Dv2/DSv2 Series, etc.
  • Subscription—Provides a break down by the Subscription number or account alias.
  • Usage Unit—Provides a break down by the type of usage unit, such as 100 Hours, 100/Hour, 10 GB/Month, etc.
  • You can also group your data by user-defined tags, such as Application, Business Unit, Cost Center, if these tags have been assigned to your instances.

View By Options

Use the options in this dropdown box to specify the timing granularity. Your report can be based on daily, monthly, quarterly or yearly data. Your selection here, depends on how much data you have collected.

All charges included in the billing period, regardless of actual charge date, are included on the time/date they are incurred. For example, if in November, the cost of AWS Support Service for December is billed, then this cost is accounted for in November.

This option is used on both the Cost Navigator and Reserved Instance Utilization reports.

Period (Time Scale) Options

Period (time scale) to include a number of options to define the date range the the Cost Navigator and Reserved Instance Utilization reports.

  • Last 7 days
  • Last 30 days
  • Month to date
  • Previous Month to date
  • Year to date
  • Previous Week
  • Previous Month
  • Previous 3 Months
  • Previous 6 Months
  • Previous 12 Months
  • Previous 4 Quarters
  • Previous 2 Years
  • Date Range...

The Date Range option allows you to specify a custom time period. By default, the date range is based on the last full period of collected data. This is the case for all time periods; however, in the case of the last quarter or year, it is based on the last full month of collected data. For example if you have selected to view your data by quarter and the last full month of data collected is March 2020, then the last quarter is Jan-Mar 2020. If you have selected to view your data by year, then the last year April 2019-Mar 2020 is displayed.

Additional Considerations

With the some time period options, you will not see the past 2 days of data due to data collection limitations. For example, when you select "Last 7 days" you will see the previous 7 days since (yesterday-1). If Period is set to "Last 7 days" and today is January 14, then you will see January 5-12, in your report.

This also applies to the following settings, Last 30 days, Month, Year to Date. Date Range (relative and absolute) will return days from the start date to the end date - 1, unless the end date is more than 2 days ago from the current date.

If you are using any of the following time periods, then you will see the full range of specified days: Previous Week, Previous Month, Previous 3 Months, Previous 6 Months, Previous 12 Months. Previous 4 Quarters, Previous 2 Years.

Filtering Billing Data

The filtering options on the left side of the console allow you to define a subset of data to review. You can then save your custom-filtered reports for later review.

When the filtering options are enabled, the filtering criteria are indicated in purple, so that you always have a clear indication that you are viewing a subset of data and what options are included in the displayed chart or table. You can:

  • Filter by Properties—These include specific attributes of the service. Properties are platform specific:
  • Note: The AWS properties on which you can filter are different depending on which report you are using.

  • Filter by Tags—These are user-defined values for resource tags. The value of the resource tag is displayed and can be used for filtering. i.e. application:WebServer, where "application" is the resource tag and "Webserver" is the user-defined value. You must map your AWS Resource tags to Densify attributes so the tags will be included in the analyses. Contact your Cloud Advisor for details.
  • Tags are not currently available for the Reserved Instance reports.

  • Settings—These are the configuration settings for the Outliers report. See Outliers.

Multi-Select Filtering Options

Use your mouse and the Shift and Ctrl keys to select multiple options in the Properties and Tags boxes:

  • Use Shift+Crtl to select a range of options in the box. Click on the first item in the range, then while holding both Shift+Crtl click the last item in the range.
  • Click on non-adjacent items to select them. Click on the item again to de-select it.

AWS Filtering Options

The following properties are available for AWS Cost Navigator and for the RI/SP reports. Azure properties are listed in Azure Filtering Options, below.

Table: AWS Filtering/Grouping Options

Filter/Group/Tag

Description

CC Nav

RI Util

SP Util

Cover-age

RI
Exch

RI Rec
Purch

SP Rec
Purch

API Operation

Allows you to filter or group data by API operations you have performed. i.e. CreateOperation, RunInstances.

Yes

No

No

No

No

No

No

Availability Zone

Allows you to filter or group data by AZ. i.e. ca-central-1a

No

No

No

Yes

No

No

Yes

Charge Frequency

Allows you to filter or group data by billing frequency. i.e. hourly, daily.

Yes

No

No

No

No

No

No

Charge Type

Allows you to filter or group data by the type of charges included in your bill. i.e. usage, taxes, additional fees.

Yes

No

No

No

No

No

No

Instance Family

Allows you to filter on the instance family.

No

No

Yes

No

No

No

Yes

Instance Type

Allows you to filter or group data by instance type. Eg. The RI instance class, instance type, or node type, such as t2.micro, db.m4, or dc2.large.

No

Yes

No

No

No

Yes

Yes

License Model

Allows you to filter or group data by license model. i.e. Bring your own license or No license required.

No

No

No

Yes

No

No

Yes

Linked Account

Allows you to filter or group data by the linked account number or account alias.

Yes

Yes

No

Yes

No

No

Yes

Offering Class

Allows you to filter or group data by standard or convertible RIs. Applicable to RIs only.

No

Yes

No

No

No

No

No

Operating System

Allows you to filter or group data by the installed operating system. i.e Linux, RHEL, Windows.

No

No

No

Yes

No

No

Yes

Payer Account

Allows you to filter or group data by the payer account number.

When there are multiple accounts, you can filter by the account name or number. The available options are based on how you configured the AWS IAM user account used for data collection.

For example, if you have a payer account for accounting purposes, you can filter on one or more of the accounts linked to the payer account. See Creating Connections from the Payer Account.

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Payment Option

Allows you to filter by the payment option. i.e. All Upfront, Partial Upfront, No Upfront

No

No

Yes

Yes

No

No

No

Platform

Allows you to filter by application platform. i.e. MariaDB, Red Hat Enterprise Linux (Amazon VPC},

No

Yes

No

No

No

Yes

No

Preinstalled Software

Allows you to filter or group data by preinstalled software.

No

No

No

Yes

No

No

Yes

Purchasing Account

Allows you to filter on the account used to buy the savings plans

No

No

Yes

No

No

No

Yes

Region

Allows you to filter or group data by the cloud region in which guests are hosted. The available options are determined by the selected cloud provider.

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Savings Plan Type

Allows you to filter on the type of savings plans type, WC2 or Comnpute.

No

No

Yes

No

No

No

Yes

Service

Allows you to filter or group data by the type of service, such as storage, data transfer, elastic compute, etc. The available options are defined by the selected cloud provider.

Currently there are only two options available for the Reserved Instances Utilization report.

Yes

Yes

No

No

No

No

No

Status

Allows you to filter by the status of the reserved instance.

No

Yes

Yes

No

No

No

No

Subscription

Allows you to filter or group data by the length of the RI subscription.

No

Yes

No

No

No

No

No

Tags

You can filter or group by the resource tags that you have defined and used to tag your instances. You must map your AWS Resource tags to Densify attributes so the tags will be included in the Densify analyses. Contact your Cloud Advisor for details.

Yes

No

No

No

No

No

Yes

Tenancy

You can filter or group by tenancy. i.e. Dedicated or Shared.

No

Yes

No

Yes

No

Yes

Yes

Term

Allows you to filter based on the term of the savings plan. 1 Yr, 3 Yrs.

No

No

Yes

No

No

No

Yes

Usage Type

Allows you to filter or group data by the type of usage, such as LoadBalancer Usage, EBS: VolumeUsage.

Yes

No

No

No

No

No

No

Usage Unit

Allows you to filter or group data by the type of usage unit, such as GB-Hrs. IOPs, minutes, etc.

Yes

No

No

No

No

No

No

Note: Not all filters are supported for all reports.

Azure Filtering Options

The following properties are available for Azure Cost Navigator and for the Reservation reports.

Table: Azure Filtering/Grouping Options

Filter/Group/Tag

Description

CC Nav

Utilize

Coverage

Rec Purch

Applied Scope

Allows you to filter the applied scope. For exampled, If scope_type = shared, Scope = Shared. If scope_type = subscription, Scope = Subscription/Pay-As-You-Go. If scope_type = resource group, Scope = Subscription/Pay-As-You-Go/resourceGroup/AKS-Cluster

No

Yes

No

No

Billing Plan

Allows you to filter on the billing plan.

No

Yes

No

No

Billing Subscription

Allows you to filter billing subscription.

No

Yes

No

No

Charge Frequency

Allows you to filter or group data by billing frequency. i.e. hourly, daily.

No

No

No

No

Charge Type

Allows you to filter or group data by the type of charges included in your bill. i.e. usage, taxes, additional fees.

Yes

No

No

No

Meter

Allows you to filter or group data by the type of usage, such as vCores, LRS Data Stores, eDTUs.

Yes

No

No

No

Instance Family

Allows you to filter on the instance family.

No

No

No

No

Instance Size Flexibility Group

Allows you to filter by the whether or not the reservation is instance flexible.

No

Yes

Yes

Yes

Instance Type

Allows you to filter or group data by instance type. Eg. The RI instance class, instance type, or node type, such as t2.micro, db.m4, or dc2.large.

No

Yes

Yes

Yes

Operating System

Allows you to filter or group data by the installed operating system. i.e. Linux, RHEL, Windows.

No

No

Yes

No

Provisioning State

Allows you to filter by the provisioning state, i.e. Succeeded, Cancelled, etc.

No

Yes

No

No

Region

Allows you to filter or group data by the cloud region from which guests are hosted.

Yes

Yes

Yes

Yes

Reservation Name

Allows you to filter by the reservation name.

No

Yes

No

No

Reservation Term

Allows you to filter by the reservation term.

No

Yes

No

No

Resource Group

Allows you to filter or group data by resource groups.

Yes

Yes

Yes

Yes

Resource Provider

Allows you to filter or group data by providers in use in your subscription. i.e. Microsoft.ServiceBus, Microsoft.ClassicStorage.

Yes

No

No

No

Scope Type

Allows you to filter by the scope type i.e. Shared, Single Subscription, Single Resource Group.

No

Yes

No

Yes

Service

Allows you to filter or group data by the type of service, such as Service Bus, Load Balancer or Storage.

Yes

No

No

No

Service Tier

Allows you to filter by service tier. i.e. Virtual Machines: A Series Windows, Virtual Machines: Dv2/DSv2 Series, etc.

Yes

No

No

No

Subscription

Allows you to filter or group data by the Subscription number or account alias.

Yes

No

Yes

No

Subscription Name

Allows you to filter by the Subscription name.

No

No

No

No

Tags

You can filter or group by the resource tags that you have defined and used to tag your instances. You must map your AWS Resource tags to Densify attributes so the tags will be included in the Densify analyses. Contact your Cloud Advisor for details.

Yes

No

No

No

Usage Unit

Allows you to filter or group data by the type of usage unit, such as 100 Hours, 100/Hour, 10 GB/Month, etc.

Yes

No

No

No

Rich Filters

The options provided by this additional filtering logic allow you to investigate your billing data in detail and create reports for various groups across your organization.

The following options can be defined for each property and tag.

Option

Description

Is one of

This is the default setting. When selected, all items that match the selected items in the filter list are included in the report.

Is not one of

When selected, all items that do NOT match the selected items in the filter list are included in the report.

Contains

When selected, all items that contain the selected items in the filter list are included in the report.

Does not contain

When selected, all items that do NOT contain the selected items in the filter list are included in the report.

Starts with

When selected, all items that start with the selected items in the filter list are included in the report.

Does not starts with

When selected, all items that do NOT start with the selected items in the filter list are included in the report.

Ends with

When selected, all items that end with the selected items in the filter list are included in the report.

Does not ends with

When selected, all items that do NOT end with the selected items in the filter list are included in the report.

Equals

When selected, all items that equal the selected items in the filter list are included in the report.

Does not equal

When selected, all items do NOT equal the selected items in the filter list are included in the report.

Is null

When selected, all items for which there is no value are included in the report.

Is not null

When selected, all items for which there is some value (are not null) are included in the report.

Use caution when setting multiple filters and when using the filters that negate the displayed items. Densify highly recommends testing and verifying your filter settings before saving and using the report.

Clearing the Filters

If you have set filters and applied them and then need to clear the settings do the following:

  • To clear all of the settings, you can click the delete button located in the breadcrumbs bar. This change is made immediately.
  • To clear selected settings:
    • You can click on selected items to de-select them, for the standard filters;
    • If you want to clear all settings in a drop down menu, click the "None" button at the bottom of the applicable drop down menu. You will need to do this for each group for which you have defined a filter.
    • To clear the rich filter options, select "Is one of" at the top of the list. The rich filtering logic is cleared and the related drop down control re-appears.
    • You can also click the Selected tab, then click the (x) for each item to be de-selected.

    You must click Apply at the bottom of the panel to make these changes.

Example - Picking Items

There are many ways to define your filters. The following sections provide a few examples:

Create a filter by selecting one or more items from one or more of the Filter or Tag menus. You can select one or more options in each of the input controls.

If no data is available for a specific filter selection box, the value "All" is used, so that if data becomes available in subsequent data collection, it will be included in these reports.

  1. Click Filters to expand the list of available filtering criteria. This list of filtering options corresponds to the grouping options. See above for descriptions.
  2. Select the option of interest and click to expand the input control. In the example, below 6 items have been selected out of the 189 available options.
  3. In the expanded input control, scroll through the list and click on the items you want to include in your report. You can select one or more items. In this example 6 items have been selected out of the 189 available options. These values are displayed on their respective tabs.
  4. Click Apply to see the results. The selected filtering criteria are applied, regardless of whether the Chart or Tabular view is selected.
  5. Click Save. Enter a descriptive name and click Save to close the dialog box and save your custom filter.

Example - Searching and Picking Items

Create a filter by searching for a specific string and selecting one or more items from the returned list.

  1. Click Filters to expand the list of available filtering criteria.
  2. Select the filtering option of interest (i.e. API Operation) and click to expand the input control.
  3. In the expanded control, enter your text in the Search list . i.e. Create. In this example, only the API operations containing "create" are shown.
  4. There are a number of selection options:
    1. Click the first item in the list, then scroll down and Shift-click to select all the items containing the string "create".
    2. You can the click on individual items to de-select them from the filtering criteria.
    3. Click in the Search list again and delete the word "create". All items are displayed, but the items that included "create" remain selected. Click the Selected tab to see only the items that are selected.
    4. Click Invert to invert the selection. In this case, all items are selected except those items that contain "create".
    5. Click Apply at the bottom of the panel. The report shows data for API Operations that do not contain the word "create".
  5. Click Save. Enter a descriptive name and click Save to close the dialog box and save your custom filter.

Example - Using the Rich Filter

Create a filter using the advanced logic provided by the rich filter options.

  1. Click Filters to expand the list of available filtering criteria.
  2. Expand API Operations and in the rich filter drop down box, select "Contains". Then enter your filtering criteria. Int his example, we are using "GET".
  3. Click Apply to see the results. The selected filtering criteria are applied, regardless of whether the Chart or Tabular view is selected.
  4. You can see the breadcrumbs section update to show the details of the applied filters.
  5. Click Save. Enter a descriptive name and click Save to close the dialog box and save your custom filter.

If the result set is empty, check the logic of your rich filter selection, especially when using filters that negate the displayed items.

Filter Breadcrumbs

The breadcrumbs show you the details of the filters that have been applied to the displayed report. Each applied filter and its settings are shown at the top of the report.

  • One item—If a filter has been selected and only one of the filtering criteria has been applied, that filter name and current setting are displayed.
  • Two or more items—If a filter has been selected and two setting have been applied, both settings are listed. The resulting data set contains one or the other of the applied settings.
  • When using rich filters the wording of the selected logic is shown.