The following dashboards are available for Office 365 SaaS platform:
Executive - Quality Overview
This is an executive dashboard, the aim is to give at first sight the quality status of the platform with the Quality Clouds for Office 365 KPIs.
The Executive dashboard covers the metrics for apps with issues and affected area (scalability, upgradeability, security, performance, maintainability, manageability). In the below image, notice the numbers in green colour within each widget. These are the results of the average of all the scans in the last quarter, excluding the most and least configured instances (i.e, the extremes).
- General: Details of the scan (Branch, target GIT repository link).
Total Issues: Total number of issues, excluding warnings.
- The trend of the number of issues is shown below the number of issues for the currently selected scan.
- The number of written-off issues is shown below the number of issues for the currently selected scan.
QC Technical Debt: KPI that provides an estimate in hours of the development effort needed to solve the issues/violations detected in the platform.
Quality of Cloud (QoC): Composite health indicator. The value starts at 100% quality and decreases based on the number of issues, with high severity issues penalising more than medium and low. The ratio of issues to changes also affects the Quality of Cloud. Healthy instances are those with values between 80% and 100% on this indicator.
The trend of the Quality of Cloud is shown below the dial which shows the value of the indicator for the currently selected scan.
Total Warnings: Total number of issues detected on an inactive configuration item, or in a commented block of code. Note: warnings do not affect the Technical Debt or Quality of Cloud indicators.
Configuration Elements (CE): An element of configuration in code or a configuration setting.
Lines of Code Scanned: Lines of source code analysed in this scan.
Ratios of CEs with issues: Percentage of changes to the total number of issues. This measures how concentrated or spread out the issues are in the instance.
There is a display filter on the right hand side for the types of written-off issues, to filter your choice.
You can export the information captured to a .csv file if needed.
This dashboard focuses on the number of SharePoint sites and lists created within an organisation, products purchased and the licenses per product and users consumption for Office 365.
Office 365 allows users to create Sharepoint sites to store data in a secure place, organise, share, and access information. The below capture displays all the sites created for an example organisation, and product purchased, within a selected period in time.
Licences availability ratio per product
The graph below displays the availability ratio for the products purchased mentioned above. For instance we have availability ratio on Microsoft Power Apps & Flow, Office 365 developer, Microsoft Flow Free. This is a good metric to review the usage / non usage of licences purchased within an organisation.
Licences - Consumed units
The section offers a comparative information graph on licences consumed units over time per product. Hovering over the graph lines generates a popup with information on consumed numbers of licences per Sharepoint site, on a specific date.
SharePoint Sites over time
The graph below displays the total number of SharePoint sites created over a period of time within your organisation. This information helps you understand business operations and improve business processes.
SharePoint lists over time per site
As a reminder, a Sharepoint list is a collection of data that you can share with team members and other site users.
This graph displays information of lists within the SharePoint sites. The graph gives information on the number of lists for a specific Sharepoint site and at the bottom of the graph we can see the sites listed in a legend.
If one hovers over the lines in the graph, the number of lists per site are displayed.
Use this dashboard to review data about your team of developers.
The main types of metrics to look at are the following:
- Created by
- Modified by
- Number of developers
- Total issues
- Technical debt (hours)
- Issues and warnings (which can be filtered by developer and/or severity)
- List of items modified by
- Configuration elements by type and modified by
- Configuration elements created per developer
- Productivity graph (Number of CEs created by developer)
- CEs created over time
- Open issues at scan date
Alerts allow you to receive notifications whenever the value of any operational metric does not match what you expect.
Alerts can be set against any of the operational metrics described above.
All the alerts information is displayed in Alerts overview dashboard for your SaaS platform.
Use the Alerts dashboard to review the alerts you have defined for your instance and which have been triggered.
- Available metrics
- Alerts defined in the instance
- Alerts triggered
- Total alerts triggered over time
- Alert metrics over time
The Operational dashboards alerts overview govern metrics alerting you of services or users activities based on set criteria. The metric displays the different alerts, with their default names and descriptions, as listed below.
There is the option to select all the predefined alerts metrics, or tick only those which are of interest to your business.
Alerts Defined in the instance
The metric below is defined in the specific instance (In Office 365 instances, these metrics will be categorized per Service)
It displays information by:
- Alert Name: Name of the alert
- Metric Name: Description of the Metric
- Category: Products associated with alert
- Threshold: Value not to be exceeded
- Range (Min.) / (Max.)
- Created on: Date of the alert creation.
The following metric displays Office 365 Alerts triggered, based on the setup you have selected for the alerts. Here we can see a list of alerts about "High inactive users over a period of time" and the "Number of SharePoint Sites for the instance", for the associated service and product. On the right hand panel you can select to display any alerts for a specific period. There is also an option to export the results for further analysis if needed.
- Triggered on: Date of the alert being triggered
- Alert Name: Name of the alert
- Value: Numbers of alerts
- Category name : Office 365 Service
- Category value: Office 365 products
Alerts triggered over time
The graph below displays Office 365 alerts triggered over time. The example displayed is for "High inactive users over the last month" and "Number of SharePoint Sites" as an example. Hovering over the graph, displays more meaningful information about the alerts.
The user adoption dashboard gives you a quick insight of the usage level for each service among your final users.
It includes the following metrics:
- Active users vs. never logged users: You can compare how many of your authorised users are currently accessing the service. If you deploy the dropdown arrow below the Service section, it will display the list of all available services for Office 365 and their active and inactive users.
- Active daily users per service: Timeline graph of the previous metrics. Hovering over the graph displays the number of active users per service. At the bottom of the graph are listed all the available services with pertaining graph colour. If you select any of the services from that section, the graph will emphasise that selected service within the graph. If you double click on the service, it will get disabled.