Using raw data to meet user needs during COVID-19

During COVID-19, gov.au Observatory use raw data to help Ministers, senior officials and agencies understand the community’s information needs.

A black screen with green and red computer code

Raw insights during COVID-19

We need to collect and analyse traffic data to make sure websites and other digital services meet user needs. Standard analytics services are a great way to explore data, but as portfolios of services grow, and questions become more complex, these services may not provide all the answers. Using the raw data that powers these services resolves this problem and provides a rich source of information. 

The Digital Service Standard for example, measures performance to understand how users engage with digital services. The information gathered from this type of data is crucial to maintain and improve products and services. Services like Google Analytics provide a simple way to explore this data, however they generally focus on single services with pre-set insights. This can make it difficult to understand cross-service behaviour and find the specific answers needed.

During times of peak traffic and high volume, analytics services can also sample website traffic data. This makes it difficult to provide up-to-date and accurate statistics.

Working with raw analytics data removes these constraints. As the Observatory uses Google Analytics for its services, we have connected our subscribers’ Google Analytics 360-enabled profiles to Big Query. This allows us and our subscribers to bring unsampled, raw data into a data warehouse for storage and processing.

Big Query integrates with other cloud data infrastructure to provide a flexible and cost-effective way to manage this resource. Using a cloud-based data warehouse allows you to focus on data engineering and science, rather than managing the infrastructure.

The difference between traditional and cloud data warehouses

Traditional data warehouses:

  • are optimised for business intelligence reporting
  • are restricted to select users
  • are optimised for batch data processing
  • have complex data extraction, transformation, and loading processes
  • require continuous patching

Cloud data warehouses:

  • are integrated for artificial intelligence and machine learning
  • provide easy sharing of insights
  • use real-time insights
  • automate data ingestion processes

These environments allow quick access to accurate information during a crisis. We use tools such as SQL and scheduling products such as Airflow to automate report production in Google Datastudio. This frees up time to focus on richer insights, not just page hits and bounce rate. The infrastructure can also collect data from other services, such as Facebook’s WhatsApp and Google’s Firebase.

Our coronavirus response services, australia.gov.au, the Coronavirus Australia app, WhatsApp channel and the COVIDSafe contact-tracing app provide simplified access to Commonwealth and state and territory information and support our contact tracers. A holistic view of these services make sure they continue to meet the community’s needs so that Ministers, senior officials and organisations know the community’s concerns.

Answering key questions

In creating a deeper understanding of the community’s engagement with your services, you need to go beyond page hits and bounce rates. Key questions many decision-makers have are ‘What information are people interested in?’ and ‘Did people read this?’ You can set up specific events and structure your analytics in tools such as Google Tag Manager so they answer these questions.

The two events we used to answer these questions were URL clicks and scroll depth. The data these tags create may seem hard to understand, but data visualisation tools can combine this data to provide the answers we need. We used regular expressions to aggregate URLs into their policy groupings, such as traffic to the jurisdictions, health, welfare and community messaging, which is easier to understand.

Raw data makes multi-channel analysis possible by combining the same metric across different sites or technologies. We used these techniques to understand how the community uses departmental websites such as the Department of Health, Services Australia, the Department of Industry, Science, Energy and Resources, and Home Affairs. We can then compare this information to traffic leaving Australia.gov.au to confirm we are connecting the community to the information it is looking for.

To develop a strategic approach to emergency communications you need accurate and up-to-date insights about how the community is accessing information.

If you want to use some of the scripts we have developed, you can find them at our GitHub repository. To find out more about the Observatory or sign up for our services, check out the Observatory web site.