ATSICHS Azure Data Platform
Building a data lake and data warehouse on Azure Synapse Analytics to enhance ATSICHS’s analytical capabilities.
Building a data lake and data warehouse on Azure Synapse Analytics to enhance ATSICHS’s analytical capabilities.
The client
Aboriginal and Torres Strait Islander Community Health Service (ATSICHS) Brisbane, has been the leading not-for-profit community owned health and human services provider to the Aboriginal and Torres Strait Islander Community in Queensland for over four decades.
From humble beginnings in the early 1970s, ATSICHS has grown to provide a diverse range of health, social and educational services throughout the Greater Brisbane and Logan areas.
The challenge
ATSICHS’s IT strategic roadmap identified that its reporting capabilities were significantly limited by the heterogeneous nature of its technical platforms and reporting solutions. Breadcrumb Digital was engaged to deliver a homogenous analytics solution to assist ATSICHS in achieving its strategic priorities.
Key challenges:
- integrating data from a broad range of cloud-hosted vendor systems through a variety of REST APIs and other interface formats
- logically organising data in the lake according to classification standards and access requirements
- implementing fine-grained access controls in the data warehouse to enable restricting access by table, column or row
- consolidating data from various health data sources and presenting a conformed view of deidentified patient data across service areas
- ensuring the solution is scalable, intuitive to configure and leverages automation wherever possible.
The skills
The project required the following skills and competencies:
- business analysis skills to work with stakeholders to clarify the required capabilities of the platform and articulate these to the technical team
- experience applying best practices with the Microsoft Azure data services including Storage, Data Factory, Synapse Analytics, and Key Vault
- technical analysis skills to interpret a wide array of data interface formats and design appropriate data load pipelines
- experience designing complex security models in Microsoft Azure
- data architecture knowledge and experience building large-scale data assets
- data warehouse dimensional modelling experience to enable intuitive views of the data built across multiple sources
- experience provisioning data platforms incrementally using an agile framework and automating deployments with DevOps.
Ashish Naik
Mark Rydzynski
Michael Cowls
The approach
ATSICHS’s IT strategic roadmap identified that its reporting capabilities were significantly limited by the heterogeneous nature of its technical platforms and reporting solutions. Breadcrumb Digital was engaged to deliver a homogenous analytics solution to assist ATSICHS in achieving its strategic priorities.
Key challenges:
- integrating data from a broad range of cloud-hosted vendor systems through a variety of REST APIs and other interface formats
- logically organising data in the lake according to classification standards and access requirements
- implementing fine-grained access controls in the data warehouse to enable restricting access by table, column or row
- consolidating data from various health data sources and presenting a conformed view of deidentified patient data across service areas
- ensuring the solution is scalable, intuitive to configure and leverages automation wherever possible.
The solution
The project required the following skills and competencies:
- business analysis skills to work with stakeholders to clarify the required capabilities of the platform and articulate these to the technical team
- experience applying best practices with the Microsoft Azure data services including Storage, Data Factory, Synapse Analytics, and Key Vault
- technical analysis skills to interpret a wide array of data interface formats and design appropriate data load pipelines
- experience designing complex security models in Microsoft Azure
- data architecture knowledge and experience building large-scale data assets
- data warehouse dimensional modelling experience to enable intuitive views of the data built across multiple sources
- experience provisioning data platforms incrementally using an agile framework and automating deployments with DevOps.