Data Integration Developer Azure and AI Solutions

The Law Society of NSW is Australias largest and most influential membership association for solicitors. Were not all lawyers but we work together to support the legal profession and ensure a just society for all.

We are currently looking for a Data Integration Developer (Azure & AI Solutions)to join our Information Management team.

About the role

Leveraging technologies such as Azure Data Factory Logic Apps Azure Data Lake SQL and Databricks the Data Integration Developer (Azure & AI Solutions) will play a key role in designing developing and maintaining data pipelines and integrations that enable informed decisionmaking and advance the organisations strategic objectives.

What youll be doing

• Design build and maintain scalable and secure data integration solutions using Azure Data Factory Logic Apps Azure Data Lake and Databricks.
• Develop and optimise data pipelines for ingestion transformation and distribution of structured and unstructured data from various internal and external sources.
• Implement best practices for data architecture ETL/ELT design and data governance.
• Integrate AI capabilities (e.g. cognitive services machine learning models automation tools) to support intelligent workflows and enhance operational efficiency.
• Monitor and troubleshoot data integration processes to ensure high data quality and availability.
• Work closely with other teams to understand data requirements and ensure the proper integration of disparate systems
• Provide technical support and troubleshooting for data integration processes ensuring smooth and accurate data transfer and processing
• Ensure highquality reliable data integration by implementing robust validation monitoring and error handling strategies
• Work in accordance with the organisations data governance policies and ensure compliance with data security and privacy standards
• Collaborate with crossfunctional teams to gather data requirements and translate them into technical specifications
• Provide documentation of data processes integration workflows and system configurations for future reference and team use
• Evaluate new technologies and tools in the Azure ecosystem and recommend improvements or enhancements to existing systems
• Continuously optimise data integration processes to improve performance scalability and costefficiency
• Define the Data and Data Integration strategy by focusing on business decision automation through quality information and developing a single source of information truth for all business users
• Administer and apply datafixes to both internally and externally developed businesscritical systems
• Troubleshoot and correct issues on various application databases such as Azure SQL and Oracle
• Identify potential faults within the Data Integrations and Data Warehouse and take a proactive approach to address the issue
• Proactively engage with various business stakeholders to encourage adoption and automation using the Information Management services
• Collaborate with data engineers analysts business units and stakeholders to understand data requirements and deliver effective solutions.
• Provide technical guidance and mentoring to other developers and team members
• Document system processes configurations and best practices
• Ensure clear processes are in place for new request management
• Collaborate with Boomi developers to build support and optimise integrations and data flows
• Assist in troubleshooting and resolving issues related to Boomi integrations and workflows
• Ensure seamless integration between Boomibased and Azurebased systems facilitating smooth data exchange and management
• Collaborate with crossfunctional teams and assist other developers with development support and maintenance of our Oracle platforms
• Report on task/project progress to manager and IT reporting as required
• Focus on improving / maintaining the perception of IT within the business
• Providing training to staff (both internally and externally) on IT IM Services
• Ensuring all policies procedures and processes are followed at all times
• Maintain all documentation for continual use and ease of new staff joining the team
• Standardise and highlight improvements to services

About you

• 5 years providing support to both internally and externally developed businesscritical production
• 5 years of proven experience with Azure Data Factory Logic Apps Azure Data Lake and Azure SQL
• 3 years designing and developing Data Integration and Data Warehouse solutions including ETL/ELT design and data modelling
• 2 years of handson experience in Oracle PL/SQL and database management
• 2 years of handson experience in AI and machine learning concepts and how they can be integrated into business processes
• 2 years of handson experience with Databricks
• 1 handson experience in Python or Scala for data transformation and pipeline development
• 1 years of handson experience with Boomi integration and flow development
• 1 years of DevOps processes (including CI/CD) and Infrastructure as code fundamentals
• Strong proficiency in Azure Data Factory for building and managing data pipelines
• Strong problemsolving skills and a proactive approach to innovation and automation
• Experience in implementing data security privacy and compliance controls in cloud environments
• Strong knowledge of SQL and data modelling
• Familiarity with scripting languages (e.g. Python PowerShell) and other integration tools
• Fundamental database administration skills (Azure SQL Oracle DB MySQL)
• Understanding of various Datawarehouse methodologies such as Data Vault and Kimball
• Experience with big data solutions realtime data streaming or machine learning pipelines
• Strong data analysis discovery and problemsolving skills
• Strong communication skills both verbal and written
• Time Management skills
• Selfmotivated with a passion for learning and adopting new technologies
• Attention to detail.

• Certification in Microsoft Azure (e.g. Azure Data Engineer Associate Azure Solutions Architect Associate)
• Certification in Databricks or AI/ML platforms is a plus
• Certification in Oracle Database
• Certification in Boomi
• Tertiary qualifications in Information Systems Computing Science or similar

To apply

The Law Society of New South Wales is committed to building and maintaining a respectful and inclusive workplace appointing the best person for the role and supporting diversity.

Applications should contain a CV and cover letter that outlines your key experience and motivations for this role.