Data Engineer

• Salary 50000 - 60000

• Flexible working arrangements

About The Information Lab:

The Information Lab is a leading data consultancy specialising in delivering innovative data-driven solutions to help businesses optimise performance enhance decision-making and drive growth. We partner with organisations across industries to harness the power of data through cutting-edge analytics AI and cloud solutions.

Role Overview:

As a Data Engineer at The Information Lab you will play a key role in delivering high-quality data solutions for our clients. Reporting to a Senior Manager your primary focus will be on day-to-day project execution ensuring technical accuracy attention to detail and alignment with client objectives. You will lead small project teams coordinate tasks and be accountable for the quality and timeliness of deliverables. This role is ideal for someone with strong technical expertise and a passion for hands-on delivery.

Key Responsibilities

• Project Execution:Manage and execute tasks within client projects ensuring high standards of quality attention to detail and timeliness.

• Technical Delivery:Apply deep technical knowledge in data engineering and solution design and to build end-to-end data solutions. This includes:

  • Developing and managing data pipelines across a medallion architecture (Bronze Silver Gold) using SQL and/or Python.

  • Creating detailed source-to-target mapping documentation to ensure data lineage and clarity.

  • Implementing robust metadata tracking and designing for schema evolution.

  • Developing reports and reconciliation dashboards to validate data accuracy.

• Quality Assurance:Maintain accountability for the accuracy and completeness of all deliverables. This includes implementing and managing data quality frameworks (e.g. Great Expectations).

• Governance and Best Practices:

  • Integrate Git and DevOps (CI/CD) concepts for version control and automated deployments.

  • Establish and enforce workspace governance security protocols and comprehensive documentation for all solutions.

  • Create clear and concise solution documentation for all aspects of the project delivery.

• Client Communication:Work directly with clients to identify and align on business value technical matters clarifying requirements presenting work and incorporating feedback.

• Team Coordination:Oversee small delivery teams delegating tasks reviewing code and other outputs and supporting collaboration.

• Issue Resolution:Proactively identify risks and challenges in the delivery process escalating to the Senior Manager as appropriate.

• Learning & Development:Stay current with emerging technologies and maintain certifications relevant to Microsoft Fabric Python and data engineering with a progression path towards becoming an Azure and Fabric Solution Architect.

• Knowledge Sharing:Contribute to internal documentation delivery standards and community initiatives within the consultancy.

Qualifications & Experience

• Strong hands-on experience delivering data engineering projects ideally using Microsoft Fabric (Lakehouse Pipelines Warehouse) Synapse or Databricks.

• Proficiency in PySpark and SQL for data transformation and analysis ideally within Fabric Notebooks or an Azure environment.

• Consulting experience and familiarity with engaging with external clients.

• Strong familiarity with data modelling techniques specifically Kimball standards.

• Experience designing and building robust Power BI semantic models.

• Practical experience with Git integration and establishing CI/CD pipelines for data projects.

• Demonstrable experience implementing data quality frameworks and testing methodologies.

• Exceptional attention to detail with a track record of high-quality output.

• Excellent organizational skills with the ability to manage multiple workstreams.

• Strong communication skills and confidence working directly with clients on technical deliverables.

• Relevant certifications in Azure or Fabric (e.g. DP-600 DP-700 or DP-203) are highly preferred.

• A bachelors or masters degree in a relevant field is preferred but not required.

Key Performance Indicators (KPIs)

• Delivery Accuracy:Quality and correctness of deliverables.

• Timeliness:Adherence to delivery schedules and project milestones.

• Client Feedback:Satisfaction from clients regarding technical execution and solution reliability.

• Team Effectiveness:Ability to manage junior team members and collaborate efficiently.

• Code Quality & Governance:Adherence to coding standards version control practices and documentation completeness.

• Technical Certification & Learning:Completion and maintenance of relevant technical certifications.

• Commercial Engagement:Support Consulting Partner Directors and Senior Managers in successful pre-sale client engagements and identification of additional opportunities with existing clients.

• Attention to Detail:Demonstrated rigour in analysis documentation and solution development.

What we offer:

• Competitive Salary

• 25 days annual leave per year

• Pension and Healthcare subject to successful probationary period

• Learning and development days

• Flexible working arrangements

• Team Building Days

• Great Team Culture