Position Description Summary
Position Details:
Job Title: Data Engineer
As a Data Engineer you will collaborate with business reporting and other teams to understand business requirements and perform data analysis. You will also apply specialized knowledge to support the organizations vision and direction serving as your teams subject matter expert. Additionally you will thrive on solving complex problems enjoy fine-tuning performance and be passionate about turning data into insights. This role is ideal for someone whos equally comfortable designing solutions building pipelines debugging performance issues and developing impactful Power BI dashboards. Youll play a key role in architecting scalable data solutions integrating disparate data sources and delivering high-quality analytics that drive business decisions. Experience with DevOps practices and automation using Python will be key in streamlining the deployment and monitoring of data solutions.
Roles & Responsibilities
- Design and develop scalable data pipelines using Azure Data Factory (ADF) and SQL-based transformations.
- Architect and implement data solutions that meet business needs and performance goals
Build enhance and maintain Power BI reports and dashboards with a focus on usability and performance. - Diagnose debug and optimize slow-running data processes and analytics queries
Collaborate with stakeholders across engineering analytics and business functions to understand requirements and translate them into scalable technical solutions. - Ensure data quality integrity and governance throughout the pipeline
Implement DevOps best practices to automate testing deployment and monitoring of data pipelines and BI assets. - Use Python for scripting automation and integration of cloud data workflows.
- Create technical documentation data models and architecture diagrams
Stay up to date with advancements in cloud data technologies and recommend improvements
Requirements
- A bachelors degree in computer science Software Engineering or a related field is required.
- The candidate should have over 7 years of experience in Data Engineering and BI Solution development.
- They must possess strong expertise in Azure Data Factory including linked services datasets pipelines and triggers.
- Expert-level SQL skills are essential including complex query design optimization and troubleshooting.
- Proficiency in Power BI is necessary particularly in data modelling DAX report design and performance tuning.
- A solid understanding of data warehousing concepts ELT/ETL strategies and data architecture best practices is crucial.
- The candidate should have experience in debugging data flows diagnosing bottlenecks and improving end-to-end performance.
- Proficiency in Python for scripting and automation is required.
- Experience with DevOps tools and CI/CD workflows (e.g. Git Azure DevOps GitHub Actions) is important.
- A passion for clean code performance optimization and designing robust supportable systems is essential.
- Proficiency in AI-assisted development practices as part of the solution development toolkit is also required.
- The candidate should have experience in leading small teams and possess good people management skills.
- Excellent presentation and documentation skills good business acumen and sound knowledge of Agile principles and SDLC are also necessary.
Good to have
- Microsoft Certifications relevant to the role.
- Experience with Azure Synapse Azure SQL DB or Databricks.
- Knowledge of PowerShell or other automation tools a plus.
- Ability to balance speed with precision in a fast-paced environment.
- Understanding of integration technologies APIs and protocols
- Experience developing/managing chatbot using virtual agent will be an asset
We Value
- Curiosity-driven problem solvers.
- Proactive collaborators who bring solutions not just issues.
- Engineers who care about both the technical design and the user outcome.
- Professionals who enjoy optimizing things that already work to make them better.
Required Experience:
Exec