Senior Tech Lead Associate Architect (Data Engineering)

The Company

We are a Norwegian owned company delivering offshore software services from our development centre in Sri Lanka. Over the last 15 years we have completed 250 successful projects worldwide for clients ranging from startups to Fortune 500 companies. For a decade and a half we have been creating breakthrough software for leading organisations in Europe USA Australia Singapore and more. We are a team of global experts who architect solutions that change the way business is done and add colour to everyday living.

We offer custom software application development to diverse sectors such as proptech fintech environment logistics maritime health and more. We assign a dedicated long-term technology team to each client allowing for seamless integration with their internal teams. Guided by the Nordic values of trust transparency and commitment our diverse team drives innovation and disruption in the modern digital era.

The Role

We have been creating breakthrough software for leading organizations in Europe USA Australia Singapore and more. Parented by a Norwegian company and with significant operations in Sri Lanka we are a team of global experts who architect solutions that change the way business is done and add color to everyday living. As a member of our team you will have the opportunity to be a part of a diverse global team with shared values of Transparency Agility Trust and Commitment.

Our behavior fosters disruptive innovation as we challenge the status quo and continually reach greater heights. As a Senior Tech Lead you will be part of a dynamic team dedicated to developing cutting-edge software for an organization committed to identifying empowering and supporting equity-driven leaders with a mission to transform education and create opportunities for all children with a core focus on reducing educational inequity.

Key Responsibilities

• Data Pipeline Development: Design develop and optimize ETL/ELT pipelines to extract transform and load data from multiple sources. Ensure data pipelines are scalable reliable and maintainable.
• Process Automation: Identify and automate manual processes to improve efficiency and reduce operational overhead. Implement solutions to eliminate repetitive tasks using modern tools and scripting languages like Python.
• Data Architecture: Design and implement scalable data architectures to meet business and analytical requirements. Collaborate with stakeholders to build data models for data warehousing and analytics.
• Cloud Integration: Manage data storage solutions using Azure services such as Azure Blob Storage Azure Data Lake and Azure SQL. Utilize Azure Data Factory for orchestrating and automating data workflows.
• API Integrations: Develop and manage APIs for integrating various data sources enabling seamless data sharing and retrieval.
• Data Governance: Implement and maintain data governance frameworks to ensure data quality security and compliance. Establish processes for data stewardship and enforce best practices across the organization.
• Business Intelligence Enablement: Work with tools like Power BI and integrate data for reporting and visualization. Collaborate with analysts to provide insights that drive decision-making.
• Collaboration and CI/CD: Deploy data solutions using CI/CD pipelines with tools like Azure DevOps or GitHub Actions. Establish best practices for development testing and deployment workflows.
• Data Pipeline Architecture: Design and implement enterprise-level data pipeline architectures to meet business and analytical needs. Optimize workflows for performance scalability and reliability.
• Monitoring and Optimization: Monitor the performance of data pipelines and optimize them for cost-efficiency and performance.
• Troubleshoot and resolve data-related issues promptly.

Required Skills

• 10 years of python/pyspark programming experience
• Azure cloud(Azure ADLS Azure SQL Azure DevOps Azure Data Factory Azure Function apps Fabric and Synapse Analytics would be a plus)
• Power BI experience
• Excellent SQL skills
• GitHub GitHub Actions experience
• Strong Database Warehouse and Mart conceptual knowledge
• Can work with minimal knowledge transition
• Can lead the data engineering space offshore and be the point of contact for data engineering
• Can wear developer analyst and lead hat as needed

Good-to-Have Skills

• Familiarity with Microsoft Fabric for data workflows.
• Experience with Google Analytics for extracting and analyzing web and app data.

Working hours

• 6pm - 3am Sri Lankan time

Benefits

• Great Remuneration
• Flexible Work Arrangement
• Performance Bonus
• Private Health Insurance
• Accelerated Career Growth
• Latest Tech Equipment
• International Exposure
• Exciting Company Events