Big Data Jobs in Colombo

About the role:We are seeking a Senior Software Engineer to join our Backend Engineering this role you will design and build scalable data infrastructure optimize data pipelines and enable advanced analytics. You will build Restful APIs to power personalization and recommendation systems.Responsibi...

Architect administer and optimize Databricks workspaces clusters jobs and workflows.Design and develop scalable Azure-based data engineering solutions including Data Lake Data Factory Synapse Key Vault etc.Build high-performance data pipelines using Python and PySpark.Work with Hadoop-based platform...

Lead the design development and deployment of AI/ML models for complex business use cases.Architect solutions involving unstructured data including text images logs and documents.Build large-scale data pipelines using Python PySpark or Scala.Drive machine learning lifecycle processes: data preparati...

Key Responsibilities Data Operations & Pipeline Support Assist in ingesting collecting validating and storing structured/unstructured batch data coming through Edge nodes or direct DB connectionsSupport ETL/ELT jobs running on Hadoop Hive Impala and SparkMonitor daily data loads troubleshoot failure...

About the role:We are looking for a Data Engineer to join Sitecores Data Platform this position you will work in a small dynamic team to build data infrastructure and manage the overall data pipeline. You will be responsible for expanding and optimizing data and data pipeline architecture as well a...

The Hiring CompanyA technology company based out of North America with a mission to help hotels drive operational efficiencies through innovation and advanced technologies delivering an end-to-end hospitality information management platform. Their core product is a cloud-based information management...

OverviewLooking for a seasoned Senior QA Engineer to drive end-to-end quality assurance across the software lifecycle. The role involves defining QA strategy building test frameworks leading QA teams and ensuring releases meet both functional and non-functional standards. You will work closely with...

IFS Ultimo an IFS company headquartered in the Netherlands with more than 2400 global customers is a leading Enterprise Asset Management software provider with a strong reputation for the completeness flexibility and configurability of its SaaS EAM solutions.Were building the next generation agentic...

Define and maintain the enterprise data architecture blueprint including data lakes warehouses marts and real-time analytics platformsLead the design of scalable secure and high-performance data solutions using Azure services (Data Factory Databricks)Implement data governance metadata management and...

About the Client & Role OverviewOur client is a data-first performance marketing agency helping businesses achieve measurable growth through smarter media analytics and automation. They are in the process of strengthening their ETL and data infrastructure to support more intelligent decision-making...

As a Principal Software Engineer you will be responsible for leading the design development and implementation of high-quality software solutions. You will work closely with cross-functional teams to ensure the delivery of robust and scalable applications. Your expertise will be crucial in guiding t...

The CompanyA leading global education technology provider delivering an adaptive online learning platform for primary school mathematics. With our product being utilised by millions of students teachers and parents in 100 countries we are helping educate the youth and bring equality to education. Wi...

Overview We are seeking a skilled Associate Architect in Data Engineering to join our team. This role will focus on designing implementing and optimizing data engineering solutions with a strong emphasis on Hadoop and Cloudera ecosystems. The ideal candidate will also bring expertise in cloud platfo...

Responsibilities:Enhance existing data pipelines using industry-standard tools and practices.Redesign and implement pipelines leveraging AWS managed components.Set up monitoring systems to proactively detect and alert on pipeline issues.Investigate and resolve pipeline-related issues.Document soluti...

Job Title: Data Engineer (4 Years Experience)Location: Pan IndiaJob Type: Full-Time Experience: 4 YearsNotice Period: Immediate to 30 days preferredJob Summary:We are looking for a skilled and motivated Data Engineer with over 4 years of experience in building and maintaining scalable data pipelines...

JDSkills & Ability Strong programming skills in Python R or in data manipulation cleaning and preprocessing using Pandas NumPy and with machine learning frameworks such as TensorFlow PyTorch or to translate business problems into data science problem-solving and analytical thinking commu...