Architect

Company Overview

Incedo is a US-based consulting data science and technology services firm with over 3000 people helping clients
from our six offices across US Mexico and India. We help our clients achieve competitive advantage through
end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering data science and
design capabilities coupled with deep domain understanding. We combine services and products to maximize
business impact for our clients in telecom Banking Wealth Management product engineering and life science
& healthcare industries.
Working at Incedo will provide you an opportunity to work with industry leading client organizations deep
technology and domain experts and global teams. Incedo University our learning platform provides ample
learning opportunities starting with a structured onboarding program and carrying throughout various stages of
your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible
career paths allow you to grow into a program manager a technical architect or a domain expert based on your
skills and interests.
Our Mission is to enable our clients to maximize business impact from technology by

• Harnessing the transformational impact of emerging technologies
• Bridging the gap between business and technology

Role Description

Role Description:
As a Senior Principle Engineer - Cloud Data Platform (Databricks) at Incedo you will be responsible for managing and optimizing the Databricks environment ensuring its performance scalability and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in big data technologies such as Spark and have experience with cloud computing platforms such as AWS or Azure. You will be responsible for configuring and optimizing the Databricks environment ensuring that data pipelines are efficient and accurate and troubleshooting any issues that arise. You will also work with the security team to ensure that the Databricks environment is secure and complies with relevant regulations.

Roles & Responsibilities:
Designing developing and deploying cloud-based data platforms using Databricks
Integrating and processing large amounts of structured and unstructured data from various sources
Managing and optimizing Spark clusters for efficient data processing
Implementing and maintaining data pipelines and ETL processes
Troubleshooting and resolving data platform issues
Collaborating with data scientists and analysts to deliver insights and solutions
Foster a collaborative and supportive work environment promoting open communication and teamwork.
Demonstrate strong leadership skills with the ability to inspire and motivate team members to perform at their best.

Technical Skills

Skills Requirements:

• Proficiency in Databricks platform including Databricks Runtime Databricks Delta and Databricks MLflow
• Experience in building scalable and reliable data pipelines using Databricks Spark and related big data technologies
• Familiarity with cloud-based infrastructure and deployment specifically on Azure or AWS
• Strong knowledge of programming languages such as Python Scala Java and SQL

Nice-to-have skills

Qualifications

Qualifications

• 13-15 years of work experience in relevant field
• or MCA degree from a reputed university. Computer science background is preferred

Company Value

We value diversity at Incedo. We do not discriminate based on race religion color national origin gender sexual orientation age marital status veteran status or disability status.