Senior Lead Data Engineer
Job Summary
Company Overview
Incedo is a US-based consulting data science and technology services firm with over 3000 people helping clients
from our six offices across US Mexico and India. We help our clients achieve competitive advantage through
end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering data science and
design capabilities coupled with deep domain understanding. We combine services and products to maximize
business impact for our clients in telecom Banking Wealth Management product engineering and life science
& healthcare industries.
Working at Incedo will provide you an opportunity to work with industry leading client organizations deep
technology and domain experts and global teams. Incedo University our learning platform provides ample
learning opportunities starting with a structured onboarding program and carrying throughout various stages of
your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible
career paths allow you to grow into a program manager a technical architect or a domain expert based on your
skills and interests.
Our Mission is to enable our clients to maximize business impact from technology by
- Harnessing the transformational impact of emerging technologies
- Bridging the gap between business and technology
Role Description
The Role
We are looking for a Data Engineer with a collaborative can-do attitude who is committed & strives with determination and motivation to make their team successful. A Data Engineer who has experience architecting and implementing technical solutions as part of a greater data transformation strategy. This role is responsible for hands on sourcing manipulation and delivery of data from enterprise business systems to data hub. This role will help drive Steward Partners digital journey by modeling and transforming data to achieve actionable business outcomes. The Data Engineer will create troubleshoot and support ETL pipelines and the cloud infrastructure involved in the process will be able to support the visualization teams.Heres What Youll DoCollaborate with business stakeholders and other technical team members to acquire data sources that are most relevant to business needs and deep technical and domain knowledge of relational and non-relation databases Data Warehouses Data lakes among other structured and unstructured storage solutions that are best suited to develop a pipeline for a particular data data flow pipelines to extract transform and load data from various data sources in various forms including custom ETL pipelines that enable model and product custom scripts to extract data from unstructured/semi-structured clear documentation for delivered solutions and processes integrating documentation with the appropriate corporate and implement internal process improvements for data management (automating manual processes optimizing data delivery re-designing infrastructure for greater scalability).Stay current with and adopt new tools and applications to ensure high quality and efficient cross-platform data strategy to aggregate multiple sources and process development datasets.
Technical Skills
Essential Qualifications / Requirements:
Bachelors degree in computer engineering3 years of ETL design development and performance tuning using ETL tools such as SSIS/ADF in a multi-dimensional Data Warehousing environment.3 years of experience with setting up and operating data pipelines using Python or SQL3 years of advanced SQL Programming: PL/SQL T-SQL3 years of strong and extensive hands-on experience in Azure preferably data heavy / analytics applications leveraging relational and NoSQL databases Data Warehouse and Big Data3 years of experience with Azure Data Factory Azure Synapse Analytics Azure Analysis Services Azure Databricks Blob Storage Databricks/Spark Azure SQL DW/Synapse and Azure functions.2 years of experience in defining and enabling data quality standards for auditing and analytical abilities and a strong intellectual curiosityIn-depth knowledge of relational database design data warehousing and dimensional data modeling conceptsDeep understanding of REST and good API collaboration and teamwork skills & excellent written and verbal communications -starter and motivated with ability to work in a fast-paced development experience highly in the development environment including IDE database server GIT Continuous Integration unit-testing tool and defect management tools.Preferred Skills:2 years of experience with Big Data Management (BDM) for relational and non-relational data (formats like json xml Avro parquet copybook etc.)Knowledge of Dev-Ops processes (CI/CD) and infrastructure as of Master Data Management (MDM) and Data Quality developing REST of key machine learning concepts & MLOPS
Nice-to-have skills
Qualifications
Qualifications
7-9 years of work experience in relevant field
or MCA degree from a reputed university. Computer science background is preferred
Company Value
We value diversity at Incedo. We do not discriminate based on race religion color national origin gender sexual orientation age marital status veteran status or disability status.
Required Experience:
Senior IC
About Company
Unlock true potential of your business with our best-in-class digital transformation solutions - data analytics, AI, cloud and decision automation, to achieve sustainable growth.