LeadBig Data Developer

Primary Tech skills Pyspark, SQL, Azure ADF

Secondary Tech skills Azure, SAS, Synapse, Databricks

JD:

Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned projects.

Ability to drive more than one projects in parallel.

Experience of DWH, Data Integration, Cloud, Architecture, Design, Data Modelling

Experience in Pyspark, SQL, Cloud data warehouse like Azure Synapse, databricks

Experience working with structured and unstructured data

Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies

Experience in ETL/Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and real-time data integration

Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements

Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server

Experience with Orchestration tools, Azure DevOps, and GitHub

Experience to own end-to-end development, including coding, testing, debugging and deployment

Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill