Job description
- Experience in Synapase with pyspark
- Knowledge of Big Data pipelinesData Engineering
- Working Knowledge on MSBI stack on Azure
- Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage
- Hands on in Visualization like PowerBI
- Implement end to end data pipelines using cosmosAzure Data factory
- Should have good analytical thinking and Problem solving
- Good communication and coordination skills
- Able to work as Individual contributor
- Requirement Analysis
- Create Maintain and Enhance Big Data Pipeline
- Daily status reporting interacting with Leads
- Version controlADOGIT CICD
- Marketing Campaign experiences
- Data Platform Product telemetry Analytical thinking
- Data Validation of the new streams
- Data quality check of the new streams
- Monitoring of data pipeline created in Azure Data factory
- updating the Tech spec and wiki page for each implementation of pipeline
- Updating ADO on daily basis
Skills
Mandatory Skills : JavaPythonScalaSnowflakeAzure BLOBAzure Data FactoryAzure FunctionsAzure SQLAzure Synapse AnalyticsAZURE DATA LAKEANSI-SQLDatabricksHDInsight
Good to Have Skills : Python Azure BLOB Azure Data Factory AZURE DATA LAKE
Required Skills : PowerBI
Basic Qualification :
Additional Skills :
Background Check : No
Drug Screen : No