Title: Senior Associate Developer
Location: Beng/Mum/Hyderabad
Exp Level: 5
Education: Any Degree
Key Responsibilities:
Proficiency in Azure Data Factory SQL Python/PySpark and ETL tools.
Design and implement data storage using services like Azure SQL Database Azure Data Lake Cosmos DB and Blob Storage.
Build and optimize ETL pipelines with Azure Data Factory Databricks or Synapse Analytics for data integration from various sources.
Ensure data quality security (e.g. RBAC encryption) and compliance while monitoring performance with Azure Monitor.
Collaborate with data scientists analysts and stakeholders to transform raw data into usable formats for reporting and machine learning
Experience with data modeling schema design big data processing and automation (CI/CD unit testing).
Strong problem-solving for troubleshooting pipelines optimizing workflows and handling large-scale unstructured data.
Good to have MS Fabric knowledge
Builds ingestion pipelines with Data Factory implements transformations using Spark/PySpark or Dataflows Gen2 designs Lakehouse/Warehouse structures and ensures data quality and optimization.
Develop and orchestrate data pipelines manage OneLake storage and implement incremental loading with validation
Creates semantic models datasets dashboards and reports; optimizes DAX and integrates with Lakehouse/Warehouse sources.
Manages tenant settings capacities permissions governance security and monitors workloads like Real-Time Analytics and Power BI.
Required Experience:
Senior IC
Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leadi ... View more