Apache Pyspark Azure Data bricks Azure Data Factory SQL Developer QBE- 6 Years
Apache Pyspark Azure Data bricks Azure Data Factory SQL Developer QBE- 6 Years
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
5 years of relevant IT experience in the BI/DW domain with minimum 4 years of handson experience on Azure modern data platform that includes Data Factory Databricks Synapse (Azure SQL DW) and Azure Data Lake
Meaningful experience of data analysis and transformation using Python/R/Scala on Azure Databricks or Apache Spark
Well versed NoSQL data store concepts
Good knowledge in Distributed Processing using Databricks (preferred) or Apache Spark
Ability to debug using tools like Ganglia UI expertise in Optimizing Spark Jobs
The ability to work across structured semistructured and unstructured data extracting information and identifying linkages across disparate data sets
Expert in creating data structures optimized for storage and various query patterns for e.g. Parquet and Delta Lake
Meaningful experience in at least one database technology in each segment such as:
o Traditional RDBMS (MS SQL Server Oracle)
o MPP (Teradata Netezza)
o NoSQL (MongoDB Cassandra Neo4J CosmosDB Gremlin)
Understanding of Information Security principles to ensure compliant handling and management of data
Experience in traditional data warehousing / ETL tools (Informatica IBM Datastage Microsoft SSIS)
Effective in communication
Proficient at working with large and complex code bases (Github Gitflow Fork/Pull Model)
Working experience in Agile methodologies (SCRUM XP Kanban
Employment Type
Full Time
