Title: Databricks Developer
Location: Plano TX ( Onsite)
Duration: Long Term Contract
Skills Required: -
- Build Very Strong Orchestration Layer in Databricks/ADF . Workflows.
- Build CICD for Databricks in Azure Devops.
- Process near Real time Data thru Auto Loader DLT Pipelines.
- Implement Security Layer in Delta Lake.
- Implement Massive Parallel Processing Layers in Spark SQL and PySpark.
- Implement Cost effective Infrastructure in Databricks.
- Experience In extracting logic and from on prem layers like SSIS Stored procedures Informatica Vertica Apache Hudi Filesystems. etc into Pyspark.
- Strong experience with Migration