Pyspark Databricks AWS
Job Summary
We are seeking a Databricks Developer with 57 years of experience in big data engineering. The ideal candidate should have strong expertise in Apache Spark Databricks and PySpark or Scala along with hands-on experience in cloud platforms such as Amazon Web Services. The role involves building and maintaining scalable data pipelines performing ETL transformations and integrating data from multiple sources using modern data lake technologies like Delta Lake. Candidates should be skilled in SQL workflow optimization data quality and performance tuning and have experience with Databricks features such as Workflows Delta Live Tables and Unity Catalog. Familiarity with CI/CD tools data governance and Agile practices is required while experience with tools like Airflow or Kafka and relevant certifications will be an added advantage.
About Company
At Virtusa, we are builders, makers, and doers. Digital engineering is in our DNA. It’s at the heart of everything we do.