Databricks Pyspark SQL

Job description:

Role: Databricks Pyspark SQL

Year of Experience:48 Years

Responsibilities:

1. Collaborate with crossfunctional teams to understand data requirements and design efficient data processing solutions.
2. Develop and maintain ETL processes using Databricks and PySpark for largescale data processing.
3. Optimize and tune existing data pipelines to ensure optimal performance and scalability.
4. Create and implement data quality and validation processes to ensure the accuracy of data.
5. Work with stakeholders to understand business needs and translate them into actionable data solutions.
6. Collaborate with the data science team to support machine learning model deployment and integration into production systems.
7. Troubleshoot and resolve datarelated issues promptly.

Requirements:

1. Bachelors degree in Computer Science Engineering or a related field.
2. Proven experience working with Databricks PySpark and SQL in a professional setting.
3. Strong proficiency in designing and optimizing ETL processes for largescale data sets.
4. Experience with data modeling data warehousing and database design principles.
5. Familiarity with cloud platforms such as AWS Azure or GCP.

Remote Work :

No