Staff Technical Solutions Engineer - Spark
Staff Technical Solutions Engineer - Spark
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
CSQ126R234
As a Staff Technical Solutions Engineer you will provide advanced technical solutions and consulting for complex Spark ML/AI Delta Streaming and Lakehouserelated challenges reported by our customers. You will leverage your deep technical and clientfacing skills to resolve issues involving the Databricks Data Intelligence Platform. Your expertise will guide customers on their Databricks journey helping them achieve value and their strategic goals using our products.
The impact you will have:
- Perform deep technical analysis and troubleshooting of Spark issues using UI metrics DAG Event Logs and logs related to job performance and failures.
- Troubleshoot resolve and conduct codelevel analysis of Spark core internal Spark SQL Structured Streaming Delta Lake and other Databricks runtime features.
- Assist customers in reproducing Spark issues and provide solutions in areas such as SQL Delta memory management performance tuning streaming data science and data integration.
- Act as a designated solutions engineer for strategic customers addressing their Spark and cloudrelated challenges daily.
- Collaborate with Account Executives Customer Success Engineers and Resident Solution Architects to align customer needs with best practices and solutions.
- Participate in live troubleshooting sessions via screen sharing actively engaging with team members and customers to resolve major Spark issues.
- Contribute to internal knowledge bases wikis and technical documentation to support both customers and internal teams.
- Work closely with Engineering and Backline Support teams to escalate and resolve product defects efficiently.
- Participate in oncall rotations driving escalations during Databricks runtime outages and ensuring operational support for critical customer issues.
What we look for:
- 6 years of handson experience in big data technologies including Spark Hadoop ML AI Streaming Kafka and data science at a production scale.
- Expertlevel experience in Spark performance tuning and troubleshooting.
- Strong understanding of JVM memory management garbage collection and heap/thread dump analysis.
- Handson experience with SQLbased databases and ETL/data warehousing technologies like Informatica DataStage Oracle Teradata SQL Server MySQL and SCDtype use cases.
- Experience with cloud services such as AWS Azure or GCP.
- Deep understanding of distributed computing principles and best practices.
- A Bachelors degree in Computer Science or a related field or equivalent practical experience is required.
Required Experience:
Staff IC
Employment Type
Full-Time
