Data Platform SRE, AI & Data Platforms (AiDP)
Austin, TX - USA
Job Summary
As a Data Platform SRE you will be responsible for developing and operating our big data platform using open source or other solutions to aid critical applications such as analytics reporting and AI/ML apps. This includes working to optimize performance and cost automate operations and identifying and resolving production errors and issues to ensure the best data platform experience.
Develop and operate large-scale big data platforms using open source and other critical applications including analytics reporting and AI/ML platform performance and cost operational tasks for big data and resolve production errors and issues to ensure platform reliability and user experience
3 years of professional software engineering experience with large-scale big data platforms including strong programming skills in Java Scala Python or expertise in operating large-scale distributed data processing systems with a strong focus on Apache -on experience with table formats and data lake technologies such as Apache Iceberg ensuring scalability reliability and optimized query background in incident management including troubleshooting root cause analysis and performance optimization in complex production with cloud technologies such as AWS and GCPnExperience with Unix/Linux systems and command-line tools for debugging and operational support.
Expertise in designing building and operating critical large-scale distributed systems with a focus on low latency fault-tolerance and high with contribution to Open Source projects is a with multiple public cloud infrastructure managing multi-tenant Kubernetes clusters at scale and debugging Kubernetes/Spark with workflow and data pipeline orchestration tools (e.g. Airflow DBT).nUnderstanding of data modeling and data warehousing with the AI/ML stack including GPUs MLFlow or Large Language Models (LLMs).nA learning attitude to continuously improve the self team and the understanding of software engineering best practices including the full development lifecycle secure coding and experience building reusable frameworks or libraries.
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more