The ideal candidate will have outstanding communication skills proven data infrastructure/platform design and implementation capabilities strong business acumen and an innate drive to deliver results. He/she will be a self-starter comfortable with ambiguity and will enjoy working in a fast-paced dynamic environment. Responsibilities will include* Build and operate Apples largest data plarform supporting exabyte scale.* Scale and operationalize the largest custom build multi-tenant highly secure privacy enabled Data Lakehouse.* Ensure data platform offers reliable high quality data with consistent SLAs with good monitoring alerting and incident response and continual investment to reduce tech-debt* Write code documentation participate in code reviews and mentor other engineers
10 years of experience in design and development of scaling and operation of distributed systems including technologies like Apache Spark Kafka Flink Iceberg and Hive along with resource management systems like Apache Mesos and Kubernetes.
Proficient in Java or Scala.
Proven expertise in designing and developing scalable reliable APIs.
A hands-on approach with a willingness to engage in daily technical work.
Contributions to Open-Source projects like Apache Iceberg are a plus.
Skilled at debugging complex issues in large-scale distributed systems.
Driven by a passion for building reliable maintainable and user-friendly products and services.
Exceptional communication and collaboration skills with the ability to work effectively across multiple teams and functions.
Bachelors Masters or Ph.D. in Computer Science or a related technical discipline.
Expertise in public cloud platforms like AWS S3 EKS IAM.
Contributor to open source technologies like Spark or Iceberg.
Expertise in building Lakehouse for large scale data platforms.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.