Spark Admin
Spark Admin
Posted on :
15-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Spark Administration: Install configure and manage Apache Spark 3.x. and optimize Spark cluster and resolve Sparkrelated Spark job scheduling and resource high availability and reliability of Spark Practices:Implement and manage CI/CD pipelines using tools like Jenkins Nexus GitHUB infrastructure provisioning and configuration management using tools like Ansible Ansible Tower Monitor system performance and ensure system availability and and manage containerization using Docker i.e. build Jupyter with development teams to ensure smooth deployment and operation of and Compliance: Code scanning tools SAST SonarCube SonatypeIQImplement security best practices for Spark clusters and DevOps compliance with industry standards and and Communication:Required Skills and Qualifications:Bachelors degree in computer science Information Technology or a related experience as a Spark Administrator with handson experience in Spark understanding of Spark architecture and with DevOps tools and practices including CI/CD configuration management and in scripting languages such as Python Bash or with cloud platforms such as AWS Azure or Google problemsolving skills and attention to communication and collaboration skills. Work closely with data engineers other stakeholders to understand requirements and provide processes configurations and Skills:Experience with big data technologies such as Hadoop Hive and of monitoring tools like Prometheus Grafana Apdynomics & with version control systems like with Agile methodologies.
Employment Type
Full-Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
