ETL Developer - Databricks Platform Admin on AWS - Onsite Dallas or Miami
ETL Developer - Databricks Platform Admin on AWS - Onsite Dallas or Miami
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
ETL Developer Databricks Platform Admin on AWS
Location: Onsite (Dallas or Miami)
Overview: This role requires a highly skilled Databricks Platform Administrator responsible for handson management optimization and maintenance of Databricks environments on AWS. The ideal candidate will have extensive experience in data engineering programming and cloudbased integration platforms ensuring seamless data flow and interoperability between various systems and applications within our organization.
Primary Responsibilities:
Build/Design largescale application development projects and programs with a handson approach.
Ensure the technical validity of solutions and actively drive their implementation.
Develop and maintain detailed business and technical process documentation and training materials and build/code frameworks
Review problem logs identify recurring issues implement longterm solutions and automate solutions
Handson development admin design and performance tuning
Minimum Qualifications:
5 years of handson experience with a BS or MS in Computer Science or equivalent education and experience.
3 years of handson experience in framework development and building integration layers to solve complex business use cases with a strong emphasis on Databricks and AWS.
Technical Skills:
Strong handson coding skills in Python.
Extensive handson experience with Databricks for developing integration layer solutions.
AWS Data Engineer or Machine Learning certification or equivalent handson experience with AWS Cloud services.
Proficiency in building data frameworks on AWS including handson experience with tools like AWS Lambda AWS Glue AWS SageMaker and AWS Redshift.
Handson experience with cloudbased data warehousing and transformation tools such as Delta Lake Tables DBT and Fivetran.
Familiarity with machine learning and opensource machine learning ecosystems.
Handson experience with integration tools and frameworks such as Apache Camel and MuleSoft.
Solid understanding of API design principles RESTful services and message queuing technologies.
Familiarity with database systems and SQL.
Handson experience with Infrastructure as Code (IaC) tools like Terraform and AWS CloudFormation.
Proficiency in setting up and managing Databricks workspaces including VPC management security groups and VPC peering.
Handson experience with CI/CD pipeline management using tools like AWS CodePipeline Jenkins or GitHub Actions.
Knowledge of monitoring and logging tools such as Amazon CloudWatch Datadog or Prometheus.
Handson experience with data ingestion and ETL processes using AWS Glue Databricks Auto Loader and Informatica.
Empowering Work Environment
We embrace innovation and collaboration fostering an inclusive workplace culture where every team members contributions are valued. We offer competitive salaries comprehensive benefits and opportunities for professional growth in a supportive environment.
If your skills and experience match this role we encourage you to apply!
Begin your application journey by visiting talentconnect.ai.
Follow us on LinkedIn for more employment opportunities: TalentConnect AI
Employment Type
Full Time
