Databricks Engineer
Databricks Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
About TheAILabb:
TheAILabb is a leading innovation company specializing in AIpowered digital solutions mobile app development and emerging technologies. We leverage datadriven insights to enhance digital experiences and drive business growth. We are looking for a Data Analyst to help translate raw data into meaningful insights that drive strategic decisionmaking.
AILabb is seeking a skilled Databricks Engineer to support in designing developing and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark SQL Python and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with crossfunctional teams to drive datadriven insights and ensure scalable highperformance data architectures.We deliver digital solutions built to help accelerate the growth of businesses in various industries by focusing on creating value through innovation. Job Responsiblities
- Design implement and optimize big data pipelines in Databricks.
- Develop scalable ETL workflows to process large datasets.
- Leverage Apache Spark for distributed data processing and realtime analytics.
- Implement data governance security policies and compliance standards.
- Optimize data lakehouse architectures for performance and costefficiency.
- Collaborate with data scientists analysts and engineers to enable advanced AI/ML workflows.
- Monitor and troubleshoot Databricks clusters jobs and performance bottlenecks.
- Automate workflows using CI/CD pipelines and infrastructureascode practices.
- Ensure data integrity quality and reliability in all pipelines.
Basic Qualifications
- Bachelors or Masters degree in Computer Science Data Engineering or a related field.
- 5 years of handson experience with Databricks and Apache Spark.
- Proficiency in SQL Python or Scala for data processing and analysis.
- Experience with cloud platforms (AWS Azure or GCP) for data engineering.
- Strong knowledge of ETL frameworks data lakes and Delta Lake architecture.
- Experience with CI/CD tools and DevOps best practices.
- Familiarity with data security compliance and governance best practices.
- Strong problemsolving and analytical skills with an ability to work in a fastpaced environment.
Preferred Qualifications
- Databricks certifications (e.g. Databricks Certified Data Engineer Spark Developer).
- Handson experience with MLflow Feature Store or Databricks SQL.
- Exposure to Kubernetes Docker and Terraform.
- Experience with streaming data architectures (Kafka Kinesis etc..
- Strong understanding of business intelligence and reporting tools (Power BI Tableau Looker).
- Prior experience working with retail ecommerce or adtech data platforms.
We are proud to offer a competitive salary alongside a strong insurance package. We pride ourselves on the growth of our employees offering extensive learning and development resources.
Required Experience:
Senior IC
Employment Type
Full-Time
