Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Love turning raw data into powerful insights Join us! Were partnering with global brands to unlock the full potential of their data. As a Data Engineer youll be at the heart of these transformations-building scalable data pipelines optimizing data flows and empowering analytics teams to make real-time data-driven decisions.
We are seeking a highly skilled Data Engineer with hands-on experience in Databricks to support data integration pipeline development and large-scale data processing for our retail or healthcare client. The ideal candidate will work closely with cross-functional teams to design robust data solutions that drive business intelligence and operational efficiency.
Key Responsibilities:
- Develop and maintain scalable data pipelines using Databricks and Spark.
- Build ETL/ELT workflows to support data ingestion transformation and validation.
- Collaborate with data scientists analysts and business stakeholders to gather data requirements.
- Optimize data processing workflows for performance and reliability.
- Manage structured and unstructured data across cloud-based data lakes and warehouses (e.g. Delta Lake Snowflake Azure Synapse).
- Ensure data quality and compliance with data governance standards.
Required Qualifications:
- 4 years of experience as a Data Engineer.
- Strong expertise in Databricks Apache Spark and Delta Lake.
- Proficiency in Python SQL and data pipeline orchestration tools (e.g. Airflow ADF).
- Experience with cloud platforms such as Azure AWS or GCP.
- Familiarity with data modeling version control and CI/CD practices.
- Experience in the retail or healthcare domain is a plus.
Benefits:
- Health Insurance Accident Insurance.
- The salary will be determined based on several factors including but not limited to location relevant education qualifications experience technical skills and business needs.
Additional Responsibilities:
- Participate in OP monthly team meetings and participate in team-building efforts.
- Contribute to OP technical discussions peer reviews etc.
- Contribute content and collaborate via the OP-Wiki/Knowledge Base.
- Provide status reports to OP Account Management as requested.
About us:
OP is a technology consulting and solutions company offering advisory and managed services innovative platforms and staffing solutions across a wide range of fields - including AI cyber security enterprise architecture and beyond. Our most valuable asset is our people: dynamic creative thinkers who are passionate about doing quality work. As a member of the OP team you will have access to industry-leading consulting practices strategies & and technologies innovative training & education. An ideal OP team member is a technology leader with a proven track record of technical excellence and a strong focus on process and methodology.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
