The Data Engineer will be responsible for requirements understanding solution designing and building modern data platforms to support data-driven decision-making. The Data Engineer will execute technical implementation of data engineering and visualization projects and will be a hands-on role. The Data Engineer will help in creating technical collateral and staying on top of technology trends with ongoing training and certifications.
Responsibilities
- Architect and build scalable data pipelines: Craft secure efficient pipelines to ingest transform and load data from diverse sources ensuring quality and availability for downstream analysis.
- Design and optimize data infrastructure: Shape the future of our data platform choosing and implementing cutting-edge technologies like cloud storage data lakes and streaming platforms.
- Own data quality and governance: Champion data quality initiatives establish data standards and implement monitoring and alerting systems to ensure data integrity.
- Automate and innovate: Drive automation initiatives to streamline data workflows and build reusable components for greater efficiency and maintainability.
- Mentor and guide: Share your expertise by mentoring junior engineers and fostering a collaborative data Culture.
Qualifications :
- 5 years of experience in dealing with data i.e. Data Engineer or related role.
- Proven track record of designing building and maintaining data pipelines and infrastructure.
- Expertise in programming languages i.e. Python Scala or Java.
- Expertise in SQL.
- Familiarity with multiple cloud platforms like AWS
- Expertise in multiple data processing frameworks e.g. Spark Beam Flink etc.
- Expertise in at least one workflow orchestration tool e.g. Airflow.
- Expertise in multiple messaging queues e.g. Kafka or PubSub.
- Expertise in at least one data warehouse e.g. Redshift Bigquery Snowflake Databricks etc.
- Expertise in implementing large-scale data lakes/Warehouses.
- Expertise in relational databases e.g. Postgres MySQL etc.
- Expertise in NoSQL databases e.g. DynamoDB MongoDB BigTable etc.
- Familiarity with multiple data visualization tools e.g. Tableau PowerBI Superset Quicksight etc.
- Expertise in data catalog and governance tools e.g. Amundsen Dataplex Glue catalog etc.
- Expertise in data validation framework(s) e.g. DBT great expectations etc.
- Strong understanding of Data warehouse Data lake Data mart OLTP and OLAP concepts.
- Strong understanding of data modeling ETL/ELT processes and data quality principles.
- Excellent communication and collaboration skills able to effectively translate technical concepts to non-technical audiences.
- Experience in Modern data stack including no code data ingestion tools transformation and orchestration tools Data Governance Data Quality and Role-based access control
Nice to Have
- Architecting and Implementing data platforms end-to-end.
- Experience with legacy data systems (e.g. Hadoop).
- Experience in networking and access controls.
- Any data engineering visualization or data science certifications on any of the clouds
Additional Information :
BENEFITS & PERKS FOR WORKING AT OLLION
Our employees multiply their potential because they have opportunities to: Create a lasting Impact Learn and Grow professionally & personally Experience great Culture and Be your Whole Self!
Beyond an amazing collaborative work environment great people and inspiring innovative work we have some great benefits and perks:
- Benchmarked competitive in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
- We are a virtual-by-default small but Global organization; learn wherever whenever frees our people from a rigid view of learning and growth
- Retirement planning (i.e. CPF EPF company-matched 401(k))
- Globally we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens. Employees have access to a fully comprehensive benefits package to choose the medical dental and vision insurance plan that best fits their lives. In addition to great healthcare coverage we also offer all employees mental health resources and additional wellness programs.
- Generous time off and leave allowances
- And more!
Ollion is an equal opportunity employer. We celebrate diversity and we are committed to creating an inclusive environment for all employees. Ollion does not discriminate in employment on the basis of race color religion sex (including pregnancy and gender identity) national origin political affiliation sexual orientation marital status disability genetic information age membership in an employee organization parental status military service or other non-merit factor.
Remote Work :
No
Employment Type :
Full-time