Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
The Data Engineer will be responsible for requirements understanding solution designing and building modern data platforms to support data-driven decision-making. The Data Engineer will execute technical implementation of data engineering and visualization projects and will be a hands-on role. The Data Engineer will help in creating technical collateral and staying on top of technology trends with ongoing training and certifications.
Responsibilities
AWS Data Engineering:
- Develop and maintain scalable ETL/ELT pipelines using AWS Glue Lambda Step Functions and Athena.
- Work with Amazon S3 Athena and Lake Formation to implement data lakes and warehouses.
- Monitor and optimize pipeline performance and cost efficiency.
Data Quality & Validation:
- Implement automated data quality checks using custom logic or tools such as Deequ or Great Expectations.
- Perform root cause analysis and resolve data-related issues during development and testing phases.
Collaboration & Support:
- Support UAT deployment and production issue resolution for ETL pipelines and reports.
- Perform root cause analysis and resolve data-related issues during development and testing phases.
Qualifications :
- 4 years of experience in dealing with data i.e. Data Engineer or related role.
- Proven track record of designing building and maintaining data pipelines and infrastructure.
- Expertise in programming languages i.e. Python pyspark.
- Expertise in SQL and AWS Athena
- Expertise in data catalog and governance tools e.g. Glue catalog etc.
- Familiarity with data validation framework(s)
- Strong understanding of AWS Data lake
- Experience in data modeling ETL/ELT processes and data quality principles.
Nice to Have
- Architecting and Implementing data platforms end-to-end.
- Experience with legacy data systems (e.g. Hadoop).
- Experience in networking and access controls.
- Any data engineering visualization or data science certifications on any of the clouds
Additional Information :
BENEFITS & PERKS FOR WORKING AT OLLION
Our employees multiply their potential because they have opportunities to: Create a lasting Impact Learn and Grow professionally & personally Experience great Culture and Be your Whole Self!
Beyond an amazing collaborative work environment great people and inspiring innovative work we have some great benefits and perks:
- Benchmarked competitive in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
- We are a virtual-by-default small but Global organization; learn wherever whenever frees our people from a rigid view of learning and growth
- Retirement planning (i.e. CPF EPF company-matched 401(k))
- Globally we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens. Employees have access to a fully comprehensive benefits package to choose the medical dental and vision insurance plan that best fits their addition to great healthcare coverage we also offer all employees mental health resources and additional wellness programs.
- Generous time off and leave allowances
- And more!
Ollion is an equal opportunity employer. We celebrate diversity and we are committed to creating an inclusive environment for all employees. Ollion does not discriminate in employment on the basis of race color religion sex (including pregnancy and gender identity) national origin political affiliation sexual orientation marital status disability genetic information age membership in an employee organization parental status military service or other non-merit factor.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
OUR STORYLet’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around ... View more
