Big Data Engineer Wallet, Payments & Commerce
Share
Job Location:
Monthly Salary:
Posted on:
27 days ago
Vacancies:
1 Vacancy
Job Summary
We are seeking pragmatic Big Data Engineer to help build and optimize data analytics and ML enablement this role you will design and deliver privacy-first reliable and quality-focused data products and platforms that enable trusted compliant data usage across the organization. You will collaborate with cross-functional teams across time zones to ensure our data platforms meet the highest standards of trust accuracy and regulatory compliance.
- Bachelors or Masters degree in Computer Science or a related technical field or equivalent experience
- 3-5 years of experience in designing developing and deploying data engineering for analytics or ML & AI pipelines.
- Strong proficiency in SQL Scala Python or Java with hands-on experience in data pipeline tools (e.g. Apache Spark Kafka Airflow) CI/CD practices and version control.
- Familiarity with cloud platforms (AWS Azure GCP) and data management and analytics tools like Snowflake Databricks and Tableau.
- Strong understanding of data warehousing data modeling (dimensional/star schemas) and metric standardization.
- Excellent problem-solving and analytical skills with the ability to influence stakeholders and drive adoption of best practices.
- Experience authoring technical and instrumentation specs and working with APIs and message schemas (MSDs).
- Proven ability to design reusable frameworks tools and automation to accelerate platform adoption.
- Hands-on experience with distributed querying (Trino) real-time analytics (OLAP) near-real-time processing (NRT) and data mesh architectures.
- Familiarity with Generative AI/LLM applications for test generation anomaly detection documentation automation and privacy-safe synthetic data creation.
- Proven experience building data quality frameworks (validation profiling anomaly detection synthetic data generation).
- Track record of independent problem-solving sound technical judgment and delivering impactful results at scale.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more
