Lead Big Data Engineer Wallet, Payments & Commerce
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
We are seeking a pragmatic Senior Big Data Engineer to help build and optimize data analytics and ML enablement solutions. You will design and deliver privacy-first reliable and quality-focused data products and platforms that enable trusted compliant data usage across the organization. You will collaborate with cross-functional teams across time zones to ensure our data platforms meet the highest standards of trust accuracy and regulatory compliance.
- Bachelors degree in Computer Science or a related technical field or equivalent experience
- 5-10 years of experience in designing developing and deploying data engineering for analytics or ML & AI pipelines.
- Expertise with data governance security protocols and compliance in financial data systems.
- Strong proficiency in SQL Scala Python or Java with hands-on experience in data pipeline tools (e.g. Apache Spark Kafka Airflow) CI/CD practices and version control.
- Familiarity with cloud platforms (AWS Azure GCP) and data management and analytics tools like Snowflake Databricks and Tableau.
- Strong understanding of data warehousing data modeling (dimensional/star schemas) and metric standardization.
- Proven experience building data quality frameworks (validation profiling anomaly detection synthetic data generation).
- In-depth knowledge of privacy-preserving techniques and compliance in financial systems.
- Excellent problem-solving and analytical skills with the ability to influence stakeholders and drive adoption of best practices.
- Experience authoring technical and instrumentation specs and working with APIs and message schemas (MSDs).
- Proven ability to design reusable frameworks tools and automation to accelerate platform adoption.
- Hands-on experience with distributed querying (Trino) real-time analytics (OLAP) near-real-time processing (NRT) and data mesh architectures.
- Familiarity with Generative AI/LLM applications for test generation anomaly detection documentation automation and privacy-safe synthetic data creation.
- Demonstrated ability to mentor engineers in data quality privacy and compliance best practices.
- Experience in Fintech Wallet Payments or Digital Commerce domains including regulatory considerations.
- Track record of independent problem-solving sound technical judgment and delivering impactful results at scale.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
We at AppleOne have one true belief. We believe in people. Since 1964, we have connected the best people, their talents, skills, career goals, and aspirations with the best companies. We are Career Gurus. We are People-People. Let us introduce you!
