Data Engineer with Apache Iceberg

We are

At Synechron we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechrons progressive technologies and optimization strategies span end-to-end Artificial Intelligence Consulting Digital Cloud & DevOps Data and Software Engineering servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization from Artificial Intelligence and Blockchain to Data Science models Digital Underwriting mobile-first applications and more. Over the last 20 years our company has been honored with multiple employer awards recognizing our commitment to our talented teams. With top clients to boast about Synechron has a global workforce of 16400 and has 60 offices in 20 countries within key global markets.

Our challenge

We are seeking a highly skilled and experienced Data Engineer to join our growing data team. This role will be instrumental in designing building optimizing and maintaining our robust data infrastructure and pipelines. Candidate will work with cutting-edge big data technologies to ingest process store and transform large datasets enabling advanced analytics and machine learning initiatives across the organization. The ideal candidate will have a deep understanding of data warehousing ETL/ELT processes and a passion for building scalable and reliable data solutions.

Additional Information*

The base salary for this position will vary based on geography and other accordance with law the base salary for this role if filled within Tampa FL/Jersey City NJ is$110k - $120k/year & benefits (see below).

The Role

Responsibilities:

• Design develop and maintain scalable and efficient data pipelines usingApache Spark Java SparkPySpark andApache Flinkfor real-time and batch processing of large datasets.
• Implement and manage data storage solutions leveragingHadoop Distributed File System (HDFS)and data lake table formats likeApache Iceberg.
• Build and optimize data models and schema definitions for various data sources and targets ensuring data quality consistency and accessibility.
• Work with stakeholders to understand data requirements translate them into technical specifications and deliver robust data solutions.
• Monitor troubleshoot and optimize existing data pipelines and infrastructure for performance reliability and cost-efficiency.
• Develop and implement data governance security and compliance best practices within the data ecosystem.
• Collaborate with data scientists analysts and other engineering teams to support their data needs and integrate new data sources.
• Evaluate and recommend new technologies and methodologies to enhance our data platform capabilities.
• Ensure proper documentation of data architectures pipelines and processes.

Requirements:

• Bachelors or Masters degree in Computer Science Engineering or a related quantitative field.
• Proven experience as a Data Engineer or in a similar role building and optimizing big data data pipelines architectures and data sets.
• Strong proficiency in programming languages such asPython (with extensive pySpark experience) Java or Scala.
• Expertise inApache Sparkfor data processing including Spark SQL DataFrames and RDDs.
• Hands-on experience withApache Hadoopecosystem components particularlyHDFS.
• Experience with real-time stream processing usingApache Flink.
• Familiarity with data lake table formats specificallyApache Iceberg for managing large evolving datasets.
• Experience with relational SQL and NoSQL databases.
• Solid understanding of ETL/ELT processes data warehousing concepts and data modeling techniques.
• Good to have experience with cloud platforms (e.g. AWS Azure GCP) and their data services.
• Excellent problem-solving analytical and communication skills.

Preferred but not required:

• Good Knowledge in Azure and Databricks in highly preferred.
• Knowledge of Apache Kafka or other streaming technologies.
• Familiarity with DevOps practices and CI/CD pipelines.
• Prior experience working in the banking or financial services industry.

We offer:

• A highly competitive compensation and benefits package.
• A multinational organization with 60 offices in 20 countries and the possibility to work abroad.
• 10 days of paid annual leave (plus sick leave and national holidays).
• Maternity & paternity leave plans.
• A comprehensive insurance plan including medical dental vision life insurance and long-/short-term disability (plans vary by region).
• Retirement savings plans.
• A higher education certification policy.
• Commuter benefits (varies by region).
• Extensive training opportunities focused on skills substantive knowledge and personal development.
• On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
• Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
• Cutting edge projects at the worlds leading tier-one banks financial institutions and insurance firms.
• A flat and approachable organization.
• A truly diverse fun-loving and global work culture.

SYNECHRONS DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.

All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law.

Candidate Application Notice