Big Data Engineer
Big Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are
At Synechron we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechrons progressive technologies and optimization strategies span end-to-end Artificial Intelligence Consulting Digital Cloud & DevOps Data and Software Engineering servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization from Artificial Intelligence and Blockchain to Data Science models Digital Underwriting mobile-first applications and more. Over the last 20 years our company has been honored with multiple employer awards recognizing our commitment to our talented teams. With top clients to boast about Synechron has a global workforce of 14500 and has 58 offices in 21 countries within key global markets.
Our challenge
We are looking for a highly skilled and experienced Senior Big Data Engineer with over a decade of expertise in building large-scale data solutions utilizing Hadoop and Spark ecosystems. The ideal candidate will be responsible for designing developing and optimizing complex data processing architectures to enable advanced analytics machine learning and reporting platforms.
Additional Information*
The base salary for this position will vary based on geography and other accordance with law the base salary for this role if filled within Charlotte NC is $100k - $110k/year & benefits (see below).
The Role
Responsibilities:
Design develop and optimize big data pipelines and processing frameworks using Hadoop (HDFS MapReduce YARN) and Apache Spark.
Build scalable data ingestion processes and data lakes for diverse data sources.
Develop and maintain ETL workflows that handle processing of structured and unstructured data.
Collaborate with Data Scientists Analysts and Business Teams to translate requirements into technical solutions.
Tune and troubleshoot Spark and Hadoop jobs for maximum efficiency and performance.
Implement data security privacy and compliance best practices across all platforms.
Mentor junior team members and foster best practices in big data development.
Stay current with emerging trends and technologies related to Hadoop and Spark.
Document architecture workflows and standards for maintainability and knowledge sharing.
Requirements:
Bachelors Masters or Ph.D. in Computer Science Information Technology or related field.
10 years of industry experience in big data engineering with proven expertise in Hadoop and Spark technologies.
Extensive experience with Hadoop ecosystem components: HDFS MapReduce YARN Hive Pig HBase and Oozie.
Strong proficiency in Apache Spark (Scala Python or Java) and Spark SQL.
Experience with data ingestion tools such as Apache NiFi Kafka or Flume.
Hands-on experience with cloud platforms (AWS Azure GCP) and their big data services integrated with Hadoop/Spark.
Knowledge of data modeling data warehousing and database technologies (NoSQL relational systems).
Familiarity with containerization and orchestration tools like Docker and Kubernetes.
Familiar with data governance security and compliance standards.
Excellent problem-solving system architecture and communication skills.
Preferred but not required:
Experience with Spark Streaming and real-time data processing.
Knowledge of advanced analytics machine learning pipelines and integration with Spark MLlib.
Experience with automation and orchestration tools such as Apache Airflow.
Familiarity with version control and CI/CD practices for big data platforms.
We offer:
A highly competitive compensation and benefits package.
A multinational organization with 58 offices in 21 countries and the possibility to work abroad.
10 days of paid annual leave (plus sick leave and national holidays).
Maternity & paternity leave plans.
A comprehensive insurance plan including medical dental vision life insurance and long-/short-term disability (plans vary by region).
Retirement savings plans.
A higher education certification policy.
Commuter benefits (varies by region).
Extensive training opportunities focused on skills substantive knowledge and personal development.
On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
Cutting edge projects at the worlds leading tier-one banks financial institutions and insurance firms.
A flat and approachable organization.
A truly diverse fun-loving and global work culture.
SYNECHRONS DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.
All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law.
Employment Type
Full-Time
