Senior Big Data Engineer | LisboaPorto

About EY

At EY youll have the chance to build a career as unique as you are with the global scale support inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better too. Join us and build an exceptional experience for yourself and a better working world for all.

The opportunity

EY is looking for a Senior Big Data Engineer to join our dynamic team that focuses on implementing scalable data solutions and working in client engagement teams to deliver advanced analytics and technology consulting this role you will leverage your extensive experience in Big Data technologies to design and implement robust data pipelines and architectures that drive business success. You will play a crucial role in optimizing data processing workflows and ensuring the integrity security and availability of large-scale data assets.

Your key responsibilities

Business Analysis: Collaborate with stakeholders to gather and analyze business requirements translating them into technical specifications for Big Data solutions.

Data Architecture & Design: Define and implement modern data architectures using distributed processing paradigms and scalable frameworks.

Pipeline Development: Design develop and maintain data pipelines and frameworks for ingestion transformation and processing of structured and unstructured data.

Performance Optimization: Optimize data workflows and distributed processing jobs to ensure efficiency and reliability at scale.

Cross-Functional Collaboration: Work closely with data scientists analysts and other teams to integrate Big Data solutions into business processes.

Monitoring & Troubleshooting: Ensure operational stability of Big Data platforms proactively identifying and resolving issues.

Data Security & Governance: Apply best practices for data quality security and compliance throughout the data lifecycle.

Leadership & Planning: Coordinate technical teams provide estimates manage risks and ensure timely delivery of Big Data projects.

Documentation: Maintain comprehensive documentation of solution designs processes and procedures to facilitate knowledge sharing and compliance with organizational standards.

Technical Support and Training: Provide technical support and training to end-users and development teams fostering a culture of continuous improvement and knowledge sharing.

Skills and attributes for success

Communication is essential must be able to listen and understand the question and develop and deliver clear insights in both verbal and written with the ability to convey complex technical concepts to non-technical stakeholders. Independent and able to manage and prioritize workload. Ability to adapt quickly and positively to change. This position will require strong analytical and problem-solving skills with a keen attention to detail. You will also be a part of larger team (incl. client-side stakeholders) so communication and collaboration skills will also help you to succeed.

A proactive approach to identifying and resolving issues

To qualify for the role you must have

Proven experience (more than 4 years) in Big Data projects including design modeling implementation and evolution of data solutions (data lakes lakehouses pipelines).

Deep knowledge of Big Data fundamentals and lifecycle (collection integration quality control processing visualization dissemination).

Hands-on experience with Big Data platforms and technologies (e.g. Spark Databricks Azure Synapse Kafka MS Fabric).

Expertise in distributed storage (S3 Blob ADLS) and file formats (Parquet Avro Delta).

Advanced programming skills in Python and SQL.

Familiarity with cloud Big Data services (Azure AWS GCP).

Experience as team leader or tech lead including planning risk management and stakeholder engagement.

Strong background in Agile methodologies and DevOps/DataOps practices.

Knowledge of CI/CD principles version control and automated testing (e.g. TFS GitHub).

Ideally youll also have

Experience with visualization tools and preparing data for business consumption.

Relevant certifications in Big Data or cloud technologies.

What we look for
An effective communicator and youll be a confident team player equipped with strong people management skills; Creative proactive a team player and able to work under pressure. Its important to have a strategically focused mindset and the ability to deliver multiple projects and present information in a clear and concise manner. Business mindset and some commercial acumen. We value a strong work ethic forward-thinking and being a self-starter; If youre ready to take on a wide range of responsibilities and are committed to seeking out new ways to make a difference this role is for you.

What we offer

We offer a competitive remuneration package where youll be rewarded for your individual and team performance. Plus we offer support and coaching opportunities to develop new skills and progress your career and the freedom and flexibility to handle your role in a way thats right for you.

Continuous learning: Youll develop the mindset and skills to navigate whatever comes next.

Success as defined by you: Well provide the tools and flexibility so you can make a meaningful impact your way.
Transformative leadership: Well give you the insights coaching and confidence to be the leader the world needs.
Diverse and inclusive culture: Youll be embraced for who you are and empowered to use your voice to help others find theirs.

If you can demonstrate that you meet the criteria above please contact us as soon as possible.

The exceptional EY experience its yours to build.

EY Shape the future with confidence

EY exists to build a better working world helping to create long-term value for clients people and society and build trust in the capital markets.

Enabled by data and technology diverse EY teams in over 150 countries provide trust through assurance and help clients grow transform and operate.

Working across assurance consulting law strategy tax and transactions EY teams ask better questions to find new answers for the complex issues facing our world today.

At EY were committed to providing recruitment and career opportunities to all regardless of gender sexual orientation social background or disability. We believe that equality and diversity are central to our recruitment process as they enhance creativity and efficiency leading to improved performance and line with this commitment EY Portugal recently became a member of the Inclusive Community Forum. This initiative led by Nova SBE focuses on the recruitment of individuals with disabilities advocating for a more inclusive community. Moreover EY Portugal has also endorsed the Diversity Charter of APPDI (the Portuguese Association for Diversity and Inclusion) pledging to establish and develop internal policies and practices which support diversity. Through these initiatives EY seeks to actively contribute to the inclusion process and promote a more inclusive community for people with disabilities by actively participating in creating solutions.

#LI-HYBRID