Senior Data Engineer

Opplane Portugal Unipessoal Lda

Job Location:

Lisbon - Portugal

Monthly Salary: Not Disclosed

Posted on: 16 days ago

Vacancies: 1 Vacancy

Job Summary

About Opplane

Opplane specializes in providing advanced data-focused solutions for financial services telecommunication and reg-tech to accelerate their digital transformation journey. Opplane leadership team is comprised of Silicon Valley serial entrepreneurs and experienced executives. Its expertise comes from years of specific industry experience at some of the worlds top companies such as PayPal Xerox Parc Amazon Wells Fargo SoFi in the areas of product management data technology data governance data privacy security machine learning and risk management.

About the Team

Multicultural Fusion: Our team comprises individuals from all corners of the world bringing together a rich tapestry of cultures ideas and perspectives. We believe diversity is our strength driving innovation and creativity in our projects.
Fast-Paced Startup Environment: We thrive in a dynamic fast-paced startup environment where adaptability and agility are prized. If youre looking for a place where your ideas can spark change youve found it.
Individual Accountability: We value personal responsibility and accountability. Each team member has a critical role and we trust you to own your part in our collective success.
Non-Formal Team Culture: We break away from stuffy formal work environments. Our culture is friendly collaborative and down-to-earth.
Office Snacks and Activities: Fuel your work with various snacks and enjoy fun activities that keep our team spirit high. Whether its a darts match board games or yoga we believe a happy team is productive.

About the position:

We are looking for a Senior Data Engineer with minimum 5 years of professional experience to design build and maintain scalable high-performance data platforms that power our analytics and machine learning initiatives. You will work in a distributed data-intensive environment and collaborate with cross-functional teams to ensure data accuracy reliability and security.

Roles & Responsabilities:

Design develop and maintain scalable data processing pipelines and workflows using frameworks such as Apache Spark PySpark and Apache Beam.
Build and maintain microservices in Python that serve data-driven features in production.
Develop internal tools to support CI/CD pipelines experiment tracking and data versioning.
Collect process and integrate large datasets from multiple sources including databases file systems and APIs.
Ensure data integrity consistency and quality through robust validation and monitoring processes.
Optimize data systems for performance scalability and high availability.
Implement best practices for data security access control and privacy.
Collaborate with data scientists analysts and engineers to support analytics and ML workflows.

Job Qualifications:

You have a solid academic background in Computer Science Engineering or related fields.
You are passionate about data enjoy working in fast-paced collaborative environments and thrive on solving complex problems.
You are a innovator that thinks about how data technology can solve new and product opportunities.
You understand the ecosystem of data technologies for example data governance and data integration softwares.
You can manage interactions with potential customers.

Must have:

- 5 years of professional experience in software engineering or data engineering.

Strong software engineering skills with Python in large-scale high-performance production environments.
Hands-on experience with Spark/PySpark and other big data frameworks.
Expertise in data modeling and working with both structured and unstructured data.
Hands-on experience with streaming data platforms particularly Apache Kafka.
Strong understanding of distributed systems and modern data architectures.
Experience working with cloud platforms preferably GCP (BigQuery Dataflow Pub/Sub Dataproc).
Excellent problem-solving and communication skills.

Nice to have:

Experience with Databricks and real-time data processing frameworks.
Experience with NoSQL databases (e.g. Redis Neo4j) and data lakes.
Knowledge of ML workflows and algorithms.
Exposure to other cloud platforms (AWS Azure) and relevant certifications.
Familiarity with ETL/integration tools (Talend Airflow dbt etc.).
Hands-on experience with version control (Git) and CI/CD pipelines.

Other Job Requirements:

The desired candidates should be open to:

Located in Lisbon Portugal or open to relocating candidates currently based elsewhere in Europe to Lisbon Portugal.
We embrace a hybrid work approach with 3 days in the office and two days working remotely. Spending time in the office is essential for building in-person connections fostering teamwork and facilitating productive whiteboarding sessions and brainstorming.

About OpplaneOpplane specializes in providing advanced data-focused solutions for financial services telecommunication and reg-tech to accelerate their digital transformation journey. Opplane leadership team is comprised of Silicon Valley serial entrepreneurs and experienced executives. Its expertis...