Portuguesecompany hires for hybrid position
Location:Lisbon Portugal
Only candidates already based in Portugal willbe considered.
LanguageRequirements: Fluent English
Seniority: 6years Instructions:Please send your CV in English and make sure to include all skills andexperience that match the requirements of the opportunity. This willsignificantly increase your chances of success
Important: All mandatory requirements listed below must be clearly stated in the CV.Applications that do not explicitly include the required experience and skillswill not be considered.
We are seeking a senior Data Architect to lead the design implementation and optimizationof large-scale Big Data ideal candidate is highly technical autonomous and capable of delivering end-to-end data solutionsensuring performancescalability reliability and governance across distributedenvironments.
Design and implement scalable resilient and secure Big Dataarchitectures
Configure and manage distributed data processing environmentson-premises and/or cloud
Develop and maintain data pipelines using Apache Airflowincluding complex DAG designmonitoring and CI/CD best practices
Build and optimize batch and streaming data applicationsusing Apache Spark
Drive technicaldecisions related to data storage processing governance andsystem integration
Collaborate with engineering analytics and businessteams to ensure dataquality consistency and availability
Produce clear and structured technical documentationincluding architectures data flows and components
Proven experience as a Big Data Architect or ina similar senior technical role
Strong expertise in Apache Spark (PySpark Spark SQL performance tuning)
Solid hands-on experience with Apache Airflow (DAGsoperators sensors)
Deep understanding of distributed systemsclusters containerization and orchestration (Kubernetes is a plus)
Experience configuring Linux environmentsincluding networking security and automation
Strong knowledge of Big Data technologiessuch as Hadoop Hive KafkaDelta Lake
Experience working with cloud platforms (AWS Azure or GCP)
Strong analyticaland problem-solving skills focused on scalable architecturedesign
Experience with microservices-based architectures
Familiarity with CI/CD tools (GitLabJenkins Argo)
Knowledge of relational and NoSQL databases
English:Professional / Working proficiency
Strong communicationskills
Excellent analyticalabilities combining synthesis with attention to detail
High adaptabilityin evolving technical environments
Strong teamspirit and collaborative mindset
Client-focusedapproach
Data Architect Big Data Architect ApacheSpark PySpark Spark SQL Apache Airflow DAGs Big Data Distributed SystemsHadoop Hive Kafka Delta Lake Data Pipelines Batch Processing StreamingCloud Computing AWS Azure GCP Linux Kubernetes CI/CD Data GovernanceLisbon
CI - PROC25739
Required Experience:
Staff IC