Lead Big Data Engineer with AIML experience

Lviv - Ukraine

Monthly Salary: Not Disclosed

Posted on: 12 hours ago

Vacancies: 1 Vacancy

Job Summary

N-iX is looking for a Lead Big Data Engineer with AI/ML experience. As a Lead Engineer youll be responsible for designing developing and optimizing data and AI pipelines (including Spark-based and RAG-style workflows) ensuring performance scalability and reliability. Youll also be working on technical discovery and solution assessment: helping the client understand existing AI tooling (currently a RAG-based solution used for document analysis) evaluating scalability quality cost and risks and advising on future architecture options.

Responsibilities:

Design and implement data pipelines to support AI and ML use cases including data preparation feature engineering and real-time model serving.
Support and enable RAG-based and NLP use cases including document ingestion data preparation feature extraction and structured data generation.
Collaborate with AI engineers to productionize AI/ML solutions and integrate them into reliable data workflows.
Participate in and lead discovery phases to analyze existing AI solutions clarify how they work and identify architectural gaps risks and improvement opportunities.
Assess scalability and multilingual support of AI/data solutions (including feasibility configuration needs cost and expected quality).
Contribute to evaluations of vendor lock-in platform alternatives and potential migration paths (e.g. toward Palantir Foundry or other modern data/AI platforms).
Ensure high standards of data quality security governance and compliance.
Drive continuous improvement in development processes tooling and engineering practices.
Foster collaboration across engineering data science and product/business stakeholders.

Requirements:

6 years of experience in Data Engineering
Strong hands-on experience with PySpark and large-scale data processing.
Proficiency in Python and distributed computing concepts.
Experience designing and optimizing scalable data pipelines for high-volume data.
Experience supporting AI/ML projects (e.g. enabling model training pipelines feature engineering real-time inference or MLOps workflows).
Ability to perform technical discovery and solution assessment including explaining complex systems to non-technical stakeholders.
Strong leadership communication and stakeholder management skills.
Experience with Palantir Foundry is a plus but not required.
Familiarity with CI/CD and infrastructure as code (e.g. Terraform CloudFormation) is desirable.
Bachelors or Masters degree in Computer Science Engineering or a related field.

We offer*:

Flexible working format - remote office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program tech talks and trainings centers of excellence and more)
Active tech communities with regular knowledge sharing
Education reimbursement
Memorable anniversary presents
Corporate events and team buildings
Other location-specific benefits

*not applicable for freelancers

Required Experience:

N-iX is looking for a Lead Big Data Engineer with AI/ML experience. As a Lead Engineer youll be responsible for designing developing and optimizing data and AI pipelines (including Spark-based and RAG-style workflows) ensuring performance scalability and reliability. Youll also be working on technic...

Responsibilities:

Design and implement data pipelines to support AI and ML use cases including data preparation feature engineering and real-time model serving.
Support and enable RAG-based and NLP use cases including document ingestion data preparation feature extraction and structured data generation.
Collaborate with AI engineers to productionize AI/ML solutions and integrate them into reliable data workflows.
Participate in and lead discovery phases to analyze existing AI solutions clarify how they work and identify architectural gaps risks and improvement opportunities.
Assess scalability and multilingual support of AI/data solutions (including feasibility configuration needs cost and expected quality).
Contribute to evaluations of vendor lock-in platform alternatives and potential migration paths (e.g. toward Palantir Foundry or other modern data/AI platforms).
Ensure high standards of data quality security governance and compliance.
Drive continuous improvement in development processes tooling and engineering practices.
Foster collaboration across engineering data science and product/business stakeholders.

Requirements:

6 years of experience in Data Engineering
Strong hands-on experience with PySpark and large-scale data processing.
Proficiency in Python and distributed computing concepts.
Experience designing and optimizing scalable data pipelines for high-volume data.
Experience supporting AI/ML projects (e.g. enabling model training pipelines feature engineering real-time inference or MLOps workflows).
Ability to perform technical discovery and solution assessment including explaining complex systems to non-technical stakeholders.
Strong leadership communication and stakeholder management skills.
Experience with Palantir Foundry is a plus but not required.
Familiarity with CI/CD and infrastructure as code (e.g. Terraform CloudFormation) is desirable.
Bachelors or Masters degree in Computer Science Engineering or a related field.

We offer*:

Flexible working format - remote office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program tech talks and trainings centers of excellence and more)
Active tech communities with regular knowledge sharing
Education reimbursement
Memorable anniversary presents
Corporate events and team buildings
Other location-specific benefits

*not applicable for freelancers

Required Experience: