Sr Big Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
26-10-2025
Vacancies:
1 Vacancy
Job Summary
Senior Big DataEngineer (Spark/Scala)
The Role
We are looking for experienced innovative and highly motivated engineer who is capable of working independently to design develop and support data engineering solutions. This role requires a considerable focus on understanding our data we deal with as an organization develop a better understanding of our data through profiling take ownership of the solution design work collaboratively with the wider engineering team to implement optimal solutions in a timely manner and ensure successful deployment and operation of the platform in production. Our platform helps solve complex business challenges pertaining to healthcare data such as mapping wide variety of healthcare drug and diagnosis data to standard coding frames. You will have the opportunity to be able to solve complex engineering challenges and develop innovative solutions. In daily work you will be responsible for create and deliver platform to loading and processing millions of electronic medical records.
The Team
The Systems Engineering team is one of the fastest growing groups within Real-World Solutions (RWS) Technology division. We are enthusiastic about Agile software development are one of the strongest advocates for DevOps and Test-Driven Development (TDD) in the group and believe strongly in enabling individuals to be their bestby allowing them to be independent and be part of a self-organizing team.
The team deals with a wide variety of patient-level health care data which is used by RWS Technology to solve complex healthcare problems for our clients ranging from supporting retrospective clinical studies to disease progression projections.
In your daily work you will work with a team of Architects responsible for designing an effective solution with Data Analysts who will help you understand the domain and medical data as well as with the Quality assurance team which will ensure high standards of software quality.
Job Responsibilities:
Build pipelines for processing big amount of medical data
Participate in system design development deployment and maintenance
Configuration and prototyping of new systems
Conduct peer code reviews
Consistently and proactively expanding knowledge network and know-how to incorporate new thinking into current processes/products/tools/methods
Contribute to the definition and adoption of technical standards
Work closely with the data analysts to identify and provide required data
Create comprehensive automated unit and integration tests
Qualifications:
Bachelors Degree in Information Technology Software Engineering Computer Science Mathematics oranotherrelated field
3 years knowledge in Big Data Stream processing (Scala Apache Spark)
Experience with Microservices Architecture
Experience withone or more of:Apache KafkaApache Spark Apache Flink HDFS
Knowledge of the NoSQL database such asHiveHBase CassandraElasticSearchor others
Experience with implementing Agile practices (ideally SCRUM)
Experience with TDD CI CDJenkins
Knowledge of build automation tools such as Maven Gradle SBT
Experience with a VCS preferably Git
Knowledge ofalgorithms & design patternsand how to apply them effectively
Personal skills and behaviours:
Excellent analytical & troubleshooting skills
Strong collaboration written and verbal skills
Familiarity with project management concepts specifically Agile/Scrum
We know that meaningful results require not only the right approach but alsothe right people.Regardless of your role we invite you to reimagine healthcare with us. You will have the opportunity to play an important part in helping our clients drive healthcare forward and
Whatever your career goals we are here to ensure you get there!
IQVIA is a leading global provider of clinical research services commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
IQVIA is the Human Data Science Company™. We are inspired by the industry we serve and provide solutions that enable life sciences companies to innovate with confidence, maximize opportunities and ultimately drive human health outcomes forward. Our approach is Human Data Science – a d ... View more
