Senior Data Engineer, AWS Data Platform
Westbrook, ME - USA
Job Summary
IT accelerates the success of IDEXX employees and customers by providing scalable and innovative solutions and leadership. We are a global organization that supports all technology needed to deliver products and solutions to customers enabling them to focus on delivering high quality patient care. We strive to provide exceptional customer service and experience in the most efficient means possible requiring alignment and cross-functional communication.
We are seeking a highly motivated and experienced Senior Data Engineer to join our IT Data Engineering team and support the accelerated advancement of IDEXXs global LIMS (Lab Information Management System) program initiatives. This role is pivotal in developing and maintaining the data systems and infrastructure that deliver diagnostic results to our customers in near-real-time. This is not a SQL/ELT or Databricks-notebook-driven role; candidates must have experience building production data systems and services end-to-end including CI/CD pipelines and IaC. This role centers on operational near-real-time data pipelines streaming ingestion AWS-native compute and API-driven data flows (using Kinesis Glue/Spark Lambda and related services).
In this role you will...
- Build and maintain streaming ingestion API-based data workflows and distributed data transformations using AWS services (Kinesis Lambda Glue/Spark EMR S3)
- Develop and maintain REST APIs for data ingestion and consumption
- Design and implement platform automation and standardized repeatable deployment mechanisms (e.g. versioned releases environment promotion and deterministic deployment workflows)
- Develop and optimize data lake and operational data models for near-real-time use cases
- Work across both streaming (operational) and batch (analytical) layers to ensure consistent high-quality data delivery
- Help improve reliability automation and observability across the RDE data platform
- Participate in an on-call rotation to help provide support for the teams data systems and services
What you will need to succeed...
PLEASE NOTE: Location: We are only considering candidates located in Maine New Hampshire or Massachusetts who are willing to be onsite eight times per month. Reduced onsite requirements may be considered for candidates located farther from the office within Massachusetts or New Hampshire.
- 4 years of experience building operating and supporting production-grade data systems and services in highly reliable fault-tolerant environments
- 3 years of hands-on experience designing and developing solutions on AWS including services such as Lambda Glue Kinesis EMR S3 SNS SQS DynamoDB API Gateway and IAM
- Strong proficiency in Python and experience with shell scripting
- Experience troubleshooting debugging and optimizing distributed data systems including streaming pipelines Spark workloads APIs messaging queues and storage layers
- Experience designing building and maintaining RESTful APIs
- Experience implementing Infrastructure as Code using Terraform and/or CloudFormation
- Experience building CI/CD pipelines and automated testing frameworks using tools such as Jenkins
- Knowledge of relational document and key-value database technologies
- Experience working with semi-structured event data (JSON XML) and evolving data schemas
- Bachelors degree in Computer Science Information Technology Engineering or equivalent combination of education and practical experience
What you can expect from us:
Base annual salary target: $110000 - $130000 (yes we do have flexibility if needed)
Opportunity for annual cash bonus
Health / Dental / Vision Benefits Day-One
5% matching 401k
Additional benefits including but not limited to financial support pet insurance mental health resources volunteer paid days off employee stock program foundation donation matching and much more!
Why IDEXX
Were proud of the work we do because our work matters. An innovation leader in every industry we serve we follow our Purpose and Guiding Principles to help pet owners worldwide keep their companion animals healthy and happy to ensure safe drinking water for billions and to help farmers protect livestock and poultry from diseases. We have customers in over 175 countries and a global workforce of over 10000 talented people.
So what does that mean for you We enrich the livelihoods of our employees with a positive and respectful work culture that embraces challenges and encourages learning and discovery. At IDEXX you will be supported by competitive compensation incentives and benefits while enjoying purposeful work that drives improvement. Did we mention that we are a dog-friendly office
IDEXX values a diverse workforce and workplace and strongly encourages women people of color LGBTQ individuals people with disabilities members of ethnic minorities foreign-born residents and veterans to apply.
IDEXX is an equal opportunity employer. Applicants will not be discriminated against because of race color creed sex sexual orientation gender identity or expression age religion national origin citizenship status disability ancestry marital status veteran status medical condition or any protected category prohibited by local state or federal laws.
Lets pursue what matters together.
#LI-EV1
Required Experience:
Senior IC