Senior AIML Engineer
Boston, MA - USA
Job Summary
Note: Fidelity is not providing immigration sponsorship for this position.
Principal AI/ML Platforms and Backend Engineer
Bring a builders mindset to Fidelitys Enterprise AI/ML Platform and help us scale the next generation of LLM-powered agentic and search systems. You will work on the core platform that connects tools agents data and modelsexpanding our MCP and Agentic ecosystem abstracting vector databases adapting and enhancing open-source libraries and automating experimentation for high-quality retrieval and reasoning.
The Team
The enterprise AI/ML platform is focused on delivering AI/ML solutions for the organization. As part of this team you will be responsible for building advanced cloud and software solutions in collaboration with Data Scientists to support packaging deployment and scaling of AI/ML Services in production.
What youll do
- Build the core AI/ML services running in Kubernetes and locally in Playground mode
- Design clean abstractions over vector databases and multistep Search/Information Retrieval pipelines
- Own automated real-time data ingestion for RAG: connectors streaming pipelines chunking/embedding strategies parallel processing retrieval metrics resilience and restartability while guaranteeing ACID integrity of processed data and elimination of redundant document processing.
- Ship developer-friendly APIs/SDKs CLIs and templates that make it trivial to develop agents tools and information retrieval pipelines at enterprise scale.
- Instrument everything: distributed tracing for services and agentic/tool sessions retrieval quality metrics performance metrics resource usage and failure forensics.
- Turn rapid prototypes into resilient systemspragmatic designs that are simple to use which scale in hardware efficient manner and above all as simple as possible.
- Read and distill open-source frameworks keep whats valuable replace the bloated with lean well engineered Python modules.
Team Culture:
- Lead through code productivity and knowledge sharing.
- Ask sharp questions challenge complexity and encourage others to do the same.
- We embrace a flat hierarchy where the best ideas win regardless of seniority.
What you bring
Engineering perspective:
- Strong Python service engineering: sound OOP clear interfaces thorough tests and an obsession with readability and maintainability.
- Real-world performance tuning across services and data stores: concurrency async I/O queues caching SQL/NoSQL indexing pagination and backpressure.
- Experience building event-driven systems and/or real-time pipelines for ingestion and inference.
- Mastery of debugging complex distributed behaviorreproducible experiments simulations and evidence-driven conclusions.
- Comfort reading open-source code and producing simplified alternatives to minimize code legacy and cognitive load.
- Effective use of developer-assist tools to amplify output while keeping quality high and code bloat at minimum.
- Produce services metrics that help us understand parallelism services can support in stable fashion ensuring efficient hardware utilization. Propose scaling approaches based on application hardware utilization footprint and metrics.
- Familiarity with key Data Science Machine Learning or AI libraries is a bonus but not mandatory as long as the candidate can demonstrate the ability to quickly learn new concepts and paradigms.
Product and Ownership perspective:
- Fast learning across new domains with a knack for spotting and reducing unnecessary complexity. Team works on new products understanding and implementing latest tech is paramount learning fast.
- Product sensibility: start from a blank slate ask the right questions and design primitives that feel Apple-like in usability.
- Produce functional picture and design of a product based on that write requirements epics and come up with stories which cover entire scope. Aim is that most of the risks are identified at start not during implementation.
- Collaborative communication healthy debate and leading by example. Comfortable switching hats to do what the projects need.
- Ability to work in a highly dynamic environment
- Attention to detail being thorough in tests and questioning assumptions being productive without a need for supervision. Our team takes pride in quality of our products.
Relevant and Nice to have skills:
- DevOps practices (CI/CD Docker Kubernetes) and infrastructure as code.
- AWS skills: EC2 S3 RDS Lambda IAM etc.
- Understanding Data performant ETL Analytics.
## Why this role
- Shape the core platform for AI/ML services and retrieval used across Fidelity.
- High ownership fast iteration and the chance to influence design.
- Work on hard high-impact problems with a team that values simplicity experimentation pace and teaching.
Is this role for you
- If reading this job spec brought a smile to your face or sparked a jolt of enthusiasm you should apply (assuming adequate skill/capability levels).
- To enjoy and thrive in our team you should be a highly motivated and productive individual who genuinely loves what they do.
Fidelitys Onsite Working Model
Fidelity is transitioning to a full-time onsite working model through a phased rollout across regions and roles. Currently some roles and locations require 100% onsite presence while others require less. Onsite expectations are likely to evolve as the rollout continues. This transition does not apply to fully remote roles.
Placement in the range will vary based on job responsibilities and scope geographic location candidates relevant experience and other factors.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements the offer package may also include bonus or other variable compensation.
Please be advised that Fidelitys business is governed by the provisions of the Securities Exchange Act of 1934 the Investment Advisers Act of 1940 the Investment Company Act of 1940 ERISA numerous state laws governing securities investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations including FINRA among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.
Required Experience:
Senior IC
About Company
The benefits you provide are about more than your workplace. They’re about life. Together, let’s create a program that meets the changing needs of your employees and your business.