We are seeking an experienced software development manager to lead a team of SDEs and MLEs in designing building and maintaining bestinclass scalable machine learning model hosting infrastructure!
As our SDE/MLE manager superstar youll have the power to lead the charge in developing innovative inference and architectures to ensure our engineers and scientists can push the boundaries of large model training (esp. experience with breadth/depth of various chips and compute options). Your groundbreaking work will directly impact our customers lives through lifechanging and delightful products and services.
Key job responsibilities
Manage a team of engineers (e.g. SDE MLE DE) to deliver their best work inclusive of managing their performance and skills growth
Serve as technical lead (i.e. technical owner of a roadmap advise on tech tradeoffs) to Sr. Managers & Directors on a suite of predictive metric products like inference model hosting performance/operations metrics and dashboarding and customer portals and features.
Ability to quickly learn emergent and everchanging technologies and algorithms in the field of Generative AI to participate in our journey to build the best LLMs.
Responsible for the development and maintenance of key platforms needed for developing evaluating and deploying LLM for realworld applications.
Manage direct reports (SDE MLE DE) and stakeholders (applied/research/data scientists linguists other engineers product leads) to investigate design approaches prototype new technology and evaluate technical feasibility.
Own and build (and iterate optimize on) infrastructure to scale machine learning models (e.g. 20B parameter)
Hold and raise the bar for operational readiness operational excellence and runbook documentation
Ability to be curious and pivot your perspective.
About the team
We are a crossfunctional org comprised of product managers data engineers business intelligence engineers software development engineers and sciencefocused teams with applied scientists research scientists and machine learning engineers. We are passionate about building and improving our analytics platform Gale which enables Alexa developers and leaders to make informed business and CX decisions reliably and quickly. We are deeply rooted in big data responsible (privacy secure) data performant services and userfriendly analytics applications. We are a mature org eager to expand our offerings with this SDM leader!
3 years of engineering team management experience
7 years of engineering experience
8 years of leading the definition and development of multi tier web services experience
Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle including coding standards code reviews source control management build processes testing certification and livesite operations
Experience partnering with product or program management teams
Experience in communicating with users other technical teams and senior leadership to collect requirements describe software product features technical designs and product strategy
Experience in recruiting hiring mentoring/coaching and managing teams of Software Engineers to improve their skills and make them more effective product software engineers
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race national origin gender gender identity sexual orientation protected veteran status disability age or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit
for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.