Senior LLM Engineer
Senior LLM Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
$ 135000 - 210000
1 Vacancy
Job Description
About SmartAsset:
SmartAsset is an online destination for consumerfocused financial information and advice whose mission is helping people make smart financial decisions reaching over an estimated 59 million people each month (as of January 2025 through our educational content and personalized calculators and tools. To extend our mission we also operate SmartAsset Advisor Marketing Platform (AMP) which helps connect consumers with fiduciary financial advisors.SmartAsset has earned recognition on the Inc. 5000 #2574 in 2023 and Deloitte Technology Fast 500 #250 in 2022 lists. Currently SmartAsset ranks on Y Combinators list of Top 100 Companies. A successful $110 million Series D funding round in 2021 valued the company at over $1 billion.
*Other than application and licensing fees SmartAsset did not provide compensation for the aforementioned awards.
About the team:
At SmartAsset you will join a team of data scientists analysts and ML engineers that are at the forefront of AI/ML application for the company. You will have the opportunity to work crossfunctionally with leaders from different teams (Marketing Product Sales and Technology) and with our growing Data team.
About the job:
We are seeking an experienced Senior LLM Engineer to join our team and develop highperformance scalable and reliable LLM capabilities to power SmartAssets future. As a key member of our team you will be responsible for designing and implementing the LLM service and supporting the logic integrating the services as well as ensuring the performance scalability including handling hundreds of simultaneous users per second. If you are passionate about building highperformance scalable and reliable LLM service and products and have a track record of delivering solutions in AWS we would love to hear from you.
Responsibilities:
- Design and implement a highperformance scalable and reliable LLM service using Python LLM Services (E.g. OpenAI Antropics ClaudeMetas LLaMA etc) and AWS technologies to power our applications and business needs including building services that can serve hundreds of concurrent users in a second.
- Design and development of RAG pipelines
- Building or integrating Voice related AI technologies and productizing at scale
- Collaborate with business leaders to understand their needs and challenges and identify potential LLM use cases.
- Design develop and deploy custom LLM solutions tailored to the requirements of different divisions including cocreating the prompts.
- Collaborate with the Data Science team to understand how to build the LLM solution including fine tuning OpenAI models as necessary.
- Implement software best practices to ensure seamless development testing and deployment of LLM solutions.
- Stay uptodate with the latest advancements in LLM technologies and continuously explore ways to integrate these advancements into our existing solutions.
- Develop and maintain comprehensive documentation including technical specifications user guides and best practices.
- Ensure data privacy and security compliance while working with LLMs.
- Provide technical support and training to internal teams as needed.
- Monitor LLM performance and make improvements to ensure acceptable response times based on use cases.
- Collaborate with other developers and data scientists within the organization to share knowledge ideas and best practices.
- Participate in code reviews and provide guidance to junior developers.
Skills/Experience you have:
- Proven experience with Cloud Platforms (AWS GCP or Azure)
- Handson experience working with Vector databases such as PineConeChroma MongoDB and LanceDB.
- Solid understanding of LLM concepts such as prompt engineering model finetuning and transfer learning.
- Familiarity with one popular LLM frameworks (e.g. OpenAI GPT Hugging Face Transformers).
- Minimum 5 years of experience in Python programming with a strong focus on developing LLM applications.
- Proven experience with automation and scaling.
- Experience building and/or integrating Voice AI solutions is a big plus.
- Strong problemsolving skills and the ability to work independently.
- Excellent communication skills with the ability to present complex concepts to both technical and nontechnical audiences.
- Experience working in a crossfunctional team and collaborating with stakeholders at various levels of the organization.
- Bachelors or Masters degree in Computer Science Data Science or a related field.
- Experience with DevOps toolsets such as Terraform Prometheus etc. and Understanding of DockerKubernetes and CI/CD tools such as Gitlab CIArgoCD and Helm charts gets you bonus points
- Experience with web frameworks such as FastAPI Django Streamlit for building production ready applications gets you bonus points.
Available Benefits and Perks:
- All roles at SmartAsset are currently and will remain remote flexibility to work from anywhere in the Contiguous US.
- Medical Dental Vision multiple packages available based on your individualized needs
- Life/AD&D Insurance basic coverage at 100 company paid additional supplemental available
- Supplemental Shortterm and Longterm Disability
- FSA: Medical and Dependant Care
- 401K
- Equity packages for each role
- Time Off: Vacation Sick and Parental Leave
- EAP (Employee Assistance Program)
- Financial Literacy Mentoring Program
- Pet Insurance
- Home Office Stipend
SmartAsset is an equal opportunity employer committed to fostering an inclusive innovative environment with the best employees. We are committed to equal employment opportunity regardless of race color ancestry religion sex national origin sexual orientation age citizenship marital status disability gender identity or Veteran status. If you have a disability or special need that requires accommodation please contact us at
California Colorado Connecticut Maryland Nevada Rhode Island Washington and New York City residents* Salary range is $135000$210000 RSUs benefits depending on experience.
**Salary at SmartAsset is determined based on permissible nondiscriminatory factors such as skills experience and geographic location within the contiguous United States.
Required Experience:
Senior IC
Employment Type
Full Time
