Principal Software Engineer
Share
Job Location:
Charlotte, VT - USA
Monthly Salary:
$ 110000 - 180000
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
General information
Ally and Your Career
The Opportunity
The Work Itself
- Architect and evolve a self-hosted AWS-based AI Agent Platform using ECS/Fargate Lambda API Gateway ALB S3 KMS CloudWatch.
- Design scalable modular infrastructure supporting multiple agent frameworks (LangGraph OpenAI Agent SDK Autogen).
- Define patterns for agent deployment orchestration and multi-tenant scaling in containerized environments.
- Build intelligent multi-agent workflows with complex reasoning and tool orchestration.
- Develop reusable SDKs templates and developer tooling for faster adoption.
- Integrate agents with enterprise systems such as ServiceNow Salesforce Snowflake Confluence Okta GRC platforms.
- Implement authentication and authorization using Okta OIDC JWT and fine-grained tool policies.
- Establish observability standards including logging metrics tracing and governance dashboards.
- Ensure compliance with enterprise AI governance and risk management frameworks.
- Mentor senior engineers and act as technical thought leader across teams.
- Collaborate with cross-functional stakeholders to drive enterprise-wide platform adoption.
The Skills You Bring
- Bachelors or Masters in Computer Science AI/ML Data Science or related experience preferred
- 5 years of software engineering experience required
- 3 years in senior or principal roles preferred
- Proven experience architecting and scaling distributed systems and AI platforms on AWS.
- Strong Python skills and familiarity with async frameworks like FastAPI and asyncio.
- Experience with AI agent frameworks (LangGraph Autogen OpenAI SDK MCP).
- Knowledge of LLM orchestration vector databases retrieval augmentation prompt patterns required
- Expertise in container orchestration serverless architectures and CI/CD pipelines (GitLab Terraform) preferred.
- Familiarity with cloud security IAM networking and enterprise authentication (Okta) preferred.
- Excellent communication skills and ability to influence technical and executive stakeholders.
- Strategic thinker with hands-on problem-solving skills.
- Proven record of building platforms or frameworks adopted at scale.
How Well Have Your Back
Allys compensation program offers market-competitive base pay and pay-for-performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry-leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life including:
- Time Away:Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).
- Planning for the Future:plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions student loan pay downs and 529 educational save up assistance programs tuition reimbursement employee stock purchase plan and financial learning center and financial coach access.
- Supporting your Health & Well-being:flexible health and insurance options including medical dental and vision employee spouse and child life insurance short- and long-term disability pre-tax Health Savings Account with employer contributions Healthcare FSA critical illness accident & hospital indemnity insurance and a total well-being program that helps you and your family stay on track physically socially emotionally and financially.
- Building a Family:adoption surrogacy and fertility assistance as well as paid parental and caregiver leave Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.
- Work-Life Integration:other benefits including Mentally Fit Employee Assistance Program subsidized and discounted Weight Watchers program and other employee discount programs.
- Other compensations:depending on the role for which you are considered you may be eligible for travel allowances relocation assistance a signing bonus and/or equity.
- To view more detailed information about Allys Total Rewards please visit this link: We Are:
Ally Financial is a customer-centric leading digital financial services company with passionate customer service and innovative financial solutions. We are relentlessly focused on Doing it Right and being a trusted financial-services provider to our consumer commercial and corporate customers. For more information visit .
Ally is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to age race color sex religion national origin disability sexual orientation gender identity or expression pregnancy status marital status military or veteran status genetic disposition or any other reason protected by law.
We are committed to working with and providing reasonable accommodation to applicants with physical or mental disabilities. For accommodation requests email us at Ally will not discriminate against any qualified individual who is capable of performing the essential functions of the job with or without reasonable accommodation.
Required Experience:
Staff IC
Key Skills
- Continuous Integration
- Docker
- Jenkins
- Python
- System Design
- Agile
- C/C++
- Go
- Systems Engineering
- Software Development
- Java
- Distributed Systems
About Company
Manage your money with Ally: online banking, auto financing, and investments. Financial products designed to help you pursue your goals.
