Software Engineering Associate (open to US or Canada)

Who we are:

Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2000 customers and operations in 13 cities around the world we are the AI technology solutions provider-of-choice to 4 out of 5 of the worlds biggest technology companies as well as leading companies across financial services insurance technology law and medicine.

By combining advanced machine learning and artificial intelligence (ML/AI) technologies a global workforce of subject matter experts and a high-security infrastructure were helping usher in the promise of clean and optimized digital data to all industries. Innodata offers a powerful combination of both digital data solutions and easy-to-use high-quality platforms.

Our global workforce includes over 3000 employees in the United States Canada United Kingdom the Philippines India Sri Lanka Israel and Germany. Were poised for a period of explosive growth over the next few years.

About the Role

Were looking for curious hands-on engineers eager to build the next wave of Generative AI applications. As an Associate Software Engineer youll work with experienced AI architects and data scientists to develop test and evaluate GenAI-powered systems that solve real enterprise problems.

This is a great opportunity for recent grads or early-career professionals passionate about Python programming prompt engineering and GenAI application evaluation.

Key Responsibilities

• Prototype LLM retrieval pipelineswith safety and filtering.

• Operate knowledge graph/ vector DBs(Pinecone Weaviate) and manage embeddings.

• Build FastAPI servicesfor search recsys and memory.

• Design resilient systems with caching retries observability.

• Run data pipelinesfor large-scale indexing and embeddings.

• Capture personalization signals (search chat purchase).

• Optimize for low-latency APIs & high-throughput pipelines.

• Collaborate with research and product on evaluation and UX.

• Build and test Python-based scripts APIs and microservices supporting GenAI workflows.

• Assist in prompt engineering data preparation and evaluation of GenAI models (e.g. GPT Claude Gemini Llama).

• Help design and run experiments to measure model quality reasoning and response consistency.

• Collaborate with project and solution teams to prototype new GenAI use cases.

• Document findings test cases and improvement ideas for continuous learning.

Technical & Required Skills

• Strong Python (FastAPI async/await Redis PostgreSQL).

• 1-3 years of hands-on experience with LLM prompting RAG embeddings vector search.

• Comfort with APIs distributed systems caching observability.

• Familiarity with GCP/AWS/Azure or similar cloud services Docker Git CI/CD.

• Clear communicator self-driven team player.

• Bachelors degree in Computer Science Data Science or related field (or equivalent practical experience).

• Proficiency in Python(experience with libraries like Pandas Requests or LangChain a plus).

• Familiarity with LLMs prompt engineering and GenAI applications.

• Eagerness to learn and experiment with new tools and APIs.

• Strong problem-solving skills curiosity and team mindset.

Preferred Skills and Experience

• Exposure to RESTful APIs cloud platforms (GCP AWS Azure) or vector databases.

• Interest in evaluating or improving AI model performance (QA safety relevance).

• TypeScript/ (NestJS) React/. familiarity with FAST API Streamlit and similar frameworks

• Recommender systems exposure.

• Embedding model evaluation skills.

Soft Skills

• Excellent communication presentation and collaboration skills

• Strong time management and organizational abilities

• Self-starter attitude with a customer-centric mindset

• Ability to work in a multicultural and fast-paced environment

Minimum Education Requirements

• Bachelors degree or higher in Computer Science Artificial Intelligence Machine Learning Linguistics Localization or a related field.

We are an equal opportunity employer committed to fostering an inclusive respectful and diverse workplace. We welcome and encourage applications from individuals of all backgrounds and are dedicated to employment equity and building a team that reflects the diverse communities in which we live and operate.

In accordance with the Accessibility for Ontarians with Disabilities Act (AODA) we are committed to providing accommodations throughout the recruitment and selection process. If you require an accommodation please let us know and we will work with you to meet your needs.

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment banking details or sensitive personal information during the application process. To learn more on how to recognize job scams please visit the Federal Trade Commissions guide at you believe youve been targeted by a recruitment scam please report it to Innodata at and consider reporting it to the FTC at .

#LI-NS1