Senior Backend Engineer

Title: Senior Backend Engineer AWS OpenSearch (Vector & Index DB)

Location: Mississauga Canada

Client: NewsCorp

Rate: 65/hr

Hire Type: Contract

Job description

Senior Backend Engineer with AWS OpenSearch Vector Index DB

Experience 8-12 years

Location Mississauga Canada

Role Summary

• Need a seasoned backend engineer to design implement and operate a semantic search platform on AWS OpenSearch focusing on vector search index designmanagement and highthroughput APIs The role requires strong backend development skills in TypeScript JavaScript andor Python
• AWS OpenSearch Detailed Requirements
• Cluster Design Management Expertise in setting up and scaling AWS OpenSearch clusters for high availability and performance shardreplica strategy cluster sizing and resource optimization
• Vector Search Implementation Handson experience with kNNHNSW algorithms for semantic search and managing vector indices for embeddingsbased retrieval
• Index Database Management Proficiency in creating and maintaining index templates analyzers tokenizers and custom mappings implement ILM policies for rollover and retention
• Query Relevance Tuning Deep knowledge of OpenSearch Query DSL boosting strategies hybrid search BM25 vector synonym handling and multilingual optimization
• Data Ingestion Pipelines Build scalable ingestion pipelines for structuredunstructured data and embeddings integrate with streamingbatch frameworks Kafka Kinesis
• Security Compliance Configure IAM roles VPC networking encryption atrestintransit and KMS for key management
• Monitoring Observability Implement metrics logs dashboards for cluster health and query performance set up s for anomalies and failures
• Backup Disaster Recovery Manage snapshot policies restore procedures and failover strategies

Key Responsibilities

• Design and implement vector search and index management in AWS OpenSearch
• Develop and maintain backend APIs and services using TypeScript JavaScript and Python
• Build scalable ingestion pipelines for documents and embeddings
• Ensure performance optimization observability and reliability of search services
• Implement security best practices and compliance measures
• Collaborate with crossfunctional teams and mentor junior engineers

Required Skills

• Strong expertise in AWS OpenSearch including vector search and index management
• Backend development experience in TypeScript JavaScript and Python
• Knowledge of distributed systems caching strategies and API design
• Experience with CICD pipelines and containerization DockerKubernetes
• Familiarity with observability tools and performance tuning techniques
• Understanding of security practices and AWS ecosystem services

Skills

Mandatory Skills : Python AWS Lambda