Title: Software Developer/Engineer (Mid Level experience)
Duration: 12 Months
Location: Philadelphia PA 19122 Work Mode: Hybrid minimum 3 days in the office
Client: Philadelphia Gas Works
Interview Schedule: 1st interview 1-hour in-person; 2nd interview 1-hour in-person
Job Description:
- Consultant Requirements On-Prem LLM & Vector DB Implementation
Core Experience:
- Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments
- Strong proficiency in Python for LLM inference prompt engineering and integration
- Experience with CPU-based inference model quantization and performance tuning
Vector Databases & RAG:
- Practical experience with open-source vector databases such as Qdrant Chroma Milvus or pgvector
- Proven implementation of Retrieval-Augmented Generation (RAG) pipelines
- Experience generating and managing embeddings and metadata filtering
Security & Governance:
- Understanding of data privacy air-gapped deployments and enterprise security requirements
- Experience implementing access controls and audit logging
Nice to Have:
- Experience with LangChain or LlamaIndex
- Exposure to Rust Go or C for high-performance services
- Familiarity with Docker and Kubernetes for on-prem deployments
- Knowledge of inference frameworks (e.g. vLLM Hugging Face Transformers)
- Prior work in regulated or enterprise environments
Deliverables:
- Reference architecture and deployment guidance
- Working prototype (LLM vector DB RAG)
- Documentation and knowledge transfer to internal teams
If you are: bright motivated skilled a difference-maker able to get things done work with minimum direction
enthusiastic a thinker able to juggle and multi-task communicate effectively and lead then we would like to
hear from you. We need exceptionally capable people for this role for our client so get back to us and tell us why
you think you are a fit.
About Us:
Consulting firm in the Philadelphia region. Tri-Force specializes in IT staffing software development (web and
mobile apps) systems integration data analytics system automation cybersecurity and cloud technology
solutions for government and commercial clients. Tri-Force works with clients to overcome obstacles such as
increasing productivity increasing efficiencies through automation and lowering costs. Our clients benefit from
our three distinguishing core values: integrity diligence and technological excellence. Tri-Force is a six-time
winner among the fastest-growing companies in Philadelphia and a four-time winner on the Inc. 5000 list of the
nations fastest-growing companies.
Required Skills:
Core Experience: Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments Strong proficiency in Python for LLM inference prompt engineering and integration Experience with CPU-based inference model quantization and performance tuning Vector Databases & RAG: Practical experience with open-source vector databases such as Qdrant Chroma Milvus or pgvector Proven implementation of Retrieval-Augmented Generation (RAG) pipelines Experience generating and managing embeddings and metadata filtering Security & Governance: Understanding of data privacy air-gapped deployments and enterprise security requirements Experience implementing access controls and audit logging Nice to Have: Experience with LangChain or LlamaIndex Exposure to Rust Go or C for high-performance services Familiarity with Docker and Kubernetes for on-prem deployments Knowledge of inference frameworks (e.g. vLLM Hugging Face Transformers) Prior work in regulated or enterprise environments Deliverables: Reference architecture and deployment guidance Working prototype (LLM vector DB RAG) Documentation and knowledge transfer to internal teams
Required Education:
Bachelors or Masters degree in Computer Science Information Systems Engineering or a related field or equivalent professional experience.
Title: Software Developer/Engineer (Mid Level experience) Duration: 12 MonthsLocation: Philadelphia PA 19122 Work Mode: Hybrid minimum 3 days in the officeClient: Philadelphia Gas WorksInterview Schedule: 1st interview 1-hour in-person; 2nd interview 1-hour in-personJob Description:Consultant Requi...
Title: Software Developer/Engineer (Mid Level experience)
Duration: 12 Months
Location: Philadelphia PA 19122 Work Mode: Hybrid minimum 3 days in the office
Client: Philadelphia Gas Works
Interview Schedule: 1st interview 1-hour in-person; 2nd interview 1-hour in-person
Job Description:
- Consultant Requirements On-Prem LLM & Vector DB Implementation
Core Experience:
- Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments
- Strong proficiency in Python for LLM inference prompt engineering and integration
- Experience with CPU-based inference model quantization and performance tuning
Vector Databases & RAG:
- Practical experience with open-source vector databases such as Qdrant Chroma Milvus or pgvector
- Proven implementation of Retrieval-Augmented Generation (RAG) pipelines
- Experience generating and managing embeddings and metadata filtering
Security & Governance:
- Understanding of data privacy air-gapped deployments and enterprise security requirements
- Experience implementing access controls and audit logging
Nice to Have:
- Experience with LangChain or LlamaIndex
- Exposure to Rust Go or C for high-performance services
- Familiarity with Docker and Kubernetes for on-prem deployments
- Knowledge of inference frameworks (e.g. vLLM Hugging Face Transformers)
- Prior work in regulated or enterprise environments
Deliverables:
- Reference architecture and deployment guidance
- Working prototype (LLM vector DB RAG)
- Documentation and knowledge transfer to internal teams
If you are: bright motivated skilled a difference-maker able to get things done work with minimum direction
enthusiastic a thinker able to juggle and multi-task communicate effectively and lead then we would like to
hear from you. We need exceptionally capable people for this role for our client so get back to us and tell us why
you think you are a fit.
About Us:
Consulting firm in the Philadelphia region. Tri-Force specializes in IT staffing software development (web and
mobile apps) systems integration data analytics system automation cybersecurity and cloud technology
solutions for government and commercial clients. Tri-Force works with clients to overcome obstacles such as
increasing productivity increasing efficiencies through automation and lowering costs. Our clients benefit from
our three distinguishing core values: integrity diligence and technological excellence. Tri-Force is a six-time
winner among the fastest-growing companies in Philadelphia and a four-time winner on the Inc. 5000 list of the
nations fastest-growing companies.
Required Skills:
Core Experience: Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments Strong proficiency in Python for LLM inference prompt engineering and integration Experience with CPU-based inference model quantization and performance tuning Vector Databases & RAG: Practical experience with open-source vector databases such as Qdrant Chroma Milvus or pgvector Proven implementation of Retrieval-Augmented Generation (RAG) pipelines Experience generating and managing embeddings and metadata filtering Security & Governance: Understanding of data privacy air-gapped deployments and enterprise security requirements Experience implementing access controls and audit logging Nice to Have: Experience with LangChain or LlamaIndex Exposure to Rust Go or C for high-performance services Familiarity with Docker and Kubernetes for on-prem deployments Knowledge of inference frameworks (e.g. vLLM Hugging Face Transformers) Prior work in regulated or enterprise environments Deliverables: Reference architecture and deployment guidance Working prototype (LLM vector DB RAG) Documentation and knowledge transfer to internal teams
Required Education:
Bachelors or Masters degree in Computer Science Information Systems Engineering or a related field or equivalent professional experience.
View more
View less
Job Location:
Salary:
Experience Required:
Posted on:
8 hours ago
Vacancies:
1 Vacancy
