Data Engineer ChatGPT ( AILLM) Intergration

Job Description : Data Engineer – ChatGPT ( AI/LLM) Intergration

Location : Bangalore Pune Hyderabad( hybrid ) – 1 or 2 days they need to visit office or 8 days a month
Experience : 5- 8 Years
Mandatory skill : Python LLM – integration databricks ( you may find a lot of AI/ ML folks – check with them did they work on LLM integration LLM tools)
Time shift : Overlap with US Hours ( 12PM- 9PM IST or 2 PM – 11 PM IST ) – it will overlap

Job description :
Organization is seeking a talented and motivated Data Engineer to join our dynamic this role you will focus on integrating AI and large language models specifically ChatGPT into our data ecosystem. You will play a critical role in designing building and maintaining data pipelines that support our innovative AI initiatives.
Key Responsibilities:
- Develop and optimize data pipelines for ingesting and processing large datasets relevant to AI and LLM applications.
- Collaborate with data scientists and AI researchers to understand model requirements and ensure seamless integration of data sources.
- Design and implement data models that support the performance and scalability of ChatGPT applications.
- Monitor troubleshoot and optimize existing data flows to ensure high performance and accuracy.
- Work with various data storage solutions including relational databases NoSQL databases and data lakes.
- Implement data quality checks and validation processes to maintain integrity and reliability of data used in AI models.
- Stay updated on industry trends and advancements in AI and LLM technologies to continually improve our data engineering practices.
- Contribute to documentation and knowledge sharing across teams to foster a culture of collaboration and continuous learning.
Qualifications:
- Bachelor’s degree in Computer Science Engineering Data Science or a related field.
- Proven experience as a Data Engineer with a strong understanding of data modeling ETL processes and data warehousing concepts.
- Familiarity with large language models particularly ChatGPT or similar AI technologies is a plus.
- Proficiency in programming languages such as Python SQL or Java.
- Experience with big data technologies like Hadoop Spark or Kafka is preferred.
- Knowledge of cloud platforms (AWS Azure Google Cloud) and their data services.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Excellent communication skills and ability to collaborate effectively with cross-functional teams.