Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
8 hours ago
Vacancies:
1 Vacancy
Job Summary
Requirements
- Mandatory skillset requirement is AWS Redshift AWS Bedrock Lamda Data Connetor
- Programming Language - Python
- Kubernetes docker Lambda
- API - python FastAPI framework
- DB - Lamda proxy - database connector
- DB - Relational dB / Redshift
- Generative AI - bedrock as LLM custom coding framework
Good to have skills -
- Real-time and Streaming Data - Apache Kafka Amazon Kinesis
- Generative ai concepts Bedrock LLM Embeddings Vector db. LanghChain Langraph etc.
Required Skills:
Strong hands-on experience in Javascript Spring Boot micro-services JPA and JPQL Strong design development and performance tuning skills on databases such as DB2 or any other RDBS. Experienced in technology stack selection and the definition of solution technology and integration architectures for mid to large sized applications and cloud hosted platforms Strong understanding of various design and architecture patterns. Must have worked on desktop application development. Exposure to debugging and troubleshooting complex issues related to memory management multi-threaded applications custom messaging systems etc. Experience of implementing and governing software engineering processes practices tools and standards for development teams(such as clean code concepts) Full SDLC experience leveraging Agile TDD and BDD for building and rolling out highly transactional and highly available platforms hosted on-premise and on the cloud Proficient in effort estimation techniques; will actively support Leads and scrum masters on planning the implementation and will work with test leads on the definition of an appropriate test strategy for the realization of a quality solution Must be hands on technology and able to troubleshoot critical issues in design or code Familiarity with CI/CD pipelines DevOps practices and version control systems like Git. Understanding of containerization tools like Docker and Kubernetes. Proven experience leading and managing software development teams. Strong project management abilities including planning tracking and delivering on time. Experience in stakeholder communication and reporting project status to senior management.
Company Industry
IT Services and IT Consulting
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
