Data Platform Engine....
Data Platform Engineer
Posted on :
06-02-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
06-02-2024
Job Description
Req ID : 2511240
Company Overview:
Niyati Tech is a leading player in the Information Technology & Services industry specializing in providing innovative solutions to enterprises.
Niyati Tech is a leading player in the Information Technology & Services industry specializing in providing innovative solutions to enterprises.
Role and Responsibilities:
The Data Platform Engineer at Niyati Tech will play a crucial role in driving insights from data accelerating machine learning at scale and building innovative AI workflows. The responsibilities include building highlyscalable and secure data infrastructure developing transformation systems for various data stores and building tools and applications to streamline data management and access. The role also involves reviewing and influencing design and architecture with stability maintainability and scale in mind identifying patterns providing solutions to a class of problems and handling dependencies with minimal oversight.
The Data Platform Engineer at Niyati Tech will play a crucial role in driving insights from data accelerating machine learning at scale and building innovative AI workflows. The responsibilities include building highlyscalable and secure data infrastructure developing transformation systems for various data stores and building tools and applications to streamline data management and access. The role also involves reviewing and influencing design and architecture with stability maintainability and scale in mind identifying patterns providing solutions to a class of problems and handling dependencies with minimal oversight.
Candidate Qualifications:
The ideal candidate should have a good understanding of distributed systems scalability and availability along with at least 2 years of experience in Spark/Scala/Java 1 year of experience in Kafka and Flint/Spark Streaming 2 years of experience in Airflow and experience in building ETL pipelines on a large scale. Strong database and storage fundamentals experience with cloud deployments and basic working knowledge of Kubernetes are also required.
The ideal candidate should have a good understanding of distributed systems scalability and availability along with at least 2 years of experience in Spark/Scala/Java 1 year of experience in Kafka and Flint/Spark Streaming 2 years of experience in Airflow and experience in building ETL pipelines on a large scale. Strong database and storage fundamentals experience with cloud deployments and basic working knowledge of Kubernetes are also required.
Required Skills:
- Airflow
- Pyspark
- Spark/Scala/Java
kubernetes,redis,gcp,data streaming,data analysis,java,amazon dynamodb,pyspark,machine learning,airflow,nosql,generative ai,llms,kafka,aws,flink,etl,sparksql,scala,distributed systems
Employment Type
Full Time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
