Data Engineer
Share
Job Location:
Dallas, IA - USA
Monthly Salary:
Not Disclosed
Posted on:
9 hours ago
Vacancies:
1 Vacancy
Job Summary
Role - Data Engineer
2 3 years of hands-on experience in Data Engineering
Strong experience in Python and PySpark/Spark for large-scale data processing
Experience working with Databricks and Delta Lake architecture
Good understanding of SQL (PostgreSQL) and NoSQL databases (MongoDB Redis)
Exposure to Kafka Streaming or real-time data processing frameworks
Experience with Azure or AWS cloud platforms
Understanding of data partitioning performance tuning and in-memory optimizations
Experience working in Linux/Unix environments
Knowledge of CI/CD pipelines and production deployment practices
Familiarity with REST APIs and application development concepts
Understanding of software design patterns and system architecture
Exposure to multi-user data platforms and access management
GenAI exposure (preferred): understanding of LLM workflows prompt versioning evaluation frameworks
Strong experience in Python and PySpark/Spark for large-scale data processing
Experience working with Databricks and Delta Lake architecture
Good understanding of SQL (PostgreSQL) and NoSQL databases (MongoDB Redis)
Exposure to Kafka Streaming or real-time data processing frameworks
Experience with Azure or AWS cloud platforms
Understanding of data partitioning performance tuning and in-memory optimizations
Experience working in Linux/Unix environments
Knowledge of CI/CD pipelines and production deployment practices
Familiarity with REST APIs and application development concepts
Understanding of software design patterns and system architecture
Exposure to multi-user data platforms and access management
GenAI exposure (preferred): understanding of LLM workflows prompt versioning evaluation frameworks
