Data Engineer
Share
Job Location:
New York City, NY - USA
Monthly Salary:
Not Disclosed
Posted on:
10 hours ago
Vacancies:
1 Vacancy
Job Summary
Data Engineer
- Role: Data Engineer (6 months W2 only)
- Location: NYC NY (3 days onsite per week) - F2F interview
- Core Requirement: Horizon Core Banking knowledge is essential; experience with core banking systems required
- Technical Skills:
- Proficient in Python (read and write)
- Strong experience with Databricks for building scalable data pipelines
- Data processing tools: SQL Python Spark
- Experience with Azure and cloud integrations with Databricks
- Knowledge of ETL tools and data architecture principles
- Data Focus:
- Strong understanding of data quality data cleansing transformation and aggregation
- Ensures data integrity security and compliance with regulations
- Collaboration & Communication:
- Works closely with data scientists analysts and business stakeholders to deliver data solutions
- Effective communicator and team player
- Responsibilities:
- Design develop and maintain scalable data pipelines and architectures
- Implement data management best practices for storage retrieval and performance optimization
- Monitor troubleshoot and document data processes
- Stay updated on latest data engineering and Databricks advancements
- Perform other related duties as assigned
- Qualifications:
- Bachelors degree in CS IT Engineering or related field (or equivalent experience)
- 3 years experience as a Data Engineer with proven Databricks expertise
- Strong problem-solving and multitasking abilities
- Role: Data Engineer (6 months W2 only)
- Location: NYC NY (3 days onsite per week) - F2F interview
- Core Requirement: Horizon Core Banking knowledge is essential; experience with core banking systems required
- Technical Skills:
- Proficient in Python (read and write)
- Strong experience with Databricks for building scalable data pipelines
- Data processing tools: SQL Python Spark
- Experience with Azure and cloud integrations with Databricks
- Knowledge of ETL tools and data architecture principles
- Data Focus:
- Strong understanding of data quality data cleansing transformation and aggregation
- Ensures data integrity security and compliance with regulations
- Collaboration & Communication:
- Works closely with data scientists analysts and business stakeholders to deliver data solutions
- Effective communicator and team player
- Responsibilities:
- Design develop and maintain scalable data pipelines and architectures
- Implement data management best practices for storage retrieval and performance optimization
- Monitor troubleshoot and document data processes
- Stay updated on latest data engineering and Databricks advancements
- Perform other related duties as assigned
- Qualifications:
- Bachelors degree in CS IT Engineering or related field (or equivalent experience)
- 3 years experience as a Data Engineer with proven Databricks expertise
- Strong problem-solving and multitasking abilities
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
