Job title : Data Engineer with Credit Card
Job type : Contract
Job Location : Mount Laurel NJ; Detroit Michigan; New York NY (4 days office)
Required Skills & Experience:
- 8 years of experience in data engineering including lead or senior-level experience.
- Strong proficiency with SQL relational databases and NoSQL technologies.
- Hands-on experience with Hadoop ecosystem (HDFS Hive HBase) Apache Spark and Kafka.
- Proven experience designing and implementing ETL/ELT processes using modern tools and frameworks.
- Solid understanding of data modeling data warehousing and data lake architectures.
- Proficiency in Python Scala or Java for data processing and automation.
- Experience with cloud data platforms (AWS Azure GCP) and distributed computing frameworks.
- Knowledge of data governance metadata management and security best practices.
- Strong analytical problem-solving and leadership skills.
Key Responsibilities:
- Lead the design and implementation of data ingestion transformation and storage pipelines using modern data engineering tools and frameworks.
- Architect and maintain relational (Oracle SQL Server PostgreSQL) and NoSQL (MongoDB Cassandra DynamoDB) databases.
- Develop and manage data models ensuring data integrity consistency and optimized query performance.
- Build and orchestrate ETL/ELT pipelines using Spark Kafka Hive and Hadoop ecosystems.
- Ensure data security governance and compliance across all data environments.
- Collaborate with data scientists analysts and application teams to enable efficient data consumption and analytics.
- Monitor and optimize performance of data workflows and streaming pipelines.
- Mentor junior engineers and enforce best practices for data engineering and coding standards.
Job title : Data Engineer with Credit Card Job type : Contract Job Location : Mount Laurel NJ; Detroit Michigan; New York NY (4 days office) Required Skills & Experience: 8 years of experience in data engineering including lead or senior-level experience. Strong proficiency with SQL relational data...
Job title : Data Engineer with Credit Card
Job type : Contract
Job Location : Mount Laurel NJ; Detroit Michigan; New York NY (4 days office)
Required Skills & Experience:
- 8 years of experience in data engineering including lead or senior-level experience.
- Strong proficiency with SQL relational databases and NoSQL technologies.
- Hands-on experience with Hadoop ecosystem (HDFS Hive HBase) Apache Spark and Kafka.
- Proven experience designing and implementing ETL/ELT processes using modern tools and frameworks.
- Solid understanding of data modeling data warehousing and data lake architectures.
- Proficiency in Python Scala or Java for data processing and automation.
- Experience with cloud data platforms (AWS Azure GCP) and distributed computing frameworks.
- Knowledge of data governance metadata management and security best practices.
- Strong analytical problem-solving and leadership skills.
Key Responsibilities:
- Lead the design and implementation of data ingestion transformation and storage pipelines using modern data engineering tools and frameworks.
- Architect and maintain relational (Oracle SQL Server PostgreSQL) and NoSQL (MongoDB Cassandra DynamoDB) databases.
- Develop and manage data models ensuring data integrity consistency and optimized query performance.
- Build and orchestrate ETL/ELT pipelines using Spark Kafka Hive and Hadoop ecosystems.
- Ensure data security governance and compliance across all data environments.
- Collaborate with data scientists analysts and application teams to enable efficient data consumption and analytics.
- Monitor and optimize performance of data workflows and streaming pipelines.
- Mentor junior engineers and enforce best practices for data engineering and coding standards.
View more
View less