Lead Data Engineer (AWS)

VDart Inc

Not Interested
Bookmark
Report This Job

profile Job Location:

Jersey, NJ - USA

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

Job Title: Lead Data Engineer (AWS)

Location: Jersey City NJ (Hybrid)

Job Type: Fulltime


Responsibilities:

  • Lead the design development and implementation of data solutions using AWS and Snowflake.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Develop and maintain data pipelines ensuring data quality integrity and security.
  • Optimize data storage and retrieval processes to support data warehousing and analytics.
  • Provide technical leadership and mentorship to junior data engineers.
  • Work closely with stakeholders to gather requirements and deliver data-driven insights.
  • Ensure compliance with industry standards and best practices in data engineering.
  • Utilize knowledge of insurance particularly claims and loss to enhance data solutions.


Skills:

  • Snowflake expertise (hands-on & architectural understanding) challenging situation in the project(most common question)this must be data related or implementation related only
  • ETL/Data Management proficiency mastery in: Query optimization data quality performance tuning big data problems RBAC row/column-level security CDC Incremental vs Batch Unix commands job scheduling CI/CD pipeline
  • Team leadership (8-10 members) End-to-end project implementation with clarity complex challenges in the project describe the specific problem and its solution
  • Excellent communication skills
  • Stakeholder management & cross-functional collaboration (knowledge on data quality checks profiling STTM data integration from multiple sources reusable framework)
  • Release planning change management training KT L2/L3 support
  • Apache Iceberg AWS glue good to have
  • 10 years of relevant experience in Data Engineering and delivery.
  • 10 years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
  • Strong experience with SQL python and Pyspark
  • Good understanding of Data ingestion and data processing frameworks
  • Good experience in Snowflake SQL AWS (glue EMR S3 Aurora RDS AWS architecture)
  • Good aptitude strong problem-solving abilities analytical skills and ability to take ownership as appropriate.
  • Should be able to do coding debugging performance tuning and deploying the apps to the Production environment.
  • Experience working in Agile Methodology

Job Title: Lead Data Engineer (AWS) Location: Jersey City NJ (Hybrid) Job Type: Fulltime Responsibilities: Lead the design development and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them int...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala