Position- Senior Data Engineer
Location- Mclean VA
Duration- Till end of this year
Experience- 7
Roles & Responsibilities
JD:
Job requirements
-
3 years of hands-on experience in production support for data engineering or analytics applications.
-
Proficiency in PySpark for managing and troubleshooting data processing jobs.
-
Solid experience with AWS cloud services including EKS (Elastic Kubernetes Service) and EMR (Elastic MapReduce) S3 Glue Step Function.
-
Hands-on experience with Control-M for workflow orchestration and monitoring.
-
Working knowledge of MongoDB and Snowflake for production data management.
-
Experience with log monitoring and analysis using Elasticsearch Service (ESS).
-
Good understanding of ETL processes incident management and production monitoring best practices.
-
Strong problem-solving troubleshooting and analytical skills.
-
Excellent communication and collaboration abilities.
Responsibilities
-
Provide production support for data pipelines and workflows ensuring high availability and timely resolution of incidents.
-
Monitor troubleshoot and optimize PySpark-based data processing jobs.
-
Support and maintain data processing applications deployed on AWS services including EKS and EMR.
-
Manage and orchestrate workflows using Control-M including scheduling monitoring and error handling.
-
Perform root cause analysis and implement permanent fixes for recurring production issues.
-
Oversee data storage and management in MongoDB and Snowflake ensuring data quality and consistency.
-
Monitor and analyze application and system logs using Elasticsearch Service (ESS) to proactively identify and resolve issues.
-
Collaborate with data engineering analytics and operations teams to deliver reliable data solutions.
-
Maintain and update technical documentation related to production support processes and incident management.
-
Participate in on-call rotations and respond to critical production alerts as needed.
Essentials skills - Strong AWS Spark - Pyspark SQL SQL (Basic Advanced) Python Hive Data Modelling Fundamentals EKSEMR.
Thanks & Regarding
Vishal Gautam Technical Recruiter
Momento USA Exceeding Customer Expectations
440 Beningo Blvd Unit#A-5 2nd Floor Bellmawr NJ 08031
Interstate Business Park.
(About US )
Exceeding customer expectations.
Desk - / Extn 1011
Email: vishal@ Linkedin - (
Minority Certified by SWAM
National Minority Certified by NMSDC
One of the fastest growing company in NJ
Awarded fastest growing Asian American business by
E-verified Company
Information transmitted by this e-mail is proprietary to Momento USA and/ or its Customers and is intended for use only by the individual or entity to which it is addressed and may contain information that is privileged confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority you are notified that any use or dissemination of this information in any manner is strictly such cases please notify us immediately at and delete this mail from your records.
Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex pregnancy sexual orientation gender identity national origin age protected veteran status or disability status.
Position- Senior Data Engineer Location- Mclean VA Duration- Till end of this year Experience- 7 Roles & Responsibilities JD: Job requirements 3 years of hands-on experience in production support for data engineering or analytics applications. Proficiency in PySpark for managing and troublesh...
Position- Senior Data Engineer
Location- Mclean VA
Duration- Till end of this year
Experience- 7
Roles & Responsibilities
JD:
Job requirements
-
3 years of hands-on experience in production support for data engineering or analytics applications.
-
Proficiency in PySpark for managing and troubleshooting data processing jobs.
-
Solid experience with AWS cloud services including EKS (Elastic Kubernetes Service) and EMR (Elastic MapReduce) S3 Glue Step Function.
-
Hands-on experience with Control-M for workflow orchestration and monitoring.
-
Working knowledge of MongoDB and Snowflake for production data management.
-
Experience with log monitoring and analysis using Elasticsearch Service (ESS).
-
Good understanding of ETL processes incident management and production monitoring best practices.
-
Strong problem-solving troubleshooting and analytical skills.
-
Excellent communication and collaboration abilities.
Responsibilities
-
Provide production support for data pipelines and workflows ensuring high availability and timely resolution of incidents.
-
Monitor troubleshoot and optimize PySpark-based data processing jobs.
-
Support and maintain data processing applications deployed on AWS services including EKS and EMR.
-
Manage and orchestrate workflows using Control-M including scheduling monitoring and error handling.
-
Perform root cause analysis and implement permanent fixes for recurring production issues.
-
Oversee data storage and management in MongoDB and Snowflake ensuring data quality and consistency.
-
Monitor and analyze application and system logs using Elasticsearch Service (ESS) to proactively identify and resolve issues.
-
Collaborate with data engineering analytics and operations teams to deliver reliable data solutions.
-
Maintain and update technical documentation related to production support processes and incident management.
-
Participate in on-call rotations and respond to critical production alerts as needed.
Essentials skills - Strong AWS Spark - Pyspark SQL SQL (Basic Advanced) Python Hive Data Modelling Fundamentals EKSEMR.
Thanks & Regarding
Vishal Gautam Technical Recruiter
Momento USA Exceeding Customer Expectations
440 Beningo Blvd Unit#A-5 2nd Floor Bellmawr NJ 08031
Interstate Business Park.
(About US )
Exceeding customer expectations.
Desk - / Extn 1011
Email: vishal@ Linkedin - (
Minority Certified by SWAM
National Minority Certified by NMSDC
One of the fastest growing company in NJ
Awarded fastest growing Asian American business by
E-verified Company
Information transmitted by this e-mail is proprietary to Momento USA and/ or its Customers and is intended for use only by the individual or entity to which it is addressed and may contain information that is privileged confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority you are notified that any use or dissemination of this information in any manner is strictly such cases please notify us immediately at and delete this mail from your records.
Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex pregnancy sexual orientation gender identity national origin age protected veteran status or disability status.
View more
View less