AWS Python Developer with Pyspark

Newark, DE - USA

Monthly Salary: Not Disclosed

Posted on: Yesterday

Vacancies: 1 Vacancy

Job Summary

Hello Folks
Hope you are doing good!

Please find the below requirement and let me know your interest
Title: Python Developer with AWS & Pyspark (Its backfill Role)
Location: New Jersey
Mode of work: Hybrid
Visa: GC GC EAD USC H4 EAD only
Looking for Local candidates only with 10years of experience and final round interview will be In-person interview

Job Summary:
We are seeking an experiencedPythonDeveloperwith strong expertise inAWSandPySparkto join our data engineering team. The ideal candidate will have hands-on experience developing scalable data pipelines processing large data sets and integrating with cloud-based environments. This role requires excellent problem-solving skills and a strong understanding of distributed data processing frameworks.

Key Responsibilities:

Design develop and maintaindata pipelinesandETL workflowsusingPythonPySpark andAWS services.
Build and optimize large-scaledata processinganddata transformationsolutions.
Integrate various data sources and ensure data quality performance and reliability.
Collaborate with data engineers analysts and architects to deliver end-to-end data solutions.
Implement best practices forcode optimizationerror handling anddata validation.
Participate in code reviews documentation and deployment automation.
Ensure adherence to data security and compliance standards.

Required Skills & Qualifications:

Bachelors degree in Computer Science Data Engineering or a related field.
10 years of experiencein software development with a strong focus onPython.
Hands-on experience withPySparkfor distributed data processing.
Solid understanding ofAWS cloud servicessuch asS3 Glue Lambda EMR Redshift and Athena.
Strong experience inETL developmentanddata pipeline orchestration.
Familiarity withSQLand relational/non-relational databases.
Excellent analytical debugging and communication skills.

Preferred Skills:

Experience withAirflowDatabricks or other workflow management tools.
Knowledge ofCI/CD pipelinesand version control tools likeGit.
Exposure todata lakeordata warehousearchitectures.
Familiarity withDockerorKubernetesfor deployment.

Thanks & Regards
Jagdish
Manager IT Staffing
Email ID: Phone: 1

6095 Marshalee Dr Suite 250 Elkridge MD 21075

Consulting Technology Development
Offices: Maryland Georgia India

Note: If you have received this message in error please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. Thank you

Required Experience:

Hello FolksHope you are doing good!Please find the below requirement and let me know your interestTitle: Python Developer with AWS & Pyspark (Its backfill Role)Location: New Jersey Mode of work: HybridVisa: GC GC EAD USC H4 EAD onlyLooking for Local candidates only with 10years of experience and fin...

Key Responsibilities:

Design develop and maintaindata pipelinesandETL workflowsusingPythonPySpark andAWS services.
Build and optimize large-scaledata processinganddata transformationsolutions.
Integrate various data sources and ensure data quality performance and reliability.
Collaborate with data engineers analysts and architects to deliver end-to-end data solutions.
Implement best practices forcode optimizationerror handling anddata validation.
Participate in code reviews documentation and deployment automation.
Ensure adherence to data security and compliance standards.

Required Skills & Qualifications:

Bachelors degree in Computer Science Data Engineering or a related field.
10 years of experiencein software development with a strong focus onPython.
Hands-on experience withPySparkfor distributed data processing.
Solid understanding ofAWS cloud servicessuch asS3 Glue Lambda EMR Redshift and Athena.
Strong experience inETL developmentanddata pipeline orchestration.
Familiarity withSQLand relational/non-relational databases.
Excellent analytical debugging and communication skills.