Data Engineer
Data Engineer
Posted on :
22-05-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Data Engineer with Python development experience
Experience: 3 Years
Mode: Hybrid (23 days/week)
Location:
Key Responsibilities
- Develop test and deploy data processing pipelines using AWS Serverless technologies such as AWS Lambda Step Functions DynamoDB and S3.
- Implement ETL processes to transform and process structured and unstructured data eiciently.
- Collaborate with business analysts and other developers to understand requirements and deliver solutions that meet business needs.
- Write clean maintainable and welldocumented code following best practices.
- Monitor and optimize the performance and cost of serverless applications.
- Ensure high availability and reliability of the pipeline through proper design and error handling mechanisms.
- Troubleshoot and debug issues in serverless applications and data workows.
- Stay uptodate with emerging technologies in the AWS and serverless ecosystem to recommend improvements.
Required Skills and Experience - 35 years of handson Python development experience including experience with libraries like boto3 Pandas or similar tools for data processing.
- Strong knowledge of AWS services especially Lambda S3 DynamoDB Step Functions SNS SQS and API Gateway.
- Experience building data pipelines or workows to process and transform large datasets.
- Familiarity with serverless architecture and eventdriven programming.
- Knowledge of best practices for designing secure and scalable serverless applications.
- Prociency in version control systems (e.g. Git) and collaboration tools.
- Understanding of CI/CD pipelines and DevOps practices.
Strong debugging and problemsolving skills. - Familiarity with database systems both SQL (e.g. RDS) and NoSQL (e.g. DynamoDB).
Preferred Qualications - AWS certications (e.g. AWS Certied Developer Associate or AWS Certied Solutions Architect Associate).
- Familiarity with testing frameworks (e.g. pytest) and ensuring test coverage for Python applications.
- Experience with Infrastructure as Code (IaC) tools such as AWS CDK CloudFormation.
- Knowledge of monitoring and logging tools .
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
