Data Engineer

Job Description: BFS

*THIS ROLE IS HYBRID IN COLUMBUS OH. 3 DAYS ONSITE*
MAX BILL RATE: $75

Job Title: Data Engineer
Experience: 6 to 8 Yrs.

Job Summary: Seeking a highly skilled Data Engineer with 68 years of experience in PySpark and AWS.

Roles & Responsibilities:
1. Collaborate with crossfunctional teams to understand data requirements and establish seamless connections with external vendors.
2. Develop and implement robust data acquisition strategies ensuring data quality integrity and security.
3. Lead the design and implementation of data cleansing and transformation process to align vendor data with internal standards and structures.
4. Utilize internal tools and SDKs for efficient data integration and processing focusing on scalability and performance optimization.
5. Implement and manage agents for monitoring logging and automation within AWS environments.
6. Work with Amazon SNS for efficient notification and communication workflows.
7. Work with other AWS services including S3 Athena and Glue to optimize data storage querying and processing.
8. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management.
9. Collaborate with the data engineering team to continuously improve data integration pipelines ensuring adaptability to evolving business needs.
Additional Sills: Skills: No items to display.