AWS Data Engineer

AWS Data Engineer Qualifications:

Locations: Raleigh NC or Foster city CA United States.

• This position requires a Bachelors Degree in Computer Science or a related technical field and 5 years of relevant employment experience
• 5 years of work experience with ETL Data Modeling and Data Architecture
• Expertlevel skills in writing and optimizing SQL
• Expertise in ETL optimization designing coding and tuning big data processes using Apache Spark or similar technologies
• Experience with Big Data technologies such as Hadoop/Hive/Spark
• Experience operating very large data warehouses or data lakes
• Experience of delivering CI/CD and DevOps capabilities in a data environment
• Experience with building data pipelines and applications to stream and process datasets
• Experience in Python
• Show efficiency in handling data tracking data lineage ensuring data quality and improving discoverability of data
• Sound knowledge of distributed systems and data architecture (lambda) design and implement batch and stream data processing pipelines knows how to optimize the distribution partitioning and MPP of highlevel data structures
• Can clearly articulate Enterprise Standards & Operational Governance mechanisms that can be builtin for each layer of AWS Cloud data and analytics (Ingestion Transformation Consumption Governance Business touchpoints)
• Technical knowledge on EC2 IAM S3 VPC Lambda Glue
• AWS Certified Solution Architect Professional OR AWS Certified Solution Architect Associate
• Good knowledge and experience in Lifesciences (Commercial Managed Markets domains)
• Excellent communication skills