Data Engineer(AWS) Associate - Operate
Data Engineer(AWS) Associate - Operate
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Industry/Sector
Not ApplicableSpecialism
Managed ServicesManagement Level
AssociateJob Description & Summary
At PwC our people in managed services focus on a variety of outsourced solutions and support clients across numerous functions. These individuals help organisations streamline their operations reduce costs and improve efficiency by managing key processes and functions on their behalf. They are skilled in project management technology and process optimization to deliver high-quality services to clients.Those in managed service management and strategy at PwC will focus on transitioning and running services along with managing delivery teams programmes commercials performance and delivery risk. Your work will involve the process of continuous improvement and optimising of the managed services process tools and services.
Driven by curiosity you are a reliable contributing member of a team. In our fast-paced environment you are expected to adapt to working with a variety of clients and team members each presenting varying challenges and scope. Every experience is an opportunity to learn and grow. You are expected to take ownership and consistently deliver quality work that drives value for our clients and success as a team. As you navigate through the Firm you build a brand for yourself opening doors to more opportunities.
Examples of the skills knowledge and experiences you need to lead and deliver value at this level include but are not limited to:
- Apply a learning mindset and take ownership for your own development.
- Appreciate diverse perspectives needs and feelings of others.
- Adopt habits to sustain high performance and develop your potential.
- Actively listen ask questions to check understanding and clearly express ideas.
- Seek reflect act on and give feedback.
- Gather information from a range of sources to analyse facts and discern patterns.
- Commit to understanding how the business works and building commercial awareness.
- Learn and apply professional and technical standards (e.g. refer to specific PwC tax and audit guidance) uphold the Firms code of conduct and independence requirements.
Job Title:Data Engineer Offshore
KEY SKILLS - Tera Data data stage AWS Data Bricks SQL Delta Live tables Delta tables Spark - Kafka Spark Streaming MQ ETL
Summary: We are seeking an experienced Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in a variety of data technologies including Teradata DataStage AWS Databricks SQL and more. As a Data Engineer you will be responsible for designing implementing and maintaining scalable data pipelines and systems that support our data-driven initiatives.
Minimum Degree Required: Bachelors degree in computer science/IT or relevant field
Degree Preferred: Masters degree in computer science/IT or relevant field
Minimum Years of Experience: 3 - 5 year(s)
Certifications Required: NA
Key Responsibilities:
- Design develop and maintain scalable ETL pipelines using DataStage and other ETL tools.
- Leverage AWS cloud services for data storage processing and analytics.
- Utilize Databricks to analyze process and transform data ensuring high performance and reliability.
- Implement and optimize Delta Live Tables and Delta Tables for efficient data storage and querying.
- Work with Apache Spark to process large datasets ensuring optimal performance and scalability.
- Integrate Kafka and Spark Streaming to build real-time data processing applications.
- Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs.
- Ensure data quality integrity and security across all data systems and pipelines.
- Monitor and troubleshoot data workflows to ensure smooth operations.
- Document data processes architecture designs and technical specifications.
Qualifications:
- Bachelors degree in Computer Science Information Technology or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL and experience with relational databases such as Teradata.
- Hands-on experience with AWS services such as S3 EMR Redshift and Lambda.
- Proficiency in using Databricks for data engineering tasks.
- Experience with Delta Live Tables and Delta Tables in a data engineering context.
- Solid understanding of Apache Spark Kafka and Spark Streaming.
- Experience with messaging systems like MQ is a plus.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
Preferred Skills:
- Experience with data warehousing and big data technologies.
- Familiarity with data governance and data security best practices.
- Certification in AWS or Databricks is a plus.
Travel Requirements
Not SpecifiedJob Posting End Date
Required Experience:
IC
Employment Type
Full-Time
