Data Engineer III

OVERVIEW/SUMMARY

The Product Analytics team at Client's is on a transformational journey to unlock the full potential of enterprise data, build a dynamic, diverse, and inclusive culture and develop a modern cloud-based data lake architecture to scale our applications, and drive growth using data and machine learning. Our objective is to enable the enterprise to unleash the potential of data through innovation and agile thinking, and to execute on an effective data strategy to transform business processes, rapidly accelerate time to market and enable insightful decision making.

JOB OVERVIEW AND RESPONSIBILITIES

• In this role you will partner with various teams to define and execute data acquisition, storage, transformation, processing and make data actionable for operational and analytics initiatives that create sustainable revenue and share growth. This role requires expertise in Client's data sources and technology business intuition, and a working knowledge of data transformation and analytical tools.
• Manage data integration and technology projects across the various platforms that comprise Client's data strategy
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, storage, transformation, and loading (ETL) of data from a wide variety of data sources
• Work with stakeholders including the Senior management, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Build and maintain databases, data pipelines, and data warehouses that provide a comprehensive understanding of the business.
• Execute unit tests and validating expected results to ensure accuracy & integrity of data and applications through analysis, coding, writing clear documentation and problem resolution.
• Leverage technical and analytical skills to understand and solve business centric questions
• Coordinate and guide cross-functional projects that involve team members across all areas of the enterprise, vendors, external agencies, and partners
• Ability to manage multiple deliverables both short and long-term in a busy and aggressive environment, while staying flexible to dynamic needs and priority levels
• Manage agile development and delivery by collaborating with project manager, product owner and development leads

REQUIRED Skills:

• 5+ years of experience in data engineering or ETL development role
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with structure, semi- structure, and unstructured datasets.
• Experience with Teradata, SQL server, etc.
• Experience with AWS cloud services: Redshift, S3, Athena, etc.
• Experience with Databricks and lakehouse architecture
• Passionate about solving problems through data and analytics, and creating data products including data models
• Strong initiative to take ownership of data-focused projects, get involved in the details of validation and testing, as well as provide a business user perspective to their work
• Ability to communicate complex quantitative concepts in a clear, precise, and actionable manner
• Proven proficiency with Microsoft Excel and PowerPoint
• Strong problem-solving skills, using data to tackle problems
• Outstanding writing, communication, and presentation skills

PREFERRED

• Experience with Quantum Metrics and Akamai
• Experience with languages: Python, R, etc.
• Strong experience with continuous integration & delivery using Agile methodologies
• Data engineering experience with transportation/airline industry
• Strong problem-solving skills

Qualifications:

• Bachelor's degree in quantitative field (statistics, software engineering, business analytics, information systems, aviation management or related degree)
• Master's degree