The International Stores Finance Central Tech team is looking for a passionate and solution oriented Data Engineer to design and implement the complex ETL pipelines and other BI solutions to support the rapidly growing and dynamic business demand for data and use it to deliver the data as service which will have an immediate influence on daytoday decision making at
As a Data Engineer you should excel in the design creation management and business use of extremely large datasets. You should have excellent business and communication skills to be able to work with business analysts and engineers to determine how best to design the data warehouse for reporting and analytics. You will be responsible for designing and implementing scalable ETL processes in the AWS platform to support the rapidly growing and dynamic business demand for data and use it to deliver the data as service which will have an immediate influence on daytoday decision making. You should have the ability to develop and tune SQL to provide optimized solutions to the business. You should be able to create data pipelines to pull data from different sources types and automate current manual process.
Key job responsibilities Design and develop the pipelines required for optimal extraction transformation and loading of data from a wide variety of data sources using SQL Python and AWS big data technologies. Oversee and continually improve production operations including optimizing data delivery redesigning infrastructure for greater scalability code deployments bug fixes and overall release management and coordination. Establish and maintain best practices for the design development and support of data integration solutions including documentation. Work closely with Finance customers DEs and BIEs to explore new data sources and deliver the data. Able to read write and debug data processing and orchestration code written Python/Scala etc following best coding standards (e.g. version controlled code reviewed etc.
3 years of data engineering experience Experience with data modeling warehousing and building ETL pipelines Experience with SQL
Experience with AWS technologies like Redshift S3 AWS Glue EMR Kinesis FireHose Lambda and IAM roles and permissions Experience with nonrelational databases / data stores (object storage document or keyvalue stores graph databases columnfamily databases)
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.