Data engineer will develop end-to-end analytics pipelines and build a world-class data platform deploying scalable business intelligence tools for the AGI team. The ideal candidate should demonstrate expertise in handling large-scale data operations and complex technical environments while maintaining strong business partnerships to drive strategic impact. The candidate will manage complete lifecycle from requirements gathering through implementation of interactive dashboards and reports. They will architect and implement large-scale data warehouse solutions utilizing SQL Distributed/MPP data storage Hadoop ecosystem and AWS services. The ideal candidate will design robust ETL processes and data models to support business intelligence initiatives while partnering with stakeholders to identify strategic opportunities where enhanced data infrastructure creates significant business value. They will support complex technical projects while maintaining attention to detail in fast-paced environments. The candidate will develop and maintain scalable BI solutions and interactive dashboards for data-driven decision making leveraging expertise in SQL data modeling ETL design AWS services Hadoop and dashboard tools like QuickSight.
Key job responsibilities Design implement and support a platform providing ad hoc access to large datasets Interface with other technology teams to extract transform and load data from a wide variety of data sources using SQL Implement data structures using best practices in data modeling ETL/ELT processes and SQL Oracle Redshift and OLAP technologies Model data and metadata for ad hoc and pre-built reporting Interface with business customers gathering requirements and delivering complete reporting solutions Build robust and scalable data integration (ETL) pipelines using SQL Python and Spark. Build and deliver high quality datasets to support business analyst and customer reporting needs. Continually improve ongoing reporting and analysis processes automating or simplifying self-service support for customers Participate in strategic & tactical planning discussions including annual budget processes
About the team AGI-DS holds a key position in the Generative intelligence space by being the provider of ground truth data for training the models that generate AI models.
- 1 years of data engineering experience - Experience with data modeling warehousing and building ETL pipelines - Experience with one or more query language (e.g. SQL PL/SQL DDL MDX HiveQL SparkSQL Scala) - Experience with one or more scripting language (e.g. Python KornShell)
- Experience with big data technologies such as: Hadoop Hive Spark EMR - Experience with any ETL tool like Informatica ODI SSIS BODI Datastage etc.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.