A leading brand in retail is seeking a Data Engineer to assist in designing and implementing scalable processes for managing large data sets. This is an exciting opportunity to work with cuttingedge technology and have a direct impact on the business.
Key Responsibilities: Designing and implementing scalable processes to manage large data sets ensuring quality and consistency across sources. This involves developing and maintaining data pipelines creating optimal extraction patterns and aligning cloud strategy with data architecture. As the Data Engineer you will also engineer data formats for analytics develop APIs for applications and collaborate with stakeholders to deliver solutions while driving process improvements enhancing scalability and supporting testing and deployment of new features.
Minimum Requirements:
At least 4 years of relevant data engineering experience
Bachelors degree in computer science business informatics mathematics statistics engineering or related field
Strong understanding of data structures algorithms and software design
Experience with structured and unstructured data data stores RDBMS and data warehouses
Proficiency in cloud tools (e.g. Redshift Athena Glue Lambda)
Proficiency in programming languages such as Python Scala Java or C
Experience with Apache Spark and cloud services (AWS Azure GCP)
Knowledge of version control systems like Git and SVN
Familiarity with DevOps practices including CI/CD and Infrastructure as Code
Exposure to AWS platform environments such as CodePipeline CodeBuild CodeDeploy
Experience with big data ETL and data management processes
Experience in API development and cloud architecture
Strong analytical and problemsolving abilities
Ability to work collaboratively in an agile environment
Additional Skills & Attributes needed:
Ability to work effectively with crossfunctional teams
Strong communication skills to articulate complex data concepts to nontechnical stakeholders
Continuous learning mindset and commitment to professional development
Innovative thinking and flexibility to adapt to changing business needs
Integrity accountability and strong work ethic
Enthusiasm for experimenting with new technologies and methodologies
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.