Data Engineer Senior Data Engineer
Data Engineer Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Collaborate with business stakeholders and other technical team members to acquire and migrate data sources that are most relevant to business needs and goals.
Demonstrate deep technical and domain knowledge of relational and nonrelational databases Data Warehouses Data lakes among other structured and unstructured storage options.
Determine solutions that are best suited to develop a pipeline for a particular data source.
Develop data flow pipelines to extract transform and load data from various data sources in various forms including custom ETL pipelines that enable model and product development.
Write custom scripts to extract data from unstructured / semistructured sources.
Provide clear documentation for delivered solutions and processes integrating documentation with the appropriate corporate stakeholders.
Identify and implement internal process improvements for data management (automating manual processes optimizing data delivery redesigning infrastructure for greater scalability).
Stay current with and adopt new tools and applications to ensure high quality and efficient solutions.
Requirements
Build a crossplatform data strategy to aggregate multiple sources and process development datasets.
Proven work experience as a Data Engineer or a similar role focusing on data pipeline development API integration database design and data management.
Strong expertise in Azure cloud services particularly Azure Data Factory (ADF) Azure SQL Database Azure Blob Storage Azure Databricks.
Proficient in SQL and Python programming and experience working with relational databases data warehousing and data modelling concepts.
Experience with API integration including RESTful APIs data extraction and data ingestion from external systems.
Solid understanding of ETL processes data integration and data transformation techniques.
Proficiency in Python programming and experience with data manipulation automation and scripting tasks.
Strong problemsolving and analytical skills with the ability to identify and resolve complex data related issues
Benefits
Competitive salary and performancebased bonuses.
Comprehensive insurance plans.
Collaborative and supportive work environment.
Chance to learn and grow with a talented team.
A positive and fun work environment.
Analysis of both high-level and granular (category and/or product specific) business trends Experience in data processing, data analysis, and automation. Strong proficiency in Excel/Sheets, SQL, and data visualization tools. Experience in Python or R language. Exposure to using Hive or Presto for data processing. Ability to analyze complex datasets and provide actionable insights. Strong communication skills and experience in documenting and presenting data findings.
Employment Type
Full Time
