Data Engineer
Data Engineer
Posted on :
09-02-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
09-02-2024
Job Description
Req ID : 2519018
Responsibilities:
Data Strategy and Alignment
Work closely with data analysts and business / product teams to understand requirements and provide
data ready for analysis and reporting.
Apply help define and champion data governance: data quality testing documentation coding best
practices and peer reviews.
Continuously discover transform test deploy and document data sources and data models.
Work closely with the Infrastructure team to build and improve our Data Infrastructure.
Develop and execute data roadmap (and sprints) with a keen eye on industry trends and direction.
Data Stores and System Development
Design and implement highperformance reusable and scalable data models for our data warehouse to
ensure our endusers get consistent and reliable answers when running their own analyses.
Focus on test driven design and results for repeatable and maintainable processes and tools.
Create and maintain optimal data pipeline architecture and data flow logging framework.
Build the data products features tools and frameworks that enable and empower Data and Analytics
teams across Porter.
Project Management
Drive project execution using effective prioritization and resource allocation.
Resolve blockers through technical expertise negotiation and delegation.
Strive for ontime complete solutions through standups and coursecorrection.
Team Management
Manage and elevate team of 58 members.
Do regular oneonones with teammates to ensure resource welfare.
Periodic assessment and actionable feedback for progress.
Recruit new members with a view to longterm resource planning through effective collaboration with the
hiring team.
Process design
Set the bar for the quality of technical and databased solutions the team ships.
Enforce code quality standards and establish good code review practices using this as a nurturing tool.
Set up communication channels and feedback loops for knowledge sharing and stakeholder management.
Explore the latest best practices and tools for constant upskilling.
Data Engineering Stack:
Analytics: Python / R / SQL Excel / PPT Google Colab
Database: PostgreSQL Amazon Redshift DynamoDB Aerospike
Warehouse: Redshift S3
ETL: Airflow DBT Custommade Python Amundsen (Discovery)
Business Intelligence / Visualization: Metabase Google Data Studio
Frameworks: Spark Dash StreamLit
Collaboration: Git Notion
Requirements:
Industry experience of minimum 7 years (5 years in data engineering role)
Experience managing a team of at least 4 developers endtoend
Strong handson data modeling and data warehousing skills
Strong technical background and ability to contribute to design and review
Strong experience applying software engineering best practices to data and analytics scope (e. g. version
control testing and CI/CD)
Strong attention to detail to highlight and address data quality issues
Excellent time management and proactive problemsolving skills to meet critical deadlines
Familiarity (expertise preferred) with our current or a similar analytics stack
etl,data warehousing,snowflake,sql,python,cloud,data engineering
Employment Type
Full Time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
