Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Sr. Data Engineer
At Storable were on a mission to power the future of storage. Our innovative platform helpsbusinesses manage track and grow their self-storage operations and were looking for a DataEngineer to join our data-driven team. Storable is committed to leveraging cutting-edgetechnologies to improve the efficiency accessibility and insights derived from data empoweringour team to make smarter decisions and foster impactful a Data Engineer you will play a pivotal role in shaping our data operations ensuring that ourdata is organized accessible and effectively managed across the organization. You will workclosely with cross-functional teams and drive the development of strategies to enhance dataquality availability and security.
Key Responsibilities:
Oversee Data Pipelines: Design implement and maintain scalable data pipelines usingindustry-standard tools to efficiently process and manage large-scale datasets.
Ensure Data Quality & Governance: Implement data governance policies andframeworks to ensure data accuracy consistency and compliance across theorganization.
ETL Development: Build optimize and maintain ETL pipelines for ingestingtransforming and delivering large datasets from multiple sources.
Workflow Orchestration: Manage and schedule complex workflows using Apache Airflow.
Query Engines & Processing Frameworks: Leverage Trino (Presto) Apache Spark andother
Manage Cross-Functional Collaboration: Partner with engineering product andbusiness teams to make data accessible and actionable and ensure it drives informeddecision-making.
Optimize Data Infrastructure: Leverage modern data tools and platforms (e.g. AWSApache Airflow Apache Iceberg) to create an efficient reliable and scalable datainfrastructure.
Monitor & Improve Performance: Proactively monitor data processes and workflowstroubleshoot issues and optimize performance to ensure high reliability and dataintegrity.
Qualifications:
Proven Expertise in Data Management: 6 years of significant experience in managingdata infrastructure data governance and optimizing data pipelines at scale.
Technical Proficiency: 5 years of strong hands-on experience with data tools andplatforms such as Apache Airflow Apache Iceberg and AWS services (S3 LambdaRedshift Glue Athena).
Data Pipeline Mastery: Familiarity with designing implementing and optimizing datapipelines and workflows in Python or other languages for data processing.
5 years of hands-on experience with Trino/Presto and Apache Spark for distributeddata processing.
Solid understanding of data modeling warehousing concepts and schema design.
Experience with Data Governance: Solid understanding of data privacy quality controland governance best practices.
Leadership Skills: Ability to lead and mentor teams influence stakeholders and drivedata initiatives across the organization.
Analytical Mindset: Strong problem-solving abilities and a data-driven approach toimprove business operations.
Excellent Communication: Ability to communicate complex data concepts to bothtechnical and non-technical stakeholders effectively.
Bonus Points: Experience with visualization tools (e.g. Looker Tableau) and reportingframeworks to provide actionable insights.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Storable's suite of self storage software delivers the industry’s most comprehensive management tools, access control and operation solutions to help storage operators grow their business.
