Sr Data Engineer
Sr Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Zylo is the enterprise leader in SaaS Management enabling companies to discover manage and optimize their SaaS applications. Zylo helps companies reduce costs and minimize risk by centralizing SaaS inventory license and renewal management. Trusted by industry leaders Zylos AIpowered platform provides unmatched visibility into SaaS usage and spend. Powered by the industrys most intelligent discovery engine Zylo continuously uncovers hidden SaaS applications giving companies greater control over their SaaS portfolio. With more than 30 million SaaS licenses and $34 billion in SaaS spend under management Zylo delivers the deepest insights backed by more data than any other provider.
Overview
Our Senior Data Engineer will be responsible for designing implementing and maintaining scalable data pipelines that efficiently collect process and store data for analysis. You will work closely with a data scientist software engineers analysts and other stakeholders to ensure that the data infrastructure supports business intelligence machine learning and other datadriven solutions.
What will you do
- Data Pipeline Development: Design build and maintain robust and scalable data pipelines to extract transform and load (ETL) data from various sources to data warehouses or data lakes.
- Data Integration: Integrate data from multiple internal and external sources into centralized storage systems while ensuring data quality and consistency.
- Database Management: Manage large datasets and databases ensuring their security performance and scalability.
- Data Modeling: Create and optimize data models to support analytics reporting and machine learning workloads.
- Optimization and Performance: Continuously monitor and improve the performance reliability and efficiency of the data pipeline infrastructure.
- Data Quality: Implement measures to maintain data integrity cleanliness and consistency across all systems.
- Automation: Automate manual data tasks to streamline data workflows and reduce manual intervention.
- Documentation: Document data processes pipeline configurations and data flow designs for team collaboration and future reference.
- For this position candidates must live within the Greater Indianapolis area. Zylo has a hybrid work environment with an inoffice schedule 2x/week.
- 5 years of experience as a Data Engineer Software Engineer with a data focus or a similar role with a proven track record of designing and building data pipelines at scale.
- Strong experience in ETL processes data modeling and managing large datasets in cloud environments.
- Proficiency with AWS services (e.g. EC2 S3 Athena Glue SageMaker Redshift) and a solid understanding of cloud data architecture.
- Expertise in Python and SQL with a focus on developing scalable maintainable code to support data transformation and processing tasks.
- Experience with orchestration tools (e.g. Fivetran Apache Airflow) to automate and schedule ETL/ELT workflows.
- Solid understanding of data warehouses (Redshift Snowflake BigQuery) and data lakes (e.g. AWS S3 for largescale data storage and retrieval.
- Experience with streaming data tools like Kafka and Apache Flink to handle realtime data flows.
- Experience with distributed data/computing tools such as Hadoop Hive or Spark.
- Familiarity with data governance principles including data retention RBAC and security best practices.
- Soft Skills:
- Strong problemsolving skills with an eye for detail and datadriven decisionmaking.
- Excellent communication and collaboration skills with the ability to work seamlessly across teams (Data Scientists Engineers Analysts).
- Selfmotivated with the ability to prioritize and manage multiple tasks in a fastpaced everchanging environment.
- Comfortable with both independent work and contributing as part of a crossfunctional team.
Nice to have
- Exposure to SaaS Management or Software Asset Management environments
- Data visualization experience (e.g. Tableau PowerBI Looker) to communicate complex data insights
- Familiarity with machine learning frameworks like TensorFlow Keras or PyTorch.
- Familiarity with Azure or other cloud platforms
What its like to work with us
At Zylo were committed to Growing Stronger Together by fostering a diverse and inclusive workplace. We believe that a variety of perspectives not only fuels innovation but also allows us to better serve our diverse customer base. If you meet the essential qualifications we encourage you to apply and join us on this journey. Still growing in your career Connect with our talent communitywere always looking for future Zylos who share our passion for continuous learning.
Required Experience:
Senior IC
Employment Type
Full Time
