Senior Data Engineer (in person)
Share
Job Location:
Westfield, MA - USA
Monthly Salary:
Not Disclosed
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
Data is only as powerful as the foundation beneath it. At SEP were building that foundation and were looking for a Senior Data Engineer whos ready to lead the way.
Weve been partnering with companies to build software that matters since 1988. From Fortune 100 enterprises to fast-moving scale-ups our clients depend on us to tackle complexity deliver with craft and stay engaged through every stage of the work. Now were growing our data practice and we want someone whos as excited about clean connected trustworthy data as we are.
What we have to offer
- Variety on every axis tools technologies market sectors methodologies
- Flexible reasonable work schedules
- Extensive opportunities to learn and develop yourself
- A community of friendly talented and effective peers
- Opportunities to try outdifferent roleswith minimal risk
- Gorgeous facilities
What youll be doing
- Provide technical direction on data engagements and mentor other engineers
- Design and implement data pipelines and transformations (batch and streaming)
- Develop data models for analytics use cases
- Implement data quality checks and testing strategies for pipelines
- Configure and manage orchestration and workflow tooling
- Build andmaintaininfrastructure as code for data platforms
- Translate architectural direction into implementation plans
- Communicate progress risks and technical tradeoffs to stakeholders
- Support client meetings in a technical capacity
Key attributes for applicants
- A passion for great products software development and learning
- Expert-level SQL skills with strongproficiencyin Python; experience with Spark Scala R or C# is a plus
- Deepexpertisein data pipeline development including batch and streaming patterns
- Solid understanding of data modeling patterns for analytics (dimensional modeling data vaultlakehousearchitectures)
- Experience with cloud data platforms Azure preferred AWS experience also valued
- Familiarity with modern data platforms such as Databricks Snowflake Microsoft Fabric or Redshift
- Understanding of orchestration and workflow management (Apache Airflow Databricks Workflows Temporal or similar)
- Experience with data quality frameworks and testing strategies for pipelines
- Familiarity withinfrastructureas code tooling (Terraform ARM/Bicep) and CI/CD pipelines (GitHub Actions or similar) is a plus
- Experience with analytics engineering tools likedbtand data catalog tools (Unity Catalog Microsoft Purview) is a plus
- Ability to evaluate architectural tradeoffs in data systems (OLAP vs. OLTP batch vs. streaming warehouse )
- Comfortable with ambiguity; can clarify requirements through conversation
- Interest in mentoring and developing less experienced engineers
- Professional data engineering experience (8 years desired)
- Must be legally authorized to work in the United States
- Must not require visa sponsorship or have work authorization based on OPT or CPT
- Must be able to work from our office in Westfield IN without relocation financialassistance
SEP is a software product design and development company located in Westfield IN. We provide powerful teams of thoughtful developers and designers to bring ideas to life. Founded in 1988 SEP is one of Indianas largest software development firms with 180 employees. Our clients span from Fortune 100 to scale-up companies. We are 100% employee-owned through an ESOP and are consistently recognized for our great culture (Top Workplaces Best Place to Work in Indiana Techpoint Mira Exceptional Employer).
We are an equal opportunity employer as to all protected groups including protected veterans and individuals with disabilities
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
SEP makes vital software. See how our software development company builds awesome products for our clients.
