drjobs Staff Data Engineer

Staff Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Salt Lake, UT - USA

Monthly Salary drjobs

$ 127700 - 191500

Vacancy

1 Vacancy

Job Description

If youre passionate about building a better future for individuals communities and our countryand youre committed to working hard to play your part in building that futureconsider Craft Education as the next step in your career.

Craft Education is on a mission to solve skilled labor shortages by powering workbased learning pathways for all.

At Craft were revolutionizing the apprenticeship degree combining onthejob learning with accredited instruction to create innovative educational pathways that accommodate working professionals and meet employer needs. Our flagship product Craft Connect helps organizations administer apprentice degree programs and address missioncritical data and reporting needs. Through the same platform Craft is also transforming how onthejob learning converts into academic credits.

Our team of technology education and workforce professionals also provides technical assistance to organizations looking to launch and manage apprenticeship degree programs. We are working tirelessly to accelerate the expansion of these programs along with the data infrastructure that underpins them.

If youre looking to join the workbased learning revolution wed love to talk with you. At Craft youll have the opportunity to solve hard problems in a highgrowth startup environment and make a lasting impact on the future of education and workforce development. We couldnt be more excited to advance this work as a team of innovative collaborative and missionoriented professionals we hope youll consider joining us.

The salary range for this position takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.

At WGU it is not typical for an individual to be hired at or near the top of the range for their position and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is:

Pay Range: $127700.00 $191500.00

Job Description

Job Summary

The Staff Data Engineer should be agnostic to tools and should be able to supervise design architect and code using tools like Apache Kafka Airflow or Spark and other cloud technologies. The position will supervise and design how data will flow through hybrid data environments comprised of opensource big data platforms and traditional database systems. The core responsibility for this position includes supervision of data engineering technical aspects design of data and system architecture for the Data Lake and data warehouse supervision of the technical aspects of a data engineering team and projects encompassing dimensional and normalized data modeling. The Staff Data Engineer will improve technical standards in the environment ensuring optimal use of data warehouse and other data stores to solve business problems. They will serve as the lead engineer and go to person for all aspects of the data engineer team including solution architecture of data systems.

Essential Functions and Responsibilities:

  • Supervise work on cloud technologies and architect scalable and performant Data Lake systems.

  • Establish design and methodology for database build processes.

  • Supervise the architecture and design of complete data model solutions.

  • Supervise necessary data protection and security processes.

  • Create and design extract processes for data access layer.

  • Translate business problems/information requirements accurately to logical/physical data models aligning with customers data architecture standards.

  • Supervise and perform research and analysis to find solutions for complex business problems.

  • Monitor job performance and fine tune Spark SQL queries as appropriate on a regular basis.

  • Supervise the profiling of data the publishing of data profiles and corrective actions if required to ensure data quality.

  • Supervise and perform documentation / reverse engineering / analysis of data mapping using data integration code/tools.

  • Work with APIs for data wrangling and integrations with other systems data in the EDW.

  • Perform impact analysis using Data Integration/Data Virtualization tool repositories DB data dictionary UNIX scripts and frontend code on versioning systems.

  • Analyze / research data on multiple platforms as wells as multiple heterogeneous databases including custom developed databases.

  • Positively impact projects by completing tasks assigned on time.

  • Communicate technical and domain knowledge as it relates to work to both technical and nontechnical audiences.

  • Ingest and transform structured semistructured and unstructured data from sources including relational databases NoSQL external APIs JSON XML delimited files and more.

  • Support business and functional requirements and translate these requirements into robust scalable solutions.

  • Collaborate with engineers to help adopt best practices in data system creation data integrity test design analysis validation and documentation.

  • Help continually improve ongoing reporting and analysis processes automate or simplify selfservice modelling and production support for customers.

  • Performs other related duties as assigned.

Knowledge Skill and Abilities:

  • Expertise with analytical reporting tools preferably Metabase

  • Mastery in code based ETL/ ELT tools for importing and exporting data across disparate systems.

  • Expertise in analytic skills related to working with unstructured datasets.

  • Use of industry best practices for code development testing implementation and documentation.

  • Ability to evaluate and prioritize work based on the organizations needs.

  • Ability to supervise cross team projects to accomplish data integrations and pipelines.

  • Supervisory abilities for data engineering team with respect to technical design and architecture.

  • Excellent verbal & written communication along with technical documentation

  • Ability to work and deliver in a team environment

  • Ability to manage the use of tools like Jira Confluence GitHub

  • Architect and Develop processes for audit of Data Integrity

  • Ability to mentor Associate/Senior/Data Engineer in data pipeline architecture and coding standards

  • Supervise Validation and testing to analyze and debug issues

  • Mastery of AWS cloud technologies and REST APIs

  • Mastery of relational SQL and NoSQL databases

  • Mastery with objectoriented/object function scripting languages: Python Java Scala

  • Mastery of big data tools: Hadoop Spark Kafka Databricks etc.

Organizational or Student Impact:

  • Recommends and implements changes in technical/business processes; identifies areas for improvement.

  • Helps lead/coordinate extremely complex technical projects and programs and leads development and implementation of innovative solutions for specialized technical issues.

  • Works proactively; identifies and helps prevent/ solve problems that may cross disciplines.

  • Fully understands and quantifies project risks with impact. Identifies generates and implements innovative solutions.

Problem Solving & Decision Making:

  • This individual accomplishes goals and objectives independently.

  • Builds and leads teams influencing decisions and results.

  • Uses discretion to fully scope design and implement solutions to complex technical problems.

  • The individual provides regular technical advice and direction to technical teams and management.

  • Models and helps set high standards for effective interactions with internal and external individuals.

Communication & Influence:

  • Communicates with parties within and outside of their job function and typically has responsibilities for communicating with parties external to the organization.

  • Works to influence others to accept and understand new concepts practices and approaches. Requires ability to communicate with executive leadership regarding matters of significant importance to the organization.

  • This individual may conduct briefings with senior leaders within the technical function.

Leadership:

  • Frequently responsible for providing guidance coaching and training to other employees across the Company within the area of expertise.

  • Responsible for managing large complex project initiatives or strategically important solutions to the organization involving large crossfunctional teams.

  • May have direct reports but generally fewer than three.

Job Qualifications:

Minimum Qualifications:

  • M. S. in Business Management Information Systems Computer Science or a related field or an equivalent combination of experience and training.

  • Six or more years of experience as a Data Engineer Data Integration Big Data or Business Intelligence Software Engineer

  • The individual is acknowledged within the group as a subject matter expert.

  • Typically requires a University Degree or equivalent experience.

Preferred Qualifications:

  • Strong experience with early stage companies distance education and distance learning students is preferred.

  • 6 years of prior relevant experience.

Physical Requirements:

  • Prolonged periods sitting at a desk and working on a computer.

  • Must be able to lift up to 15 pounds at times.

Position & Application Details

FullTime Regular Positions (classified as regular and working 40 standard weekly hours): This is a fulltime regular position (classified for 40 standard weekly hours) that is eligible for bonuses; medical dental vision telehealth and mental healthcare; health savings account and flexible spending account; basic and voluntary life insurance; disability coverage; accident critical illness and hospital indemnity supplemental coverages; legal and identity theft coverage; retirement savings plan; wellbeing program; discounted WGU tuition; and flexible paid time off for rest and relaxation with no need for accrual flexible paid sick time with no need for accrual 11 paid holidays and other paid leaves including up to 12 weeks of parental leave.

How to Apply: If interested an application will need to be submitted online. Internal WGU employees will need to apply through the internal job board in Workday.

Additional Information

Disclaimer: The job posting highlights the most critical responsibilities and requirements of the job. Its not allinclusive.

Accommodations: Applicants with disabilities who require assistance or accommodation during the application or interview process should contact our Talent Acquisition team at

Equal Employment Opportunity: All qualified applicants will receive consideration for employment without regard to any protected characteristic as required by law.


Required Experience:

Staff IC

Employment Type

Full-Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.