Responsible for designing and building data pipelines.
Designing and implementing solutions and developing applications utilizing airflow dataflow Apache beam snowflake or GCP components.
Reading extracting transforming staging and loading data to multiple targets using Hadoop Hive Snowflake BigQuery and Cloud Storage.
Migrating existing data processing from standalone or legacy technology scripts to distributed framework processing.
Working with gigabytes/terabytes of data and dealing with the challenges of transforming and enriching such large datasets.
Utilizing Google Cloud Platform and strong big data technology foundation
Designing and Architecting data model to modernize legacy data warehouses.
Writing ELT jobs using DBT to maintain data lineage and data auditability.
Designing architecture of CI/CD pipelines to perform continuous build and isolate multiple environments.
Experience/Qualifications
Masters or foreign academic equivalent inBusiness Analytics Computer Science Statistics Data Scienceor any related field plus one (1) year of experience. Location: Northridge CA telecommuting permitted HQ in Naperville IL. Approx. 25% domestic travel required. Travel Expenses to be paid by employer. One year of experience withHadoop Spark Pig Hive Snowflake BigQuery Kubernetes and Dataflowrequired.
SALARY: $116334per year
BENEFITS: Medical Insurance Dental Life Insurance Paid Time Off 401(k)
WHERE TO APPLY: SpringML Inc. dba Egen Solutions 40 Shuman Blvd Suite 204 Naperville IL;
Email:
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion diversity and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race color religion sex national origin disability status protected veterans status or any other characteristic protected by federal state or local laws. Egen will also consider qualified applications with criminal histories consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.