Data Engineer Architect - Data Bricks
Data Engineer Architect - Data Bricks
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
SeniorDataEngineer/Architect Remote
Fulltime
Responsibilities:
As part of a team involved in a project doingdataanalytics to support the project team a successfulDataEngineer candidate will have the following responsibilities:
Maintain and enhance processing pipelines using tools and frameworks in the AWS ecosystem.
Maintainarchitecture specifications and detailed design documentation.
Conductdataengineering functions includingdataextraction transformation loading and integration in an AWS environment leveraging Snowflake andDatabricks.
Work with largedatasets and otherDataEngineers andDataScientists ondataanalysis tasks.
Implement and configure bigdatatechnologies as well as tune processes for performance at scale.
Design and build ETL pipelines to automate the ingestion anddatamigration of structured and unstructureddata.
Work with DevOps engineers on CI CD and IaC (Continuous Integration Continuous Delivery and Infrastructure as Code) processes; read specifications and translate them into code and design documents; and perform code reviews and develop processes for improving code quality.
Basic Qualifications:
7 years experience with Python or another OOP language.
5 years Experience with NoSQL products such as JSON.
5 years Experience withDatabricks.
5 years experience with advanced SQL features regular expressions analytical functions (e.g. RANK PARTITION LEAD LAG etc..
4 years experience using a query planner anddatabase metrics to analyze and optimize queries table structure indices and partitioning strategies.
Federal Government contracting work experience.
Need very goodDatabricks experience
If interested in applying for this position please reach out to me at
Our Benefits:
Competitive pay and 401K retirement saving plan
Flexible and remote work opportunities as per the clients requirement
Health care benefits (medical dental vision)
Tuition reimbursement
Employee Referral Program
Short term and longterm disability insurance
Flexible Savings Account
Global Alliant Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race color religion gender sexual orientation gender identity or expression national origin age disability genetic information marital status amnesty or status as a covered veteran in accordance with applicable federal state and local laws. We especially invite women minorities veterans and individuals with disabilities to apply.
Required Experience:
Senior IC
Employment Type
Full-Time
