Sr. Data Engineer Databricks
Share
Job Location:
Dalton, GA - USA
Monthly Salary:
Not Disclosed
Posted on:
9 hours ago
Vacancies:
1 Vacancy
Job Summary
Job Title
Sr. Data Engineer - DatabricksPosition Overview
We are looking for a data engineer to join our enterprise analytics team! This individual will partner with data scientists analysts and product owners to support data science projects and initiatives across the enterprise including in our manufacturing planning/forecasting and customer service areas.
Applicant must be an experienced data pipeline builder who enjoys building solutions from the ground up. We are looking for someone who is self-directed and comfortable supporting the data needs of multiple teams and projects.
Responsibilities:
Partner with data scientists data analysts data stewards and product owners to understand data needs and develop solutions
Design build launch and maintain efficient and reliable data pipelines to support data analysis and machine learning models
Define and manage standards guidelines and processes to ensure data quality
Assemble large complex datasets based on business requirements
Identify and deploy various methods and techniques for optimal extraction transformation and loading of data from a wide variety of data sources
Help build and maintain best practices for our data engineering strategy identifying and addressing gaps in existing processes and solutions
Minimum Qualifications:
Bachelors degree in a quantitative field (e.g. Computer Science Engineering) or a related quantitative field or equivalent work experience is required.
At least 4-6 years of work experience in data management disciplines including data integration modeling optimization and data quality and/or other areas directly relevant to data engineering responsibilities and tasks.
Expert SQL programming skills
Expertise in at least one relevant object-oriented programming language (e.g. Python Scala)
Experience building and optimizing data pipelines architectures and data sets
Experience with big data tools (Spark Kafka etc.)
Experience in data warehousing and data modeling
Good knowledge of data management data integration and database development techniques with a good understanding of data architecture principles
Strong analytical and problem solving skills
Ability to communicate across all levels of the organization and work with diverse project teams
Experience using cloud-based infrastructure such as Azure and AWS
Experience in DevOps best practices including CI/CD process automation and optimization
Preferred Qualifications:
Experience with designing and implementing real-time pipelines
Experience with data quality and validation
Experience working in an Agile environment
Required Competencies:
Make Effective Decisions
Drive Results
Demonstrate Strategic Influence
Demonstrate Customer Orientation
The position may be filled as a data engineer or senior data engineer based on experience.
Work Shift
8 Hr non-rotating shift Hrs fall to in punch day Observed Calendar shift starts AMRequired Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
We are approximately 20,000 individuals bound together by a common vision to create a better future, for our customers, for our company, for our people, and for our communities. By combining deep market knowledge with new ways of thinking, we drive innovation into our business and set ... View more
