Data Engineer

SmartIPlace

Not Interested
Bookmark
Report This Job

profile Job Location:

Atlanta, GA - USA

profile Monthly Salary: Not Disclosed
Posted on: 2 hours ago
Vacancies: 1 Vacancy

Job Summary

Top Skills Details

1- Databricks data modeling w/ Python
2- Azure ETL / Data analysis
3- Spark/Hive/Airflow

Job Description

5-10 Years Focused on manipulating data in a software engineering capacity. Some of that data might live in relational systems but increasingly moving towards data Lakehouse architecture.

Normalize databases and ascertain the structure of the data meets the requirements of the applications that are accessing the information.

Construct datasets that are easy to analyze and support company requirements.

Combine raw information from different sources to create consistent and machine-readable formats.

This role is not in IT but requires a significant set of technical skills including a deep knowledge of SQL data modeling and tools like Spark/Hive/Airflow.

Hands on experience with Databricks and Microsoft Azure is required.

Top Skills Details 1- Databricks data modeling w/ Python 2- Azure ETL / Data analysis 3- Spark/Hive/Airflow Job Description 5-10 Years Focused on manipulating data in a software engineering capacity. Some of that data might live in relational systems but increasingly moving towards data Lakehouse...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala