Sr Data Engineer GC25001
Sr Data Engineer GC25001
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
$ 150363 - 180870
1 Vacancy
Job Description
JOB TITLE:
Sr. Data Engineer (GC25001
POSITION DUTIES:
Design develop test and implement Big Data technical solutions. Recommend the right
technologies and solutions for a given use case from the application layer to infrastructure. Lead
the delivery of compiling and installing database systems integrating data from a variety of data
sources (data warehouse data marts) utilizing onprem or cloudbased data structures. Drive
solution architecture and perform deployments of data pipelines and applications. Author DDL
and DML SQL spanning technical tacks. Develop data transformation code and highly complex
provisioning pipelines. Ingest data from relational databases. Execute automation strategy. Tools
and technologies used include: DDL DML HDFS Hadoop Spark Kafka Python Pyspark
UNIX shell Java Scala Sqoop Pipewrench Streamsets NiFi Cloudera AWS Snowflakes
Databricks HDFS Hive YARN HBAs Solr Impala Kudu and SQL. Position may include a
telecommuting benefit from anywhere in the United States. May require travel to unanticipated
client sites throughout the United States less than 10 of time.
REQUIREMENTS:
At least a Bachelors Degree or foreign equivalent in Computer Science Computer Engineering
Electrical and Electronics Engineering or a closely related technical field and at least five 5
years of postbachelors progressive experience writing shell scripts; validating data; and
engaging in data wrangling. Experience must include at least three 3 years of experience
debugging data; transforming data into Microsoft SQL server; developing processes to import
data into HDFS using Sqoop; and using Java UNIX Shell Scripts and Python. Experience must
also include at least one 1 year of experience developing Hive scripts for data transformation
on data lake projects; converting Hive scripts to Pyspark applications; automating in Hadoop;
and implementing CI/CD pipelines. Position may include a telecommuting benefit from
anywhere in the United States. May require travel to unanticipated client sites throughout the
United States less than 10 of time.
Wage range $150363.00$180870.00 per year. The company offers medical health dental and
life insurance; PTO and paid holidays.
LOCATION OF EMPLOYMENT:
400 South 4th Street Suite 401 Minneapolis MN 55415
APPLY TO:
Resumes To:
phData Inc.
ATTN: HR Job ID: GC25001
P.O. Box 15051
Minneapolis MN 55415
#LIDNI
Required Experience:
Senior IC
Employment Type
Full-Time
