Data Engineer SME CK22
Data Engineer SME CK22
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Fuel
Data Engineer (SME) McLean
Duties and Responsibilities:- Create and maintain a data pipeline architecture
- Assembling large complex sets of data that meet mission requirements
- Identify design and implement improvements including redesigning infrastructure for greater scalability optimizing data delivery and automating manual processes
- Build required infrastructure for optimal extraction transformation and loading of data from various data sources using AWS SQL NiFi technologies
- Build analytical tools to utilize the data pipeline providing actionable insight into data performance including operational efficiency and customer acquisition
- Working with mission stakeholders and assist them with datarelated technical issues
- Working with technology stakeholders to support their data infrastructure needs while assisting with datarelated technical issues
Skills and Experience:
- Ability to build and optimize data sets big data data pipelines and architectures
- Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
- Excellent analytic skills associated with working on unstructured datasets
- Ability to build processes that support data transformation workload management data structures dependency and metadata
- Bachelors degree in information systems informatics statistics or computer science/software engineering
- Minimum of five years of experience using some of the below software and tools:
- Big data tools like Kafka Spark and Hadoop
- Relational NoSQL and SQL databases including Cassandra and PostgreSQL
- Workflow management and pipeline tools such as Airflow Luigi and Azkaban
- AWS close services including Redshift RDS EMR and EC2
- Streamprocessing systems like SparkStreaming and Storm
- Object function/objectoriented scripting languages including Scala C Java and Python.
- Data workflow orchestration tools including Pentahoe or Apache NiFi
About Fuel
Fuel Consulting LLC helps clients create the path to their future. Clients get expertisethat needs no rampup time to deliver the best practices customized tools and methodologies to helpthem achieve theirvision and leave a legacy. If helping others and working with a team of exceptionally talented individuals excites you then look no further than Fuel. Fuel offers
Employment Type
Full Time
