Data Engineer

Dear Partner Good Morning!

Greetings from SnapRecruit LLC. We do have urgent requirement for Data Engineer

• Identify design and implement internal process improvements for the automation of data flow optimizing data delivery redesigning infrastructure for greater scalability etc
• Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using SQL and big data technologies
• Build processes supporting data transformation data structures metadata dependency and workload management
• Perform engineering tasks including writing and testing software creating software tools updating drawings and documentation
• Develop documentation to support objectives of operationallyfocused team members
• Effectively Interface with customer personnel at varying organizational levels
• Effectively report status on tasks and assignments and to support business development team in the production of winning proposals
  

Qualifications And Education Requirements

• BS degree in Engineering discipline Computer Science Mathematics or related field required
• Experience manipulating processing and extracting value from large disconnected datasets
• Experience integrating data from diverse sources to a structured data repository ensuring the quality and consistency of data is maintained at all times
• Advanced working knowledge of SQL language and experience with RDBMS NoSQL DBs Data Warehouses big data repositories and unstructured datasets
• Strong analytic skills related to working with unstructured datasets
• Advanced working knowledge of Python with the ability to write high performance code
• Minimum 5 years experience implementing high performant data ingestion pipelines using one or more ETL/ELT tools (Talend Informatica etc) or workflow tools (Argo AirFLow etc)
• You will be expected to support a diverse set of projects and teams. The skillsets required for this role will vary based on what systems you are working on. To be considered you should have strong skills in 1 or more of the following categories
  • Programming language (Rust C# C C Julia)
  • Database systems (PostgreSQL MongoDB Oracle MSSql etc)
  • Devops (Docker Kubernetes Jenkins etc)
  • Cloud Systems (Azure GCP AWS)
• Ability to effectively prepare and present information and respond to questions from peers and customers
• Must be able to perform effectively as part of a project team
• Must be selfmotivated and expected to work independently with minimal supervision
  

Desired Skills

• Experience with Agile Development
• Experience using Git or other source code management system
• Security clearance

IT