Cloud Era Data Engineer

Title: Cloud Era Data Engineer

Location: Oshkosh WI

Duration: 6 Months (Remote)

Note: Need USC or GC

Role and Responsibility:

Technical Lead Experience around 8 to 10 yrs

Capable of interfacing customer day to day basis.

Coordination and communication with Offshore team (with 2 time zones IndiaUS)

Should be able to work on technical activities related to development and testing on requirement basis asked by offshore team.

Responsibly handling work in secured/constrained manner in Clients operating environment (NDA data security.)

Key technical Skill:

1. Strong experience on Cloud Era Data platform.
2. Experience in Azure (CDP on Azure would be plus).
3. Strong Experience in HDFS Object storage.
4. Hands on with Devops deployments Virtual machines Dockers Kubernetes VPCs.

Tools:

Service Connection: Understanding of how to securely connect Azure DevOps with other services and environments for automated deployment.
Build Tools: Familiarity with build tools like MSBuild or Maven (depending on the projects programming language) to compile code.
SonarQube: Proficiency with SonarQube for continuous inspection of code quality to perform automatic reviews to detect bugs vulnerabilities and code smells.
Docker: Knowledge of containerization with Docker managing images.
Docker Registry/Docker Hub: Experience with Docker registries for storing and managing Docker images.
Continuous Deployment Tools: Understanding of deployment tools and services such as Jenkins/Gitlab/Bamboo for automated deployment.
Virtual Machines (VMs): Knowledge of virtualization managing virtual machines and possibly container orchestration if VMs are used to host containers.

Reverse proxy (nginx or similar tools)

Skill Sets:

Code Quality Analysis: Ability to set up and maintain code quality analysis tools and interpret their reports for continuous improvement.
Containerization: Proficiency in creating deploying and managing Docker containers.
Version Control: Expertise in using version control systems like Git.
Continuous Integration: Experience in setting up and maintaining continuous integration systems to automatically build test and prepare apps for deployment.
Continuous Deployment: Capability to implement continuous deployment to automatically deploy applications to production environments.
Security: Knowledge of security best practices in CI/CD pipelines to ensure safe deployment processes.

System integration knowledge(docker containers and CDP Storage).