Azure Data Engineer

Sysmind LLC

Not Interested
Bookmark
Report This Job

profile Job Location:

Lake Saint Louis, MO - USA

profile Monthly Salary: Not Disclosed
Posted on: 9 hours ago
Vacancies: 1 Vacancy

Job Summary

**Please strictly adhere to the following resume naming convention:
ALL CAPS NO SPACES B/T UNDERSCORES

Bill Rate $60.00 - $80.00

PTNUSGBAMSREQIDCandidateBeelineID
i.e. PTNUS9999999SKIPJOHNSON0413

MSP Owner: Rob Finton
Location:
Duration: 6 months
GBaMS ReqID:

Competencies: Digital : Microsoft Azure Digital : Application Programming Interface (API) Digital : Python for Data Science Digital : Databricks

Technical/Functional Skills
1 years of experience working with Matillion
5 years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools
2 years of developing and supporting a cloud-based data platform - Snowflake
Experience with AWS lambda functions and data pipeline
Experience implementing Change Data Capture (CDC)
Strong knowledge and experience with SQL programming including stored procedures triggers functions and error trapping
Demonstrated proficiency developing technical skills and performing problem-solving
Excellent verbal and written communications skills and ability to multi-task within a team-oriented environment
Demonstrated proficiency developing and supporting extract transform and load (ETL) and extract load transform (ELT) processes
Experience building self-service reporting solutions using business intelligence software (e.g. OBIEE Looker Power BI etc.)
Ability to maintain documentation on ELT process and procedures
Experience conducting project-specific data analysis that includes analyzing and mapping required data and supporting all facets of the ELT process
Ability to assist with the creation and maintenance of ELT specifications (e.g. source-to-target maps)
Ability to participate in production on-call support rotation schedule for ETL processing and completion
Ability to assist with estimates for the ELT process and suggest improvements
Experience with Oracle Data Integrator also a strong advantage

Experience Required 8-12 Years
Roles & Responsibilities As a Senior Engineer you will be responsible for using your technical knowledge to solve business problems. We are looking for a talented individual that can serve as a subject matter expert in their area of focus and represent their department on complex assignments. You will be responsible for evaluating elements of technologies effectiveness through requirements gathering testing research and investigation and make recommendations for improvements that result in increased quality and effectiveness. You will be required to listen to and evaluate customer needs to determine and provide high quality solutions that align with customer expectations.

In this role on the Cloud Data Engineering team you will be a part of a team responsible for migrating existing data platform solutions to the cloud. You will also collaborate with others to develop new data pipelines. As a data engineer in the Cloud Data Engineering team you will need to work in a data first mindset. You will use Microsoft Azure Cloud PaaS technologies to engineer our data solutions in a way that allows for us to optimize our information make better decisions and meet our customers needs. If you have a passion for engineering working with massive amounts of data and empowering smart business decisions this is the role for you.

Required -
Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the future (as we would like the Right to Hire and we cannot convert talent that is under an E3 level ideally this is a Senior level which is an E2ish)
Must be committed to incorporating security into all decisions and daily job responsibilities
Protects our customers our employees and our brands by incorporating security and compliance in all decisions; ensures security policy and procedure requirements are met; continuously identifies opportunities for improving security and implements strategies to improve our security posture
Experience with API development and support of Azure functions written in Python
3 years development experience in one of the following languages: Python and/or Azure SQL
3 years data engineering experience working with large datasets and complex data environments processes and associated solutions
3 years experience writing and tuning complex SQLs and the ability to analyze and make recommendations on results
3 years experience in full lifecycle development and end-to-end testing
Experience with Microsoft Azure platform technologies like Databricks applications Event Hub Data Factory Scala Synapse Analytics Delta Lake Cosmos DB or DevOps
Must have good troubleshooting and problem-solving skills including debugging multi-threaded applications
Experience with configuration management and build automation capabilities such as Git/Jenkins
Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives
Must be able to both collaborate in a team-oriented environment and work independently with direction

Preferred:
Bachelors degree in Computer Science Computer Information Systems Management Information Systems or related field preferred
Experience with Big Data solutions and no SQL DBMSs
Experience with Azure AWS or other Public Cloud environments
Prior experience leading large-scale projects
Knowledge and working experience with Agile methodologies
Generic Managerial Skills
Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives
Must be able to both collaborate in a team-oriented environment and work independently with direction
Education Bachelors
**Please strictly adhere to the following resume naming convention: ALL CAPS NO SPACES B/T UNDERSCORES Bill Rate $60.00 - $80.00 PTNUSGBAMSREQIDCandidateBeelineID i.e. PTNUS9999999SKIPJOHNSON0413 MSP Owner: Rob Finton Location: Duration: 6 months GBaMS ReqID: Competencies: Digital : Microsoft ...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala