Data Engineer

Job Description: The Senior Data Engineer will play a pivotal role in operationalizing the mosturgent data and analytics initiatives for our company. The primary focus will be on choosing optimal solutions to use for these purposes then implementing maintaining and monitoring them. In addition the Senior Data Engineer will be responsible for integrating them with the architecture used across the company.

Key Responsibilities:
1. Develop construct test and maintain architectures such as databases and largescale data processing systems.
2. Ensure systems meet business requirements and industry practices.
3. Research opportunities for data acquisition and new uses for existing data.
4. Employ a variety of languages and tools to marry systems together.
5. Recommend ways to improve data reliability efficiency and quality.
6. Collaborate with data architects modelers and IT team members on project goals.

Required Skills and Experience:
1. Proven experience with data warehousing solutions particularly with Snowflake and AWS Redshift.
2. Handson experience with cloudbased data warehouses such as Snowflake on Azure or AWS Redshift.
3. Extensive experience in developing maintaining and testing data infrastructures in cloud environments such as Microsoft Azure and AWS.
4. Experience handling and extracting value from large disconnected and/or unstructured datasets using tools available on Azure and AWS.
5. Proficiency with ETL tools and SQL in cloud environments particularly with Azure Data Factory and AWS Glue.
6. Strong programming skills with languages such as Python or Java specifically for cloud environments like Azure and AWS.
7. Experience with big data tools like Azure HDInsight (for Hadoop Spark) AWS EMR (for Hadoop) and Amazon MSK (for Kafka).
8. Proficiency with data pipeline and workflow management tools such as Azure Data Factory AWS Step Functions and AWS Glue.
9. Experience with objectoriented/object function scripting languages like Python Java or Scala for cloudbased applications on Azure or AWS.
10. Strong organizational skills with the ability to manage projects in a cloud environment.
11. Ability to work independently and collaborate with team members from different backgrounds in particular within a cloudbased workspace.
12. Excellent communication and collaboration skills with experience in tools like Salesforce for customer relationship management and Microsoft Teams for team collaboration.