Senior Cloud Data Engineer
Senior Cloud Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
SysMind is seeking an experienced cloud data engineer to join our team. This position will be mainly tasked with transforming data into useful data systems by developing maintaining and testing infrastructures for data generation and aligning those data systems with business goals. This position is responsible for bridging the gap between raw data and actionable insights making them a crucial asset in data-driven decision-making.
This role will be responsible for expanding and optimizing data architectures as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. This position will support software developers database architects data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing data architectures to support the next generation of products and data initiatives.
This role will be responsible for ensuring that data flows smoothly from its source to its destination efficiently and securely and will be responsible for ensuring the accuracy of data promoting data quality and transforming data into more useful formats.
The ideal candidate should have strong analytical skills and the ability to combine data from different sources as well as strong familiarity with several programming languages and learning machine methods.
Prior experience with large international airports and other transportation data is considered an asset.
This role will be remote without any travel required. The ideal candidate will be available during the US Eastern Time Zone working hours from Monday - Friday.
Job Responsibilities
- Assemble large complex sets of data that meet non-functional and functional business requirements
- Identify design and implement internal process improvements including re-designing infrastructure for greater scalability optimizing data delivery and automating manual processes
- Build required infrastructure for optimal extraction transformation and loading of data from various data sources using Azure Cloud technologies
- Create and maintain optimal data pipeline architecture
- Build analytical tools to utilize the data pipeline providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
- Work with stakeholders including data design product and executive teams and assist them with data-related technical issues
- Work with stakeholders including the Executive Product Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
- Interpret trends and patterns
- Conduct complex data analysis and report on results
- Prepare data for prescriptive and predictive modeling
- Build algorithms and prototypes
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Identify opportunities for data acquisition
- Develop analytical tools and programs
- Collaborate with data scientists and architects on several projects
Required Technical Qualifications & Skills
- Minimum of 10 years experience with Azure Cloud
- Minimum of 10 years experience with the following technologies: ADF ADLS Synapse Data Warehouse (dedicated pool) knowledge of MS Fabric ML - Python
- Previous experience of ten or more years as a data engineer or in a similar role
- Technical expertise with data models data mining and segmentation techniques
- Knowledge of programming languages (e.g. Java and Python)
- Hands-on experience with SQL database design
- Great numerical and analytical skills
- Bachelors degree in Computer Science Information Systems or similar field (Masters degree is a plus)
- Data engineering certification (MS Certified Data Engineer) is a plus
- Advanced working SQL knowledge and experience working with relational databases query authoring (SQL) as well as working familiarity with a variety of databases
- Experience building and optimizing big data data pipelines architectures and data sets
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Strong analytic skills related to working with unstructured datasets
- A successful history of manipulating processing and extracting value from large disconnected datasets
- Working knowledge of message queuing stream processing and highly scalable big data data stores
- Strong project management and organizational skills
- Experience supporting and working with cross-functional teams in a dynamic environment
Soft Skills Requirements
- Excellent communication skills to collaborate with data scientists analysts and business stakeholders
- Self-directed work style with ability to architect solutions independently
- Adaptability to work with evolving data requirements and emerging web technologies
Employment Type
Full-time
