The Cloud Data Engineer designs develops and maintains data solutions on the Microsoft Azure platform. Responsibilities include building scalable data pipelines optimizing data storage and integrating data from multiple sources to support datadriven decisionmaking across the organization. The position emphasizes the use of Azure tools and technologies to deliver robust secure and efficient data solutions in a cloud or hybrid application environment. This position is nonremote and will require the individual to be based in the Fargo ND area.
Specific Job Duties:
- Analyzes and defines business requirements to determine specifications and standards; proposes and develops solutions.
- Deploys and oversees implementation and integration of webbased applications ensuring that appropriate information security standards are met.
- Maintains reports logs or other records of security audits.
- Monitors system uptime and performance troubleshooting and resolving errors.
- Stays informed of emerging cloud technologies and evaluates their value to the organizations operations.
- Designs and implements cloud architectures: Azure SQL Data Lake and Blob Storage.
- Develops tests and maintains data ingestion processes using Azure Data Factory Microsoft Fabric and other tools appropriate to a variety of sources: API IoT or relational.
- Manages and optimizes Azure Storage services Fabric Data Warehousing Azure Databricks Apache Spark or similar services for advanced analytics and data processing.
- Ensures data quality security and compliance with organizational and regulatory standards.
- Implements and maintains CI/CD pipelines using Azure DevOps for seamless deployments.
Requirements:
- Knowledge of data processing languages and tools including SQL Python Java and C# with the ability to understand parallel processing and data architecture patterns.
- Proficient in using cloud services: Azure Data Factory Azure Data Lake Storage Synapse Analytics Stream Analytics Azure Event Hubs as required to create data processing solutions.
- Proficient in software design and software documentation debugging and problemsolving skills.
- Detailoriented and capable of working within a collaborative team environment.
- Requires a bachelors degree and 3 to 8 years of experience.
- Masters degree beneficial.
EOE/M/F/Disabled/Veteran