Data Platform Specialist Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
22 hours ago
Vacancies:
1 Vacancy
Job Summary
About This Role
Passionate about your field Looking for a work environment where you can meet challenges innovate use state-of-the-art tools and collaborate with experts from various sectors Want to join a worldclass company and industry leader and be proud to contribute to our projects and mission Come join our team and share your passion with us!
Key Responsibilities:
We are looking for a passionate data specialist to design develop and optimize data pipelines and models. You will play a key role in building robust infrastructures integrating complex datasets and creating analytical solutions that support strategic decision-making.
Responsibilities:
Build an optimal and scalable data pipeline aligned with the target architecture.
Integratedata set aligned with business requirements.
Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources and big data technologies.
Identify design and implement internal process improvements: automating manual processes optimizing data delivery re-designing infrastructure for greater scalability.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition operational efficiency and other key business performance metrics.
Keep data separated and secure across national boundaries through multiple data centers.
Qualifications:
Bachelors degree in Computer Science Engineering or related field.
A minimum of 3 years industry experience working with data coding and scripting (Python/Java/Scala/SQL/JS/Bash) design and testing.
A minimum of 3 years experience developing and administering large data systems.
Solid knowledge of CS fundamentals in algorithms and data structures.
Experience with big data tools: Hadoop Spark Kafka.
Experience with relational SQL and NoSQL databases including SQL Server and CosmosDb.
Experience with automated data pipeline and workflow management tools: DevOps ARM Data Factory Airflow.
Experience with Microsoft cloud services: Azure Databrick.
Experience with stream-processing systems: Storm Spark-Streaming.
Position Type
RegularCAE thanks all applicants for their interest. However only those whose background and experience match the requirements of the role will be contacted.
Equal Opportunity Employer
CAE is an equal opportunity employer committed to providing equal employment opportunities to all applicants and employees without regard to race nationality colour religion sex gender indentity and expression sexual orientation disability neurodiversity veteran status age or other characteristics protected by local laws.
If you dont see yourself fully reflected in every job requirement listed in the job posting we still encourage you to reach out and apply. At CAE everyone is welcome to contribute to our success. Applicants needing reasonable accommodations should contact their recruiter at any point in the recruitment process. If you need assistance to submit your application because of incompatible assistive technology or a disability please contact us at
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
CAE's Defense and Security business unit focuses on helping prepare military customers to develop and maintain the highest levels of mission readiness. With nearly 5,000 employees, CAE USA Inc. is the largest segment within CAE's Defense and Security business unit. The organization le ... View more
