Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Job Title: Data Engineer
Job Location: Mississauga ON
Job Type: Fulltime
Mandatory Skills: Python Spark
Responsibilities:
Design develop and maintain software solutions using Python.
Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark Data Frames/RDDs were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
Develop back-end services APIs and integrate databases.
Optimize applications for performance security and maintainability.
Troubleshoot and resolve software defects and issues.
Required Skills:
Strong proficiency in Python and Spark.
Employment Type
Full-time
