Data Engineer-Python, SQL and Unix (Big data)
Data Engineer-Python, SQL and Unix (Big data)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are seeking a highly motivated and detailoriented Entry Level Data Engineer to join our dynamic team. The ideal candidate will have a strong foundation in relational databases SQL and distributed systems concepts with handson experience in Python and Apache Spark. As a Data Engineer you will be responsible for building and maintaining scalable data pipelines ensuring data integrity and supporting datadriven decisionmaking processes for Platform Products Technology organization.
Key Responsibilities:
- Design develop and maintain robust and scalable data pipelines to support various data processing and analytics needs.
- Implement and optimize SQL queries to extract transform and load (ETL) data from various data sources into our data warehouse.
- Work with relational databases to ensure data consistency integrity and performance.
- Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions that meet their needs.
- Develop and maintain data models and schemas to support business intelligence and reporting activities.
- Utilize distributed computing frameworks such as Apache Spark to process large datasets efficiently.
- Debug and troubleshoot datarelated issues ensuring data quality and reliability.
- Document data engineering processes workflows and best practices.
This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.
Qualifications :
Basic Qualifications:
Bachelors degree OR 3 years of relevant work experience
Preferred Qualifications:
Bachelors degree OR 3 years of relevant work experience
Bachelors degree in Computer Science Information Technology Engineering or a related field (or equivalent practical experience).
Strong proficiency in SQL and experience working with relational databases (e.g. MySQL PostgreSQL SQL Server).
Solid understanding of distributed systems concepts including parallel processing data partitioning and fault tolerance.
Handson experience with Python for data manipulation scripting and automation.
Practical experience with Apache Spark for distributed data processing.
Basic understanding of data warehousing concepts and ETL processes.
Excellent problemsolving skills and attention to detail.
Strong communication skills with the ability to work effectively in a teamoriented environment.
Additional Information :
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
