Sr. PySpark Developer Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Education
- Degree in computer science engineering mathematics or equivalent experience
Experiences:
- 7 years of previous commercial experience as a leader in a data-driven role
- 7 years of hands-on experience building data pipelines in production and ability to work across structured semi-structured and unstructured data
- 7 years of experience in ML pipeline for streaming/batch workflow
Knowledge & Skills
- Ability to write clean maintainable and robust code in Python
- Understanding and expertise of software engineering concepts and best practices
- Knowledge of testing frameworks and libraries
- Experience with analytics (descriptive predictive EDA) feature engineer algorithms anomaly detection data quality assessment and python visualization libraries - e.g. matplotlib seaborn or other
- Comfortable with notebook and source code development - Jupyter Pycharm/VScode
- Hands-on experience of technologies like Python Spark/Pyspark Hadoop/MapReduce/HIVE Pandas etc.
- Familiarity with query languages and database technologies CI/CD testing and validation of data and software
- Tech stack and activities that you would use and preform on a daily basis
- Python
- Spark (PySpark)
- Jupyter
- SQL and No-SQL DBMS
- Git (as source code versioning and CI/CD)
- Exploratory Data Analysis (EDA)
- Imputation Techniques
- Data Linking / Cleansing
- Feature Engineering
- Apache Airflow/ Jenkins scheduling and automation Github and Github Actions
- Collaborative - able to build strong relations that enable robust debate and resolve periodic disagreements regarding priorities.
- Excellent interpersonal and communication skills
- Ability to communicate effectively with technical and non-technical audience
- Ability to work under pressure with a solid sense for setting priorities
- Ability to lead technical work with strong sense of ownership
- Strong command of English language (both verbal and written)
Behavioral Competencies
- Thinking Related
- People Related
- Self-Related
- Practical and action oriented
- Compelling communicator
- Excellent stakeholder management
- Foster and promote entrepreneurial spirit and curiosity amongst team members
- Team player
- Quick learner
SYNECHRONS DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.
All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law.
Required Experience:
Senior IC
Key Skills
About Company
Chez Synechron, nous croyons en la puissance du numérique pour transformer les entreprises en mieux. Notre cabinet de conseil mondial combine la créativité et la technologie innovante pour offrir des solutions numériques de premier plan. Les technologies progressistes et les stratégie ... View more
