Associate Staff Engineer, Big Data Engineer
Associate Staff Engineer, Big Data Engineer
Posted on :
21-06-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
REQUIREMENTS:
- Total experience 5 years.
- Excellent knowledge and experience in Big data engineer.
- Strong programming experience in Python.
- Strong hands-on experience in Apache Spark and Python.
- Proficiency in GCP Pub/Sub Hadoop MapReduce and Hive.
- Solid understanding of relational databases (e.g. PostgreSQL) and NoSQL systems (e.g. MongoDB Kafka).
- Experience with Big Data tools and platforms such as Trino Hive/Pig.
- Expertise in writing complex queries using SQL MQL HQL etc.
- Proven experience in building and maintaining data pipelines.
- Familiarity with CI/CD pipelines and Git for version control.
- Solid understanding of distributed computing parallel processing and big data best practices
- Strong problem-solving and debugging skills
- Experience working in Agile/Scrum environments
- Familiarity with data modeling data warehousing and building distributed systems.
- Expertise in Spanner for high-availability scalable database solutions.
- Knowledge of data governance and security practices in cloud-based environments.
- Problem-solving mindset with the ability to tackle complex data engineering challenges.
- Strong communication and teamwork skills with the ability to mentor and collaborate effectively.
RESPONSIBILITIES:
- Writing and reviewing great quality code.
- Understanding the clients business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers
- Identifying different solutions and being able to narrow down the best option that meets the clients requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation
- Writing and reviewing design document explaining overall architecture framework and high-level design of the application for the developers
- Reviewing architecture and design on various aspects like extensibility scalability security design patterns user experience NFRs etc. and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies patterns and frameworks to materialize it.
- Understanding and relating technology integration scenarios and applying these learnings in projects.
- Resolving issues that are raised during code/review through exhaustive systematic analysis of the root cause and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements
Qualifications :
Bachelors or masters degree in computer science Information Technology or a related field.
Remote Work :
No
Employment Type :
Full-time
Employment Type
Full-time
Department / Functional Area
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
