drjobs Software Senior Engineer - Bigdata

Software Senior Engineer - Bigdata

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Pune - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

About Boomi and What Makes Us Special

Are you ready to work at a fast-growing company where you can make a difference Boomi aims to make the world a better place by connecting everyone to everything anywhere. Our award-winning intelligent integration and automation platform helps organizations power the future of business. At Boomi youll work with world-class people and industry-leading technology. We hire trailblazers with an entrepreneurial spirit who can solve challenging problems make a real impact and want to be part of building something big. If this sounds like a good fit for you check out or visit ourBoomi Careers page to learn more.

Join us as a Software Sr. Engineer on our Software Engineering team in Pune to do the best work of your career and make a profound social impact.

About us

Boomis Cloud API Management the pioneer in the API management space was born out of key business needs in the market to enable faster app development and partner growth provide better secure API performance and deliver data-powered insights. We help customers launch their API programs quickly to get new products and services to market faster and connect with business partners more easily to foster innovation and expand routes to market. We can also deliver successful API performance with integrated security and ensure that analytics and a performance dashboard help users understand what works what doesnt and how to improve governance for the API program.

We are looking for a skilled Big Data Engineer with 5-8 years of experience in managing and processing large datasets particularly using Big Data technologies. The ideal candidate should have proficiency in tools like PySpark Kafka and Airflow alongside a strong programming background in Python or Java. Additionally experience with relational databases (e.g. MySQL) and NoSQL databases (e.g. Cassandra MongoDB Time-series DB) is essential. Familiarity with cloud platforms like AWS or GCP will be a plus.Key Responsibilities:
  • Big Data Processing:Design develop and optimize distributed data processing pipelines using technologies likePySparkandKafka.
  • Data Integration:Implement solutions to process streaming and batch data efficiently ensuring real-time and historical data are accessible.
  • Workflow Automation:UtilizeApache Airflowto orchestrate complex workflows and scheduling of data pipeline tasks.
  • Database Management:Work with both relational databases (MySQL) and NoSQL databases (e.g. Cassandra MongoDB Time-series DB) to design maintain and optimize database solutions for large datasets. Optimize database performance and ensure data integrity and security.
  • Programming:Write robust efficient and scalable code inPythonorJavafor data processing manipulation and transformation.
  • Cloud Platforms:LeverageAWSorGCPto build scalable cloud-based data architectures.
  • Debugging:Troubleshoot and resolve data-related issues in a timely manner.
Qualifications:
  • 5-8 years of hands-on experience as a Big Data Engineer Data Engineer or similar role.
  • Expertise in Big Data technologies likePySparkKafka andApache Airflow.
  • Strong programming skills inPythonorJava.
  • Experience working with bothrelational databases(MySQL) andNoSQL databases(Cassandra MongoDB etc.).
  • Solid understanding of data pipeline development ETL processes and data warehousing concepts.
  • Familiarity with time-series databases is a plus. (Druid InfluxDB Prometheus)
  • Familiarity withCloud platformssuch asAWS(e.g. S3 EC2 EMR) orGoogle Cloud Platform (GCP).
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

#Li-VC1

Be Bold. Be You. Be Boomi. We take pride in our culture and core values and are committed to being a place where everyone can be their true authentic self. Our team members are our most valuable resources and we look for and encourage diversity in backgrounds thoughts life experiences knowledge and capabilities.

All employment decisions are based on business needs job requirements and individual qualifications.

Boomi strives to create an inclusive and accessible environment for candidates and employees. If you need accommodation during the application or interview process please submit a request to. This inbox is strictly for accommodations please do not send resumes or general inquiries.


Required Experience:

Senior IC

Employment Type

Full Time

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.