drjobs Sr. Data Engineer (Bigdata + Java/Python/Go)

Sr. Data Engineer (Bigdata + Java/Python/Go)

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Bangalore - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Visas Data and AI Platform team is at the forefront of transforming the payment industry by harnessing the power of big data artificial intelligence and cutting-edge open-source technologies. Our mission is to build scalable high-performance data platforms and services that enable Visas businesses to innovate and deliver unparalleled value to our customers worldwide.

Our Work

At Visa we are dedicated to developing robust data platforms that handle massive volumes of data ensuring real-time processing analytics and low-latency responses. Our team leverages a variety of open-source software to create flexible efficient and reliable solutions that meet the dynamic needs of our business operations.

  • Big Data Platforms: We design and implement platforms capable of processing and analyzing vast amounts of data generated by millions of transactions daily. These platforms support various use cases from fraud detection to personalized customer experiences.
  • Open-Source Software: Our development approach heavily relies on open-source technologies allowing us to build innovative solutions while contributing to the wider tech community. We use and contribute to projects like Apache Hadoop Apache Druid Apache Pinot Apache Spark Apache Flink and Apache Kafka among others.
  • Cutting-Edge Technologies: To achieve our goals we incorporate state-of-the-art technologies in our stack. This includes leveraging streaming analytics real-time data processing and low-latency services to ensure that our platforms are always at the cutting edge of performance and reliability.

Who We Are Looking For

We are seeking seasoned professionals with a deep understanding and expertise in large-scale distributed systems and platform development using open-source software. Ideal candidates will have:

  • Expertise in Distributed Systems: Proven experience in designing developing and maintaining large-scale distributed systems.
  • Open-Source Contributions: Active involvement in the open-source community particularly in streaming analytical and low-latency services.
  • Technical Proficiency: Strong proficiency in technologies such as Apache Druid Apache Pinot Apache Spark Apache Flink Apache Kafka Temporal and Yugabyte.
  • Innovative Mindset: A passion for innovation and a drive to stay ahead of the curve by continuously exploring and implementing new technologies.

Join Us

If you are a passionate technologist with a track record of delivering high-quality scalable solutions and contributing to the open-source community we invite you to join our team. At Visa you will have the opportunity to work on groundbreaking projects collaborate with talented professionals and make a significant impact on the future of payments.

By joining our Data Platform team you will play a crucial role in enabling Visas businesses to leverage data and AI to drive innovation enhance security and deliver exceptional customer experiences.

The candidate will:

Actively participate in all phases of software development lifecycle: analysis technical design planning development testing/CICD release post production/escalation support

Work on a highly scalable available and resilient multi-tenant Platforms that can host large scale and highly critical applications.

Develop large scale multi-tenant software components on the Platform in an Agile based methodology to provide self-service capabilities.

Collaborating with partners from business and technology organizations develop key deliverables for Data Platform Strategy - Scalability optimization operations availability roadmap.

Build partnerships with other technology teams to drive efficiency in their use of platforms and services that PaaS provide

Expertise in applying the appropriate software engineering patterns to build robust and scalable systems.

Be a self-starter work independently and Mentor junior members in the scrum team. Stays current with new and evolving technologies

Builds strong commitment within the team to support the appropriate team priorities

This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.


Qualifications :

Basic Qualifications:
3 years of relevant work experience with a Bachelors Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters MBA JD MD) or 0 years of work experience with a PhD OR 3 years of relevant work experience.

Preferred Qualifications:
Bachelors degree in Computer Science or related technical discipline. With 10 years of overall software development experience in building PaaS or Application frameworks.
Excellent verbal and written communication and presentation skills analytical and problem solving skills
Proficiency in engineering practices and writing high quality code with expertise in either one of Java or Python or Go.
Experience in Technologies like Spark Druid Ray and streaming platforms (Kafka Flink) containers and kubernetes.
Open source committers in Druid Pinot and/or Spark.
Experience in Devops and core infra development using technologies like Kubernetes Docker Ansible Terraform.
Experience in building REST services and APIs following best practices of service abstractions Micro-services and Orchestration frameworks.
Experience building generic services and instrumentation of libraries for wide use across an organization / company.
Experience in Agile methodology and CICD - tool Integration automation configuration management in GIT
Appreciation of diverse LOBs(Line of business) and their platform needs combined with deep technical expertise are required for the role
Basic understanding of generative AI concepts including large language models (LLMs) prompt engineering and the general capabilities and limitations of GenAI tools.
Familiarity with interacting with AI chatbots and leveraging AI-generated outputs to enhance productivity and workflows.
Ability to verify refine and integrate AI-generated content into project tasks ensuring outputs are accurate and actionable within the relevant domain.
Ability to craft effective prompts for LLMs and AI chatbots to obtain relevant and high-quality outputs.
Experience making API requests to interact with AI models (e.g. using OpenAIs API)
Willingness to learn and adapt to new AI technologies tools and methodologies
Strong analytical and critical thinking skills to assess and validate AI-generated outputs ensuring reliability and relevance


Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.


Remote Work :

No


Employment Type :

Full-time

Employment Type

Full-time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.