Data Solution Architect

About The Job:

• We are looking for an experienced Big Data Engineer with strong expertise in distributed data systems Hadoop ecosystem data engineering and team leadership.
• The ideal candidate should have hands-on experience in designing developing optimizing and managing large-scale data platforms while leading engineering teams and driving data solutions.

Essential Job Functions:

• Work extensively in the Big Data ecosystem including Hadoop Stack (MapReduce HDFS Pig Hive HBase Flume Sqoop) and NoSQL databases such as Cassandra and HBase.
• Develop optimize and maintain complex Java MapReduce and Hive jobs.
• Lead Backend and Distributed Data Systems teams while remaining actively involved in hands-on development activities.
• Manage Business Intelligence teams and vendor partners prioritizing projects based on customer and business requirements.
• Develop and maintain enterprise-grade dashboards using industry best practices.
• Lead and mentor a team of Data Engineers including full-time employees and third-party resources.
• Analyze and validate the integrity and quality of source data.
• Lead deployment activities and audit data models and attributes for accuracy and consistency.
• Design and implement real-time and stream-processing solutions using technologies such as Spark Streaming and Storm.
• Develop solutions using object-oriented and functional programming languages including Python and Scala.
• Design and build dimensional data models to improve data accessibility efficiency and quality.
• Write advanced SQL queries and perform SQL performance tuning and optimization.
• Collaborate with data science and analytics teams to support machine learning and advanced analytics initiatives.
• Manage relational and NoSQL databases including PostgreSQL and Cassandra.
• Own and deliver key Big Data engineering deliverables from a project and delivery perspective.
• Troubleshoot and resolve complex networking software and data-related issues.
• Develop and maintain strong relationships with internal stakeholders and cross-functional teams.
• Support team goals by assisting colleagues and promoting collaborative work practices.

Qualifications:
Required Skills & Experience

• 7-10 years of experience as a Big Data Engineer.
• Strong experience with Hadoop ecosystems preferably Cloudera Hadoop distribution.
• In-depth knowledge of Hadoop Spark and distributed computing frameworks.
• Hands-on experience with Big Data querying tools such as Hive Pig and Impala.
• Strong programming and scripting experience in Java Python Scala C Linux Shell scripting Ruby PHP and R.
• Experience with stream-processing frameworks such as Spark Streaming and Storm.
• Experience working with relational databases and NoSQL platforms including PostgreSQL Cassandra and HBase.
• Strong expertise in advanced SQL development and query performance tuning.
• Experience designing and implementing dimensional data models and data warehouse solutions.
• Proven experience leading and mentoring Big Data engineering teams.
• Strong understanding of distributed systems architecture and large-scale data processing.
• Excellent analytical troubleshooting and problem-solving skills.
• Strong planning organizational and project execution capabilities.
• Excellent interpersonal and stakeholder management skills.

Good to Have

• Experience with Data Science and Machine Learning tools and technologies.
• Experience with Azure Cloud Services and cloud-native data platforms.
• Exposure to Financial Services domain.
• Experience contributing to open-source Big Data technologies.

Key Competencies

• Strong leadership and team management capabilities.
• Ability to work in fast-paced and highly collaborative environments.
• Excellent communication and stakeholder management skills.
• Ability to effectively plan organize and prioritize work.
• Strong focus on delivery excellence and operational efficiency.
• Commitment to mentoring team members and driving continuous improvements.

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes and for additional job opportunities please visit Jobs In India VARITE.

Unlock Rewards: Refer Candidates and Earn.

If youre not available or interested in this opportunity please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral Program where youll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

• 0-2 years - INR 5000
• 2-6 years - INR 7500
• 6 years - INR 10000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 companies in the USA UK Canada and India. VARITE is currently a primary and direct vendor to leading corporations in Networking Cloud Infrastructure Hardware & Software Digital Marketing & Media Solutions Clinical Diagnostics Utilities Gaming & Entertainment and Financial Services.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race color religion sex sexual orientation gender identity or expression national origin age marital status veteran status or disability status.