drjobs Senior Data Engineer / Architect

Senior Data Engineer / Architect

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Hyderabad - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Description

Experience Required: 8Years

Mode of work: Remote

Skills Required: Azure DataBricks Eventhub Kafka ArchitectureAzure Data Factory Pyspark Python SQL Spark

Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within July 4th 2025)

  • Design develop and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks.
  • Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights.
  • Build and optimize data pipelines for data ingestion processing and integration using Spark and Databricks.
  • Ensure data quality integrity and security throughout all stages of the data lifecycle.
  • Collaborate with cross-functional teams to design and implement data models schemas and storage solutions.
  • Optimize data processing and analytics performance by tuning Spark jobs and leveraging Databricks features.
  • Provide technical guidance and expertise to junior data engineers and developers.
  • Stay up to date with emerging trends and technologies in cloud computing big data and data engineering.
  • Contribute to the continuous improvement of data engineering processes tools and best practices.


Benefits
  • Bachelors or masters degree in computer science engineering or a related field.
  • 10 years of experience as a Data Engineer Software Engineer or similar role with a focus on building cloud-based data solutions.
  • Strong knowledge and experience with Azure cloud platform DatabricksEventHubArchitectureSparkKafka ETL PipelinePython/Pyspark SQL.
  • Strong experience with cloud platforms such as Azure .
  • Proficiency in Apache Spark and Databricks for large-scale data processing and analytics.
  • Experience in designing and implementing data processing pipelines using Spark and Databricks.
  • Strong knowledge of SQL and experience with relational and NoSQL databases.
  • Experience with data integration and ETL processes using tools like Apache Airflow or cloud-native orchestration services.
  • Good understanding of data modelling and schema design principles.
  • Experience with data governance and compliance frameworks.
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication and collaboration skills to work effectively in a cross-functional team.

Interested in joining our team Send your resume to to explore this opportunity further.


Required Experience:

Senior IC

Employment Type

Full-Time

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.