Experience required 14 Years with Mandate Skills Databricks Snowflake Python Pyspark SQL and Banking
Overview:
We are seeking a skilled Data Engineer with expertise in Databricks Snowflake Python Pyspark SQL and Release Management to join our dynamic team. The ideal candidate will have a strong background in the banking domain and will be responsible for designing developing and maintaining robust data pipelines and systems to support our banking operations and analytics.
Key Responsibilities:
Design develop and maintain scalable and efficient data pipelines using Snowflake Pyspark and SQL.
Write optimized and complex SQL queries to extract transform and load data.
Develop and implement data models schemas and architecture that support banking domain requirements.
Collaborate with data analysts data scientists and business stakeholders to gather data requirements.
Automate data workflows and ensure data quality accuracy and integrity.
Manage and coordinate release processes for data pipelines and analytics solutions.
Monitor troubleshoot and optimize the performance of data systems.
Ensure compliance with data governance security and privacy standards within the banking domain.
Maintain documentation of data architecture pipelines and processes.
Stay updated with the latest industry trends and incorporate best practices.
Required Skills and Experience:
Proven experience as a Data Engineer or in a similar role with a focus on Snowflake Python Pyspark and SQL.
Strong understanding of data warehousing concepts and cloud data platforms especially Snowflake.
Hands-on experience with release management deployment and version control practices.
Solid understanding of banking and financial services industry data and compliance requirements.
Proficiency in Python scripting and Pyspark for data processing and automation.
Experience with ETL/ELT processes and tools.
Knowledge of data governance security and privacy standards.
Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities.
Preferred Qualifications:
Good Knowledge in Azure and Databricks in highly preferred.
Knowledge of Apache Kafka or other streaming technologies.
Familiarity with DevOps practices and CI/CD pipelines.
Prior experience working in the banking or financial services industry.
Disclaimer:
This e-mail contains confidential information or information belonging to Infyshine Technologies and is intended solely for the Addresses. The unauthorized disclosure use dissemination or copying (either whole or partial of this e-mail or any information it contains) is prohibited. E-mail is susceptible to alteration and their integrity cannot be guaranteed. Infyshine Technologies shall not be liable of this e-mail if modified or falsified. If you are not the intended recipient of this e-mail please delete it immediately from your system & notify the sender of the wrong delivery and mail the deletion.
Greetings from Infyshine Inc. Job Title: Senior Data Engineer - Iselin NJ Location Iselin NJ (3 days onsite hybrid) Duration: Long term In-person Interview required. Experience required 14 Years with Mandate Skills Databricks Snowflake Python Pyspark SQL and Banking Overview: We are...
Greetings from Infyshine Inc.
Job Title: Senior Data Engineer - Iselin NJ
Location Iselin NJ (3 days onsite hybrid)
Duration: Long term
In-person Interview required.
Experience required 14 Years with Mandate Skills Databricks Snowflake Python Pyspark SQL and Banking
Overview:
We are seeking a skilled Data Engineer with expertise in Databricks Snowflake Python Pyspark SQL and Release Management to join our dynamic team. The ideal candidate will have a strong background in the banking domain and will be responsible for designing developing and maintaining robust data pipelines and systems to support our banking operations and analytics.
Key Responsibilities:
Design develop and maintain scalable and efficient data pipelines using Snowflake Pyspark and SQL.
Write optimized and complex SQL queries to extract transform and load data.
Develop and implement data models schemas and architecture that support banking domain requirements.
Collaborate with data analysts data scientists and business stakeholders to gather data requirements.
Automate data workflows and ensure data quality accuracy and integrity.
Manage and coordinate release processes for data pipelines and analytics solutions.
Monitor troubleshoot and optimize the performance of data systems.
Ensure compliance with data governance security and privacy standards within the banking domain.
Maintain documentation of data architecture pipelines and processes.
Stay updated with the latest industry trends and incorporate best practices.
Required Skills and Experience:
Proven experience as a Data Engineer or in a similar role with a focus on Snowflake Python Pyspark and SQL.
Strong understanding of data warehousing concepts and cloud data platforms especially Snowflake.
Hands-on experience with release management deployment and version control practices.
Solid understanding of banking and financial services industry data and compliance requirements.
Proficiency in Python scripting and Pyspark for data processing and automation.
Experience with ETL/ELT processes and tools.
Knowledge of data governance security and privacy standards.
Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities.
Preferred Qualifications:
Good Knowledge in Azure and Databricks in highly preferred.
Knowledge of Apache Kafka or other streaming technologies.
Familiarity with DevOps practices and CI/CD pipelines.
Prior experience working in the banking or financial services industry.
Disclaimer:
This e-mail contains confidential information or information belonging to Infyshine Technologies and is intended solely for the Addresses. The unauthorized disclosure use dissemination or copying (either whole or partial of this e-mail or any information it contains) is prohibited. E-mail is susceptible to alteration and their integrity cannot be guaranteed. Infyshine Technologies shall not be liable of this e-mail if modified or falsified. If you are not the intended recipient of this e-mail please delete it immediately from your system & notify the sender of the wrong delivery and mail the deletion.