Python Data Engineer
Python Data Engineer
Posted on :
22-02-2024
Employer Active
1 Vacancy
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Req ID : 2567716
We are looking to hire Senior Data Engineer with a financial background. Who will play a crucial role in leveraging Snowflake a cloudbased data warehousing platform to manage and analyze financial data.
Job Title Python Data Engineer
End client: Financial Institution
Office location: New York NY (Remote)
Duration: 6 months minimum to start with but will be a long term contract
Exp needed: 34 yrs
Please feel free to send over any names or forward this message to anyone who may be interested. Please check it out on our career site.
Job Description
Qualification
Strong Python Django Flask Data bricks Data Pipeline SSIS
Skills sets which are must:
- First priority: Strong Python
- Second priority: Snow Flakes
- Third Priority: Data Bricks
- ELK experience if they have in actual is a plus.
Good to Have:
- Experience in the Finance / Banking industry some understanding of Securities and Banking products.
Job Responsibilities:
- Able to provide architecture design implementation and operationalization of largescale data and analytics solutions on Snowflake Cloud Data Warehouse
- Provide production support for Data Warehouse issues such data load problems transformation translation problems.
- Able to translate mapping specifications to data transformation design and development strategies and code incorporating standards and best practices for optimal execution.
- Able to work on data pipelines and modern ways of automating data pipeline using cloudbased testing and clearly document implementations.
- Able to perform code reviews to ensure fit to requirements optimal execution patterns and adherence to established standards.
- Able to develop EL pipelines in and out of data warehouse using combination of Databricks Python and Snow SQL.
- Able to provide data ingestion and processing pipelines using Python Databricks Snow SQL
- Able to Establish and monitor Operational Level Agreements for the health and performance/cost of the warehouse environment (Loads queries data quality)
Required Qualifications
- Overall 7 years of experience is required.
- Minimum 3 years of experience in design and implementation of largescale data solution on Azure Snowflake Data Warehouse
- Handson experience with Snowflake utilities such as Snow SQL Snow Pipe Python Tasks Streams Time travel Optimizer Metadata Manager data sharing and stored procedures.
- Good experience in Data warehousing OLTP OLAP Dimensions Facts and Data modelling
- Good knowledge of MS Azure configuration items with respect to Snowflake
- Experience in writing scripts (UNIX Python)
- Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
