EWB Senior Lead Data Engineer R
Share
Job Location:
Monthly Salary:
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
Senior Lead Data Engineer
Primary Skills
Primary Duties and Responsibilities:
- 10 years of SQL Server ETL Development experience using SSIS Azure Data Factory andAzure Databricks. Strong ETL data warehouse T-SQL skills.
- Understanding of data warehouse and data mart architecture and Kimball methodology.
- 8 years of strong hands-on experience building large-scale databases
- Design build and launch efficient & reliable data pipelines to move and transform data
- Broad understanding and experience of data modeling data management ETL and BI
- Experience in building enterprise data warehousing with table partitioning encryption and data compression
- Experience with cloud migration
- Perform ongoing monitoring automation and refinement of reports and BI solutions.
- Work with BI Management to identify and resolve data related issues.
- Work with business departmental teams to help them define and document business requirements for new metrics and reports.
- Participate in process reviews and enhancements.
- Provide analysis and issue resolution on business reported concerns.
- Participate in design and delivery of cubes dashboards and various self-service business intelligence solutions.
Other:
- Enforces established documentation guidelines and best practices.
- Maintains a high degree of business functional knowledge and current automated technologies and tools.
- Adheres to all policies and procedures concerning all confidential information including but not limited to internal use and restricted information
Qualifications:
- 7 years of experience in working as DataEngineer for Enterprise DWH and BI project for both on prem and cloud (Azure) with minimum of 3 years of hands-on experience in working on Microsoft Technologies (SQL Server Synapse SSIS Data Factory Data Bricks)
- Hands on experience on scripting language python C# or equivalent
- Advanced level experience on MS SQL Server MySql or Oracle
- Experience with Big Data Technologies (NoSQL databases Hive Hbase Pig or Spark)
- Exposure and hands on exposure to ETL using SSIS Data Factory
- Experience and detailed knowledge with Master Data Management ETL Data Quality metadata management data profiling micro-batches streaming data loads.
- Experience of using one/more scalable (MPP) relational databases such as Synapse or Snowflake for advanced analytics
- Working knowledge of application and system availability scalability and distributed data platforms
- Strong experience in data warehousing technologies ETL/ELT implementations
- Knowledge and experience with full SDLC lifecycle
- Experience with Lean / Agile development methodologies
- Experience in providing technical leadership and other engineers for the best practices on the data engineering space.
Desired
- Experience in defining new architectures and ability to drive an independent project from anarchitecturalstand point
- Familiarity with data modeling and ETL tools such as Erwin Talend etc.
- Support users with troubleshooting tuning queries (partition bucket recommendations etc.)
- Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshooting
- Hands-on development mentality with a willingness to troubleshoot and solve complex problems
- CI / CD exposure
- Excellent verbal and written communication skills
Job requirements
Summary:
This position designs and constructs East West Bank enterprise-wide data and information architecture to support business intelligence and data warehouse efforts. Responsible for the design implementation and maintenance of data warehouse and data marts. ETL development skills using Microsoft SSIS expertise in relational structures dimensional data modeling and T-SQL skills are a must. Responsibilities will include physical design and creation of physical databases Work-Load-Management/Priority Scheduling data & user security SQL performance tuning and enforcement of standards data replication and documentation. Help the Bank adopt and organize data. He or she will improve existing systems (and potentially assess new technologies) to make it easier to manage and deliver information. Combining their knowledge of technology and business management to deliver state-of-the-art business intelligence solutions improve efficiency.
Primary Duties and Responsibilities:
- 10 years of SQL Server ETL Development experience using SSIS Azure Data Factory andAzure Databricks. Strong ETL data warehouse T-SQL skills.
- Understanding of data warehouse and data mart architecture and Kimball methodology.
- 8 years of strong hands-on experience building large-scale databases
- Design build and launch efficient & reliable data pipelines to move and transform data
- Broad understanding and experience of data modeling data management ETL and BI
- Experience in building enterprise data warehousing with table partitioning encryption and data compression
- Experience with cloud migration
- Perform ongoing monitoring automation and refinement of reports and BI solutions.
- Work with BI Management to identify and resolve data related issues.
- Work with business departmental teams to help them define and document business requirements for new metrics and reports.
- Participate in process reviews and enhancements.
- Provide analysis and issue resolution on business reported concerns.
- Participate in design and delivery of cubes dashboards and various self-service business intelligence solutions.
Other:
- Enforces established documentation guidelines and best practices.
- Maintains a high degree of business functional knowledge and current automated technologies and tools.
- Adheres to all policies and procedures concerning all confidential information including but not limited to internal use and restricted information
Qualifications:
- 7 years of experience in working as DataEngineer for Enterprise DWH and BI project for both on prem and cloud (Azure) with minimum of 3 years of hands-on experience in working on Microsoft Technologies (SQL Server Synapse SSIS Data Factory Data Bricks)
- Hands on experience on scripting language python C# or equivalent
- Advanced level experience on MS SQL Server MySql or Oracle
- Experience with Big Data Technologies (NoSQL databases Hive Hbase Pig or Spark)
- Exposure and hands on exposure to ETL using SSIS Data Factory
- Experience and detailed knowledge with Master Data Management ETL Data Quality metadata management data profiling micro-batches streaming data loads.
- Experience of using one/more scalable (MPP) relational databases such as Synapse or Snowflake for advanced analytics
- Working knowledge of application and system availability scalability and distributed data platforms
- Strong experience in data warehousing technologies ETL/ELT implementations
- Knowledge and experience with full SDLC lifecycle
- Experience with Lean / Agile development methodologies
- Experience in providing technical leadership and other engineers for the best practices on the data engineering space.
Desired
- Experience in defining new architectures and ability to drive an independent project from anarchitecturalstand point
- Familiarity with data modeling and ETL tools such as Erwin Talend etc.
- Support users with troubleshooting tuning queries (partition bucket recommendations etc.)
- Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshooting
- Hands-on development mentality with a willingness to troubleshoot and solve complex problems
- CI / CD exposure
- Excellent verbal and written communication skills
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
Senior IC
Key Skills
About Company
Brillio is a global leader in Enterprise Digital Transformation Solutions, providing strategic consulting services and solutions using emerging technologies.
