Data Engineer with GCP SPARK SCALA

Data Engineer with experience on Assembling large complex sets of data that meet nonfunctional and functional business requirements.
Identifying designing and implementing internal process improvements including redesigning infrastructure for greater scalability optimizing data delivery and automating manual processes Building required infrastructure for optimal extraction
Transformation and loading of data from various data sources using GCP and SQL technologies
Strong in Java Spark Scala
Hans on experience on Python
Building analytical tools to utilize the data pipeline providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
Experience Working with stakeholders including data design product and executive teams and assisting them with datarelated technical issues
Experience Working with stakeholders including the Executive Product Data and Design teams to support their data infrastructure needs while assisting with datarelated technical issues

General Information Job Description: Expectations from this role:
Act creatively to develop applications by selecting appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions. Account for others developmental activities; assisting Project Manager in day to day project execution.

1. Interpret the application feature and component designs to develop the same in accordance with specifications.
2. Code debug test document and communicate product component and feature development stages.
3. Validate results with user representatives integrating and commissions the overall solution.
4. Select and create appropriate technical options for development such as reusing improving or reconfiguration of existing components while creating own solutions for new contexts
5. Optimises efficiency cost and quality.
6. Influence and improve customer satisfaction
7. Influence and improve employee engagement within the project teams
8. Set FAST goals for selfTypical performance measures:
1. Adherence to engineering process and standards (coding standards)
2. Adherence to project schedule / timelines
3. Number of technical issues uncovered during the execution of the project
4. Number of defects in the code
5. Number of defects post delivery
6. Number of non compliance issues
7. Percent of voluntary attrition
8. On time completion of mandatory compliance trainingsPerformance Areas:
Code:
Code as per the design
Define coding standards templates and checklists
Review code for team and peers

Documentation:
Create/review templates checklists guidelines standards for design/process/development
Create/review deliverable documents. Design documentation requirements test cases and results


Configure:
Define and govern configuration management plan
Ensure compliance from the team

Test:
Review/Create unit test cases scenarios and execution
Review test plan created by testing team
Provide clarifications to the testing team

Domain relevance:
Advise software developers on design and development of features and components with deeper understanding of the business problem being addressed for the client
Learn more about the customer domain and identify opportunities to provide value addition to customers
Complete relevant domain certifications

Manage Project:
Support Project Manager with inputs for the projects
Manage delivery of modules
Manage complex user stories

Manage Defects:
Perform defect RCA and mitigation
Identify defect trends and take proactive measures to improve quality

Estimate:
Create and provide input for effort and size estimation and plan resources for projects