6yrs of Experience in Spark ETL on Bigdata and Above is Must Database knowledge and should be able to write the queries Spark ETL on Big Data Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have).Design & implementation of scalable & fault tolerant ETL Pipelines on Bigdata Platform to store & process terabytes of contract informations from upstream sources with high availabilityActively work on performance tuning techniques through understanding Spark DAGs on data structures on both Relational & Big Data Platforms giving high performance to both ETL & Reporting ComponentsPerforms adhoc data research & analysis provide written summaries of results for nontechnical business usersWorking with the onsite development team and providing necessary overlap coverage to ensure smooth transition and communication between offshore and onsiteWork closely with multiple teams(Business Analyst ETL DB team Infra Support etc )Work collaboratively in a small crossfunctional Global Team
Required Experience:
Senior IC