PySpark ANSI SQL HDFS Hive Python Scala Java Airflow Any ETL tool Shell Scripts ControlM Git CI & CD Unix File System RDBMSEmpirical understanding of data systems (BI analytics data blending data warehousing data ETL etc. on process automation and standardization Good experience in requirement gathering/ analysis coding Unit testing SIT SupportKnowledge working on both Agile and waterfall modelsDevelop end to end framework4 Years of relevant Experience in ETL and Data EngineeringStrong Knowledge in Spark PythonStrong experience in Hive/SQL PL/SQLGood Understanding of ETL & DW Concepts Unix ScriptingDesign implement and maintain Data Pipeline to meet the business requirements.Convert the Business need into Technical complex PySpark Code.Ability to write complex SQL queries for reporting purpose.Strong written and verbal communication and proficiency in reporting analysis tools.Understanding of any ETL toolUnderstanding of any BI toolCloud Computing AWS/AzureGood understanding of SDLCCore Compliance Domain knowledgeExperience in the Agile Scrum Methodology