azaman

Highly experienced, multi-skilled programmer with a progressive career covering multiple generations of technology, culminating in good knowledge of Python, Snowflake and AWS. Meticulous in analysis, design and development of solutions and applications in an agile environment, with experience across the full software development life cycle (SDLC). Confident in balancing the requirements of stakeholders and reporting on build progress and defect remediation status. Task-driven and capable of self-governance in project management and equally strong operating as part of a technical team. I have been working in the area of data integration/data warehousing since 2000 , with particular focus on analysis, design, development and support of DW/ETL applications and completed over sixteen data integration projects in UK and across Europe, with sizes in terabytes, for clients such as London Transport, Vodafone UK, BT, Sky, Vodafone Netherlands, O2 , Sainsbury, Deutsche Bank, Barclaycard, e. on Energy Trading and orange, T-Mobile , ECHA ,Standard Life, Ingenico e-payments , Lidl and UBS.I have also been involved in a number of high profile data migration projects for clients such as Polish Ministry of Finance in Poland, Sky in Scotland and Vodafone in Netherlands.

<p>Identifying requirements for data pipelines<br>
Investigating and identifying available data points for each pipeline dataset<br>
Agreeing record format (csv or json), data delivery time and data landing location (AWS S3) with source data provider<br>
Performing Data Vault Modelling (conceptual and Physical)<br>
Producing ETL Specification (source to target mapping) with data validation rules<br>
Producing Outline design specification (including animated data pipeline data flow) for each dataset<br>
Helping Product Owner with work breakdowns<br>
Building, Testing and Deploying data pipeline using python, snowflake tasks, stored procedures, streams, AWS s3 and DBT<br>
Designing automated data integration report for target tables in target database<br>
Version controlling all artefacts in Github repository<br>
Overseeing development (review Git-Hub PR, discuss technical option)<br>
Dealing with any blocking issue reported during stand-up<br>
Helping fellow engineers overcoming any technical challenges<br>
Automating all backend tasks with shell scripts</p>

<p>Studied various aws services (EC2, S3, Lambda, Boto3, Dynamo DB, RDB)<br>
Designed, built and deployed CICD pipeline using GitHub Actions<br>
Designed and built Django-based testimonials website and deployed on AWS using Route53<br>
Learnt advanced features of python (multithreading, multiprocessing, asynchronous programming and socket programming)<br>
Built up expertise in snowflake and DBT<br>
Become project base AWS solution architect</p>

<p>Identifying requirements for data pipelines<br>
Investigating and identifying available data points for each pipeline dataset in kafka stream<br>
Designing schema for target database<br>
Designing flat file structures for HDFS<br>
Producing ETL specification (transformation and validation rules) for oracle database target<br>
Producing ETL specification (transformation and validation rules) for HDFS target<br>
Creating test data for both database and HDFS targets<br>
Building and testing data pipeline for target database<br>
Building and testing pipeline for target HDFS<br>
Version controlling all artefacts in Github<br>
Manually deploy artefacts<br>
Automating all backend tasks with shell scripts</p>

<p>Producing outline design for Data Lake from requirements<br>
Producing ETL specification for json file target<br>
Producing ETL specification for flat file target<br>
Producing ETL specification for excel files target<br>
Producing ETL specification for multiple oracle database targets<br>
Building and testing pipeline for json target<br>
Building and testing pipeline for flat file target<br>
Building and testing pipeline for excel file target<br>
Building and testing pipeline for database targets<br>
Version controlling all artefacts into Github<br>
Manually deploy all artefacts<br>
Automating all backend tasks with shell scripts</p>

<p>Establishing required datasets for pipelines from requirements<br>
Identifying data landing zone for data sources<br>
Designing target schema for oracle database<br>
Designing flat file structures for target HDFS<br>
Producing ETL specification for target database<br>
Producing ETL specification for HDFS<br>
Developing and testing pipeline for oracle database<br>
Developing and testing pipeline for HDFS<br>
Version controlling all artefacts<br>
Deploying all artefacts manually<br>
Automating all backend tasks with shell scripts</p>

<p>Establishing required dataset from requirements<br>
Identifying sources for dataset in kafka stream<br>
Designing target database schema<br>
Producing ETL specification<br>
Creating test data<br>
Building and testing data pipeline<br>
Version controlling all artefacts<br>
Manual deploying all artefacts<br>
Automating all backend tasks with shell scripts<br>
Establishing reporting data structure from requirements<br>
Identifying sources for dataset in reporting database<br>
Designing required json schema for the report<br>
Designing required flat file record structure for the report<br>
Building and testing json and csv reports<br>
Designing and building module for emailing reports to clients<br>
Manually deploying all artefacts</p>

<p>Joined an Agile/Scrum driven IT and change department to conduct performance analysis and quality assurance (QA) of graphs designed to perform ETL<br>
Facilitated technical team leadership during project management lifecycle</p>

<p>Evaluated the new Denodo data virtualisation platform for capability in integrating data for dashboard reporting<br>
Focused on deliverables across data interfacing, relationship profiling, database design, ETL specifications, test strategy and PL/SQL procedures<br>
Facilitated support in resolving ETL processing problems such as logic fixes, PL/SQL performance improvement and OWB module creation<br>
Analysed new and existing star schemas against preliminary requirements to enable creation of a business object universe, operating within a regulatory environment</p>

<p>Served in a consultancy capacity on a number of PL/SQL and Oracle based projects for various multi-sector clients<br>
Testing of data marts<br>
ETL application enhancement and rewrite<br>
Bug fixing<br>
Application deployment issues</p>

<p>Formed part of a project management team to consult on a BI program for client EE as a senior developer and solution designer, from initial analysis to testing of data integration applications<br>
Engaged with client Data Authority on data integration and warehousing projects<br>
Liaised with Delivery Manager on high-level project planning and estimating<br>
Built a sound understanding of upcoming projects using software requirements specifications</p>