About Me
20+ years of proven expertise, in envisioning and executing strategic & operational, data and analytic initiatives in partnership with business community and product organizations…
Experience
Senior Data Engineer
•
Collaborate with clients to understand their business needs and design scalable, cost-effective, and secure solutions using AWS services.
•
Develop detailed architectures that encompass various AWS services, considering factors like performance, security, reliability, and cost optimization.
•
Provide technical leadership and guidance to development teams, ensuring the proper implementation of AWS best practices and design patterns.
•
Gather and analyze client requirements to determine the most suitable AWS services and configurations to meet their needs.
•
Plan and execute the migration of on-premises systems and applications to AWS, considering factors like data transfer, compatibility, and downtime minimization.
•
Optimize AWS resources to ensure cost-effectiveness by choosing the right instance types, storage options, and pricing models.
•
Design and implement security measures following AWS best practices, including IAM (Identity and Access Management), encryption, and compliance with relevant regulations.
•
Identify and address performance bottlenecks by optimizing configurations and utilizing AWS performance monitoring tools.
•
Create detailed technical documentation, including architectural diagrams, design documents, and best practice guidelines.
•
Lead pilot projects to demonstrate the feasibility of proposed solutions and validate their performance and scalability.
•
Diagnose and resolve technical issues related to AWS services, collaborating with support teams when necessary.
•
Continuously evaluate existing solutions for optimization opportunities, considering advancements in AWS services and evolving business requirements.
•
Design and develop data architecture and data models that cater to the organization's data needs, considering scalability, performance, and data integrity.
•
Build and maintain data pipelines to efficiently ingest and process data from various sources into AWS data storage solutions like Amazon S3, Amazon Redshift, or Amazon DynamoDB.
•
Implement data transformation processes using tools like AWS Glue, Apache Spark, and custom ETL (Extract, Transform, Load) scripts to clean, enrich, and prepare data for analysis.
•
Integrate and harmonize data from disparate sources, ensuring consistency and accuracy across different datasets.
•
Utilize big data technologies such as Amazon EMR (Elastic MapReduce) and AWS Lambda to process and analyze large volumes of data efficiently.
•
Develop and maintain data warehousing solutions usi
Manager
<p>Establish, configure, and manage data warehousing tools, while also developing and conducting testing for applications associated with data warehouse ETL for the client JLL, Chicago, USA.</p>
Senior Informatica Developer
<p>Designed and developed multiple ETL applications using Informatica and Oracle business intelligence tools.<br>
Lead the efforts for platform evaluation & optimization.</p>
Assistant Vice President
<p>Orchestrated the design and development of numerous data marts tailored specifically for an investment banking trading desk.<br>
Conceptualized, structured, and implemented data marts to align with the unique needs and analytical requirements of the trading operations.</p>
Architect
<p>Designed and managed ETL app for trading desk.<br>
Led requirement compilation, conceptual/logical model design, and alignment with trading operations intricacies.</p>
Technical Lead
<p>Thoroughly research data pathways across Dell Inc.'s databases, apps, and systems.<br>
Map using accessible resources, configuring Informatica Metadata Manager for accurate representation, leveraging connectors or custom resources.<br>
Ensure precise and updated data flow visualization.</p>
HCL Technologies, India
<p>Led global team of 16 at Deutsche Bank, Singapore, overseeing project planning, design and technical review of ETL app developed using Informatica, Oracle and UNIX.<br>
Also overseeing compliance, code management, and stakeholder interactions for aligned standards.</p>
Wipro Ltd, USA
<p>Architected data warehouse apps and ETL for trading desks at Charles Schwab and Putnam Investments in the USA.<br>
Led end-to-end process from requirement compilation with business analysts to conceptual/logical model design, accurately reflecting trading intricacies.</p>
AWS Lead Data Engineer – Data Platform
<p>Managed real time data platform for marketing and campaigning analytics and reporting.<br>
Architected and migrated multiple on-premises data warehousing applications from Teradata, vertica etc., to AWS cloud environment.</p>