About Me
20+ years of proven expertise, in envisioning and executing strategic & operational, data and analytic initiatives in partnership with business community and product organizations…
Experience
Senior Data Engineer
•
Collaborate with clients to understand their business needs and design scalable, cost-effective, and secure solutions using AWS services.
•
Develop detailed architectures that encompass various AWS services, considering factors like performance, security, reliability, and cost optimization.
•
Provide technical leadership and guidance to development teams, ensuring the proper implementation of AWS best practices and design patterns.
•
Gather and analyze client requirements to determine the most suitable AWS services and configurations to meet their needs.
•
Plan and execute the migration of on-premises systems and applications to AWS, considering factors like data transfer, compatibility, and downtime minimization.
•
Optimize AWS resources to ensure cost-effectiveness by choosing the right instance types, storage options, and pricing models.
•
Design and implement security measures following AWS best practices, including IAM (Identity and Access Management), encryption, and compliance with relevant regulations.
•
Identify and address performance bottlenecks by optimizing configurations and utilizing AWS performance monitoring tools.
•
Create detailed technical documentation, including architectural diagrams, design documents, and best practice guidelines.
•
Lead pilot projects to demonstrate the feasibility of proposed solutions and validate their performance and scalability.
•
Diagnose and resolve technical issues related to AWS services, collaborating with support teams when necessary.
•
Continuously evaluate existing solutions for optimization opportunities, considering advancements in AWS services and evolving business requirements.
•
Design and develop data architecture and data models that cater to the organization's data needs, considering scalability, performance, and data integrity.
•
Build and maintain data pipelines to efficiently ingest and process data from various sources into AWS data storage solutions like Amazon S3, Amazon Redshift, or Amazon DynamoDB.
•
Implement data transformation processes using tools like AWS Glue, Apache Spark, and custom ETL (Extract, Transform, Load) scripts to clean, enrich, and prepare data for analysis.
•
Integrate and harmonize data from disparate sources, ensuring consistency and accuracy across different datasets.
•
Utilize big data technologies such as Amazon EMR (Elastic MapReduce) and AWS Lambda to process and analyze large volumes of data efficiently.
•
Develop and maintain data warehousing solutions usi
Manager
Establish, configure, and manage data warehousing tools, while also developing and conducting testing for applications associated with data warehouse ETL for the client JLL, Chicago, USA.
Senior Informatica Developer
Designed and developed multiple ETL applications using Informatica and Oracle business intelligence tools.
Lead the efforts for platform evaluation & optimization.
Assistant Vice President
Orchestrated the design and development of numerous data marts tailored specifically for an investment banking trading desk.
Conceptualized, structured, and implemented data marts to align with the unique needs and analytical requirements of the trading operations.
Architect
Designed and managed ETL app for trading desk.
Led requirement compilation, conceptual/logical model design, and alignment with trading operations intricacies.
Technical Lead
Thoroughly research data pathways across Dell Inc.'s databases, apps, and systems.
Map using accessible resources, configuring Informatica Metadata Manager for accurate representation, leveraging connectors or custom resources.
Ensure precise and updated data flow visualization.
HCL Technologies, India
Led global team of 16 at Deutsche Bank, Singapore, overseeing project planning, design and technical review of ETL app developed using Informatica, Oracle and UNIX.
Also overseeing compliance, code management, and stakeholder interactions for aligned standards.
Wipro Ltd, USA
Architected data warehouse apps and ETL for trading desks at Charles Schwab and Putnam Investments in the USA.
Led end-to-end process from requirement compilation with business analysts to conceptual/logical model design, accurately reflecting trading intricacies.
AWS Lead Data Engineer – Data Platform
Managed real time data platform for marketing and campaigning analytics and reporting.
Architected and migrated multiple on-premises data warehousing applications from Teradata, vertica etc., to AWS cloud environment.