Sapharish Natarajan

Sapharish Natarajan

Data Engineer
India

About Me

Data Engineer with over 9 months of experience in optimum infosystems pvt ltd. Excellent reputation for developing new functionalities. Ability in resolving problems and improving customer satisfaction.

Experience

Data Engineer

Optimum infosystem pvt ltd
Feb 2022 - Present · 4 years 5 months

Data engineer (Feb 2022 -till date)
 Involved in interacting with Design Leads, Business Admins to understand various project
requirements and implement (transformation of raw data) using PySpark.  Worked on a highly agile environment where multiple features are developed and merged
into the existing framework.  Prepared written summaries to accompany results and maintain documentation in
confluence.  Contributed to internal activities for overall process improvements, efficiencies and
innovation.  Actively participated in code reviews, prod deployments, debugging and fixing issues.  Implemented ETL using AWS Services such as S3, Lambda, SSM, CloudWatch, and SNS.  Analyzed SQL scripts and designed the solution to implement using PySpark.  Worked on Mongo DB as part of Ad hoc activity by client to manipulate historical data.  Archiving data from production server as a part of data cleaning activity through AWS Glue.  Good exposure in Version Controlling system GitHub .  Experience with Pandas, PyMongo, Requests, boto3, Python libraries during development
lifecycle.

Data engineer

optimum infosystems pvt ltd
Feb 2022 - Present · 4 years 5 months

Involved in interacting with Design Leads and Business Admins to understand various project requirements and implement transformation of raw data using PySpark.
Worked on a highly agile environment where multiple features are developed and merged into the existing framework.
Prepared written summaries to accompany results and maintain documentation in Confluence.
Contributed to internal activities for overall process improvements, efficiencies and innovation.
Actively participated in code reviews, prod deployments, debugging and fixing issues.
Implemented ETL using AWS Services such as S3, Lambda, SSM, CloudWatch, and SNS.
Analyzed SQL scripts and designed the solution to implement using PySpark.
Worked on Mongo DB as part of ad hoc activity by client to manipulate historical data.
Archiving data from production server as a part of data cleaning activity through AWS Glue.
Good exposure in version controlling system GitHub.
Experience with Pandas, PyMongo, Requests, boto3, Python libraries during development lifecycle.

Skills

Big Data Data Repository Hadoop Spark Amazon Web Services (AWS) NoSQL S3 Python PySpark Java Oracle MongoDB AWS Lambda AWS Glue Amazon S3 Amazon SNS AWS SSM AWS Crawler Amazon Athena AWS CloudWatch GitHub Pandas PyMongo Requests boto3 MapReduce Big Data Analytics Apache Spark PL/SQL
Report this Profile?