Nimal Manoj

Nimal Manoj

Associate Software Engineer
India
Malayalam, English, Hindi

About Me

Passionate and experienced data engineer adept at designing and building robust data solutions, implementing scalable ETL pipelines, collaborating with cross-functional teams, and exploring innovative approaches to drive…

Experience

Associate Software Engineer

Prodapt Solution
Aug 2022 - Present · 3 years 11 months

Orchestrated end-to-end data migration and transformation from PostgreSQL and SQL dump sources to JSON format, facilitating integration with app systems.
Designed and implemented SQL scripts to establish staging tables and optimize data extraction, alongside Python automation for efficient ETL processes.
Integrated Kafka messaging framework to ensure real-time data flow, enhancing communication between systems.
Worked closely with the app integration team to customize JSON outputs according to their requirements, ensuring smooth integration.
Executed rigorous testing procedures and comprehensive documentation to guarantee data integrity and streamline future maintenance.

Associate Software Engineer

Prodapt solution
Aug 2022 - Present · 3 years 11 months

Orchestrated end-to-end data migration and transformation from PostgreSQL and SQL dump sources to JSON format, facilitating integration with app systems.
• Designed and implemented SQL scripts to establish staging tables and optimize data extraction, alongside Python automation for efficient ETL processes.
• Integrated Kafka messaging framework to ensure real-time data flow, enhancing communication between systems
• Worked closely with the app integration team to customize JSON outputs according to their requirements, ensuring
smooth integration
• Executed rigorous testing procedures and comprehensive documentation to guarantee data integrity and streamline
future maintenance

Intern

Prodapt Solution
May 2022 - Jul 2022 · 2 months

Completed training covering Postgres, ETL processes and data modeling concepts.
Completed hands-on training in PySpark, a big data processing framework that enables distributed data processing using Python programming language.
Completed network fundamentals.

Skills

ETL Data Integration and Transformation (ETL) Linux PostgreSQL Python Software Engineering Software Development Professional Software Installation SQL Database Code Reviews Data Integration and ETL Database Control GIT Version Control (GIT) Procedures Graph Databases SQL PostgreSQL Neo4j Git GitHub Apache Airflow AWS EC2 Athena Glue Redshift S3 IAM Docker Snowflake Apache Kafka PySpark FastAPI Postman
Report this Profile?