Nimal Manoj

Nimal Manoj

Associate Software Engineer
India
Malayalam, English, Hindi

نبذة عني

Passionate and experienced data engineer adept at designing and building robust data solutions, implementing scalable ETL pipelines, collaborating with cross-functional teams, and exploring innovative approaches to drive…

الخبرة

Associate Software Engineer

Prodapt Solution
Aug 2022 - حتى الآن · 3 سنوات 11 أشهر

Orchestrated end-to-end data migration and transformation from PostgreSQL and SQL dump sources to JSON format, facilitating integration with app systems.
Designed and implemented SQL scripts to establish staging tables and optimize data extraction, alongside Python automation for efficient ETL processes.
Integrated Kafka messaging framework to ensure real-time data flow, enhancing communication between systems.
Worked closely with the app integration team to customize JSON outputs according to their requirements, ensuring smooth integration.
Executed rigorous testing procedures and comprehensive documentation to guarantee data integrity and streamline future maintenance.

Associate Software Engineer

Prodapt solution
Aug 2022 - حتى الآن · 3 سنوات 11 أشهر

Orchestrated end-to-end data migration and transformation from PostgreSQL and SQL dump sources to JSON format, facilitating integration with app systems.
• Designed and implemented SQL scripts to establish staging tables and optimize data extraction, alongside Python automation for efficient ETL processes.
• Integrated Kafka messaging framework to ensure real-time data flow, enhancing communication between systems
• Worked closely with the app integration team to customize JSON outputs according to their requirements, ensuring
smooth integration
• Executed rigorous testing procedures and comprehensive documentation to guarantee data integrity and streamline
future maintenance

Intern

Prodapt Solution
May 2022 - Jul 2022 · 2 أشهر

Completed training covering Postgres, ETL processes and data modeling concepts.
Completed hands-on training in PySpark, a big data processing framework that enables distributed data processing using Python programming language.
Completed network fundamentals.

المهارات

دمج وتحويل البيانات باستخدام ETL (ETL) لينكس بوستجريس كيو إل بايثون (لغة برمجة) هندسة البرمجيات تطوير البرمجيات المحترف تثبيت البرمجيات قاعدة بيانات SQL مراجعات الشفرة دمج البيانات وETL التحكم في قواعد البيانات جيت (GIT) إجراءات قواعد بيانات الرسوم البيانية SQL PostgreSQL Neo4j Git GitHub Apache Airflow AWS EC2 Athena Glue Redshift S3 IAM Docker Snowflake Apache Kafka PySpark FastAPI Postman
الإبلاغ عن هذا الملف الشخصي؟