Having around 4 years of experience in software development as a Hadoop developer in Big Data/ Hadoop/Spark technology development. Experience in developing applications that perform large scale distributed data processi…
Having around 4 years of experience in software development as a Hadoop developer in Big Data/ Hadoop/Spark technology development. Experience in developing applications that perform large scale distributed data processing using big data ecosystem tools like HDFS, YARN, Sqoop, Flume, Kafka, MapReduce, Pig, Hive, Spark, Spark SQL, Spark Streaming, HBase, Cassandra, MongoDB, Mahout, Oozie, and AWS. Good functional experience in using various Hadoop distributions like Hortonworks, Cloudera, and EMR. Good understanding in using data ingestion tools- such as Kafka, Sqoop and Flume. Experienced in performing in-memory real time data processing using Apache Spark. Good experience in developing multiple Kafka Producers and Consumers as per business requirements. Extensively worked on Spark components like Spark SQL, MLlib, GraphX, and Spark Streaming. Configured Spark Streaming to receive real time data from Kafka and store the stream data to HDFS and process it using Spark and Scala. Experience in spinning up different Azure resources using ARM templates. Experience in setting up Azure Big data environment using Azure HD Insight. Experience in Amazon AWS cloud Administration and actively involved highly available, Scalability, cost effective and fault tolerant systems using multiple AWS services. Experience with an in-depth level of understanding in the strategy and practical implementation of AWS Cloud-Specific technologies including IAM, EC2, EMR, SNS, RDS, Redshift, Athena, Dynamo DB, Lambda, Cloud Watch, Auto-Scaling, S3, and Route 53. Developed quality code adhering to Scala coding standards and best practices. Experienced in the Hadoop ecosystem components like Hadoop Map Reduce, Cloudera, Hortonworks, HBase, Oozie, Flume, Kafka, Hive, Scala, SPARK SQL, Data Frames, SQOOP, MySQL, Unix commands, Cassandra, MongoDB, Tableau tool and related big data tools. Hands on developing and debugging YARN (MR2) Jobs to process large Datasets. Experience in support of IBM Mainframe applications - MVS, COBOL, JCL, PROCs, VSAM, File aid, JCL, SQL and DB2. Hands on experiences with Hadoop stack. (HDFS, Map Reduce, YARN, Sqoop, Flume, Hive-Beeline, Impala, Tez, Pig, Zookeeper, Oozie, Sentry, Kerberos, Centrify DC, Falcon, Hue, Kafka, Storm). Experienced in working with Hadoop/Big-Data storage and analytical frameworks over Azure cloud. Extensive work experience in creating UDFs, UDAFs in Pig and Hive. Involved in deploying applications on Azure. Involved in setting big data cluster using Azure HDInsight. Good experience in using Impala for data analysis. Experience on NoSQL databases such as HBase, Cassandra, MongoDB, and DynamoDB. Implemented CRUD operations using CQL on top of Cassandra file system. Manage and review HDFS data backups and restores on Production cluster. Experience in creating data-models for client's transactional logs, analyzed the data from Cassandra tables for quick searching, sorting, and grouping using the Cassandra Query Language (CQL). Expert knowledge on MongoDB data modeling, tuning, disaster recovery and backup. Hands on experience on Ad-hoc queries, Indexing, Replication, Load balancing, Aggregation in MongoDB. Extending HIVE and PIG core functionality by using custom User Defined Function's (UDF), User Defined Table-Generating Functions (UDTF) and User Defined Aggregating Functions (UDAF) for Hive and Pig. Expertise in relational databases like MySQL, SQL Server, DB2, and Oracle. Great understanding on Solr to develop search engine on unstructured data in HDFS. Experience in cloud platforms like AWS, Azure. Working closely with Azure to migrate the entire Data Centers to the cloud using Cosmos DB, ARM templates. Extensively worked on AWS services such as EC2 instance, S3, EMR, Cloud Formation, Cloud Watch, and Lambda. Experience on ELK stack and Solr to develop search engine on unstructured data in HDFS. Implemented ETL operations using Big Data platform. Involved in identifying job dependencies to design workflow for Oozie & YARN resource management. Experience working with Core Java, J2EE, JDBC, ODBC, JSP, Java Eclipse, EJB and Servlets. Strong experience on Data Warehousing ETL concepts using Informatica, and Talend.
With over 3 years of experience building scalable data pipelines, ETLs, and cloud data warehouses using Azure, Databricks, and Spark, I have the proven ability to design and develop efficient systems to integrate and transform data from diverse sources into analytics-ready structures. My expertise across the full data engineering stack, from infrastructure design to ETL logic to database optimization, along with my strong communication skills to collaborate with stakeholders, deliver solutions, and drive data-driven decision making, make me an excellent fit for this position. I am eager to apply my technical skills in Azure, SQL, Python, and Scala along with my problem-solving aptitude to help clients maximize the value of their data.
نظام التوظيف التشغيلي المعتمد على الذكاء الاصطناعي أولاً، الذي يوحّد ويؤتمت دورة التوظيف بالكامل للمؤسسات الحديثة حول العالم.
د.جوب منطقة حرة ذ.م.م. 2026 © جميع الحقوق محفوظة
