About Me
Data Engineer with 4+ years of experience, proven track record in designing, implementing, and maintaining robust data infrastructure and pipelines. Proficient in Python, SQL, and Scala and Machine Learning, specialize i…
Data Engineer with 4+ years of experience, proven track record in designing, implementing, and maintaining robust data infrastructure and pipelines. Proficient in Python, SQL, and Scala and Machine Learning, specialize in ETL processes, leveraging tools like Apache Spark and Hadoop for distributed data processing and also proficient in NLP, Deep Learning, and machine learning models for analysis.
Experience
Data Engineer
•Identified and curated diverse data sources (databases, APIs, streaming platforms) for predictive analytics, using
Python (numpy, pandas) and Agile methodology for adaptability.
•Orchestrated robust ETL pipelines with Apache Airflow DAGs, employing SQL Server for data querying.
Emphasized Agile principles for rapid iteration and responsiveness.
•Architected and optimized Snowflake data lake infrastructure, tailoring schemas and implementing versioning
mechanisms for efficient data governance. Proficient in SQL for database management.
•Conducted meticulous data cleaning and preprocessing using Python (Pandas, numpy, Scipy), adhering to
stringent validation standards. Applied Agile principles for flexibility in data preparation workflows.
•Developed predictive models (regression, classification, time series forecasting) using scikit-learn and
TensorFlow frameworks. Applied Agile methodologies for iterative model development, ensuring alignment with
evolving business objectives.
Data Engineer
Implemented robust data ingestion pipelines utilizing AWS services, Lambda functions, and Python scripting, leveraging libraries such as NumPy and pandas for advanced data manipulation and analysis.
Collaborated with interdisciplinary data teams to address complex queries related to customer management, employing SQL for efficient data retrieval and analysis.
Played a pivotal role in training and onboarding 30+ new employees, ensuring proficiency in Python, SQL, and data analytics tools for seamless project integration.
Designed and developed intuitive reporting dashboards and visualizations using Power BI and Excel, enabling stakeholders to derive actionable insights on a daily and weekly basis.
Managed 125-member team to achieve 20% save/load time reduction and 15% overall operation time improvement through strategic resource allocation and process enhancements.
Spatial Data Specialist
Spearheaded the conversion of physical maps into digital formats, optimizing computer usage and streamlining project workflows.
Applied advanced spatial data analysis using ArcGIS and MapInfo, developing structured data models for precise insights and informed decision-making.
Led and mentored a 25-member team, ensuring timely project execution and issue resolution, fostering a collaborative and high-performing environment.
Implemented daily checks and feedback mechanisms, reducing labor costs by 30% while maintaining superior project deliverables through stringent quality assurance measures.