Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Wissen Technology is now hiring Full Stack Developer (React Node)
We are seeking a skilled Data Engineer with expertise in building and managing data pipelines data transformation and integration processes. The ideal candidate will have strong experience in handling data in Dimension and Fact tables as well as in migrating and managing data on a Common Data Platform (CDP). You will be responsible for ensuring the integrity and availability of data across various systems supporting both Technical and Business QA processes and collaborating with crossfunctional teams to deliver highquality data solutions.
Experience 512 Years
Location: Bangalore
Key Responsibilities:
Data Pipeline Development:
Design develop and maintain data pipelines for integration and ingestion from various sources.
Implement data cleaning enriching and aggregation processes within a Common Data Platform following the Bronze Silver and Gold architecture layers.
Ensure data pipelines are robust scalable and efficient feeding data to consumer systems in a timely and reliable manner.
Data Handling & Management:
Manage data in Dimension and Fact tables ensuring data integrity and accuracy.
Update EntityRelationship (ER) models and maintain data cataloging within the platform.
Migrate local data platforms to the Common Data Platform using tools like Talend or Informatica.
Replicate existing ETL transformations from local sources to the CDP ensuring consistency and accuracy.
Technical & Business QA Support:
Collaborate with Technical and Business QA teams to validate data pipelines and transformations.
Troubleshoot and resolve datarelated issues ensuring that all data processes meet the required quality standards.
Technology Skills:
MustHave:
Proficiency in PySpark & SQL.
ShouldHave:
Scripting experience with Python & Bash.
AWS Knowledge.
CI/CD experience with GitHub Actions.
CouldHave:
Terraform for infrastructure management.
Airflow for workflow automation.
Knowledge of graph databases like Neptune or Neo4j.
Understanding of Medallion Architecture for data structuring.
Experience with Atlassian or Unity Catalog for data governance.
Qualifications:
Bachelors degree in Computer Science Information Technology or a related field.
3 years of experience in Data Engineering with a focus on data pipeline development data integration and data transformation.
Strong problemsolving skills and attention to detail.
Excellent communication skills and the ability to work collaboratively in a team environment.
Preferred Qualifications:
Experience with Talend Informatica or similar ETL tools.
Familiarity with cloud platforms and data migration strategies.
About Wissen Technology:
Employment Type
Full-Time
