Data Engineer

Purple Drive

Not Interested
Bookmark
Report This Job

profile Job Location:

Plano, TX - USA

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary



Responsibilities:



Design develop and maintain scalable ETL/ELT pipelines to support data processing and analytics.


Automate data ingestion and transformation workflows using APIs scripting and orchestration tools.


Implement automated health checks data quality validation and pipeline monitoring frameworks.


Utilize technologies such asPython SQL Snowflake SQL and Databricksfor data engineering and analysis.


Develop and maintain comprehensive documentation including:



Architectural and technical diagrams


Job schedules and dependencies


Data dictionaries and schema descriptions


Validation and testing methodologies




Collaborate with cross-functional teams to ensure smooth integration with business systems.


Implement and validate data specifications and business rules to meet functional and compliance requirements.


Deliver accurate and timely data exports and reporting deliverables.


Resolve outstanding data and process backlog items within defined timelines.

Required Skills:

DATA PROCESSINGDOCUMENTATIONSQL

Responsibilities:Design develop and maintain scalable ETL/ELT pipelines to support data processing and analytics.Automate data ingestion and transformation workflows using APIs scripting and orchestration tools.Implement automated health checks data quality validation and pipeline monitoring framewo...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala