Data Engineer
Job Location:
Monthly Salary:
Posted on:
Yesterday
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Job Title: Data Engineer
Key Skills: Power BI Azure Data Bricks Python
Plano TX- In person only
Its ITAR Position- Need USC Only
Job Summary: We are seeking a Data Engineer with strong experience with data wrangling and building enterprise data pipelines including ingestion transformation and management.
Responsibilities:
- Design develop and maintain end-to-end data pipelines using data ingestion tools and Azure Databricks
- Implement scalable data ingestion frameworks (batch and incremental) from diverse data sources (APIs databases files cloud storage)
- Build and optimize data transformation logic using Spark (Databricks) SQL and Python
- Develop and maintain data models supporting analytics reporting and machine learning use cases
- Collaborate with analytics teams to enable Power BI datasets and reporting solutions
- Ensure data quality reliability and consistency through validation frameworks and monitoring
- Optimize performance of pipelines storage and compute resources in Azure
- Implement data governance practices including lineage cataloging and documentation
- Support CI/CD deployment pipelines for data engineering workflows
Minimum Qualifications
- 5 years of experience in Data Engineering roles
- Strong hands-on experience with data ingestion / ETL / ELT tools like Azure Data Factory and data modelling
- Proficient in using Azure Databricks (PySpark/Spark SQL) and medallion architecture
- Experience with other SQL databases relational databases and NoSQL databases
- Understanding of data lake and data warehouse architectures (e.g. Azure Data Lake One Lake Delta Tables) Experience working with large-scale structured and semi-structured datasets
- Ability to work with cross-functional teams and translate business requirements into technical solutions
