Data Engineer Python, SQL

Toronto - Canada

Monthly Salary: Not Disclosed

Experience Required: 5years

Posted on: 9 hours ago

Vacancies: 1 Vacancy

Job Summary

Job Description: Data Engineer (Python SQL SemiStructured Data ES APIs)

Experience Required: 68 years

Skills: Python SQL Data Modeling ETL/ELT DBeaver SQLite/Postgres/Dremio API Integration

Role Summary

We are seeking a highly skilled Data Engineer with strong Python and SQL expertise to build reliable scalable data pipelines that transform semistructured data from ES URLs/APIs into clean analyticsready datasets. You will work primarily in a local environment (Python DBeaver SQLite/Postgres/Dremio) establish database connections flatten and normalize JSON/Elasticsearch topics and prepare datasets for downstream Power BI reporting. This role requires deep handson engineering ability strong data modeling skills and clear communication with business stakeholders.

Key Responsibilities

1. Data Ingestion & Transformation

Extract semistructured data from ES URLs API endpoints and Elasticsearch topics (JSON-based).

Flatten normalize and structure nested JSON into relational tables suitable for analytics.

Build reproducible ETL/ELT workflows using Python (pandas NumPy SQLAlchemy requests).

Implement transformation logic incremental loads and schema alignment for downstream use.

2. Database Engineering

Design create and maintain database schemas in SQLite Postgres and Dremio.

Configure and manage local DB connections through DBeaver.

Optimize queries using indexing strategies caching and partitioning.

Implement performance tuning for Python data jobs and SQL queries.

3. Data Quality & Governance

Build and maintain validation rules deduplication logic and anomaly detection.

Establish dataset versioning lineage tracking and data contract/documentation.

Ensure secure handling of API credentials tokens and data source endpoints.

Use Git for version control perform code reviews write unit tests and support CI checks.

Produce clear documentation runbooks and support materials for adhoc data requests.

4. Reporting & Downstream Enablement

Prepare clean analyticsready datasets for use in Power BI dashboards and business reporting.

Collaborate with stakeholders to translate business requirements into technical data solutions.

Ensure accurate complete and timely delivery of data to reporting teams.

Required Skills & Experience

Programming & Data Engineering

Strong handson experience with Python (pandas NumPy SQLAlchemy requests).

Ability to work with and transform semistructured JSON/ES data.

Experience integrating with REST APIs ES endpoints or similar data sources.

SQL & Databases

Advanced SQL proficiency across SQLite Postgres and Dremio querying.

Understanding of dimensional modeling normalization and modeling nested/semistructured data.

Experience with query tuning indexing and performance optimization.

Tools & Pipelines

Proficient in DBeaver (database connections schema management).

Experience building ETL/ELT pipelines with error handling logging and recoverability.

Familiarity with dataset preparation for Power BI.

Collaboration & Delivery

Strong communication skills; ability to work closely with business stakeholders.

Experience translating requirements into technical specifications and deliverables.

Preferred / Bonus Skills

Experience with Elasticsearch ES endpoints scroll APIs or schemaonread engines (e.g. Dremio).

Familiarity with Docker for reproducing local environments.

Experience with schedulers such as Airflow Prefect or similar orchestration tools.

Knowledge of performance profiling tools (EXPLAIN plans indexing strategies caching).

Required Skills:

Experience (Years): 4-6 Essential Skills: Work with project teams throughout the organization to design implement and manage CDN infrastructure using Akamai to ensure high availability performance and scalability for customer facing applications and business processes. Handle multiple priorities and assignments with excellence and precision. Be a part of a 24/7/365 organization (some after hours support is expected as part of normal on-call rotation). Directly support line of business development teams provide guidance to them on implementation and changes for customer facing applications Develop and maintain security protocols and measures to protect CDN infrastructure from cyber threats. Monitor and analyze network performance identifying and resolving issues to optimize content delivery of critical applications. Collaborate with cross-functional teams to integrate Akamai CDN solutions with existing systems and applications. Collaborate with information security teams to implement DDoS protection strategies and other security measures in the CDN. Provide technical support and guidance to clients and internal teams regarding CDN and security best practices. Work closely with vendor and professional service teams on delivery related activities and strategy. Qualifications: Bachelors degree in Computer Science Information Technology or a related field. OR similar work experience. Strong understanding of network protocols (HTTP/HTTPS DNS TCP/IP). Proven experience as a CDN Engineer or similar role with a strong focus on -depth knowledge of Content Delivery Network technologies including caching load balancing and content optimization. Excellent problem-solving skills and attention to detail. Strong communication and teamwork abilities. Experience supporting 24/7/365 customer facing applications at enterprise scale. Awareness and experience with cybersecurity tools and practices such as firewalls intrusion detection/prevention systems and encryption. Proficiency in scripting and automation (e.g. Python Bash) a plus. Relevant certifications (e.g. CISSP CEH) are a plus but not required.

Job Description: Data Engineer (Python SQL SemiStructured Data ES APIs)Experience Required: 68 yearsSkills: Python SQL Data Modeling ETL/ELT DBeaver SQLite/Postgres/Dremio API IntegrationRole SummaryWe are seeking a highly skilled Data Engineer with strong Python and SQL expertise to build reliab...