Big Data Engineer

Not Interested
Bookmark
Report This Job

profile Job Location:

São Paulo - Brazil

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

  • Develop and maintain ETL pipelines and data integration services using Python and SQL 
  • Work with AWS services (S3 DynamoDB Lambda Glue) and NoSQL databases (MongoDB DynamoDB) 
  • Design optimize and validate data flows ensuring data quality across systems 
  • Collaborate with Senior engineers on architecture and performance improvements 
  • Troubleshoot production data issues and perform root cause analyses. 
  • Contribute to the continuous improvement of development practices and performance monitoring 

Qualifications :

  • 2-4 years of experience as a Data Engineer or Back-end Developer 
  • Strong hands-on experience with Python and SQL 
  • Experience with AWS data services (S3 DynamoDB Lambda Glue) 
  • Familiarity with NoSQL databases and API integrations
  • Basic understanding of PySpark or similar distributed frameworks 
  • Analytical mindset and proactive problem-solving skills 
  • Fluent in English (Upper-Intermediate level or higher) 

WILL BE A PLUS

  • Experience with Airflow or other orchestration tools 
  • Interest in big data performance tuning and cloud optimization 

 


    Additional Information :

    PERSONAL PROFILE

    • Strong communication and collaboration skills 
    • Self-motivated responsible and able to work independently 

    Remote Work :

    Yes


    Employment Type :

    Full-time

    Develop and maintain ETL pipelines and data integration services using Python and SQL Work with AWS services (S3 DynamoDB Lambda Glue) and NoSQL databases (MongoDB DynamoDB) Design optimize and validate data flows ensuring data quality across systems Collaborate with Senior engineers on architecture...
    View more view more

    Key Skills

    • Apache Hive
    • S3
    • Hadoop
    • Redshift
    • Spark
    • AWS
    • Apache Pig
    • NoSQL
    • Big Data
    • Data Warehouse
    • Kafka
    • Scala

    About Company

    Company Logo

    At Sigma Software, we are involved with the client’s team to contribute to the design and development of a technical solution for their tokenized domain reservation platform. We started by assigning a software architect to design the smart contracts and integrate blockchain into the s ... View more

    View Profile View Profile