Data Engineer

Job Title: Data Engineer

Location: Remote

Duration: Fulltime

Overview: We are seeking a skilled Data Engineer to join our team remotely. The ideal candidate will have expertise in various data processing technologies such as Apache Airflow Apache Spark BigQuery and GCP (Google Cloud Platform) with proficiency in Scala. As a Data Engineer you will be responsible for designing building and maintaining scalable data pipelines and processing systems ensuring high performance and reliability.

Required Skills:

Must Have:

• Proficiency in Apache Airflow for workflow management
• Extensive experience with Apache Spark for largescale data processing
• Strong familiarity with Google BigQuery for data warehousing and analytics
• Expertise in GCP (Google Cloud Platform) and/or Terraform for cloud infrastructure management
• Advanced proficiency in Scala for data manipulation and analysis

Nice To Have:

• Familiarity with Dataflow (Apache Beam) for stream and batch processing
• Experience with PySpark for Pythonbased data processing on Spark
• Knowledge of Python programming language for scripting and automation
• Understanding of Scalding for Scalabased data processing