Data Engineer

صاحب العمل نشط

1 وظيفة شاغرة
drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني
Valid email field required
أرسل الوظائف
drjobs drjobs drjobs
drjobs drjobs
drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني

Valid email field required
أرسل الوظائف

الراتب الشهري

drjobs

لم يكشف

drjobs

لم يتم الكشف عن الراتب

عدد الوظائف الشاغرة

1 وظيفة شاغرة

الوصف الوظيفي

رقم الوظيفة : 2771717

Location: United States (Remote option available)

Job Type: Fulltime

Salary Range: $90000 $130000 per year

Company Overview:

We are a leading technology firm that specializes in big data solutions and advanced analytics to drive business transformations. Our company is dedicated to innovation quality and providing stateoftheart data services to our clients across various industries.

Job Summary:

As a Data Engineer you will be integral to our operations focusing on optimizing our data management and pipeline architecture. This role requires someone who is proficient in building scalable data platforms ensuring efficient data integration and maintaining the overall architecture. You will collaborate closely with data scientists and analysts to support our analytics platform and contribute to our strategic data initiatives.

Responsibilities:
  • Design construct install test and maintain highly scalable data management systems.
  • Ensure systems meet business requirements and industry practices.
  • Build highperformance algorithms prototypes predictive models and proof of concepts.
  • Implement data ingestion routines both realtime and batch using best practices in data modeling ETL/ELT processes SQL and Oracle.
  • Work collaboratively with data scientists to design and develop datasets for analysis and operational use.
  • Optimize data pipelines and architect scalable and performant databases.
  • Monitor data performance and modify infrastructure as needed.
  • Define company data assets (data models) spark spark SQL and hive SQL jobs to populate data models.
  • Work closely with team members to identify ways to improve data reliability efficiency and quality.
  • Deploy sophisticated analytics programs machine learning and statistical methods.
Qualifications:
  • Bachelors or masters degree in Computer Science Information Technology Engineering or a related field.
  • Demonstrated interest or experience in a Data Engineering role.
  • Advanced working SQL knowledge and experience working with relational databases as well as working familiarity with a variety of databases.
  • Experience building and optimizing big data data pipelines architectures and data sets.
  • Strong analytic skills related to working with unstructured datasets.
  • Experience with big data tools: Hadoop Spark Kafka etc.
  • Experience with data pipeline and workflow management tools: Azkaban Luigi Airflow etc.
  • Experience with AWS cloud services: EC2 EMR RDS Redshift.
  • Strong project management and organizational skills.
  • Experience supporting and working with crossfunctional teams in a dynamic environment.
Skills:
  • Proficient in scripting languages (Python Java Scala)
  • Expertise in SQL and database design
  • Experience with big data technologies (Hadoop Spark Kafka)
  • Familiarity with cloud services (AWS Azure GCP)
  • Knowledge of ETL techniques and frameworks (Airflow NiFi)
  • Strong analytical and problemsolving abilities
  • Excellent communication and teamwork skills
  • Attention to detail
  • Ability to handle multiple projects and prioritize tasks
  • Adaptable and willing to learn new technologies
Benefits:
  • Competitive salary and bonus structure
  • Comprehensive health dental and vision insurance
  • 401(k) plan with company match
  • Generous paid time off and flexible working conditions
  • Professional development opportunities
  • Remote work options
How to Apply:

Please submit a detailed resume and a cover letter that highlights your experience and skills in data engineering specifically your work with large data sets realtime processing and cloudbased infrastructure. Applications should be submitted through our companys career portal.

We are an equal opportunity employer and value diversity. All employment is decided based on qualifications merit and business need.

نوع التوظيف

عن بُعد

المهارات المطلوبة

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • البيانات الضخمة
  • مستودع البيانات
  • Kafka
  • Scala

نبذة عن الشركة

الإبلاغ عن هذه الوظيفة
إخلاء المسؤولية: د.جوب هو مجرد منصة تربط بين الباحثين عن عمل وأصحاب العمل. ننصح المتقدمين بإجراء بحث مستقل خاص بهم في أوراق اعتماد صاحب العمل المحتمل. نحن نحرص على ألا يتم طلب أي مدفوعات مالية من قبل عملائنا، وبالتالي فإننا ننصح بعدم مشاركة أي معلومات شخصية أو متعلقة بالحسابات المصرفية مع أي طرف ثالث. إذا كنت تشك في وقوع أي احتيال أو سوء تصرف، فيرجى التواصل معنا من خلال تعبئة النموذج الموجود على الصفحة اتصل بنا