Job Summary
key skills are Very Very Strong SQL capability Data Pipelines Mgmt Python and Airflow. Location is New York mandatory 3 days a week.
a hardcore heavy hitting Data Engineer who is extremely skilled and is able to function independently and manage their deliverables
of writing ETL pipelines using Python from scratch
in OOP principles and concepts
to independently write efficient and reusable code for ETL pipelines
in data modeling concepts such as schemas and entity relationships
at analyzing and developing queries in SQL in various dialects (SQL Server DB2 Oracle)
with Airflow and understands how to develop DAGS
in data warehouses like BigQuery Databricks Deltalakehouse and how to programmatically ingest cleanse govern and report data out of them
with Spark is plus
to learn new cloud-based business apps and tools
knowledge of IBM Apptio is a plus
ETL - Big Data/Data Warehousing MS SQLSQLPython Big Data SparkRDBMS Data Analytics