Job Title: Sr. Lead Data Engineer (Databricks & Spark)
Location: Princeton NJ (Hybrid)
Duration: 6 months contract to hire
What Were Looking For:
- Minimum 10 years of working experience in Technology (application development and production support).
- 5 years of experience in development of pipelines that extract transform and load data into an information product that helps the organization reach its strategic goals.
- Minimum 3 years of experience in developing & supporting ETLs and using Python/Scala in Databricks/Spark platform.
- Experience with Python Spark and Hive and Understanding of data-warehousing and data modeling techniques.
- Knowledge of industry-wide visualization and analytics tools (ex: Tableau R)
- Strong data engineering skills with AWS cloud platform
- Experience with streaming frameworks such as Kafka
- Knowledge of Core Java Linux SQL and any scripting language
- Experience working with any relational Databases preferably Oracle.
- Experience in continuous delivery through CI/CD pipelines containers and orchestration technologies.
- Experience working in an Agile development environment.