Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are seeking a highly skilled Lead Data Engineer to join our data engineering team for an onpremise environment. A large portion of your time will be in the weeds working alongside your team architecture designing implementing and optimizing data solutions. The ideal candidate will have extensive experience in building and optimizing data pipelines architectures and data sets with a strong focus on Python SQL Hadoop HDFS and Apache NiFi.
What youll be doing
- Design develop and maintain robust scalable and highperformance data pipelines and data integration solutions.
- Manage and optimize data storage in Hadoop Distributed File System (HDFS).
- Design and implement data workflows using Apache NiFi for data ingestion transformation and distribution.
- Collaborate with crossfunctional teams to understand data requirements and deliver efficient solutions.
- Ensure data quality governance and security standards are met within the onpremise infrastructure.
- Monitor and troubleshoot data pipelines to ensure optimal performance and reliability.
- Automate data workflows and processes to enhance system efficiency.
Qualifications :
- Bachelors degree in computer science Software Engineering or a related field
- 6 years of experience in data engineering or a related field
- Strong programming skills in Python and SQL.
- Handson experience with Hadoop ecosystem (HDFS Hive etc.).
- Proficiency in Apache NiFi for data ingestion and flow orchestration.
- Experience in data modeling ETL development and data warehousing concepts.
- Strong problemsolving skills and ability to work independently in a fastpaced environment.
- Good understanding of data governance data security and best practices in onpremise environments.
Good to Have:
- Experience with other big data tools like Spark Kafka etc.
Additional Information :
What do you get in return
- Competitive Salary: Your skills and contributions are highly valued here and we make sure your salary reflects that rewarding you fairly for the knowledge and experience you bring to the table.
- Dynamic Career Growth: Our vibrant environment offers you the opportunity to grow rapidly providing the right tools mentorship and experiences to fasttrack your career.
- Idea Tanks: Innovation lives here. Our Idea Tanks are your playground to pitch experiment and collaborate on ideas that can shape the future
- Growth Chats: Dive into our casual Growth Chats where you can learn from the best whether its over lunch or during a laidback session with peers its the perfect space to grow your skills.
- Snack Zone: Stay fueled and inspired! In our Snack Zone youll find a variety of snacks to keep your energy high and ideas flowing
- Recognition & Rewards: We believe great work deserves to be recognized. Expect regular HiveFives shoutouts and the chance to see your ideas come to life as part of our reward program.
- Fuel Your Growth Journey with Certifications: Were all about your growth groove! Level up your skills with our support as we cover the cost of your certifications.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
