Senior Data Scientist

The Senior Data Engineer will lead the design development and maintenance of robust ETL pipelines and data infrastructure to support the Data Engineering/Science team. This role involves managing large-scale data deliveries to clients ensuring data reliability and performance in a Linux/Hadoop environment using technologies like Spark and Python and monitoring SLAs for timely deliverables. Responsibilities include developing engineering and data science solutions potentially utilizing LLMs and other tools to transform unstructured data into structured feeds. The position offers potential for growth into a managerial role including architecture planning code reviews and directing junior team members to drive scalable data solutions that enhance insights efficiency revenue and profitability for clients in market research finance and brands across multiple verticals.

Qualifications :

Essential Job Functions and Responsibilitie:

• Design implement and maintain ETL pipelines and data processing workflows using Python PySpark and Hadoop in a Linux environment to ensure efficient transformation and delivery of large-scale data to clients.
• Monitor data pipelines troubleshoot issues and ensure compliance with SLAs to maintain high availability reliability and performance of data systems.
• Manage client deliveries of large-scale datasets optimizing for scalability security and integration with Postgres databases.
• Utilize LLMs and other relevant tools to transform unstructured data into structured actionable feeds enhancing pattern recognition and insights for client solutions.
• Document work projects in JIRA including tracking progress on assigned tasks and proposing/writing new tickets in collaboration with the team and management.
• Support management in data architecture planning including system design and optimization to support long-term growth and innovation in data solutions.
• Support management in conducting code reviews providing technical guidance and directing day-to-day activities of junior team members to foster team development and maintain code quality.
• Collaborate with sales and other teams to identify growth opportunities and develop data-driven strategies for clients.
• Any other tasks and projects as assigned by management.

Other Job Functions and Responsibilities:

• Commitment: Expert knowledge of market research and data engineering and data science practices dedicated to the goals of the company while leading and promoting a positive collaborative culture to ensure strong team relationships overall satisfaction and profitability.
• Accessibility: Must be able to access and function within areas key to productivity. Adequate manual dexterity to operate assigned and shared office equipment. Ability to travel on periodic overnight and extended stays and work extended hours when necessary.
• Communications: Must speak clearly and fluently to communicate on a wide range of technical and business topics. Superior reading comprehension and grammatically correct written communication skills including the ability to document complex data processes and architectures. Must have the ability to understand and respond intelligently to business and technical correspondence. Advanced interpersonal skills to persuade manage conflict debate negotiate and mentor junior team members. Response to pressure should be calm reasonable and solution oriented.
• Technical: Must demonstrate expert proficiency in data engineering tools and environments including Python Spark (PySpark) Linux/Command Line Hadoop Postgres and LLMs as well as basic office software such as Microsoft Outlook Excel PowerPoint and Word.
• Judgment: Strong comprehension of job requirements and procedures. Can independently initiate lead and perform work assignments under minimal supervision that are broad varied and highly complex in nature. Employee must leverage educated intuitive and experienced judgment to make strategic decisions.
• Flexibility: Must thrive in a dynamic environment with the ability to juggle and prioritize multiple competing tasks and demands seeking supervisory assistance only as needed for high-level alignment.
• Analysis: Advanced mathematical and analytical aptitude; proficient in numeric calculations statistical methods and data modeling for accuracy in reports pipelines and tasks.
• Organization: Superior organizational and time management skills sufficient to plan execute and accomplish assigned goals while overseeing team efforts.
• Logic: Advanced deductive and inductive reasoning ability to apply general concepts to specific real-world situations. Able to translate theoretical data engineering principles into practical business solutions. Employee must apply extensive experience skills and information to identify complex problems and architect strategic resolutions.
• Work Ethics:  Must be willing to work hard be highly dependable and responsible possess a positive attitude and maintain a strong sense of honesty and integrity.
• Core Values: Luth Research and its employees are committed to our Core Values; Passionate and Driven * Delivering Excellence * Embracing and Driving Change * Career Growth and Development * Sustaining a Connected Fulfilled Team.

Education Experience & Skill:

Education:   

• BS or MS Degree in Computer Science Data Engineering or a related field or equivalent work-related experience.

Specific Job Experience and Skills:

• Pay range is from $80k - $95k (depending on experience)
• 3 years of experience in data engineering with proven expertise in building and managing ETL pipelines in large-scale environments.
• Expert proficiency in Python for data scripting processing and automation.
• Hands-on experience with Spark (PySpark) for distributed data processing.
• Strong command of Linux/Command Line and Hadoop for data management and operations.
• Proficiency in Postgres for database integration and querying.
• Experience utilizing LLMs for data transformation pattern recognition and solution development.
• Excellent problem-solving skills creative thinking and the ability to develop innovative data engineering and science solutions.
• Familiarity with project management tools like JIRA for documentation tracking and ticket creation.

Shift Availability:

• Flexible schedule with the ability to work some nights and weekends as needed for deliverables or issues.

Additional Information :

All your information will be kept confidential according to EEO guidelines.

Remote Work :

Yes

Employment Type :

Full-time