Data Engineer

Who we are: BAL is a team of brilliant people who change lives through elite immigration work and collaborative innovation. We pursue the exceptional in all that we do but never at the expense of our values. Theres no denying our work is demanding both in volume and pace but were up for the challenge. We love the balance of hard work and fun so youll see us in jeans as we shatter glass ceilings and conventional stereotypes. BAL employees feel valued rewarded and respected. We seek opportunities to be of service to others and our communities. We are committed to your growth and development and want to set you up for success here at BAL and beyond.

Who you are: You are looking for work that has a purpose. You arent afraid to roll up your sleeves and get stuff done. You learn quickly. You move fast. You embrace challenge and detail as well as creative thinking. You believe you have something unique to contribute and you arent afraid to raise your hand. You understand that powering human achievement is ultimately about impacting a real person. You are looking for a place to grow and an environment where everyone has a spot and is genuinely welcome.

Were better together: A bright driven person like you and an industry-leading powerhouse like BAL Its a perfect combination! We truly want to see you succeed here and become an integral part of our mission to provide an experience that makes a positive difference in peoples lives. Come be a part of something special where you can have an impact and be valued just for being you!

In addition to competitive pay a discretionary annual bonus and a supportive team oriented culture we offer an outstanding benefits package that includes medical dental vision disability and life insurance sick time unlimited vacation and 401(k) with company match.

OVERVIEW:

We are looking for an experienced Data Engineer to join our Data Products team working primarily on data pipelines and related automation. The ideal candidate will have experience in a variety of data engineering technologies and a keen attention to this role you will focus on designing building and managing resilient and scalable data pipelines implementing production automations and integrations and optimizing performance and quality across our portfolio.

PRIMARY RESPONSIBILITIES:

• Design develop and maintain scalable high-performance data pipelines and ETL processes that clean transform and integrate data from various sources ensuring data is prepared and accessible for downstream consumers.
• Manage and enhance production data workflows and automations for external and internal integrations implementing continuous improvement initiatives to standardize technologies improve monitoring and alerting systems and optimize our production automation infrastructure.
• Optimize database performance implement schema changes and maintain data governance standards to enhance reporting capabilities analytics and data integration processes.
• Collaborate with the Data Engineering Manager and cross-functional teams to understand business requirements and develop optimal data solutions that meet organizational needs.
• Apply strong analytical and problem-solving skills to translate complex business requirements into efficient scalable and maintainable solutions.
• Establish implement and maintain testing and monitoring processes to ensure production data is always accurate consistent and readily available.

QUALIFICATIONS:

• Minimum of 5 years of experience in data engineering or associated software development.
• Bachelors degree in a related area or a combination of relevant certifications and job experience.
• Experience designing building and operationalizing large-scale enterprise data solutions and applications including ETL/ELT data flows using technologies such as Spark EMR Databricks Glue Kinesis Redshift Snowflake etc.
• Proficiency in Python/PySpark various dialects of SQL and batch scripting (Shell Bash PowerShell); experience with C# a plus.
• Experience developing and optimizing complex SQL and Python for high-volume high-efficiency data extraction and transformation.
• Familiarity with cloud services and tools (AWS preferred) including storage serverless functions and data engineering tools.
• Experience testing monitoring and rectifying data anomalies to ensure data integrity.
• Building and maintaining batch scripts cron jobs and similar forms of automation in production environments.

ADDTIONAL EXPERIENCE A PLUS:

• Data platforms like Databricks or similar technologies.
• REST API development and/or integration using OpenAPI/Swagger and languages like Python or C#.
• Experience with machine learning and AI pipelines and MLOps.
• Experience with containerization (Docker/Kubernetes) and related tools and patterns.
• Experience with CI/CD and DevOps tools and processes (e.g. Azure DevOps Terraform).
• Experience with user-facing report and dashboard development.

The ideal candidate likes to work both independently and collaboratively in a small convivial team.

Note: To perform this job successfully an individual must be able to perform each essential duty satisfactorily. The requirements listed are representative of the knowledge skill and/or ability required and are not intended to be an exhaustive list of all duties responsibilities or qualifications associated with this job.

Berry Appleman & Leiden is an Equal Opportunity Employer. It is the policy of BAL to ensure an equal employment opportunity without discrimination or harassment on the basis of race color national origin religion gender gender identity or expression age disability alienage or citizenship status marital status creed genetic predisposition or carrier status sexual orientation or any other characteristic protected by law. BAL prohibits and will not tolerate any such discrimination or harassment.

BAL does not accept unsolicited resumes from recruiters or employment agencies. BAL is under no obligation to pay any referral compensation or recruiter fee in the absence of a current executed Recruitment Services the event a recruiter or agency submits an unsolicited resume or candidate without an agreement BAL reserves the right to pursue and hire said candidate(s) without any financial obligation to the recruiter or agency. Any unsolicited resumes including those submitted to hiring managers shall be deemed the property of BAL. If your agency would like to be considered as a potential recruiting partner please forward your contact information to