Lead Data Engineer

Washington, AR - USA

Yearly Salary: USD 130000 - 135000

Posted on: 24 days ago

Vacancies: 1 Vacancy

Job Summary

Amida Technology Solutions is a DC-based technology company focused on data interoperability integrity governance and security. We create solutions that collect reconcile transform and standardize data for business intelligence advanced analytics decision support and user transactions. We specialize in taking data from inception to impact.

Our team is composed of creative forward-looking thinkers who are passionate about using cutting-edge technology to improve lives and generate a positive impact on our country. We offer an entrepreneurial high-growth environment that values fresh ideas candid conversations and authentic teamwork.

Amida Technology Solutions is seeking a skilled Lead Data Engineer. The successful candidate will design and develop data pipelines using Databricks Azure Data Factory Azure Synapse Analytics and other platforms within Azure Cloud. This role will report to Data Engineering Manager. The ideal candidate will be motivated by the opportunity to support public agencies nonprofit organizations and private companies in transforming their data into actionable insights. Preference will be given to candidates able to work a hybrid schedule in our DC headquarters office.

Key Responsibilities

Lead the design development and maintenance data pipelines for Extract Transform Load (ETL) data on Azure platforms (focusing on Databricks)
Optimize data flow to ensure high-quality data integrity consistency and reliability
Monitor and troubleshoot data pipeline issues ensuring high availability and performance
Collaborate with data scientists analysts and stakeholders to understand data requirements and translate them into technical solutions
Document data workflows architecture and technical processes
Implement data governance and security best practices
Automate data workflows to improve efficiency and reduce manual efforts
Lead and mentor other engineers
Other duties as assigned

Required Education:

Bachelors degree in computer science Information Technology or a related field

Required Experience:

7 years of experience with Python and one or more programming languages such as Java Scala or SQL
3 years of experience leading and mentoring data engineers
4 years of experience building data pipelines using Azure services (e.g. Azure Databricks Azure Data Factory Azure Synapse Azure Functions)
4 years of experience developing solutions on Azure
2 years of experience working with Databricks
Experience with version control and software development collaboration tools such as Git and GitHub
Experience using resources in cloud environments such as AWS or Azure

Required Skills:

Expertise in ETL processes data modeling and database design.
Proficiency in programming languages such as Python or Java
Expertise in Delta Lake and other file storage formats including CSV JSON and Parquet
Strong problem-solving skills and attention to detail
Excellent communication and collaboration abilities
Ability to obtain a Public Trust security clearance

Preferred Skills:

Familiarity with VA infrastructure and data sources
Proficiency in Cypher query language
Proficiency in graph data modeling concepts
Experience with database systems and data warehousing technologies such as MySQL PostgreSQL MongoDB Amazon Redshift Microsoft SQL Server etc.

This is not a remote position. Priority will be given to candidates who can work from our Washington D.C. or Richmond office.

Success at Amida

Communication is the key to success at Amida. Our people are known for their can-do attitude and their ability to work effectively with both internal and client teams. We pride ourselves on having a collegial multidisciplinary team with diverse backgrounds and experience. Our best team members pay intense attention to detail in all aspects of their work have great initiative are opinionated about the best ways of doing things and align quickly to decisions. A sense of humor is an asset at Amida.

Full-time regular employees at Amida enjoy a robust benefits package that includes a generous 401(k) match with immediate vesting 4 weeks of PTO paid parental leave medical insurance dental insurance vision insurance life AD&D insurance and short-term disability. We also offer tuition/training assistance and team building opportunities to encourage professional growth and collaboration.

All qualified applicants will receive consideration without regard to race color religion sex sexual orientation gender identity national origin disability protected veteran status or any other characteristic protected by law.