Data Engineer
Share
Job Location:
Tysons Corner, VA - USA
Monthly Salary:
Not Disclosed
Posted on:
22 hours ago
Vacancies:
1 Vacancy
Department:
Job Summary
***Active TS/SCI with CI Polygraph Required***
Red Arch Solutions is a proven and effective small business integrator and consultant recognized as a leading provider of IT development to the Federal Government and primarily focused within the Intelligence Community.
As aData Engineer youll work with team members to build deploy and operate data pipelines and data engineering components to enable data brokering and exchange capabilities across a diverse range of producers and this role you will be responsible for building robust scalable data pipelines while working collaboratively with cross-functional teams to ensure seamless integration optimized performance and efficient delivery of solutions.
If you think you can see yourself delivering our mission and pursuing our goals with us then check out the job description below!
What youll do:
- Work with team members to operationalize data pipelines and supporting cloud infrastructure
- Collaborate with external data producers and consumers to obtain and provide data through interfaces such as REST APIs and S3
- Provide day-to-day support of deploying Python-native data pipelines and performing data engineering tasks to enable data brokering and exchange capabilities
- Provide Tier 2/3 troubleshooting and incident resolution support for data pipelines in Production
What youll need to succeed:
- Active TS/SCI with CI poly required
- 4-7years of proven experience in data engineering with expertise in designing developing and maintaining data ingestion transformation and loading pipelines and components
- Demonstrated experience in designing and deploying data pipelines leveraging AWS cloud infrastructure across multiple classification domains (e.g. IL5 to IL6)
- Experience with Infrastructure-as-Code (IaC) tools including Terraform CloudFormation or Ansible to automate deployment of data pipeline cloud infrastructure
- Understanding of RMF security principles and hands-on experience implementing security controls for data pipelines in cloud environments
- Strong scripting and programming skills in languages such as Go Python and Bash
- Experience with data pipeline tools and technologies such as Nifi Hadoop HDFS and Kafka. Experience implementing data pipelines in the Cloudera Data Platform environment is highly preferred.
- Strong communication skills with the ability to clearly convey complex technical concepts
TS/SCI with Poly required #CJ
The Red Arch Solutions pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Determination of official compensation or salary relies on several factors including but not limited to level of position job responsibilities geographic location scope of relevant work experience educational background certifications contract-specific affordability organizational requirements alignment with local internal equity as well as alignment with market data.
Red Arch Solutions Benefits Snapshot:
- 100% paid employee healthcare premiums. CareFirst Advantage Best in Class Benefits.
- HaloScripts Concierge prescription medication service
- Generous PTO.
- 10 % 401K 6% match vested day one and up to 4% profit sharing contribution.
- Annualized bonus compensation.
- Spot bonuses for hard work.
- Tuition reimbursement.
- 529 College Saving Plan.
- College Loan Pay Back Program.
- 11 Paid Federal Holidays
- Generous Referral Bonuses.
Red Arch Solutions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race color religion age sex national origin disability status genetics protected veteran status sexual orientation gender identity or expression or any other characteristic protected by federal state or local laws.
Have more questions about Red Arch Email us at
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Founded in January 2004, Red Arch Solutions is a premier U.S. small business providing its customers with state-of-the-art tactical and strategic intelligence, systems, and software engineering solutions, solving some of the most pressing and unique intelligence community challenges r ... View more
