We are seeking skilled and detail-oriented Data Engineers with expertise in utilizing Python SQL and Palantir (or other ETL platforms) to extract transform and load structured and unstructured data from various sources. The ideal candidate will have a strong background in data engineering and a deep understanding of ETL processes.
CLEARANCE REQUIRED: TS/SCI Full Scope Polygraph
Responsibilities
Write robust and efficient Python and SQL scripts to automate data processing tasks
Integrate data from diverse sources such as databases APIs and flat files into centralized systems
Implement data transformations enrichment and modeling workflows to ensure data quality and usability
Ensure data structures are optimized for performance and scalability
Provide technical guidance and support to ensure effective use of Palantir tools across teams
Implement data quality checks validation and monitoring mechanisms to ensure the accuracy and reliability of datasets
Integrate data from diverse sources such as databases APIs and flat files into centralized systems
Ensure proper data transformation and curation to meet business and analytics requirements
Maintain and improve data quality consistency and accuracy through validation and cleansing processes
Requirements
TS/SCI FSP Clearance
3 years of experience in data engineering
Strong proficiency in scripting and programming with Python
Expertise in working with SQL for data querying transformation and optimization
Experience with data integration from diverse sources such as APIs relational databases and file systems
Strong analytical and problem-solving skills with attention to detail
Excellent communication and teamwork skills to collaborate with technical and business teams
Desired Skills
Bachelors degree in Computer Science Data Engineering or a related field
Hands-on experience with Palantir
Experience with cloud platforms (e.g. AWS Azure GCP) and big data technologies (e.g. Apache Spark Hadoop)
Familiarity with data orchestration tools such as Apache Airflow Prefect or similar
About Us For more than 20 years NewGen Technologies has solved our clients toughest IT challenges with integrity security and outstanding service by delivering both technology and talent. We have helped secure borders have used artificial intelligence (AI) to fight terror aided the identification of criminals and have helped to prevent crime through the introduction of team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ
Required Experience:
IC
We are seeking skilled and detail-oriented Data Engineers with expertise in utilizing Python SQL and Palantir (or other ETL platforms) to extract transform and load structured and unstructured data from various sources. The ideal candidate will have a strong background in data engineering and a deep...
We are seeking skilled and detail-oriented Data Engineers with expertise in utilizing Python SQL and Palantir (or other ETL platforms) to extract transform and load structured and unstructured data from various sources. The ideal candidate will have a strong background in data engineering and a deep understanding of ETL processes.
CLEARANCE REQUIRED: TS/SCI Full Scope Polygraph
Responsibilities
Write robust and efficient Python and SQL scripts to automate data processing tasks
Integrate data from diverse sources such as databases APIs and flat files into centralized systems
Implement data transformations enrichment and modeling workflows to ensure data quality and usability
Ensure data structures are optimized for performance and scalability
Provide technical guidance and support to ensure effective use of Palantir tools across teams
Implement data quality checks validation and monitoring mechanisms to ensure the accuracy and reliability of datasets
Integrate data from diverse sources such as databases APIs and flat files into centralized systems
Ensure proper data transformation and curation to meet business and analytics requirements
Maintain and improve data quality consistency and accuracy through validation and cleansing processes
Requirements
TS/SCI FSP Clearance
3 years of experience in data engineering
Strong proficiency in scripting and programming with Python
Expertise in working with SQL for data querying transformation and optimization
Experience with data integration from diverse sources such as APIs relational databases and file systems
Strong analytical and problem-solving skills with attention to detail
Excellent communication and teamwork skills to collaborate with technical and business teams
Desired Skills
Bachelors degree in Computer Science Data Engineering or a related field
Hands-on experience with Palantir
Experience with cloud platforms (e.g. AWS Azure GCP) and big data technologies (e.g. Apache Spark Hadoop)
Familiarity with data orchestration tools such as Apache Airflow Prefect or similar
About Us For more than 20 years NewGen Technologies has solved our clients toughest IT challenges with integrity security and outstanding service by delivering both technology and talent. We have helped secure borders have used artificial intelligence (AI) to fight terror aided the identification of criminals and have helped to prevent crime through the introduction of team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ
After a couple of years without an operating business, NewGen Technologies (formerly Bongiovi Entertainment) is once again revving its engines following a reverse merger with alternative fuel developer ReFuel America (which now functions as its operating subsidiary). The company hopes
... View more