QC Data Testing Engi....
QC Data Testing Engineer Big Data
Posted on :
12-03-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
12-03-2024
Job Description
Req ID : 2617564
QC Data Testing Engineer (Big Data)
Location: Alpharetta GA (north of Atlanta GA) local candidates only will work onsite
Role: Contract to Perm 12 mos
VISA: Any
Travel: None < 5%
Mandatory:
- 37 years QA/QC Data Testing of Big Data
- Large Data Warehouse environments in the GB Terabit or PB levels
- Large pipeline scripting/testing in daily volume in the 520GB range
- Strong SQL & Python programing for mid to complex queries and data manipulation
- SQL and Python; Java Korn Shell also good
- Unix/Linux commands and some SSIS (ideal)
- ETL (ingestion normalize transform) data cleaning formatting manipulation testing
- Familiar with Data JSON format working with simple data models
- Understands TDD (testdriven development) code coverage Scrum/Agile methods Git/GitLab/GitHub Jira
- Embraces testing and process standards Execute test cases via manual & automated scripts and tools
- Understands business logic
- Selfstarter committed reliable has integrity desire to learn new processes and technologies
- Analytical smart excellent problemsolving skills ability to follow through logic and instructions
- Clear oral & written communications skills
- Degree in BS Engineering/Computer Science or equivalent experience
Optional:
- SSIS Hadoop Informatica Scala Spark PySpark
- PowerBI Tableau
- MapReduce Hive HBase NoSQL Parquet GLUE Athena (queries) Kafka Data Bricks Snowflake Tableau Yarn API Java C/C HTML XML Windows UNIX
Job Duties:
- Analyze large data within HPCC (high performance cluster computing) environment
- Write scripts for day to day analysis and manipulation activities
- Perform moderate/complex QC testing of large datasets (manual/automated) within HPCC
- Perform research design software development assignments. Develop scripts/ programs to make Big Data management easier.
- Role includes extracting loading cleansing translating manipulating analyzing linking and indexing massive amounts of data utilizing cutting edge technology and techniques.
- Utilize ECL language (Enterprise Control Language) and others. ECL training provided
- Run/manage test execution & results validation; May modify manual or automated testing scripts
- Review portions of detailed specs for development of system components of moderate complexity
- Full testing of new development code and bug fixes Resolve technical issues as necessary
- Work closely with programming/development team members & Business to understand product requirements translate them testing procedures
- Operate in various development environments (Agile Waterfall etc.)
- Keep abreast of new technology developments
- Make suggestions for code design changes be accountable for your testing procedures
- Collaborate w/ Data Engineers Dev other QA Business to understand product requirements & translate into successful data testing to help ensure high quality output
- Keep abreast of new Big Data and Testing technology developments
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
