Role: Business Consulting - Data Engineer
Location : Atlanta GA (Onsite)
Type: Contract
Job duties:
- Design develop automate and support complex applications to extract transform and load data; Implement and automate complex processes.
- Plan and conduct ETL unit and development tests; Monitor results and take corrective actions; Translate data access transformation and movement requirements into functional requirements and mapping designs.
- Use SQL to design database schemas optimize data retrieval and implement ETL processes. Investigate analyze and resolve complex technical problems related to system functions environment and procedures; and Manage service levels standards and configurations.
- Participate in Agile teams to meet goals; Development and support of Kafka integrations including topics producers consumers and streaming applications; Design develop and maintain Enterprise micro services security logging common APIs and enforcing coding standards.
Job requirements:
- Bachelors degree in Computer Science Computer Engineering Electrical/Electronic Engineering or related technical field and 5 years of software development experience.
- Design build and maintain batch or real-time data pipelines.
- Automate data workflows such as data ingestion aggregation and ETL processing.
- Ensure data accuracy integrity privacy security and compliance through quality control procedures.
- Monitor data systems performance and implement optimization strategies.
- Must have experience with analyzing tuning and optimizing queries in the RDBMS.
- Strong computer skills including proficiency in at least one programming language (C/C Java Python)
- hands-on experience in designing developing and maintaining software solutions on ETL process utilizing IBM Infosphere DataStage/Quality Stage.
- Experience with large datasets including structured and unstructured data.
- Knowledge of Kafka and messaging is a plus.
- Must be able to produce thorough technical design documents test plans and documented results.
- Experience with Agile methodologies and fast pace environment preferred.
- Experience developing API Integrations with cloud and other applications.
- Experience building applications using Java and Java based frameworks like Spring Boot is strongly preferred.
- Strong Skills on SQL PL/SQL Programming Query Optimization.
- Knowledge of Data Management Strategies (ETL Frameworks Data Modeling concepts)
- Willingness to learn new technologies.
- Excellent verbal and written communication skill to clearly and simply communicate complex information.
- 5 years experience working in a Data Warehouse environment (or equivalent).
- 5 years experience with the design development automation and support of applications to extract transform and load data;
- 5 years experience with databases including Oracle DB2 Teradata SQL Server and Access;
- 5 years experience with IBM Infosphere DataStage;
- 5 years experience with Data warehouse;
- 5 years experience with Unix Shell Scripting;
- 5 years experience with Spring boot is preferred.
- Knowledge of Kafka and streaming solutions is a plus