DataStage Upgrade Project - ETL Developers

The following document contains the tasks and qualifications for this MNSITE 2.0 Event.

Test migrated ETL jobs, including data validation and data integrity testing

Fix issues found during migration or testing

Create new ETL jobs and update existing ETL jobs

Migrate ETL jobs from DataStage V8.5 server to DataStage V11.7 server

Document processes and details as directed by team lead

Assist with implementation of ETL jobs into the production batch process as needed

Performance tune ETL jobs as needed

Provide knowledge transfer to State staff as needed

Perform other related duties as assigned

Three (3) years' experience in DataStage ETL developer role(s)

Two (2) years' experience with Oracle PL/SQL development

Experience with DataStage Server and Parallel jobs, Routines, hash files, and/or sequences

Experience testing and/or performance tuning ETL jobs

Experience with batch scheduling tools, e.g., Automic, Control-M, etc.

Experience with Activity Diagrams and/or Process Modeling

Experience with DataStage migration projects

Experience developing Oracle Business Intelligence reports

Experience with PeopleSoft Human Resources and/or Finance modules/data

Description of Project

The Minnesota Department of Information Technology Services (MNIT), partnering with Minnesota Management and Budget (MMB), is seeking two (2) full-time staff augmentation resources to migrate, test, and implement Data Warehouse ETLs from IBM DataStage V 8.5 on Windows 2008 Server to IBM DataStage V 11.7 on Red Hat Linux 8.

MMB's DataStage ETL tool supports the transfer of data from the PeopleSoft source system (Financial Management Solutions (FMS), Human Capital Management (HCM), Enterprise Learning Management (ELM)) to the EPM Data Warehouse which agency users across State government use for reporting. The current DataStage software operates on Windows 2008 physical machines which are no longer supported; therefore MNIT/MMB has undertaken an upgrade of the DataStage software, which includes moving the servers to supported server operating systems.

The upgrade project is underway and requires the migration of approximately 1,700 server jobs to bring it to completion. With the exception of a relatively small number of jobs that still need to be migrated to the DataStage V11 Test instance, the server jobs have generally already been migrated to the DataStage V11 Test instance, and now need to be tested/fixed and migrated to the DataStage V11 Production instance. The contractor resources under this engagement will perform these migration tasks, supplementing State staff members who will also be performing this work. State staff will provide project management. The contractor resources will work closely with the MNIT Data Warehouse Team lead along with other project team members.

The metadata database is Oracle 19C and the Data Warehouse is Oracle 12C. DataStage Version 11.7 on Red Hat is up and running and has already been configured.

During the production batch process, data is moved from the source Oracle databases into a staging layer in the Warehouse database and then moved to a multi-dimensional layer used for reporting using Oracle Business Intelligence Enterprise Edition (OBIEE). The Warehouse nightly batch takes about 10 hours to complete each night. Each upgraded job will need to be performance tuned so that it takes the same or less time to load when compared to DataStage V 8.5.

Work will be performed off-site/remotely.

For additional details on the request such as tasks, qualifications, and evaluation criteria, see the attachments found in the Buyer Attachment section of the Event.

Resource Need

This request is for two (2) full-time staff augmentation resources. Each resource will come from a different vendor as each vendor is only allowed to submit 1 resource.

Incumbent (Currently holding the position while this Event is posted.)

There is no incumbent for this Event.

Mode of Interview

The State will conduct interviews with a short list of the highest scoring candidates. The State reserves the right to remove a resource from consideration if the resource is unavailable for interview as requested by the State. Interviews will be conducted via Microsoft Teams.

Project Schedule

The State retains the option to extend the work orders in increments determined by the State.