Compare Two Data Files
Test Case 03, Track Inserts & Deletes
  Table of Contents  v-16.01.01 - tc03cp01.htm 
  Introduction
  Items Provided with TC03
  Items to be Created by TC03
  Execution Tasks
  1. CMD, Compare with EQ Results
  2. CMD, Compare with NE Results
  3. JCL, Compare with EQ Results
  4. JCL, Compare with NE Results
  Review
  Compare with "EQUAL" Results
  Compare with "NOT EQUAL" Results
  Preparation Tasks
  Create a Directory Structure
  Configure a Batch Server Instance
  Technical Details
  JCL to Delete/Define TC01KS01
  FTP Specifications
  Directives Files for Program Compile
  Compile using Mainframe Dialect
  Compile using Micro Focus Dialect
  Set Environment Variables
  Display and Log Messages
  Summary
  Software Agreement and Disclaimer
  Downloads and Links
  Current Server or Internet Access
  Internet Access Required
  Glossary of Terms
  Comments or Feedback
  Company Overview
The SimoTime Home Page 

Table of Contents Previous Section Next Section Introduction

The primary objective of this test case is to describe and demonstrate how to compare (on a record-by-record basis) the content of two non-relational data structures such as a sequential file and/or a VSAM Data Set. The process for comparing two data structures should be executable on an IBM/ZOS Mainframe System or on a Linux, UNIX or Windows (LUW) System using Micro Focus Server. Also, the process should be supported in a development, test or production environment. Any system changes to the mainframe or the installation of additional software on the mainframe should be avoided. The creation of batch jobs using JCL and the creation of additional COBOL programs is acceptable. These items will need to be documented and should be kept to a minimum.

In addition to the record-by-record compare a secondary objective is to describe and demonstrate how to track record inserts and deletes.

Note:  It is important to note the intent of Test Case 03 is not simply to do a one-time data file validation (or compare) during an application and data migration. The intent is to describe and demonstrate a low-cost, repeatable process that may be used as a model for doing data validation as part of the ongoing unit, application and system testing processes.
 

Test Case 03 is a series of tasks that are categorized a into a Prepare group and an Execute group. The items in the Prepare group are one-time tasks to define and create the processes for doing the data file compares. The items in the Execute group are the ongoing, repeatable tasks that will be executed many times.


We have made a significant effort to ensure the documents and software technologies are correct and accurate. We reserve the right to make changes without notice at any time. The function delivered in this version is based upon the enhancement requests from a specific group of users. The intent is to provide changes as the need arises and in a timeframe that is dependent upon the availability of resources.

Copyright © 1987-2024
SimoTime Technologies and Services
All Rights Reserved

Table of Contents Previous Section Next Section Items Provided with TC03

Test Case 03 (TC03) includes a suite of job scripts and programs that will create data files to be used in the data file compare process.

1. Application and/or Utilitarian Assets
1.1. A COBOL copy file that defines the record structure for the Record Sequential files (RSEQ).
1.2. A program to convert Line Sequential files (LSEQ) to Record Sequential files (RSEQ).
2. Non-Relational Data Structures
2.1. A Record Sequential File (TESTCASE.TC03.TC03BASE.dat) with 128 byte, fixed-length records. This file is used as the baseline (or expected results) file.
2.2. A Record Sequential File (TESTCASE.TC03.TC03SAME.dat) that is a copy of the baseline file and is used to describe and demonstrate a compare process that produces an "EQUAL" result.
2.3. A Record Sequential File (TESTCASE.TC03.TC03DIFF.dat) that is used to describe and demonstrate a compare process that produces a "NOT EQUAL" result.

 

Table of Contents Previous Section Next Section Items to be Created by TC03

A "Prepare" process (or System Configuration) must be performed to set environment variables, create a directory structure, configure a Micro Focus Server Instance and create the utility programs that will do various data file converts and compares. The following is a list of the tasks.

1. System Preparation
1.1. Create a process to set the necessary Environment Variables.
1.2. Create a directory structure to support a development environment.
1.3. Configure a Micro Focus batch server instance that will run Test Case 03 using ASCII-encoded, non-relational data structures. Describe and demonstrate how this is accomplished.
2. Utility Programs and Processes
2.1. Create a set of Windows Command Files to be used as a repeatable data file compare process for the non-relational data structures included in Test Case 03. This repeatable process should serve as a model for comparing other non-relational data structures. The comparison process should run in a development, test and production environment on a Windows System using Micro Focus Enterprise Server. Describe and demonstrate how this is accomplished.
2.1.1. Create a batch job using a Windows command file that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the preparation phase.
2.1.2. Create a batch job using a Windows command file that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the execution phase.
2.2. Create a set of JCL Members to be used as a repeatable data file compare process for the non-relational data structures included in Test Case 03. This repeatable process should serve as a model for comparing other non-relational data structures. The comparison process should run in a development, test and production environment on a ZOS Mainframe or a Linux, UNIX or Windows System using Micro Focus Enterprise Server. Describe and demonstrate how this is accomplished.
2.2.1. Create a batch job using a JCL Member that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the preparation phase.
2.2.2. Create a batch job using a JCL Member that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the execution phase.
3. Documentation
3.1. Create documentation for the preceding items.
3.2. The documentation should be easily viewed from devices that have browser capability.

 

Table of Contents Previous Section Next Section Execution Tasks

Test Case 03 (TC03) was created on a Windows/7 System with Micro Focus Enterprise Server (this includes both Enterprise Studio and Enterprise Developer). The COBOL programs were compiled in the new environment and the JCL was submitted to the Micro Focus Server and executed as expected.

             
Entry Point
ZOS
Entry Point
Windows
   
   
TC03CPJ1
jcl
TC03CPW1
cmd
Submit the Job
   
   
IEFBR14
Utility
IF Exist
statement
Delete previously created output files
   
   
 
 
   
   
 
 
   
   
TC03BASE
rseq
   
   
TC03CPC1
cbl
   
   
SYSOUT
rseq
Compare the Files
   
   
   
   
   
   
TC03SAME
rseq
   
   
   
   
   
SYSLOG
rseq
   
EOJ
End-Of-Job
 
Overview of Test Case 03, Compare two Data Files

 

Table of Contents Previous Section Next Section 1. CMD, Compare with EQ Results

The following Windows command (TC03CPW1.cmd) will set the environment and execute a generated COBOL program that will compare two record sequential files. The compare process will result in an "EQUAL" condition (or ZERO return code).

@echo OFF
rem  * ************************************************************************
rem  *                 TC03CPW1.cmd - a Windows Command File                  *
rem  *           This program is provided by SimoTime Technologies            *
rem  *              (C) Copyright 1987-2019 All Rights Reserved               *
rem  *                Web Site URL:   http://www.simotime.com                 *
rem  *                      e-mail:   helpdesk@simotime.com                   *
rem  * ************************************************************************
rem  *
rem  * Text   - Compare two Data Files and track record inserts and deletes.
rem  * Author - SimoTime Technologies
rem  * Date   - January 24, 1996
rem  *
rem  * *******************************************************************
rem  * Step 1, Delete any previously created file...
rem  *
     set CmdName=TC03CPW1
     call ..\Env1BASE
     set SYSLOG=%BaseLib1%\LOGS\TESTCASE.TC03.TC03LOGS.dat
     run SYSLOGC8
     set SYSOUT=%BaseLib1%\DATA\SPOOL\TESTCASE.TC03.TC03SP09.txt
     if exist %SYSOUT% erase %SYSOUT%
rem  *
     call SimoNOTE "*******************************************************%CmdName%"
     call SimoNOTE "Starting JobName %CmdName%"
     call SimoNOTE "Identify JobStep DeleteLSEQ"
     set TC03ACTL=%BaseLib1%\DATA\APPL\TESTCASE.TC03.TC03SAME.dat
     set TC03EXPT=%BaseLib1%\DATA\ASC1\TESTCASE.TC03.TC03BASE.dat
rem  *
rem  * *******************************************************************
rem  * Step 2, Compare two non-relational Record Sequential File (RSEQ)
rem  *         with 128-byte, ASCII-encoded records.
rem  *
     call SimoNOTE "Identify JobStep Do the File Compare"
     run TC03CPC1
     if not "%ERRORLEVEL%" == "0" set JobStatus=0010
     if not "%JobStatus%" == "0000" goto EojNok
rem  *
rem  * *******************************************************************
rem  *
:EojAok
     call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%"
     goto :End
:EojNok
     call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%"
:End
     set SYSLOGVR=%SYSLOG%
     set SYSLOGLS=%BASELIB1%\LOGS\TESTCASE.TC03.TC03LOGS.txt
     if exist %SYSLOGLS% erase %SYSLOGLS%
     run SYSLOGC1
     call SimoNOTE "Conclude SysOut is %SYSOUT%"
     call SimoNOTE "Conclude SysLog is %SYSLOG%"
     call SimoNOTE "Conclude TxtLog is %SYSLOGLS%"
     if not "%1" == "nopause" pause

The results are posted in the SYSLOG file. To Review the Results refer to the "Review" section of this document.

Table of Contents Previous Section Next Section 2. CMD, Compare with NE Results

The following Windows Command file (TC03CPW2.cmd) will set the environment and execute a generated COBOL program that will compare two record sequential files. The compare process will result in a "NOT EQUAL" condition (or 16 return code).

@echo OFF
rem  * ************************************************************************
rem  *                 TC03CPW2.cmd - a Windows Command File                  *
rem  *           This program is provided by SimoTime Technologies            *
rem  *              (C) Copyright 1987-2019 All Rights Reserved               *
rem  *                Web Site URL:   http://www.simotime.com                 *
rem  *                      e-mail:   helpdesk@simotime.com                   *
rem  * ************************************************************************
rem  *
rem  * Text   - Compare two Data Files, track record inserts and deletes.
rem  * Author - SimoTime Technologies
rem  * Date   - January 24, 1996
rem  *
rem  * *******************************************************************
rem  * Step 1, Delete any previously created file...
rem  *
     set CmdName=TC03CPW2
     call ..\Env1BASE
     set SYSLOG=%BaseLib1%\LOGS\TESTCASE.TC03.TC03LOGS.dat
     run SYSLOGC8
     set SYSOUT=%BaseLib1%\DATA\SPOOL\TESTCASE.TC03.TC03SP09.txt
     if exist %SYSOUT% erase %SYSOUT%
rem  *
     call SimoNOTE "*******************************************************%CmdName%"
     call SimoNOTE "Starting JobName %CmdName%"
     call SimoNOTE "Identify JobStep DeleteLSEQ"
     set TC03ACTL=%BaseLib1%\DATA\APPL\TESTCASE.TC03.TC03DIFF.dat
     set TC03EXPT=%BaseLib1%\DATA\ASC1\TESTCASE.TC03.TC03BASE.dat
rem  *
rem  * *******************************************************************
rem  * Step 2, Compare two non-relational Record Sequential File (RSEQ)
rem  *         with 128-byte, ASCII-encoded records.
rem  *
     call SimoNOTE "Identify JobStep Do the File Compare"
     run TC03CPC1
     if not "%ERRORLEVEL%" == "0" set JobStatus=0010
     if not "%JobStatus%" == "0000" goto EojNok
rem  *
rem  * *******************************************************************
rem  *
:EojAok
     call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%"
     goto :End
:EojNok
     call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%"
:End
     set SYSLOGVR=%SYSLOG%
     set SYSLOGLS=%BASELIB1%\LOGS\TESTCASE.TC03.TC03LOGS.txt
     if exist %SYSLOGLS% erase %SYSLOGLS%
     run SYSLOGC1
     call SimoNOTE "Conclude SysOut is %SYSOUT%"
     call SimoNOTE "Conclude SysLog is %SYSLOG%"
     call SimoNOTE "Conclude TxtLog is %SYSLOGLS%"
     if not "%1" == "nopause" pause

The results are posted in the SYSLOG file. To Review the Results refer to the "Review" section of this document.

Table of Contents Previous Section Next Section 3. JCL, Compare with EQ Results

The following JCL Member (TC03CPJ1.jcl) will housekeeping functions and execute a generated COBOL program that will compare two record sequential files. The compare process will result in an "EQUAL" condition (or ZERO return code)

//TC03CPJ1 JOB (SIMOTIME),'DATA FILE COMPARE',CLASS=1,MSGCLASS=0,
//             NOTIFY=CSIP1
//* *******************************************************************
//*       TC03CPJ1.JCL - a JCL Member for Batch Job Processing        *
//*       This JCL Member is provided by SimoTime Technologies        *
//*           (C) Copyright 1987-2019 All Rights Reserved             *
//*             Web Site URL:   http://www.simotime.com               *
//*                   e-mail:   helpdesk@simotime.com                 *
//* *******************************************************************
//*
//* Text   - Compare two data files.
//* Author - SimoTime Technologies
//* Date   - January 24, 1996
//*
//* This set of programs will run on a mainframe under MVS or on a
//* Personal Computer with Windows and Micro Focus Technologies.
//*
//*                     ************
//*                     * TC03CPJ1 *
//*                     ********jcl*
//*                          *
//*                     ************
//*                     * IEFBR14  *
//*                     ********utl*
//*                          *
//*    ************     ************     ************
//*    * TC03BASE *-----* TC03CPC1 *-----*  SYSOUT  *
//*    ********dat*  *  ********cbl*  *  ************
//*                  *       *        *
//*    ************  *       *        *  ************
//*    * TC03SAME *--*       *        *--*  SYSLOG  *
//*    ********dat*          *           *******vseq*
//*                          *
//*                     ************
//*                     *   EOJ    *
//*                     ************
//*
//* *******************************************************************
//* Step 1 of 2, Delete and Define a New SYSLOG file...
//*
//         SET  DDSYSLOG=TESTCASE.TC03.SYSLOGJ1
//CRTLOGS1 EXEC SYSLOGP8
//* *******************************************************************
//* Step 2 of 2, Compare two data files, expect an EQUAL result...
//*
//COMPARE1 EXEC PGM=TC03CPC1
//STEPLIB  DD  DSN=SIMOTIME.DEMO.LOADLIB1,DISP=SHR
//TC03ACTL DD  DSN=TESTCASE.TC03.TC03SAME,DISP=SHR
//TC03EXPT DD  DSN=TESTCASE.TC03.TC03BASE,DISP=SHR
//SYSLOG   DD  DSN=&DDSYSLOG,DISP=SHR
//SYSOUT   DD  SYSOUT=*
//

Table of Contents Previous Section Next Section 4. JCL, Compare with NE Results

The following JCL Member (TC03CPJ2.jcl) will housekeeping functions and execute a generated COBOL program that will compare two record sequential files. The compare process will result in a "NOT EQUAL" condition (or 16 return code)

//TC03CPJ2 JOB (SIMOTIME),'DATA FILE COMPARE',CLASS=1,MSGCLASS=0,
//             NOTIFY=CSIP1
//* *******************************************************************
//*       TC03CPJ2.JCL - a JCL Member for Batch Job Processing        *
//*       This JCL Member is provided by SimoTime Technologies        *
//*           (C) Copyright 1987-2019 All Rights Reserved             *
//*             Web Site URL:   http://www.simotime.com               *
//*                   e-mail:   helpdesk@simotime.com                 *
//* *******************************************************************
//*
//* Text   - Compare two data files.
//* Author - SimoTime Technologies
//* Date   - January 24, 1996
//*
//* This set of programs will run on a mainframe under MVS or on a
//* Personal Computer with Windows and Micro Focus Technologies.
//*
//*                     ************
//*                     * TC03CPJ1 *
//*                     ********jcl*
//*                          *
//*                     ************
//*                     * IEFBR14  *
//*                     ********utl*
//*                          *
//*    ************     ************     ************
//*    * TC03BASE *-----* TC03CPC1 *-----*  SYSOUT  *
//*    ********dat*  *  ********cbl*  *  ************
//*                  *       *        *
//*    ************  *       *        *  ************
//*    * TC03DIFF *--*       *        *--*  SYSLOG  *
//*    ********dat*          *           *******vseq*
//*                          *
//*                     ************
//*                     *   EOJ    *
//*                     ************
//*
//* *******************************************************************
//* Step 1 of 2, Delete and Define a New SYSLOG file...
//*
//         SET  DDSYSLOG=TESTCASE.TC03.SYSLOGJ2
//CRTLOGS1 EXEC SYSLOGP8
//* *******************************************************************
//* Step 2 of 2, Compare two data files, expect an EQUAL result...
//*
//COMPARE1 EXEC PGM=TC03CPC1
//STEPLIB  DD  DSN=SIMOTIME.DEMO.LOADLIB1,DISP=SHR
//TC03ACTL DD  DSN=TESTCASE.TC03.TC03DIFF,DISP=SHR
//TC03EXPT DD  DSN=TESTCASE.TC03.TC03BASE,DISP=SHR
//SYSLOG   DD  DSN=&DDSYSLOG,DISP=SHR
//SYSOUT   DD  SYSOUT=*
//

Table of Contents Previous Section Next Section Review

This section will show the contents of two SYSLOG files. The first example is produced as a result from an "EQUAL" compare. The second example is produced as a result of a "NOT EQUAL" compare.

Table of Contents Previous Section Next Section Compare with "EQUAL" Results

The following shows the content of the SYSLOG file that is created when the file compare process resulted in an "Equal" condition.

*** 2013/09/10 22:45:28:87 *******************************************************************************
*** 2013/09/10 22:45:28:87 * TC03CPC1 Key Field 1-6, 128-Byte Comparison v13.09.10   helpdesk@simotime.com
*** 2013/09/10 22:45:28:87 * TC03CPC1 This Data File Compare Member was generated by SimoTime Technologies
*** 2013/09/10 22:45:28:87 *******************************************************************************
*** 2013/09/10 22:45:28:87 Starting  - Key Field 1-6, 128-Byte Comparison          http://www.SimoTime.com
*** 2013/09/10 22:45:28:87 *****************************************************************************QT
*** 2013/09/10 22:45:28:87 Conclude  - Key Field 1-6, 128-Byte Comparison
*** 2013/09/10 22:45:28:87 000000026 - Record count for TC03ACTL
*** 2013/09/10 22:45:28:87 000000026 - Record count for TC03EXPT
*** 2013/09/10 22:45:28:89 000000000 - NOT Equal count for compare is ZERO
*** 2013/09/10 22:45:28:89 000000026 - Number of matching record pairs for Compare Task
*** 2013/09/10 22:45:28:89 Finished  - Key Field 1-6, 128-Byte Comparison          http://www.SimoTime.com

Table of Contents Previous Section Next Section Compare with "NOT EQUAL" Results

The following shows the content of the SYSLOG file that is created when the file compare process resulted in a "Not Equal" condition.

*** 2013/09/13 16:37:42:04 *******************************************************************************
*** 2013/09/13 16:37:42:04 * TC03CPC1 Key Field 1-6, 128-Byte Comparison v13.09.12   helpdesk@simotime.com
*** 2013/09/13 16:37:42:04 * TC03CPC1 This Data File Compare Member was generated by SimoTime Technologies
*** 2013/09/13 16:37:42:04 *******************************************************************************
*** 2013/09/13 16:37:42:04 Starting  - Key Field 1-6, 128-Byte Comparison          http://www.SimoTime.com
*** 2013/09/13 16:37:42:04 *******************************************************************************   Refer to Note-01
*** 2013/09/13 16:37:42:04 This record is MISSING from TC03ACTL - the record is PRESENT in TC03EXPT
*** 2013/09/13 16:37:42:05 KEYFIELD..000000011(00001:00006) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:05 ....:.
*** 2013/09/13 16:37:42:05 001100
*** 2013/09/13 16:37:42:05 333333
*** 2013/09/13 16:37:42:05 001100
*** 2013/09/13 16:37:42:05 ######
*** 2013/09/13 16:37:42:05 *
*** 2013/09/13 16:37:42:05 KEYRECID..000000011(00001:00032) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:05 ....:...10....:...20....:...30..
*** 2013/09/13 16:37:42:05 001100 Kemper         Kelly
*** 2013/09/13 16:37:42:07 33333324667672222222224666722222
*** 2013/09/13 16:37:42:07 0011000B5D052000000000B5CC900000
*** 2013/09/13 16:37:42:07 *******************************************************************************   Refer to Note-02
*** 2013/09/13 16:37:42:07 This record is PRESENT in TC03ACTL - the record is MISSING from TC03EXPT
*** 2013/09/13 16:37:42:07 KEYFIELD..000000011(00001:00006) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:07 ....:.
*** 2013/09/13 16:37:42:07 001150
*** 2013/09/13 16:37:42:07 333333
*** 2013/09/13 16:37:42:07 001150
*** 2013/09/13 16:37:42:07 ######
*** 2013/09/13 16:37:42:07 *
*** 2013/09/13 16:37:42:07 KEYRECID..000000011(00001:00032) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:08 ....:...10....:...20....:...30..
*** 2013/09/13 16:37:42:08 001150 Kemper         Kelly
*** 2013/09/13 16:37:42:08 33333324667672222222224666722222
*** 2013/09/13 16:37:42:08 0011500B5D052000000000B5CC900000
*** 2013/09/13 16:37:42:08 *******************************************************************************   Refer to Note-03
*** 2013/09/13 16:37:42:08 This record is PRESENT in TC03ACTL - the record is MISSING from TC03EXPT
*** 2013/09/13 16:37:42:08 KEYFIELD..000000018(00001:00006) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:08 ....:.
*** 2013/09/13 16:37:42:08 001744
*** 2013/09/13 16:37:42:08 333333
*** 2013/09/13 16:37:42:08 001744
*** 2013/09/13 16:37:42:08 ######
*** 2013/09/13 16:37:42:10 *
*** 2013/09/13 16:37:42:10 KEYRECID..000000018(00001:00032) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:10 ....:...10....:...20....:...30..
*** 2013/09/13 16:37:42:10 001744 Newton         Nancy
*** 2013/09/13 16:37:42:10 33333324677662222222224666722222
*** 2013/09/13 16:37:42:10 0017440E574FE000000000E1E3900000
*** 2013/09/13 16:37:42:10 *******************************************************************************   Refer to Note-04
*** 2013/09/13 16:37:42:10 TC03ACTL..000000025(00007:00122) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:10 ..10....:...20....:...30....:...40....:...50....:...60....:...70....:...80....:...90....:..100....:..110....:..120....:..1
*** 2013/09/13 16:37:42:10  Xray           Xavier    2424 24th Avenue        Nashville      TN 44190  +000175000 441-207-1135
*** 2013/09/13 16:37:42:10 25767222222222225676672222333323376247667622222222467676666222222542333332223333333332333233323333222222222222222222222222
*** 2013/09/13 16:37:42:10 082190000000000081695200002424024480165E5500000000E13869CC50000004E04419000B0001750000441D207D1135000000000000000000000000
*** 2013/09/13 16:37:42:11 TC03EXPT..000000024(00007:00122) COMPARISON  PHYSICAL
*** 2013/09/13 16:37:42:11 ..10....:...20....:...30....:...40....:...50....:...60....:...70....:...80....:...90....:..100....:..110....:..120....:..1
*** 2013/09/13 16:37:42:11  Xray           Xavier    2424 24TH Street        Nashville      TN 44190  +000175000 441-207-1135
*** 2013/09/13 16:37:42:11 25767222222222225676672222333323354257766722222222467676666222222542333332223333333332333233323333222222222222222222222222
*** 2013/09/13 16:37:42:11 08219000000000008169520000242402448034255400000000E13869CC50000004E04419000B0001750000441D207D1135000000000000000000000000
*** 2013/09/13 16:37:42:11 =================================##=######================================================================================
*** 2013/09/13 16:37:42:11 *
*** 2013/09/13 16:37:42:11 *******************************************************************************   Refer to Note-05
*** 2013/09/13 16:37:42:11 Conclude  - Key Field 1-6, 128-Byte Comparison
*** 2013/09/13 16:37:42:11 000000027 - Record count for TC03ACTL
*** 2013/09/13 16:37:42:11 000000026 - Record count for TC03EXPT
*** 2013/09/13 16:37:42:11 WARNING!  - Record counts are not equal
*** 2013/09/13 16:37:42:13 000000004 - NOT Equal count for compare of existing records
*** 2013/09/13 16:37:42:13 000000024 - Number of matching record pairs for Compare Task
*** 2013/09/13 16:37:42:13 ABENDING  - Key Field 1-6, 128-Byte Comparison          http://www.SimoTime.com

Note-01: This group of line items was produced when a record was present in the Expected Results file (TC03EXPT) but was missing from the Actual Results file (TC03ACTL).

Note-02: This group of line items was produced when a record was present in the Actual Results file (TC03ACTL) but was missing from the Expected Results file (TC03EXPT).

Note-03: This group of line items was produced when a record was present in the Actual Results file (TC03ACTL) but was missing from the Expected Results file (TC03EXPT).

Note-04: This group of line items was produced when two records were compared and the record content was not equal.

Note-05: This group of line items was produced when the compare program performed the End-of-Job processing.

 

Table of Contents Previous Section Next Section Preparation Tasks

A Data Migration effort presents a user with a number of choices. For non-relational data structures the decision process will leverage a variety of skills and a broad knowledge base that may be acquired through training, experience, research and assistance.

Table of Contents Previous Section Next Section Create a Directory Structure

Test Case 01 will focus on the development environment.

Link to Internet   Link to Server   Explore a Directory Structure for a Development Environment that supports the execution of business applications using Micro Focus Enterprise Server.

Table of Contents Previous Section Next Section Configure a Batch Server Instance

The purpose of this section is to describe how to configure a JES sub-system (or Server Instance) that will run under Micro Focus Enterprise Server. To run all the jobs in Test Case 01 it will be necessary to populate the catalog with a minimum number of Partitioned Data Sets (or PDS's).

Link to Internet   Link to Server   Explore how to Configure a Batch JES sub-system (or Server Instance) that will run under Micro Focus Enterprise Server and execute batch jobs using JCL.

 

Table of Contents Previous Section Next Section Technical Details

This section contains information about items that are used by the mainline Job Scripts and/or Programs.

Table of Contents Previous Section Next Section JCL to Delete/Define TC01KS01

The following JCL member (TC01DDJ1.jcl) is a job that uses IDCAMS to do a DELETE/DEFINE of the VSAM/KSDS used in this Test Case.

//TC01DDJ1 JOB SIMOTIME,CLASS=1,MSGCLASS=0,NOTIFY=CSIP1
//* *******************************************************************
//*       TC01DDJ1.JCL - a JCL Member for Batch Job Processing        *
//*       This JCL Member is provided by SimoTime Technologies        *
//*           (C) Copyright 1987-2019 All Rights Reserved             *
//*             Web Site URL:   http://www.simotime.com               *
//*                   e-mail:   helpdesk@simotime.com                 *
//* *******************************************************************
//*
//* Text   - Create an empty VSAM, KSDS data set using IDCAMS.
//* Author - SimoTime Technologies
//* Date   - January 24, 1996
//*
//* This job will create a VSAM, KSDS data set. The key is six (6)
//* characters starting at the first position in the record.
//* The record length is 128 characters.
//*
//* This set of programs will run on a mainframe under MVS or on a
//* Personal Computer with Windows and Micro Focus Mainframe Express.
//*
//* *******************************************************************
//* Step   1   This is a single step job.
//*
//KSDSMAKE EXEC PGM=IDCAMS
//SYSPRINT DD   SYSOUT=*
//SYSIN    DD   *
 DEFINE    CLUSTER  (NAME(TESTCASE.TC01.TC01KS10)             -
                    TRACKS(45,15)                             -
                    INDEXED)                                  -
           DATA     (NAME(TESTCASE.TC01.TC01KS10.DAT)         -
                    KEYS(6,0)                                 -
                    RECORDSIZE(512,512)                       -
                    FREESPACE(10,15)                          -
                    CISZ(8192))                               -
           INDEX    (NAME(TESTCASE.TC01.TC01KS10.IDX))
/*
//*

Note:  The DELETE/DEFINE will replace an existing data set

Table of Contents Previous Section Next Section FTP Specifications

The following member (TC02GET3.ctl) contains the FTP specifications to download a sequential file from the Mainframe System to a Windows System.

UserID
Password
CD ..
PWD
ASCII
GET  MFI01.SIMOTIME.RSEQ81.JCL  D:\TC02\DATA\FTP1\MFI01.SIMOTIME.RSEQ81.JCL.txt
QUIT

Note:  The Specifications or control information is stored in the PARMLIB Partitioned-Data-Set (PDS).

Table of Contents Previous Section Next Section Directives Files for Program Compile

This section will describe the directives files that are used when compiling the COBOL programs that are used in Test Case 01.

Table of Contents Previous Section Next Section Compile using Mainframe Dialect

The following member (OS390AscCBLBAT.dir) is the directives file that is used to compile the COBOL programs that conform to the OS390 dialect. The compiled programs may be executed using JCL or a Windows Command line.

DIALECT"OS390"
CHARSET"ASCII"
ASSIGN"EXTERNAL"
IDXFORMAT"8"
IBMCOMP
NOTRUNC
HOSTNUMMOVE
HOSTNUMCOMPARE
NOSIGN-FIXUP
HOSTARITHMETIC
CHECKNUM
NOOPTIONAL-FILE
NOHOSTFD
NOQUERY
SSRANGE
COBIDY
ANIM
outdd"SYSOUT 121 L"
SHARE-OUTDD
DATE
TIME
DATAMAP
settings
list()
noform

Table of Contents Previous Section Next Section Compile using Micro Focus Dialect

The following member (MiFoAscIBMcomp.dir) is the directives file that is used to compile the COBOL programs that conform to the Micro Focus dialect. The compiled programs are typically executed using a Windows Command line.

DIALECT"MF"
CHARSET"ASCII"
ASSIGN"EXTERNAL"
IDXFORMAT"8"
IBMCOMP
NOTRUNC
RTNCODE-SIZE"2"
NOOPTIONAL-FILE
NOHOSTFD
NOQUERY
COBIDY
NOANIM
outdd"SYSOUT 121 L"
SHARE-OUTDD
DATAMAP
settings
list()
noform

Table of Contents Previous Section Next Section Set Environment Variables

The following is a Windows CMD File (ENV1BASE.cmd) that is called to set the common or shared environment variables for a development environment that will support the execution of Test Case 01.

@echo OFF
rem  * *******************************************************************
rem  *               ENV1BASE.cmd - a Windows Command File               *
rem  *        This program is provided by SimoTime Technologies          *
rem  *           (C) Copyright 1987-2021 All Rights Reserved             *
rem  *             Web Site URL:   http://www.simotime.com               *
rem  *                   e-mail:   helpdesk@simotime.com                 *
rem  * *******************************************************************
rem  *
rem  * Text   - Provide a single point to set common environment variables.
rem  * Author - SimoTime Technologies
rem  * Date   - January 24, 1996
rem  *
rem  * Set the commonly used environment variables. This is used to provide
rem  * a single point for managing the commonly used environment variables.
rem  *
     set SimoLIBR=c:\SimoLIBR
     set BASELIB1=c:\SIMOSAM1\DEVL
     set BASELIB8=c:\SimoSAM8
     set BaseWIP1=c:\SimoSAM1\WIP1
     set DATAZERO=c:\SIMODATA\DEVL\DATA\ZERO
     set BASEAPP=%BaseLib1%
     set BASESYS=%BaseLib1%\SYS1
     set BASECAT=%BaseLib1%\DATA
     set UMAPALIB=%BASECAT%\ASC1
     set UMAPELIB=%BASECAT%\EBC1
     set SYSLOG=%BASESYS%\LOGS\SYSLOG_USER.DAT
     set SYSOUT=%BASEAPP%\LOGS\SYSOUT_SIMSAM01.txt
     set SLZMSG=%BASEAPP%\LOGS\SLZMSG_USER.TXT
     set PostNOTE=%BASEAPP%\LOGS\JOBLOG_SIMONOTE.TXT
     set SIMONOTE=%BASEAPP%\LOGS\JOBLOG_SIMONOTE.txt
     set USERPOST=%BASEAPP%\LOGS\ASSIGNED_USER_POST_FILE.txt
     if [%1]==[] goto NO_POST
     set SYSOUT=%BaseLib1%\LOGS\SYSOUT_%1.txt
     call SIMONOTE "+ ENV1BASE *"
     call SIMONOTE "+ ENV1BASE ********************************************************************%1"
     call SIMONOTE "+ ENV1BASE is preparing the System Environment..."
     call SIMONOTE "+ SIMOLIBR is %SIMOLIBR%"
     call SIMONOTE "+ MIFOSYS1 is %MIFOSYS1%"
     call SIMONOTE "+ BASELIB1 is %BASELIB1%"
:NO_POST
     call SIMONOTE "+ SIMONOTE Job Log File is %SIMONOTE% "
rem  *
     set MQBASE=C:\Program Files\IBM\WebSphere MQ
rem  *
rem  * Set the location for the Apache-Tomcat Server...
     set CATALINA_HOME=C:\APACHETC\apache-tomcat-7.0.52
rem     set CATALINA_HOME=C:\Program Files (x86)\Java\jdk1.8.0_112
rem  *
rem  * Set the Environment for the Java Environment...
rem     set JAVABASE=C:\APACHETC\apache-tomcat-7.0.52
     set JAVABASE=C:\Program Files (x86)\Java\jdk1.8.0_112
     set JAVASDK="%JAVABASE%\bin"
     set JAVA_HOME=%JAVABASE%
     set JRE_HOME=%JAVABASE%
     set SIMOTCAT=%CATALINA_HOME%\webapps\simotcat
     set SIMPACKS=%CATALINA_HOME%\webapps\simotcat\WEB-INF\classes\simpacks
rem  *
rem  * Set the environment for the Micro Focus technology...
     set MIFOEDEV=C:\Program Files (x86)\Micro Focus\Enterprise Developer
     set MIFOVCBL=C:\Program Files (x86)\Micro Focus\Visual COBOL Build Tools
     set MIFOESTU=C:\Program Files (x86)\Micro Focus\Studio Enterprise Edition 6.0
     set MIFOEMFE="C:\Program Files (x86)\Micro Focus\Mainframe Express"
rem  *
rem  * Large file support, performance tuning and record locking of the File Handler
     set EXTFH=%BASESYS%\CONFIG\EXTFHBIG.CFG
rem  *
rem  * For IMS Support
     set ES_IMSLIB=%BASEAPP%\IMSLIB
     set ES_ACBLIB=%BASEAPP%\IMSLIB
rem  *
rem  * EZASOKETS Check EZASOKETS Enabled box or set ES_EZASOKET_SUPPORT=YES
     set EZACONFG=BASESYS1\CONFIG\EZACONFG.dat
rem  *
rem  * Resource Allocation and Performance for SORT and non-Relational Data
rem  set MFJSENGINE=SYNCSORT
     set SORTSCHEME=1
     set SORTSPACE=750000000
     set TMP=C:\SORTWORK
rem  *
     set ES_ALLOC_OVERRIDE=%BASESYS%\CONFIG\CATMAPA1.cfg
rem  * For CORE_ON_ERROR function, ABEND Dump
rem  *     set COBCONFIG_=%BASESYS%\CONFIG\diagnose.cfg
rem  *
rem  * Consolidated Trace Facility (CTF)
rem  *     set MFTRACE_CONFIG=%BASESYS%\CONFIG\ctf.cfg
rem  *     set MFTRACE_LOGS=c:\ctflogs
rem  *
rem  * For Job Restart, ABEND Recovery
     set MF_UCC11=Y
     set ES_JES_RESTART=Y
rem  *
rem  * Set environment for MFBSI (Micro Focus Batch Scheduling Interface)
     set ES_EMP_EXIT_1=mfbsiemx
     set MFBSI_DIR=%BASESYS%\LOGS\%JESSERVERNAME%
     set MFBSIEOP_CMD=ENABLE
     set MFBSIEOP_CSV=ENABLE
     set MFBSIEOP_HTM=ENABLE
     set MFBSIEOP_XML=ENABLE
rem  *
rem  * Set Behavior and Trace Flags for GETJOBDD
rem  *   Position=12345678/12345678
     set JDDFLAGS=nnnWnnnn/YYnnnnnn
rem  *
rem  * If not already set then set the PATH for Micro Focus Directories
     if "%SIMOPATH%" == "Y" goto JUMPPATH
     if "%MIFOSYS1%" == "EDEV" goto JUMPEDEV
     if "%MIFOSYS1%" == "VCBL" goto JUMPVCBL
     if "%MIFOSYS1%" == "ESTU" goto JUMPESTU
     if "%MIFOSYS1%" == "EMFE" goto JUMPEMFE
:JUMPEDEV
     set path=%BASESYS%\LOADLIB;%MIFOEDEV%\bin;%JAVASDK%;%BASEAPP%\JAVA;%PATH%;
     set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR%;%MIFOEDEV%\CPYLIB
     set MIFOBASE=%MIFOEDEV%
     goto JUMPPATH
:JUMPVCBL
     set path=%MIFOVCBL%\bin;%MIFOVCBL%;%JAVASDK%;%BASEAPP%\JAVA;%PATH%;
     set MIFOBASE=%MIFOVCBL%
     goto JUMPPATH
:JUMPESTU
     set MIFOBASE=%MIFOESTU%\Base
     set MIFOBIN=%MIFOBASE%\bin
     set path=%BASESYS%\LOADLIB;%MIFOBASE%;%MIFOBIN%;%JAVASDK%;%BASEAPP%\JAVA;%PATH%;
     set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR%;%MIFOBASE%\SOURCE
     goto JUMPPATH
:JUMPEMFE
     set MIFOBASE=%MIFOEMFE%\Base
     set MIFOBIN=%MIFOBASE%\bin
     set path=%BASESYS%\LOADLIB;%MIFOBASE%;%MIFOBIN%;%JAVASDK%;%BASEAPP%\JAVA;%PATH%;
     set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR%;%MIFOBASE%\SOURCE
     goto JUMPPATH
rem  *
:JUMPPATH
     set SIMOPATH=Y
rem  *
     set MAINFRAME_FLOATING_POINT=true
     set COBIDY=%BASEAPP%\COBIDY
     set COBPATH=.;%BASEAPP%\LOADLIB;%BASEAPP%\LOADLIB\GNTS;%BASESYS%\LOADLIB;%SimoLIBR%
     set LIBPATH=.;%BASEAPP%\LOADLIB;%BASEAPP%\LOADLIB\GNTS;%BASESYS%\LOADLIB;%SimoLIBR%
     set TXDIR=%BASESYS%\LOADLIB;%MIFOBASE%
     set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR%
rem  *
     set USERCLASS=%BASELIB1%\LOADLIB
     set CLASSPATH=.
     set CLASSPATH=%CLASSPATH%;%JAVABASE%
     set CLASSPATH=%CLASSPATH%;%JAVABASE%\lib
     set CLASSPATH=%CLASSPATH%;\%USERCLASS%\simpacks
     set CLASSPATH=%CLASSPATH%;C:\APACHETC\apache-tomcat-7.0.52\webapps\simotcat\WEB-INF\classes
     set CLASSPATH=%CLASSPATH%;C:\APACHETC\apache-tomcat-7.0.52\webapps\simotcat\WEB-INF\classes\simpacks
rem  *
     if "%MIFOSYS1%" == "ESTU" set CLASSPATH=%CLASSPATH%;%MIFOBIN%
     if "%MIFOSYS1%" == "EDEV" set CLASSPATH=%CLASSPATH%;%MIFOEDEV%
     if "%MIFOSYS1%" == "VCBL" set CLASSPATH=%CLASSPATH%;%MIFOVCBL%
     if "%MIFOSYS1%" == "VCBL" set CLASSPATH=%CLASSPATH%;%MIFOVCBL%\bin\mfcobol.jar
rem  *
     set JobStatus=0000
     call SIMONOTE "+ ENV1BASE is returning to caller"


Table of Contents Previous Section Next Section Display and Log Messages

The following is a Windows CMD File (SIMONOTE.cmd) that is called to display a user message to the screen and post the message to a log file. This provides a consistent method for viewing a jobs progress during execution or reviewing the job results some time after the job has been executed.

@echo OFF
rem  * *******************************************************************
rem  *               SIMONOTE.cmd - a Windows Command File               *
rem  *         This program is provided by SimoTime Technologies         *
rem  *            (C) Copyright 1987-2019 All Rights Reserved            *
rem  *              Web Site URL:   http://www.simotime.com              *
rem  *                    e-mail:   helpdesk@simotime.com                *
rem  * *******************************************************************
rem  *
rem  * Text    - Display message on screen and write to a log file.
rem  * Author  - SimoTime Technologies
rem  *
rem  * This script may be called from other scripts and expects a single
rem  * parameter enclosed in double quotes. The double quotes will be
rem  * removed. Before writing to the log file a date and time stamp
rem  * will be inserted in front of the message text.
rem  *
rem  * Note: The tilde (~) removes leading/trailing double-quotes.
rem  *
if "%SimoNOTE%" == "" set SimoNOTE=c:\SimoLIBR\LOGS\SimoTime.LOG
echo %date% %time% %~1>> %SimoNOTE%
echo %~1

 

Table of Contents Previous Section Next Section Summary

The primary objective of this test case is to describe and demonstrate how to compare (on a record-by-record basis) the content of two non-relational data structures such as a sequential file and/or a VSAM Data Set. This document may be used as a tutorial for new programmers or as a quick reference for experienced programmers.

In the world of programming there are many ways to solve a problem. This documentation and software were developed and tested on systems that are configured for a SIMOTIME environment based on the hardware, operating systems, user requirements and security requirements. Therefore, adjustments may be needed to execute the jobs and programs when transferred to a system of a different architecture or configuration.

SIMOTIME Services has experience in moving or sharing data or application processing across a variety of systems. For additional information about SIMOTIME Services or Technologies please contact us using the information in the  Contact or Feedback  section of this document.

Table of Contents Previous Section Next Section Software Agreement and Disclaimer

Permission to use, copy, modify and distribute this software, documentation or training material for any purpose requires a fee to be paid to SimoTime Technologies. Once the fee is received by SimoTime the latest version of the software, documentation or training material will be delivered and a license will be granted for use within an enterprise, provided the SimoTime copyright notice appear on all copies of the software. The SimoTime name or Logo may not be used in any advertising or publicity pertaining to the use of the software without the written permission of SimoTime Technologies.

SimoTime Technologies makes no warranty or representations about the suitability of the software, documentation or learning material for any purpose. It is provided "AS IS" without any expressed or implied warranty, including the implied warranties of merchantability, fitness for a particular purpose and non-infringement. SimoTime Technologies shall not be liable for any direct, indirect, special or consequential damages resulting from the loss of use, data or projects, whether in an action of contract or tort, arising out of or in connection with the use or performance of this software, documentation or training material.

Table of Contents Previous Section Next Section Downloads and Links

This section includes links to documents with additional information that are beyond the scope and purpose of this document. The first group of documents may be available from a local system or via an internet connection, the second group of documents will require an internet connection.

Note: A SimoTime License is required for the items to be made available on a local system or server.

Table of Contents Previous Section Next Section Current Server or Internet Access

The following links may be to the current server or to the Internet.

Note: The latest versions of the SimoTime Documents and Program Suites are available on the Internet and may be accessed using the Link to Internet icon. If a user has a SimoTime Enterprise License the Documents and Program Suites may be available on a local server and accessed using the Link to Server icon.

Link to Internet   Link to Server   Explore How to Generate a Data File Convert Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do the actual data file conversion. The User Guide contains a list of the PCF statements that are used for the data file convert process.

Link to Internet   Link to Server   Explore How to Generate a Data File Compare, Validate or Hex-Dump Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do a data file compare, accumulate summary totals with a record count or produce a Hex-Dump of records in a VSAM, KSDS based on a list of user-defined keys. The User Guide contains a list of the PCF statements that are used for the data file compare, validate or dump process.

Link to Internet   Link to Server   Explore An Enterprise System Model that describes and demonstrates how Applications that were running on a Mainframe System and non-relational data that was located on the Mainframe System were copied and deployed in a Microsoft Windows environment with Micro Focus Enterprise Server.

Link to Internet   Link to Server   Explore the evolution of application software from conception to retirement. This document includes an overview of how to setup a Development, Test and Production environment on a Windows System using Micro Focus Enterprise Server.

Link to Internet   Link to Server   Explore the COBOL Connection for more examples of COBOL programming techniques and sample code.

Link to Internet   Link to Server   Explore The ASCII and EBCDIC Translation Tables. These tables are provided for individuals that need to better understand the bit structures and differences of the encoding formats.

Link to Internet   Link to Server   Explore The File Status Return Codes that are used to interpret the results of accessing VSAM data sets and/or QSAM files.

Table of Contents Previous Section Next Section Internet Access Required

The following links will require an internet connection.

This suite of programs and documentation is available for download. Link to an Evaluation zPAK Option that includes the program members, documentation and control files.

A good place to start is The SimoTime Home Page for access to white papers, program examples and product information. This link requires an Internet Connection

Explore The Micro Focus Web Site for more information about products (including Micro Focus COBOL) and services available from Micro Focus. This link requires an Internet Connection.

Table of Contents Previous Section Next Section Glossary of Terms

Link to Internet   Link to Server   Explore the Glossary of Terms for a list of terms and definitions used in this suite of documents and white papers.

Table of Contents Previous Section Next Section Comments or Feedback

This document was created and is maintained by SimoTime Technologies. If you have any questions, suggestions, comments or feedback please use the following contact information.

1. Send an e-mail to our helpdesk.
1.1. helpdesk@simotime.com.
2. Our telephone numbers are as follows.
2.1. 1 415 763-9430 office-helpdesk
2.2. 1 415 827-7045 mobile

 

We appreciate hearing from you.

Table of Contents Previous Section Next Section Company Overview

SimoTime Technologies was founded in 1987 and is a privately owned company. We specialize in the creation and deployment of business applications using new or existing technologies and services. We have a team of individuals that understand the broad range of technologies being used in today's environments. Our customers include small businesses using Internet technologies to corporations using very large mainframe systems.

Quite often, to reach larger markets or provide a higher level of service to existing customers it requires the newer Internet technologies to work in a complementary manner with existing corporate mainframe systems. We specialize in preparing applications and the associated data that are currently residing on a single platform to be distributed across a variety of platforms.

Preparing the application programs will require the transfer of source members that will be compiled and deployed on the target platform. The data will need to be transferred between the systems and may need to be converted and validated at various stages within the process. SimoTime has the technology, services and experience to assist in the application and data management tasks involved with doing business in a multi-system environment.

Whether you want to use the Internet to expand into new market segments or as a delivery vehicle for existing business functions simply give us a call or check the web site at http://www.simotime.com


Return-to-Top
Test Case 03, Compare Files and Track Insert/Deletes
Copyright © 1987-2024
SimoTime Technologies and Services
All Rights Reserved
When technology complements business
http://www.simotime.com