Introduction Copyrights and Notices Conventions Abbreviations About the DATABridge Client How Replication Works DATABridge Components Comparing the Service to Command Line Operations Using the Console and Service Switching from Command Line to Service Operations Command-Line Client Operations Before You Run the Command Line Client Controlling and Monitoring dbutility dbutility Exit Status Values Testing for the Exit Status Getting Started Tips for More Efficient Cloning Creating Client Control Tables Creating a Second Set of Tables Dropping and Re-Creating Client Control Tables Updating Client Control Tables Primary and Secondary Data Tables Defining a Data Source Defining a Data Source via the Configuration File Results of the Define Command Cloning from Multiple Data Sources Customizing with User Scripts Types of User Scripts User Script Syntax User Script Execution Writing and Testing User Scripts Using Scripts to Disable Data Sets Creating Indexes for Tables Keys Derived from the DMSII Database Using Sets with the KEYCHANGEOK Attribute RSNs and AA Values as Keys Forcing the Client to Use RSN or AA Values as Keys Composite Keys Defined by the User Composite Keys When to Use Composite Keys Creating a Composite Key Cloning DMSII Dates, Times, and Date/Times DMSII Dates DMSII Dates Represented as a GROUP of Numbers Decoding DMSII Dates Represented as ALPHA or NUMBER DMSII Times DMSII Times Represented as ALPHA, NUMBER, or TIME Decoding DMSII Date/Times Decoding DMSII Date/Time Represented as ALPHA or NUMBER Unique DMSII Date/Time Represented as ALPHA or NUMBER Numeric Date and Time in Non-Contiguous Columns Adding a Non DMSII Column Types of Non DMSII Columns Setting Up History Tables Modifying NonDMSII Column Names Preserving Deleted Records Generating DATABridge Client Scripts Example of Script Files Summary of Script Files When to Run dbutility generate Cloning a DMSII Database Cloning Issues for All Relational Databases Bulk Loader Parameters Controlling Temporary File Storage for Windows Clients Bulk Loader Operations for UNIX Clients Controlling the Bulk Loader Maximum Error Count Oracle SQL*Loader Bulk Loader Files Related to SQL*Loader Microsoft SQL Server bcp bcp_auditor Utility Files Related to bcp Configuring Host Parameters Running tcptest Populating the DATABridge Data Tables Data Validation and Discard Files Numeric Data Validation Alpha Data Validation Date Validation Special Handling of Key Items in Discard Files Handling Blank Character Data for Key Items (DATABridge Client for Oracle) dbutility process Command Cloning a DMSII Database Via dbutility Process Terminating Cloning DATASETS Client Control Table ds_mode values dbutility clone Command Cloning Specific Data Sets Cloning Command Line Options Configuring for Optimal Performance Overlapped Bulk Loader Operations for Windows Overlapped Index Creation Optimizing State Information Passing Multiple Statements and Pre-parsed SQL Statements Reducing the Number of Updates to Data Tables Other Considerations Updating and Recloning Updating the DATABridge Data Tables Unscheduled Updating Scheduling dbutility Updates Scheduling Examples Rolled Back Updates Reorganizations, Filler Substitutions, and Initializations DMSII Reorganizations Filler Substitutions Initialization DMSII Changes to Record Layouts About dbutility redefine Recovering after a DMSII Reorganization DMSII Changes to Record Locations Configuring the auto_reclone Parameter Sample DMSII Reorganization Handling New Columns Recloning Recloning with dbutility clone Recloning with dbutility process Adding a Data Set Dropping a Table Backing Up and Maintaining Client Control Tables Unload Command Reload Command Refresh Command Changing an Index from AA Values to Composite Key DMSII and Relational Database Data Mapping DMSII and Relational Database Terms DMSII and Relational Database Data Types DATABridge Data Types Changing the Default Data Type Supported DMSII Structures Embedded Data Sets AA Values Selecting Embedded Data Sets for Cloning Variable-Format Data Sets Resulting Tables Split Variable Format Data Sets Option Handling DMSII GROUPs Handling DMSII OCCURS DMSII DASDL with OCCURS Flattening OCCURS Clauses Flattening OCCURS Clause for Three-Bit Numeric Flags Flattening OCCURS Clause for Items Cloned as Dates DMSII GROUP OCCURS DMSII Nested OCCURS OCCURS DEPENDING ON Handling Unflattened OCCURS DEPENDING ON Clauses Relational Database Split Tables Split Table Names Keys for Split Tables Exceeding the Maximum Record Size Relational Database Table and Column Names Uppercase and Lowercase Hyphens and Underscores Name Length Duplicate Names Reserved Keywords DMSII Links Record Serial Numbers DATABridge Client Control Tables Changes in DATABridge Client 6.1 Control Tables DATASOURCES Client Control Table DATASETS Client Control Table DATATABLES Client Control Table DMS_ITEMS Client Control Table DATAITEMS Client Control Table Appendix A: DATABridge Client Messages Informational Messages Configure Command Messages Define Command Messages Redefine Command Messages Generate Command Messages Reorg Command Messages Process and Clone Commands Messages Drop and Dropall Commands Messages Switchaudit Command Messages Display Command Messages Runscript Command Messages Unload Command Messages Reload Command Messages Refresh Command Messages Export Command Messages Import Command Messages CreateScripts Command Messages Tcptest Command Messages dbutility Console Informational Messages Usage Messages Error Messages Warning Messages Host Messages Sockets Error Messages Oracle Call Interface (OCI) Errors Microsoft SQL Server ODBC Errors Client Exit Codes Server/Daemon Messages Appendix B: Troubleshooting General Troubleshooting Procedures Troubleshooting Table Using SQL Query to Find Duplicate Records Log and Trace Files Using Log and Trace Files to Resolve Issues Enabling a Trace Trace Messages API Trace Bulk Loader Trace DBServer Message Trace Information Trace Load Trace Protocol Trace SQL Trace User Script Trace Log Error Messages Appendix C: dbutility Commands and Options dbutility Commands dbutility Command-Line Options Stop a dbutility Process Via dbauditwait Writing the Command File Appendix D: Client Configuration Client Configuration Files Exporting and Importing Configuration Files Password Encoding Deprecated Parameters Command-Line Options Syntax Sample SQL Server Client Configuration File Sample Oracle Client Configuration File Processing Order [signon] [Log_File] [Trace_File] [Scheduling] [Bulk_Loader] [params] Define and Redefine Command Parameters allow_nulls check_key_changes clr_dup_extr_recs default_user_columns dflt_history_columns enable_dynamic_hist external_column[n] flatten_all_occurs force_aa_value_only history_tables maximum_columns min_varchar optimize_updates read_null_records sec_tab_column_mask split_varfmt_dataset suppress_new_columns suppress_new_datasets use_bigint use_binary_aa use_clob use_clustered_index use_column_prefixes use_date use_datetime2 use_decimal_aa use_nullable_dates use_primary_key use_time use_varchar Display Command Parameter [EbcdictoAscii] ISO Standard Redefining a Character External Data Translation DLL Support Generate Command Parameters Process and Clone Command Parameters alpha_error_cutoff auto_reclone automate_virtuals aux_stmts century_break commit_absn_inc commit_longtrans commit_time_inc commit_txn_inc commit_update_inc controlled_execution convert_ctrl_char correct_bad_days dbe_dflt_origin defer_fixup_phase discard_data_errors display_bad_data enable_dms_links enable_doc_records enable_optimized_sql engine_workers error_display_limits extract_embedded inhibt_8_bit_data inhibit_console inhibit_ctrl_chars inhibit_drop_history history_tables linc_century_base max_clone_count max_retry_secs max_wait_secs min_check_time miser_database months n_dmsii_buffers n_update_threads null_digit_value numeric_date_format preserve_deletes redef_all_active_ds rollback_segment show_perf_stats show_statistics show_tables_stats statistics_increment stop_after_fixups stop_after_gc_reorg stop_after_given_afn suppress_dup_warnings use_dbwait use_latest_si Server Option Parameters User Scripts Parameters Reference Tables Bulk Loader Parameters EBCDIC to ASCII Parameters Params Parameters Scheduling Parameters Appendix E: Service Configuration Sample Client Service Configuration File [Control_Program] data_sources ipc_port notify_port sched_minwait_secs userid = <userid>, <passwd>,<role> [Log_File] file_name_prefix logsw_on_newday logsw_on_size max_file_size newfile_on_newday [<data_source_name>] auto_generate auto_redefine client_dir daily blackout_period sched_delay_secs max_retries sched_retry_secs run_at_startup working_dir sw_audit_on_notify stop_afn_on_notify Appendix F: Customization Scripts Customization Rules for Client Configurator Sample Scripts for Customizing Data Set Mapping Selecting DMSII Items Cloning a Numeric Field as a Date Cloning an Alpha Field as a Date Cloning an Alpha or Number Field as a Time Cloning an Alpha or Number Field as a Date/Time Flattening OCCURS Clause Flattening OCCURS Clause for Item Cloned as Dates Flattening OCCURS Clause for Three Bit Numeric Flags Splitting an Unsigned Number Item into Two Items Adding a Composite Key to Tables Mapped from a Data Set Specifying How to Handle Alpha Items That Are Too Long Sample Data Set Selection Script Sample Data Table Global Customization Script Sample Data Table Customization Scripts Disabling the Cloning of Secondary Tables Renaming a Table Renaming Columns Changing SQL Data Types Cloning a Number as a Character Type Adding a Non DMSII Column Glossary of Terms absolute address (AA) value Accessroutines audit file audit trail caching client cloning consolidated file CONTROL file DASDL data set DATABridge Director DATABridge Plus DBClient DBClntCfgServer DBGenFormat DESCRIPTION file direct disk entry point extraction file format conversion filler substitution garbage collection reorganization lag time mutex null value primary database quiet point (QPT) record format conversion record serial number (RSN) replicated database replication secondary database semaphore service set structure subset table tracking undigits Contact Attachmate