Batch data stream framework and patterns

The batch environment provides a batch data stream (BDS) framework that includes pre-built code to work with streams such as text, byte, database, and data sets. You can implement an interface where the business logic for processing the stream is added. The pre-built code manages actions such as opening, closing, and externalizing and internalizing checkpoints.

BDS framework patterns

A BDS framework pattern is a simple Java TM interface for a particular type of data stream that a user implements to insert business logic. The BDS framework has several supporting classes for each pattern that do most of the mundane tasks related to stream management. The following table shows the patterns that the batch environment provides:

Table 1. BDS framework patterns. The table includes the pattern name, description, and supporting classes.
Pattern name Description Supporting classes

JDBCReaderPattern

Used to retrieve data from a database using a JDBC connection.

  • LocalJDBCReader
  • JDBCReader
  • CursorHoldableJDBCReader

JDBCWriterPattern

Used to write data to a database using a JDBC connection.

  • LocalJDBCWriter
  • JDBCWriter
[Updated in July 2012]

JDBCCallableStatementReaderPattern

[Updated in July 2012]
jul2012
[Updated in July 2012]

Used to implement the business logic of processing data from a JDBC connection using a stored procedure

[Updated in July 2012]
jul2012
[Updated in July 2012]
  • JDBCCallableStatementReader
  • LocalJDBCCallableStatementReader
[Updated in July 2012]
jul2012
[Updated in July 2012]

JDBCCallableStatementWriterPattern

[Updated in July 2012]
jul2012
[Updated in July 2012]

Used to implement the business logic of outputting data to a JDBC connection using a stored procedure

[Updated in July 2012]
jul2012
[Updated in July 2012]
  • JDBCCallableStatementWriter
  • LocalJDBCCallableStatementWriter
[Updated in July 2012]
jul2012

ByteReaderPattern

Used to read byte data from a file.

FileByteReader

ByteWriterPattern

Used to write byte data to a file.

FileByteWriter

FileReaderPattern

Used to read a text file.

TextFileReader

FileWriterPattern

Used to write to a text file.

TextFileWriter

JPAReaderPattern

Used to retrieve data from a database using OpenJPA

JPAReader

JPAWriterPattern

Used to write data to a database using a Java Persistence API (JPA) connection.

JPAWriter

BDS framework steps

BDS framework steps minimize the amount of work to create a batch step by performing the bookkeeping tasks related to step management and delegating the business logic to a class implemented by the user.

Table 2. BDS framework steps. The table includes the framework step and description.
Step Description

Implementing the generic batch step (GenericXDBatchStep)

A simple step that uses one input and one output stream.

Implementing the error tolerant step (ThresholdBatchStep)

A simple step that uses one input, one output stream, and one error stream.

ThresholdPolicies

Table 3. ThresholdPolicies. The table includes the step and description.
Step Description

Declaring the record based threshold policy (RecordBasedThresholdPolicy)

This policy provides a batch implementation of the ThresholdPolicy interface.

Declaring the percentage-based threshold policy (PercentageBasedThresholdPolicy)

This policy provides a batch implementation of the ThresholdPolicy interface




Related tasks
Developing batch applications
Using the batch data stream (BDS) framework
Implementing the generic batch step (GenericXDBatchStep)
Concept topic Concept topic    

Terms and conditions for information centers | Feedback

Last updatedLast updated: Jan 30, 2014 9:17:32 AM CST
http://www14.software.ibm.com/webapp/wsbroker/redirect?version=matt&product=was-nd-iseries&topic=cgrid_btchpttrnover
File name: cgrid_btchpttrnover.html