Creating a job using the Design module. Here you have to define the source and the target of the job. This can be either a text file or an Oracle table. After choosing the source and the target, the job must be implemented and the unit tests executed.
Creating the job control. The job that has just been created should be integrated into a set of job and the moment of launchment should be established(after what job it starts). The job will be executed and the logs viewed with the help of the DataStage Director.

1. Job Design

In order to design a job there are a few steps to follow:

• Define the entering parameters
• Use stages like: databases, ODBC, sequential files, hashed files, folders, containers, transformer, aggregator, pivot, sort, link partitioner, link collector.
• Define the derivations(transforming functions)
• Execute the unit tests. In order to execute the unit tests, the definition of parameters is required, real time view of the number of lines treated as well as the end of the job(Error or Succes). This can be done using the Director module.The logs are not visible in the designer.

Frequent tasks when creating a job:

• Adding a Transformer item that can be based either on a formula, a filter or some variables.
• Adding a hashed file for creating and alimenting a table.
• Adding a lookup(database of hashed file ).
• Adding a OCI Oracle (query type/ sql overload)

Frequent transformations in a job:

• Alimenting a table using insert else update
• Aggregation
• Sort
• Removing duplicates
• Manage the rejects: generating one ore more rejects starting from a single line .
• Lookup for a big database table.

2. Job Control

The steps in executing a job are the following:

• define the entry parameters
• use the stages: Job Activity, Execute Command, Wait for file activity, Routine Activity, Sequencer, Terminator Activity, Exception Handler, StartLoop activity, EndLoop Activity.
• execute the unit test

• extract data from the datawarehouse or from files that arrive from different other applications
• transform and modify the data and after
• insert or load data into the datawarehouse.

DataStage is composed of more modules that will allow you to implement these three main functionalities:

The client module:

• Designer – creates the jobs
• Director – launches and stops the jobs, enables you to consult the logs of the jobs
• Administrator – manages the projects , the users and the security
• Manager – manages the objects of a project: Import – Export

The server module:

• The DataStage Server – can be installed on Windows/Unix/Linux
• The Repository – stores all the Datastage objects as well as the logs

Different other products:

• Datastage Server
• Datastage Parallel Extender
• Datastage MVS

Bussines Intelligence, Data warehouse, Data mart, Key performance indicators, Extract Transfer Load (ETL), Data mining, OLAP Modelling, Multidimensional analysis, Type of models, Cube model.

My Cognos training was composed of the following :

Impromptu Series 7 Administration.

The course contained :

• Administrator Role
• Planning Process
• The Project lifecycle in 14 steps
• How to use the catalog’s data
• Joints
• Folders
• How to create user profiles
• How to optimize the performance
• User defined functions
• System deployment and mentenance

Power Play Series 7 Version 3 – OLAP Modelling using Transformer

The modules studied were :

• Plannfication, creation and use of a model plan
• Organizing multiple data sources
• How to use the measurements and the data dimensions
• Customizing the model in order to satisfy specific business needs
• Cubes customization and optimization
• Customizing the dimensions
• Security application