Introduction to AB Initio. Operating Systems & Hardware Platforms that it supports

Products of AB Initio Software Corporation

• The AB Initio Co>Operating System
• Graphical Development Environment (GDE)
• The AB Initio Enterprise Meta>Environment (EME)

Salient Features of AB Initio

Understanding the High Level Architecture of AB Initio What is the Anatomy of Running a Job? What happens when we push the Run Button?

• Deployment Process
• Host Process Creation
• Agent Process Creation
• Component Process Creation
• Successful Component Termination
• Agent Termination
• Host Termination
• Abnormal Component Termination

How do we Connect from GDE to the Server

• Host Profile File (.aih)
• Connection, Co-Operating System, Shell & Host Directory

What is Graph Programming? What are the basic parts of an AB Initio Graph?

Broad Classification of Components

• Dataset Components
• Program / Computing Components

Data Manipulation Language (DML)

• Record Formats
• DML Expressions
• Transform Functions
• Key Specifiers

How do we build a basic AB Initio Graph? Using .dat(Data File) & .dml(Record Format File)

Dataset Components

• Input File
• Output File
• Intermediate File
• Lookup file

Editors in the GDE

• Record Format Editor
• Expression Editor
• Transform Editor
• Key Specifier Editor
• Package Editor
• Variables Editor
• Sequence Specifier Editor

Transform Functions

• Transform File(.xfr)
• Functions, Variables, Statements & Rules

Transform Components – Multistage and Advanced Components

• Filter by Expression
• Dedup Sorted
• Reformat
• Aggregate
• Scan
• Rollup
• Join
• Match Sorted
• Normalize
• Denormalize Sorted

Lookup Datasets & DML Lookup Functions Partition Components

• Broadcast
• Partition by Key
• Partition by Expression
• Partition by Percentage
• Partition by Range
• Partition by Round-Robin
• Partition with Load Balancing
• Multifiles and Multidirectories De-partition Components
• Concatenate
• Gather
• Interleave
• Merge

What is Parallelism – Types

• Component ||sm
• Pipeline ||sm
• Data ||sm

Repartitioning – When & Why Layout Implications

• Sort
• Sort within Groups
• Sample
• Partition by Key & Sort
• Check point Sorted

Working with Databases. Introduction Database Configuration File (.dbc)

Interactive Database Components (IDB)

• Input Table
• Output Table
• Run SQL
• Truncate Table
• Update Table
• Join with DB

Miscellaneous Components

• Redefine Format
• Gather Logs
• Replicate
• Run Program
• Thrash

Deprecated Components

• Find Splitters
• Compress Components
• Compress Uncompress GZip GUnzip

File Transfer Protocol (FTP) Components

• FTP From
• FTP To

Testing and Validation of AB Initio Graphs using Validate Components

• Check Order
• Compare Records
• Validate Records
• Generate Records
• Generate Random Bytes
• Compute Checksum
• Compare Checksum

Phasing & Checkpointing Reusability Features

Sub graphs Graph Parameters

The AB Initio Enterprise Meta>Environment(EME)

• High level anatomy of the EME
• Relation to sandbox environment
• Checking in your sandbox
• Checking out a graph or a sandbox
• Locking in order to change an object
• Tagging
• Common projects
• Dependency and Impact analysis

Performance Tuning AB Initio Graphs

• What is Good Performance?
• Going Parallel
• Serial Inputs
• Phases
• Record Formats and Components
• Memory Usage
• Various Tips