Académique Documents
Professionnel Documents
Culture Documents
July 2008
Actions
E.g. Submit a TWS jobStream Send an e-mail, Send An event to T/EC, Write a message in
the
message log
Correlation rule
Sample scenarios
Submit a Job Stream when a defined set of events is received
When file /abc/file1 is FTPed on machine-x and at least one of the TWS job* running on the Workstation machine-x is in successful status, then start the TWS jobstream-y
Action Action
Event
Event
Event
Actions
e.g submit job_x on machine_y, send an email to joe_smith@abc.com,
Correlation rule
Rule Editor
Rules Builder
Deploys Events
Monitors
Create, Modify, Delete, List Starts the monitoring activity Activates the events receiving Activates the correlation and actions triggering
Query and browse event rule instances Drill down on actions executed for a specific event rule
Scheduling Database Extract Job Stream Calendar Job Job Job Cal rules Jobs Generate
Production Plan
Job Stream Instance
Planner
Engine
Job
Event Rules
Ah-Hoc submission
Event-Rules
Rules Builder
Engine
Events
User Interfaces
Modeling
Can be done using the Tivoli Dynamic Workload Console (aka TWS Web UI) and the TWS Command Line Interface (composer)
Activation
&
Deploy
It can be automated using the option manager (optman) A new customization of the planman CLI is provided for manual or scheduled activation
Can be done both using the Tivoli Dynamic Workload Console (aka TWS WebUI) and the TWS Command Line Interface (aka TWS composer CLI)
Documented APIs are provided
File created, file modification completed, file deleted, log message written
Event
A message is issued on a log-file (e.g. may be an application log file) TWS specific monitors
Job/jobstream status changed and return code condition Status of TWS agents (linked/unlinked, started/stopped) Application server status changed Prompt status changed
Event
Event
Correlation rule
Generic event. May also be an event generated via a Command Line Interface that will be provided by TWS and that can be used by customer to generate custom events SAP batch related events (using TWS 8.4 for Applications)
Action
Action
Event filter
Event Rule is activated when a single event matches a user specified filtering condition based on the Event properties
Event
Event
Event
Events Sequence
Event Rule is activated when the ordered sequence of events is detected within a specified time window
Correlation rule
Events Collection
Event Rule is activated when the un-ordered sequence of events is detected within a specified time window
Event timeout
Event Rule is activated when one or more events arrive but the complete sequence does not arrive within the specified time window
Action
Action
Event
Event
Event
10
create extract delete display Local encoding is used by default encoding For XML list - print lock - unlock modify new rename
eventRule definition is completely written in XML unlike other TWS objects written in Scheduling Language
11
where:
12
deploymentFrequency / df = 5
13
Manage the monitoring process using startmon and stopmon commands (permissions to start and stop actions on the specified workstation are required in the security file): startmon [domain!]workstation [;noask] stopmon [domain!]workstation [;wait] [;noask]
14
Manage the new event processing server used in event-driven workload automation using starteventprocessor, stopeventprocessor and switcheventprocessor commands (permissions to start and stop actions on the specified workstation are required in the security file):
startevtproc [domain!]workstation stopevtproc [domain!]workstation switchevtproc [domain!]workstation
15
ISC
TWS WEB-UI
Rules Modeling Portlets Rules Monitoring Portlets
CLI
C:\>
http(s)
Monitoring agent Responsible to monitor for events condition on TWS agents Embeds NetCool Monitoring technology EIF based technology Rules Correlation Server Responsible to receive/correlate events and to execute actions Integrates with ITM, T/EC, TEP, TSM, TBSM, NetView J2EE application, it embeds a very advanced correlation engine component Web-UI Provides portlets for event rules modeling, monitoring and mgmt Portal application on Integrated Solution Console technology Implements WEB 2.0 concepts, uses Ajax/Dojo technology Command line Interface Provides CLI for event rules modeling, monitoring and mgmt Use SOAP/HTTP and XML technology
2008 IBM Corporation
eWAS
TWS Master
Planner
Model Connector
RMI Stub
Java Based UI
DB
Rules Correlation Server
JDBC
JSC
RMI
Plan Connector
Scheduling Model
TWS Engine
Production Plan
JDBC
TWS DM
eWAS
TWS Engine
Production Plan
Triggering Engine
Agent
TWS FTA
Monitoring Agent
TWS Engine
Production Plan
TWS Engine
Production Plan
17
1.
ISC
TWS WEB-UI
Rules Monitoring Portlets Rules Modeling Portlets
User queries, creates or modifies eventrules in the TWS database. Correlation and monitoring rules are updated. Events-Correlation Server starts its events listening and processing activity Monitoring configurations are downloaded and activated to the TWS agents The monitoring agent starts to monitor and to send events Rules Correlation Server receives the events and check if they match any defined rule If an event rule is matched, the correlation server calls an actions helper to execute the actions The action helper creates a event-rule instance and logs the action result into the database User uses the monitoring interface, to query the status of TWS event-rule instances and actions
2008 IBM Corporation
2.
CLI
C:\>
http(s)
3.
eWAS
TWS Master
Planner
2
Rules Correlation Server
RMI Stub
Java Based UI
DB
JDBC
JSC
RMI
Scheduling Model
4.
5.
Production Plan
JDBC
TWS Engine
TWS DM
eWAS
6.
TWS Engine
Production Plan
4
Triggering Engine
7.
TWS Engine Production Plan
Agent
TWS FTA
Monitoring Agent
TWS Engine
Production Plan
8.
18
Is Extensible
EDWA allow to plug-in new event types, new event monitors and actions without requiring changes to TWS code
Is Scalable
EDWA Is able to support a big number of events, actions and jobs submission based on events.
19
Pluggable architecture
Under TWS installation directory, there is the folder eventPlugIn; it contains all the plugins that implement events and actions for event management.
The steps to implement new events or actions are the following: create a new event/action plugin put it inside the directory eventPlugIn restart Websphere Application Server
Every plugin is composed by three main components: TWSPlugIn.properties = a file containing main plugins informations TWSPluginConfiguration.xml = a file containing plugins configuration One or more java class file containing the implementation of the plugin
20
SDK
We developed a Workbench eclipse based that will help customers to create new plugins for event management and to use APIs.
http://www-01.ibm.com/software/brandcatalog/portal/opal/details?catalog.label=1TW10WS01
This workbench will allow to: Create Event plugins Create Action plugins Create applications that will use TWS public APIs This workbench will contain: Sample event plugins Sample action plugins Examples regarding how to make connections to TWS and how to work with objects in the database and in the plan using TWS public APIs. Examples regarding how to interface with TWS WebServices (JobService, JobStreamService and SchedulingFactory)
21
Draft/Complete status
Validity interval
Timeout conditions
Common attributes correlation
Events
Timeout actions
Actions
23
As soon as you select an engine, the Editor connects to the engine and loads the list of event and action plug-ins available on it.
When the connection is successful, the Editor opens in its entirety. The Event Rule, whether existing or a new one, is locked on the TWS database and is kept locked until the Editor is Closed. You can then save the progresses on the Rule multiple times while you are working on it. The Rule will be kept locked all the time.
24
A Non Draft, or Complete Rule will be activated and deployed at next Planman deploy (either scheduled or manual) and will be active within its Validity Period.
The changes you make to a Rule (including changing the Draft flag) will be effective only after the next deploying of the Rule.
25
Dates and times expressed here will be referred to the TWS engine Time zone unless otherwise specified here
The Rule will be valid every day between the specified dates, but only within the hours specified here. An empty value for one or both extremes means midnight. A Daily end prior to Daily start is a valid range and represents a range that crosses midnight. In this case refer to the manuals for what are the effects on the first and last validity day.
Select the type of correlation: Single event, Unordered Set of events, Ordered Sequence of events Click here to change
26
Enable Timeout and specify a value here Select properties common to all events here. They must all match for the rule to be satisfied
27
property Remove Optional properties clicking here A non-empty value is required Specify a comparison operator
A variable chooser helps inserting variables. Variables are used to take values from Event properties to use into Action properties You can use Variables for any Action Property
29
30
31
An Event or Action box turns RED if there are outstanding errors with it. Click the box to resolve them in the Properties section Errors are detected while you are typing and are shown below the corresponding field
32
Errors related to invalid ranges are outlined with a box around the corresponding fields
33
34
36
37
38
39
Global Options
General options for EDWA:
enEventDrivenWorkloadAutomation (ed)
enables or disables the event driven workload automation feature default = YES (EDWA is enabled)
deploymentFrequency (df)
specifies how often event rule updates are applied on the event processor and deployed to the TWS agents default = 5 (minutes)
enEventProcessorHttpsProtocol (eh)
enables or disables use of the HTTPS protocol to connect to the event processor server default = YES (HTTPS is enabled)
eventProcessorEIFPort (ee)
port of the Tivoli Event Integration Facility (EIF) for communication with the event processor server default = 31131
logHistory (lh)
number of days for which history of triggered rule instances, action runs and logged messages are kept in the TWS database default = 10
logCleanupFrequency (lc)
specifies how often to look for history data older than logHistory days, which must be deleted default = 5 (minutes)
TECServerPort (tp)
port of the TEC server to which events are forwarded default = 5529
40
Global Options
Options used by MailSender action plugin:
smtpServerName (sn)
hostname or IP address of the SMTP server through which outgoing e-mails are delivered default = localhost
smtpServerPort (sp)
port of the SMTP server through which outgoing e-mails are delivered default = 25
smtpUseSSL (us)
enables or disables use of Secure Sockets Layer (SSL) to secure the connection to the SMTP server default = NO (SSL is disabled)
smtpUseTLS (tl)
enables or disables use of Transport Layer Security (TLS) to secure the connection to the SMTP server default = NO (TLS is disabled)
smtpUseAuthentication (ua)
enables or disables user/password authentication against the SMTP server default = NO (authentication is disabled)
smtpUserName (un)
name of the user to be used to authenticate with the SMTP server (if authetication is enabled) default = name of the tws_user
smtpUserPassword (up)
password of the user to be used to authenticate with the SMTP server (if authetication is enabled) default = not set
mailSenderName (ms)
name of the mail sender to be used for e-mails sent by TWS default = TWS
41
Local Options
Options added to the localopts file for EDWA:
AUTOSTART MONMAN
Tells whether or not the monman process for monitoring of generated events should be automatically started at the startup of this CPU
default is YES
processors
only the master domain manager and the backup master can be event default is YES for master DM and backup master DM, NO for other CPUs
42
ITM Architecture
The TEMS (Enterprise Monitoring Server) is the key component on which all other architecture components depend directly and collects and control data received from agents. The TEPS (Enterprise Portal Server) is the repository for all monitoring data which allows for retrieval, manipulation, and analysis of it (it needs an RDBMS installed on the same physical system). The TEPS keeps a persistent connection to the Hub Tivoli Enterprise Monitoring Server and can be considered a logical gateway between it and the TEPC.
RDBMS Tivoli Enterprise Monitoring Server (Hub)
The TEPC (Tivoli Enterprise Portal Client) is a Javabased user interface that connects to the TEPS to view all monitoring data collections.
The Tivoli Enterprise Monitoring Agents are data collectors. Agents monitor systems and applications passing the collected data to the monitoring server. ITM v6.1 provides also a customizable agent called Universal Agent (UA). The UA is a full-featured intelligent remote agent with dynamic application capabilities that allows monitoring only the data you are interested in.
44
Tivoli Enterprise Portal Client (Browser/Desktop)
Systems being monitored and data collected using Tivoli Enterprise Monitoring Agents
The Tivoli Universal Agent obtains its data from interfaces called data providers, which use data definitions files (metafiles) to describe the source and structure of the data supplied by the data providers. The obtained data can be seen via TEP with specific monitoring situations.
There are different data providers but TWS uses two of them: File Data Provider to have a logical view inside TEP to monitor the jobs/jobstreams status changes Script Data Provider to have a logical views inside TEP to monitor the TWS resources and processes
45
The following TWS resources and processes can be monitored via TEP:
netman batchman jobman Mailman Appserver Host availability Page out Swap space availability TWS disk free TWS Message files TWS space used by: stdlist schedlog
46
47
Backup
48
You save the Event Rule that is automatically activated by the TWS
TWS starts monitoring all the specified jobs, and as soon as one of the specified jobs ends in error, it send the notification e-mail
You receive the e-mail and check the status of the jobs.
49
You save the Event Rule that is automatically activated by the TWS TWS starts monitoring the status of the Workstation CPU1 As soon as the Workstation status is unlinked and the TWS starts the 10 minutes timeout If the event CPU1 linked is not received in 10 minutes, TWS sends the Error email Ricky Jones receives the Error email, goes to the TWS Event Rule management interface, queries the actions/rules that was triggered in the last 10 minutes and from there navigates to the CPU1 instance where can perform a first problem analysis
50
You save the Event Rule that is automatically activated by the TWS
TWS starts monitoring file /abc/file1 on machine_1, and as soon as the file is created and it is not anymore in use, it submits the jobstream-y
You check if the Event Rule was triggered in the last two hours and see its status
51
You save the Event Rule that is automatically activated by the TWS The Event Rule is automatically activated
Once the event shopping request is received, TWS starts the 1 minute timeout
If the event shopping transaction permission is not received in 1 minute, TWS sends an Error email to the user, otherwise it logs an Information message with the transaction status and submits the TWS Ad Hoc job_order_dealt_with
52
You save the Event Rule in draft status. After few days the user reedits the rule, changes the email recipient and save it as not-draft The Event Rule is automatically activated Once the job-x status is exec, TWS starts the 5 minutes timeout If the event job-y successful or abend is not received in 5 minutes, TWS sends the Informational email otherwise it replies Yes to prompt-1 and submits the jobstream-z
53
30 minutes before a flight departure, a job is run sending an event seat available for each person that has not checked-in
Each time a person is added to the queue for the flight a event person in queue is generated The following Event Rule is defined
When the event seat available and the event person in queue are received for the same flight than submit a job to assign the seat to the person.
The rule is saved and automatically activated. As soon as a couple events for the same flight are received, the job to assign the seat is submitted.
54
You save the Event Rule that is automatically activated by the TWS TWS starts monitoring the status of SAP events activated on the Billing system. As soon as the specified event is triggered on SAP, TWS executes the specified help desk command and sends an event to T/EC After some period, you set the above Event Rule in draft status. The Event Rule is automatically deactivated by TWS. You can reactivate the Event Rule in a later time.
55