[SOLVED] IRD 7.5 Cannot Copy Strategy File issue

[Gef Buneri]

Hi all,
I'm fronting this error when trying to save strategy files on DB. It happens randomly, but only with large strategy files, but once appeared, that file will become unsavable.

Any tip on how to go deep and indagate the causes ?

The DB is on a different LAN than mine, but network says there's no restricton between the two.

Regards, Gef.


*EDIT*
Going deeper, I discovered the table in where IRD writes the app number, have only 2 fields: DBID and RBN. All values inside the RBN column reports the '(BLOB)' and in the DBID thers a number, sometimes with a - statement; example: -1233912159 (BLOB). In a standard GVP 7.5 installation, where are usually stored .rbn (or zipped .pk) files?

[genesysguru]

At a database level check if there is any size limit on the BLOB column (where the data is stored). Might also be worth checking DB server logs for errors.

Regards

[Gef Buneri]

Thanks Guru, I'm imploring the DB Area of my company to do a deeper check of the logs, but as as usual the first answer is "no problems at all...". I'll try with an escalation, let's see what appens

[genesysguru]

Can't you get the Genesys DB server logs without relying on the DBAs?

Regards

[Gef Buneri]

Activated dbserer logs, verbose. Can be these, the reason ? Not sure what to search exactly. DBA says session does'nt reaches Config DB, in failed IRD savings. Another doubt is that in dbserver75urs options, in CME, I can see a "connect_break_time" set at "1200"; are they secondo or milliseconds ? What if I raise the value ? I haven't a  client_stop_timeout option in dbserver75urs, should I add and set it ? And just in case, what the dbserver restart implications are ?

11:55:23.139 Dbg 10749 Forwarding response '1.1' from 'Oracle: 1404.2' to 'App: 1404'
11:55:23.139 Dbg 10739 Oracle: id='1404.2' req='1' SQL: DELETE FROM ird_strategies WHERE dbid=-1400577511
+3969  MSG_SQLEXECUTED status='DBM_SUCCESS'

11:55:23.140 Dbg 10741 'App: 1404' has put request id='1' into queue
11:55:23.140 Dbg 10737 Forwarding request '1' from 'App: 1404' to 'Oracle: 1404.2'
11:55:23.140 Dbg 10743 'Oracle: 1404.2' is spare
11:55:23.166 Dbg 10749 Forwarding response '1.2' from 'Oracle: 1404.2' to 'App: 1404'
11:55:23.166 Dbg 10739 Oracle: id='1404.2' req='1' SQL: INSERT INTO ird_strategies values(-1400577511,'B')
+0025  MSG_SQLEXECUTED status='DBM_SUCCESS'

11:55:23.174 Std 04523 Connection to client 'App: 1404' closed, reason ''client disconnected''
11:55:23.174 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 1404.2', request id '-1'
  /Statistics             
    name                      = Oracle: 1404.2
    app_name                  = App: 1404
    req_rcvd                  = 12
    req_sent                  = 5
    data_rcvd                = 1243
    data_sent                = 267
    msg_error                = 0
    msg_log                  = 4
11:55:23.175 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 1404.1', request id '-1'
  /Statistics             
    name                      = Oracle: 1404.1
    app_name                  = App: 1404
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 911
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
11:55:23.175 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 1404.3', request id '-1'
  /Statistics             
    name                      = Oracle: 1404.3
    app_name                  = App: 1404
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 870
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
11:55:23.175 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 1404.4', request id '-1'
  /Statistics             
    name                      = Oracle: 1404.4
    app_name                  = App: 1404
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 870
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
11:55:23.176 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 1404.5', request id '-1'
  /Statistics             
    name                      = Oracle: 1404.5
    app_name                  = App: 1404
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 870
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
11:55:23.176 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 1404.6', request id '-1'
  /Statistics             
    name                      = Oracle: 1404.6
    app_name                  = App: 1404
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 870
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
11:55:23.239 Std 02024 OS signal 'SIGCHLD' received
11:55:23.240 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 27370
    id                        = 8421
    expiration_time          = 2014-05-20T11:55:53
    client copy              = 3
11:55:23.246 Std 02024 OS signal 'SIGCHLD' received
11:55:23.246 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 27371
    id                        = 8422
    expiration_time          = 2014-05-20T11:55:53
    client copy              = 4
11:55:23.251 Std 02024 OS signal 'SIGCHLD' received
11:55:23.251 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 27369
    id                        = 8420
    expiration_time          = 2014-05-20T11:55:53
    client copy              = 2
11:55:23.257 Std 02024 OS signal 'SIGCHLD' received
11:55:23.257 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 27372
    id                        = 8423
    expiration_time          = 2014-05-20T11:55:53
    client copy              = 5
11:55:23.263 Std 02024 OS signal 'SIGCHLD' received
11:55:23.263 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 27367
    id                        = 8418
    expiration_time          = 2014-05-20T11:55:53
    client copy              = 0
11:55:23.267 Std 02024 OS signal 'SIGCHLD' received
11:55:23.267 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 27368
    id                        = 8419
    expiration_time          = 2014-05-20T11:55:53
    client copy              = 1

[genesysguru]

Hi,

Those timeouts are in seconds and you can find the documentation here:

http://genesyslab.info/wiki/index.php/DB_Server_Configuration_Options

From a quick look I would say that this is an Oracle problem and you need to work with the DBAs to understand the client disconnection.

Regards

[Gef Buneri]

Thanxs Guru, I was just studying that documentation. This night I'll try to add the client stop timeout option with a "60 s" value on DBServerURS75, and I'll restart the process using SCI. In your experience, for wich implication I should pay attention after the restart of the dbserver process ? Known things to do/known issues ? (version 7.5).

[Gef Buneri]

Added the client_stop_timeout with a "60 s" value on DBServer timers, restarted the service, but no result; on bigger applications still the same log; sent it to DBA, for further analysis.

02:38:20.282 Trc 04521 New client 2963 connected from '10.x.x.x'
02:38:20.283 Dbg 10745 'App: 10.x.x.x:2963' registered; protocol version '1.3' id '2'
02:38:20.283 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 2', request id '0'
02:38:20.283 Dbg 10750 Start client request, dbprocesses per client '6'
02:38:20.283 Dbg 10734 Send message 'MSG_CLIENTSTARTED' to 'App: 2', request id '1'
02:38:20.287 Std 05022 Process './dbclient_oracle' started
02:38:20.324 Std 05022 Process './dbclient_oracle' started
02:38:20.395 Std 05022 Process './dbclient_oracle' started
02:38:20.626 Std 05022 Process './dbclient_oracle' started
02:38:20.781 Std 05022 Process './dbclient_oracle' started
02:38:20.911 Std 05022 Process './dbclient_oracle' started
02:38:20.943 Trc 04521 New client 54965 connected from '10.x.x.x'
02:38:20.948 Trc 04521 New client 54966 connected from '10.x.x.x'
02:38:20.949 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '2.2'
02:38:20.949 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 2.2', request id '1'
02:38:20.949 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 2', request id '0'
02:38:20.949 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 2.2', request id '0'
02:38:20.958 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '2.1'
02:38:20.958 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 2.1', request id '1'
02:38:20.958 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 2', request id '0'
02:38:20.958 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 2.1', request id '0'
02:38:20.959 Dbg 10743 'Oracle: 2.2' is spare
02:38:20.965 Dbg 10743 'Oracle: 2.1' is spare
02:38:21.121 Trc 04521 New client 54968 connected from '10.x.x.x'
02:38:21.122 Trc 04521 New client 54969 connected from '10.x.x.x'
02:38:21.122 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '2.3'
02:38:21.122 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 2.3', request id '1'
02:38:21.122 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 2', request id '0'
02:38:21.122 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 2.3', request id '0'
02:38:21.123 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '2.4'
02:38:21.123 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 2.4', request id '1'
02:38:21.123 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 2', request id '0'
02:38:21.123 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 2.4', request id '0'
02:38:21.132 Dbg 10743 'Oracle: 2.3' is spare
02:38:21.132 Dbg 10743 'Oracle: 2.4' is spare
02:38:21.186 Dbg 10749 Forwarding response '1.1' from 'Oracle: 2.1' to 'App: 2'
02:38:21.186 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='2.1' req='-1' Connection to multiserver created, host 'genrouting-lh', port '54964', socket '5'
+0002  MSG_STARTDB status='2'
Oracle: id='2.1' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0226  MSG_DBOPENED status='DBM_SUCCESS' msg='Open DB success'

02:38:21.186 Dbg 10743 'Oracle: 2.1' is spare
02:38:21.186 Dbg 10739 Oracle: id='2.1' req='0' Chmode to extended packet on sock 5

02:38:21.275 Dbg 10741 'App: 2' has put request id='1' into queue
02:38:21.276 Dbg 10737 Forwarding request '1' from 'App: 2' to 'Oracle: 2.2'
02:38:21.276 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='2.2' req='-1' Connection to multiserver created, host 'genrouting-lh', port '54964', socket '5'
+0001  MSG_STARTDB status='2'
Oracle: id='2.2' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0301  MSG_RECONNECTED status='DBM_SUCCESS'

02:38:21.276 Dbg 10743 'Oracle: 2.2' is spare
02:38:21.276 Dbg 10739 Oracle: id='2.2' req='0' Chmode to extended packet on sock 5

02:38:21.276 Dbg 10743 'Oracle: 2.2' is spare
02:38:21.299 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='2.3' req='-1' Connection to multiserver created, host 'genrouting-lh', port '54964', socket '5'
+0002  MSG_STARTDB status='2'
Oracle: id='2.3' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0002  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0168  MSG_RECONNECTED status='DBM_SUCCESS'

02:38:21.299 Dbg 10743 'Oracle: 2.3' is spare
02:38:21.299 Dbg 10739 Oracle: id='2.3' req='0' Chmode to extended packet on sock 5

02:38:21.361 Trc 04521 New client 54973 connected from '10.x.x.x'
02:38:21.362 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '2.5'
02:38:21.362 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 2.5', request id '1'
02:38:21.362 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 2', request id '0'
02:38:21.362 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 2.5', request id '0'
02:38:21.364 Dbg 10743 'Oracle: 2.5' is spare
02:38:21.372 Trc 04521 New client 54974 connected from '10.x.x.x'
02:38:21.373 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '2.6'
02:38:21.373 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 2.6', request id '1'
02:38:21.373 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 2', request id '0'
02:38:21.373 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 2.6', request id '0'
02:38:21.375 Dbg 10743 'Oracle: 2.6' is spare
02:38:21.397 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='2.4' req='-1' Connection to multiserver created, host 'genrouting-lh', port '54964', socket '5'
+0002  MSG_STARTDB status='2'
Oracle: id='2.4' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0272  MSG_RECONNECTED status='DBM_SUCCESS'

02:38:21.397 Dbg 10743 'Oracle: 2.4' is spare
02:38:21.397 Dbg 10739 Oracle: id='2.4' req='0' Chmode to extended packet on sock 5

02:38:21.525 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='2.5' req='-1' Connection to multiserver created, host 'genrouting-lh', port '54964', socket '5'
+0002  MSG_STARTDB status='2'
Oracle: id='2.5' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0160  MSG_RECONNECTED status='DBM_SUCCESS'

02:38:21.525 Dbg 10743 'Oracle: 2.5' is spare
02:38:21.525 Dbg 10739 Oracle: id='2.5' req='0' Chmode to extended packet on sock 5

02:38:21.644 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='2.6' req='-1' Connection to multiserver created, host 'genrouting-lh', port '54964', socket '5'
+0002  MSG_STARTDB status='2'
Oracle: id='2.6' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0269  MSG_RECONNECTED status='DBM_SUCCESS'

02:38:21.644 Dbg 10743 'Oracle: 2.6' is spare
02:38:21.644 Dbg 10739 Oracle: id='2.6' req='0' Chmode to extended packet on sock 5

02:38:28.885 Dbg 10749 Forwarding response '1.1' from 'Oracle: 2.2' to 'App: 2'
02:38:28.885 Dbg 10739 Oracle: id='2.2' req='1' SQL: DELETE FROM ird_strategies WHERE dbid=-1400632632
+7608  MSG_SQLEXECUTED status='DBM_SUCCESS'

02:38:28.886 Dbg 10741 'App: 2' has put request id='1' into queue
02:38:28.886 Dbg 10737 Forwarding request '1' from 'App: 2' to 'Oracle: 2.2'
02:38:28.887 Dbg 10743 'Oracle: 2.2' is spare
02:38:28.905 Dbg 10749 Forwarding response '1.2' from 'Oracle: 2.2' to 'App: 2'
02:38:28.905 Dbg 10739 Oracle: id='2.2' req='1' SQL: INSERT INTO ird_strategies values(-1400632632,'B')
+0018  MSG_SQLEXECUTED status='DBM_SUCCESS'

02:38:28.913 Std 04523 Connection to client 'App: 2' closed, reason ''client disconnected''
02:38:28.913 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 2.2', request id '-1'
  /Statistics             
    name                      = Oracle: 2.2
    app_name                  = App: 2
    req_rcvd                  = 12
    req_sent                  = 5
    data_rcvd                = 1225
    data_sent                = 267
    msg_error                = 0
    msg_log                  = 4
02:38:28.914 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 2.1', request id '-1'
  /Statistics             
    name                      = Oracle: 2.1
    app_name                  = App: 2
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 899
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:38:28.914 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 2.3', request id '-1'
  /Statistics             
    name                      = Oracle: 2.3
    app_name                  = App: 2
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:38:28.914 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 2.4', request id '-1'
  /Statistics             
    name                      = Oracle: 2.4
    app_name                  = App: 2
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:38:28.914 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 2.5', request id '-1'
  /Statistics             
    name                      = Oracle: 2.5
    app_name                  = App: 2
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:38:28.915 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 2.6', request id '-1'
  /Statistics             
    name                      = Oracle: 2.6
    app_name                  = App: 2
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:38:29.003 Std 02024 OS signal 'SIGCHLD' received
02:38:29.003 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 14664
    id                        = 10
    expiration_time          = 2014-05-21T02:39:28
    client copy              = 4
02:38:29.007 Std 02024 OS signal 'SIGCHLD' received
02:38:29.007 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 14662
    id                        = 8
    expiration_time          = 2014-05-21T02:39:28
    client copy              = 2
02:38:29.010 Std 02024 OS signal 'SIGCHLD' received
02:38:29.010 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 14661
    id                        = 7
    expiration_time          = 2014-05-21T02:39:28
    client copy              = 1
02:38:29.014 Std 02024 OS signal 'SIGCHLD' received
02:38:29.014 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 14660
    id                        = 6
    expiration_time          = 2014-05-21T02:39:28
    client copy              = 0
02:38:29.018 Std 02024 OS signal 'SIGCHLD' received
02:38:29.018 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 14663
    id                        = 9
    expiration_time          = 2014-05-21T02:39:28
    client copy              = 3
02:38:29.022 Std 02024 OS signal 'SIGCHLD' received
02:38:29.022 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 14665
    id                        = 11
    expiration_time          = 2014-05-21T02:39:28
    client copy              = 5
  /Statistics             
    name                      = App: 2
    req_rcvd                  = 4
    req_sent                  = 11
    data_rcvd                = 253
    data_send                = 383
    invalid_params            = 0
    abandoned_req            = 0
    abandon_req_fail          = 0
    error_start_client        = 0
    invalid_register_req      = 0
    msg_error                = 0
    pending_requests          = 0
    pending_queue_size        = 0
    max_pending_requests      = 1
    max_pending_queue_size    = 80
-AP[4]->-5 @02:38:44.4330
-Ap[4]-<-5 @02:38:44.4348
-AP[5]->-5 @02:39:34.4421
-Ap[5]-<-5 @02:39:34.4434
-AP[6]->-5 @05/21/14 02:40:24.4510
-Ap[6]-<-5 @02:40:24.4519
02:40:28.889 Trc 04521 New client 2983 connected from '10.x.x.x'
02:40:28.890 Dbg 10745 'App: 10.x.x.x:2983' registered; protocol version '1.3' id '3'
02:40:28.890 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 3', request id '0'
02:40:28.890 Dbg 10750 Start client request, dbprocesses per client '6'
02:40:28.890 Dbg 10734 Send message 'MSG_CLIENTSTARTED' to 'App: 3', request id '1'
02:40:28.893 Std 05022 Process './dbclient_oracle' started
02:40:28.952 Std 05022 Process './dbclient_oracle' started
02:40:29.055 Std 05022 Process './dbclient_oracle' started
02:40:29.275 Std 05022 Process './dbclient_oracle' started
02:40:29.297 Std 05022 Process './dbclient_oracle' started
02:40:29.304 Std 05022 Process './dbclient_oracle' started
02:40:29.498 Trc 04521 New client 55030 connected from '10.x.x.x'
02:40:29.498 Trc 04521 New client 55031 connected from '10.x.x.x'
02:40:29.498 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '3.1'
02:40:29.498 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 3.1', request id '1'
02:40:29.499 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 3', request id '0'
02:40:29.499 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 3.1', request id '0'
02:40:29.506 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '3.2'
02:40:29.506 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 3.2', request id '1'
02:40:29.506 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 3', request id '0'
02:40:29.506 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 3.2', request id '0'
02:40:29.506 Dbg 10743 'Oracle: 3.1' is spare
02:40:29.513 Dbg 10743 'Oracle: 3.2' is spare
02:40:29.659 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='3.2' req='-1' Connection to multiserver created, host 'genrouting-lh', port '55029', socket '5'
+0001  MSG_STARTDB status='3'
Oracle: id='3.2' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0152  MSG_RECONNECTED status='DBM_SUCCESS'

02:40:29.659 Dbg 10743 'Oracle: 3.2' is spare
02:40:29.660 Dbg 10739 Oracle: id='3.2' req='0' Chmode to extended packet on sock 5

02:40:29.714 Dbg 10749 Forwarding response '1.1' from 'Oracle: 3.1' to 'App: 3'
02:40:29.714 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='3.1' req='-1' Connection to multiserver created, host 'genrouting-lh', port '55029', socket '5'
+0001  MSG_STARTDB status='3'
Oracle: id='3.1' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0213  MSG_DBOPENED status='DBM_SUCCESS' msg='Open DB success'

02:40:29.714 Dbg 10743 'Oracle: 3.1' is spare
02:40:29.714 Dbg 10739 Oracle: id='3.1' req='0' Chmode to extended packet on sock 5

02:40:29.716 Dbg 10741 'App: 3' has put request id='1' into queue
02:40:29.716 Dbg 10737 Forwarding request '1' from 'App: 3' to 'Oracle: 3.1'
02:40:29.717 Dbg 10743 'Oracle: 3.1' is spare
02:40:29.775 Trc 04521 New client 55034 connected from '10.x.x.x'
02:40:29.776 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '3.4'
02:40:29.777 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 3.4', request id '1'
02:40:29.777 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 3', request id '0'
02:40:29.777 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 3.4', request id '0'
02:40:29.777 Dbg 10743 'Oracle: 3.4' is spare
02:40:29.922 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='3.4' req='-1' Connection to multiserver created, host 'genrouting-lh', port '55029', socket '5'
+0003  MSG_STARTDB status='3'
Oracle: id='3.4' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0144  MSG_RECONNECTED status='DBM_SUCCESS'

02:40:29.922 Dbg 10743 'Oracle: 3.4' is spare
02:40:29.922 Dbg 10739 Oracle: id='3.4' req='0' Chmode to extended packet on sock 5

02:40:29.932 Trc 04521 New client 55036 connected from '10.x.x.x'
02:40:29.932 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '3.5'
02:40:29.932 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 3.5', request id '1'
02:40:29.932 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 3', request id '0'
02:40:29.932 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 3.5', request id '0'
02:40:29.933 Dbg 10743 'Oracle: 3.5' is spare
02:40:29.966 Trc 04521 New client 55037 connected from '10.x.x.x'
02:40:29.967 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '3.3'
02:40:29.967 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 3.3', request id '1'
02:40:29.967 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 3', request id '0'
02:40:29.967 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 3.3', request id '0'
02:40:29.968 Dbg 10743 'Oracle: 3.3' is spare
02:40:30.024 Trc 04521 New client 55040 connected from '10.x.x.x'
02:40:30.024 Dbg 10745 './dbclient_oracle' registered; protocol version '1.3' id '3.6'
02:40:30.025 Dbg 10734 Send message 'MSG_OPENDB' to 'Oracle: 3.6', request id '1'
02:40:30.025 Dbg 10734 Send message 'MSG_EXTPACKETS' to 'App: 3', request id '0'
02:40:30.025 Dbg 10734 Send message 'MSG_EXTPACKET' to 'Oracle: 3.6', request id '0'
02:40:30.025 Dbg 10743 'Oracle: 3.6' is spare
02:40:30.314 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='3.5' req='-1' Connection to multiserver created, host 'genrouting-lh', port '55029', socket '5'
+0002  MSG_STARTDB status='3'
Oracle: id='3.5' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0379  MSG_RECONNECTED status='DBM_SUCCESS'

02:40:30.314 Dbg 10743 'Oracle: 3.5' is spare
02:40:30.314 Dbg 10739 Oracle: id='3.5' req='0' Chmode to extended packet on sock 5

02:40:30.572 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='3.6' req='-1' Connection to multiserver created, host 'genrouting-lh', port '55029', socket '5'
+0001  MSG_STARTDB status='3'
Oracle: id='3.6' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0546  MSG_RECONNECTED status='DBM_SUCCESS'

02:40:30.572 Dbg 10743 'Oracle: 3.6' is spare
02:40:30.572 Dbg 10739 Oracle: id='3.6' req='0' Chmode to extended packet on sock 5

02:40:30.604 Dbg 10739 Unknown: id='' req='-1' ORACLE_HOME is '/opt/oracle/product/9.2.0.7'.
+0000 
DBClient Oracle, Copyright (c) 1997-2005 Genesys Telecommunications Labs, Inc.
All Rights Reserved
Db Client version:        7.1.100.03
DB Common part version:    7.1.100.03
Vendor supported versions: Oracle 8i, 9i
Build on 'sparc-solaris7'
Oracle: id='3.3' req='-1' Connection to multiserver created, host 'genrouting-lh', port '55029', socket '5'
+0002  MSG_STARTDB status='3'
Oracle: id='3.3' req='1' Protocols versions: dbclient='00010003' dbserver='00010003' dblib='00010003'
+0000  Open DB: username = 'genesys', database = '', dbserver = 'CONFIG'
+0636  MSG_RECONNECTED status='DBM_SUCCESS'

02:40:30.604 Dbg 10743 'Oracle: 3.3' is spare
02:40:30.604 Dbg 10739 Oracle: id='3.3' req='0' Chmode to extended packet on sock 5

02:40:32.950 Dbg 10749 Forwarding response '1.2' from 'Oracle: 3.1' to 'App: 3'
02:40:32.950 Dbg 10739 Oracle: id='3.1' req='1' SQL: DELETE FROM ird_strategies WHERE dbid=-1400632632
+3232  MSG_SQLEXECUTED status='DBM_SUCCESS'

02:40:32.951 Dbg 10741 'App: 3' has put request id='1' into queue
02:40:32.951 Dbg 10737 Forwarding request '1' from 'App: 3' to 'Oracle: 3.1'
02:40:32.951 Dbg 10743 'Oracle: 3.1' is spare
02:40:32.964 Dbg 10749 Forwarding response '1.3' from 'Oracle: 3.1' to 'App: 3'
02:40:32.964 Dbg 10739 Oracle: id='3.1' req='1' SQL: INSERT INTO ird_strategies values(-1400632632,'B')
+0012  MSG_SQLEXECUTED status='DBM_SUCCESS'

02:40:32.971 Std 04523 Connection to client 'App: 3' closed, reason ''client disconnected''
02:40:32.971 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 3.1', request id '-1'
  /Statistics             
    name                      = Oracle: 3.1
    app_name                  = App: 3
    req_rcvd                  = 12
    req_sent                  = 5
    data_rcvd                = 1266
    data_sent                = 267
    msg_error                = 0
    msg_log                  = 4
02:40:32.972 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 3.2', request id '-1'
  /Statistics             
    name                      = Oracle: 3.2
    app_name                  = App: 3
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:40:32.972 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 3.4', request id '-1'
  /Statistics             
    name                      = Oracle: 3.4
    app_name                  = App: 3
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:40:32.972 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 3.5', request id '-1'
  /Statistics             
    name                      = Oracle: 3.5
    app_name                  = App: 3
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:40:32.973 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 3.3', request id '-1'
  /Statistics             
    name                      = Oracle: 3.3
    app_name                  = App: 3
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:40:32.973 Dbg 10734 Send message 'MSG_DISCONNECTED' to 'Oracle: 3.6', request id '-1'
  /Statistics             
    name                      = Oracle: 3.6
    app_name                  = App: 3
    req_rcvd                  = 6
    req_sent                  = 3
    data_rcvd                = 858
    data_sent                = 108
    msg_error                = 0
    msg_log                  = 2
02:40:33.080 Std 02024 OS signal 'SIGCHLD' received
02:40:33.081 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 17702
    id                        = 13
    expiration_time          = 2014-05-21T02:41:32
    client copy              = 1
02:40:33.086 Std 02024 OS signal 'SIGCHLD' received
02:40:33.086 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 17703
    id                        = 14
    expiration_time          = 2014-05-21T02:41:32
    client copy              = 2
02:40:33.090 Std 02024 OS signal 'SIGCHLD' received
02:40:33.090 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 17704
    id                        = 15
    expiration_time          = 2014-05-21T02:41:32
    client copy              = 3
02:40:33.094 Std 02024 OS signal 'SIGCHLD' received
02:40:33.094 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 17701
    id                        = 12
    expiration_time          = 2014-05-21T02:41:32
    client copy              = 0
02:40:33.097 Std 02024 OS signal 'SIGCHLD' received
02:40:33.098 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 17708
    id                        = 17
    expiration_time          = 2014-05-21T02:41:32
    client copy              = 5
02:40:33.102 Std 02024 OS signal 'SIGCHLD' received
02:40:33.102 Std 05023 Process './dbclient_oracle' stopped
  /./dbclient_oracle       
    pid                      = 17707
    id                        = 16
    expiration_time          = 2014-05-21T02:41:32
    client copy              = 4
  /Statistics             
    name                      = App: 3
    req_rcvd                  = 4
    req_sent                  = 11
    data_rcvd                = 253
    data_send                = 383
    invalid_params            = 0
    abandoned_req            = 0
    abandon_req_fail          = 0
    error_start_client        = 0
    invalid_register_req      = 0
    msg_error                = 0
    pending_requests          = 0
    pending_queue_size        = 0
    max_pending_requests      = 1
    max_pending_queue_size    = 80

[Gef Buneri]

The issue seems somehow linked to the excessive process charge. Solved using a different istance of dbserver, dedicated to IRD. I lost the corrupted strategy (the one thate showed the error the first time), but it is the lesser evil... just rewrite all the coding work.

[Kubig]

In environment where the strategies are large I strongly recommend to use dedicated DBServer for IRD. I have encountered many similiar issues related to the communication between database and IRD, for example within export of strategy.

[Gef Buneri]

Thnks Kubig, at the end was I did; to dedicate a dbserver to IRD. Now seems to work fine.