" /> [SOLVED] WDE when logged in shows UCS out of service and back in service - Genesys CTI User Forum
« previous next »
Pages: [1]   Go Down

Author Topic: [SOLVED] WDE when logged in shows UCS out of service and back in service  (Read 5591 times)

Offline ryusuf

  • Full Member
  • ***
  • Posts: 108
  • Karma: 0
[SOLVED] WDE when logged in shows UCS out of service and back in service
« on: December 19, 2016, 11:11:17 AM »
Advertisement
Dears,

I have this issue that when we login to Workspace, UCS is out of service and after a second or two it is back in service. This happens continuously.

Had suspected it might be some port blocking. However, the same is happening on the server where there is no firewall between them. Sat with the network guy and checked all the port traffic and opened it (4200,4210). The port used by UCS is 4210.

I have noticed that the chat server is going into "Service Unavailable" state and then comes back to Primary. On checking the stat server logs, i see connection lost to UCS. Both chat server and UCS are on the same host.

I suspect both the issue with Workspace and chat server might have something to do with UCS.

The Workspace logs shows as follows

[quote]16-12-18 16:12:13.403 [.PCT.Invoker#4] INFO                  ESDK - Channel tcp://g1-aux-p:4210/ opened
16-12-18 16:12:13.403 [.PCT.Invoker#4] INFO  acts.ContactHandling - UCS connection opened Genesyslab.Platform.Contacts.Protocols.UniversalContactServerProtocol
16-12-18 16:12:13.416 [            1] INFO  ws.ToasterController - Add the message (MessageId00001 BroadcastMessage)
16-12-18 16:12:13.425 [.PCT.Invoker#4] INFO  acts.ContactHandling - GetIndexProperties
16-12-18 16:12:13.425 [.PCT.Invoker#4] INFO  acts.ContactHandling - GetIndexProperties request ReferenceID=3 handle=System.Threading.AutoResetEvent
16-12-18 16:12:13.426 [.PCT.Invoker#4] INFO  .Core.ChannelManager - Protocol UniversalContactServer814 - tcp://g1-aux-p:4210 Opened
16-12-18 16:12:13.436 [            1] INFO  cture.ChainOfCommand - Start Execution of Chain of Command ShowMessageToasterWindow
16-12-18 16:12:13.436 [            1] INFO  cture.ChainOfCommand - Execute of Chain of Command ShowMessageToasterWindow -> Name:ShowMessageToasterWindow Type:Genesyslab.Desktop.Modules.Windows.Views.Toaster.ShowMessageToasterWindowCommand
16-12-18 16:12:13.436 [            1] INFO  ToasterWindowCommand - ShowMessageToasterWindowCommand
16-12-18 16:12:13.455 [.PCT.Invoker#4] INFO  .AsyncSearchCallback - HandleIndexProperties
16-12-18 16:12:13.455 [.PCT.Invoker#4] INFO  .AsyncSearchCallback - HandleIndexProperties event ReferenceID=3
16-12-18 16:12:13.456 [.PCT.Invoker#4] INFO                  ESDK - Default strategy 'DefaultEventStrategy' [Dn] ? Processing msg [Name] EventGetIndexProperties [EndPoint] UniversalContactServer814 - tcp://g1-aux-p:4210 Asynchronous message
16-12-18 16:12:13.457 [            1] INFO  cture.ChainOfCommand - End of Execution of Chain of Command ShowMessageToasterWindow (  21.001 ms)
16-12-18 16:12:29.873 [            1] INFO  tructure.ViewManager - Cannot find the region 'ToolbarHamburgerButtonRegion'
16-12-18 16:12:55.522 [            6] ERROR 814.CommonConnection -  tcp://g1-aux-p:4210(Socket#2564) connection is firing 'Closed' event with: Exception Genesyslab.Platform.Commons.Connection.ConnectionException: Closing idle connection tcp://g1-aux-p:4210
16-12-18 16:12:55.526 [.PCT.Invoker#4] WARN                  ESDK - Channel tcp://g1-aux-p:4210/ closed
16-12-18 16:12:55.526 [.PCT.Invoker#4] WARN                  ESDK - Channel closing [Name] UniversalContactServer814 [Uri] tcp://g1-aux-p:4210/ has 0 request pending. They are lost
16-12-18 16:12:55.527 [.PCT.Invoker#4] INFO  acts.ContactHandling - UCS connection closed Genesyslab.Platform.Contacts.Protocols.UniversalContactServerProtocolGenesyslab.Platform.Commons.Protocols.ClosedEventArgs:
PreviousChannelState = Closing
Cause = Genesyslab.Platform.Commons.Connection.ConnectionException: Closing idle connection tcp://g1-aux-p:4210

16-12-18 16:12:55.528 [.PCT.Invoker#4] WARN  .Core.ChannelManager - Protocol UniversalContactServer814 - tcp://g1-aux-p:4210 Closed  message:'Genesyslab.Platform.Commons.Connection.ConnectionException: Closing idle connection tcp://g1-aux-p:4210' Previous Channel State:'Closing'
16-12-18 16:12:55.538 [            1] INFO  ws.ToasterController - Add the message (MessageId00002 BroadcastMessage)
16-12-18 16:12:55.565 [            1] INFO  cture.ChainOfCommand - Start Execution of Chain of Command ShowMessageToasterWindow
16-12-18 16:12:55.565 [            1] INFO  cture.ChainOfCommand - Execute of Chain of Command ShowMessageToasterWindow -> Name:ShowMessageToasterWindow Type:Genesyslab.Desktop.Modules.Windows.Views.Toaster.ShowMessageToasterWindowCommand
16-12-18 16:12:55.565 [            1] INFO  ToasterWindowCommand - ShowMessageToasterWindowCommand
16-12-18 16:12:55.586 [            1] INFO  cture.ChainOfCommand - End of Execution of Chain of Command ShowMessageToasterWindow (  21.001 ms)
16-12-18 16:12:56.007 [.PCT.Invoker#4] INFO                  ESDK - Channel tcp://g1-aux-p:4210/ opened
16-12-18 16:12:56.007 [.PCT.Invoker#4] INFO  acts.ContactHandling - UCS connection opened Genesyslab.Platform.Contacts.Protocols.UniversalContactServerProtocol
16-12-18 16:12:56.015 [            1] INFO  ws.ToasterController - Add the message (MessageId00003 BroadcastMessage)
16-12-18 16:12:56.027 [.PCT.Invoker#4] INFO  acts.ContactHandling - GetIndexProperties
16-12-18 16:12:56.027 [.PCT.Invoker#4] INFO  acts.ContactHandling - GetIndexProperties request ReferenceID=4 handle=System.Threading.AutoResetEvent
16-12-18 16:12:56.027 [.PCT.Invoker#4] INFO  .Core.ChannelManager - Protocol UniversalContactServer814 - tcp://g1-aux-p:4210 Opened
16-12-18 16:12:56.043 [            1] INFO  cture.ChainOfCommand - Start Execution of Chain of Command ShowMessageToasterWindow
16-12-18 16:12:56.043 [            1] INFO  cture.ChainOfCommand - Execute of Chain of Command ShowMessageToasterWindow -> Name:ShowMessageToasterWindow Type:Genesyslab.Desktop.Modules.Windows.Views.Toaster.ShowMessageToasterWindowCommand
16-12-18 16:12:56.043 [            1] INFO  ToasterWindowCommand - ShowMessageToasterWindowCommand
16-12-18 16:12:56.054 [.PCT.Invoker#4] INFO  .AsyncSearchCallback - HandleIndexProperties
16-12-18 16:12:56.054 [.PCT.Invoker#4] INFO  .AsyncSearchCallback - HandleIndexProperties event ReferenceID=4
16-12-18 16:12:56.055 [.PCT.Invoker#4] INFO                  ESDK - Default strategy 'DefaultEventStrategy' [Dn] ? Processing msg [Name] EventGetIndexProperties [EndPoint] UniversalContactServer814 - tcp://g1-aux-p:4210 Asynchronous message
16-12-18 16:12:56.066 [            1] INFO  cture.ChainOfCommand - End of Execution of Chain of Command ShowMessageToasterWindow (  23.001 ms)
16-12-18 16:12:59.170 [            1] INFO  cture.ChainOfCommand - Start Execution of Chain of Command ToasterShowBroadcastMessage
16-12-18 16:12:59.170 [            1] INFO  cture.ChainOfCommand - Execute of Chain of Command ToasterShowBroadcastMessage -> Name:ShowToaster Type:Genesyslab.Desktop.Modules.Windows.Views.Toaster.Broadcast.ShowToasterBroadcastMessageCommand
16-12-18 16:12:59.171 [            1] INFO  adcastMessageCommand - ShowToasterBroadcastMessageCommand
16-12-18 16:12:59.176 [            1] INFO  cture.ChainOfCommand - Start Execution of Chain of Command BroadcastMessageShow
16-12-18 16:12:59.177 [            1] INFO  cture.ChainOfCommand - Execute of Chain of Command BroadcastMessageShow -> Name:Show Type:Genesyslab.Desktop.Modules.Windows.Views.Broadcast.ShowBroadcastMessageCommand
16-12-18 16:12:59.178 [            1] INFO  adcastMessageCommand - ShowBroadcastMessageCommand
16-12-18 16:12:59.309 [            1] INFO  cture.ChainOfCommand - End of Execution of Chain of Command BroadcastMessageShow ( 133.008 ms)
16-12-18 16:12:59.310 [            1] INFO  cture.ChainOfCommand - End of Execution of Chain of Command ToasterShowBroadcastMessage ( 140.008 ms)
16-12-18 16:13:00.289 [            1] INFO  cture.ChainOfCommand - Start Execution of Chain of Command BroadcastMessageClose
16-12-18 16:13:00.289 [            1] INFO  cture.ChainOfCommand - Execute of Chain of Command BroadcastMessageClose -> Name:Close Type:Genesyslab.Desktop.Modules.Windows.Views.Broadcast.CloseBroadcastMessageCommand
16-12-18 16:13:00.290 [            1] INFO  adcastMessageCommand - CloseBroadcastMessageCommand
16-12-18 16:13:00.297 [            1] INFO  cture.ChainOfCommand - End of Execution of Chain of Command BroadcastMessageClose (  8.000 ms)
16-12-18 16:13:45.151 [            9] ERROR 814.CommonConnection -  tcp://g1-aux-p:4210(Socket#2556) connection is firing 'Closed' event with: Exception Genesyslab.Platform.Commons.Connection.ConnectionException: Closing idle connection tcp://g1-aux-p:4210
16-12-18 16:13:45.157 [.PCT.Invoker#4] WARN                  ESDK - Channel tcp://g1-aux-p:4210/ closed
16-12-18 16:13:45.157 [.PCT.Invoker#4] WARN                  ESDK - Channel closing [Name] UniversalContactServer814 [Uri] tcp://g1-aux-p:4210/ has 0 request pending. They are lost
16-12-18 16:13:45.158 [.PCT.Invoker#4] INFO  acts.ContactHandling - UCS connection closed Genesyslab.Platform.Contacts.Protocols.UniversalContactServerProtocolGenesyslab.Platform.Commons.Protocols.ClosedEventArgs:
PreviousChannelState = Closing
Cause = Genesyslab.Platform.Commons.Connection.ConnectionException: Closing idle connection tcp://g1-aux-p:4210

16-12-18 16:13:45.158 [.PCT.Invoker#4] WARN  .Core.ChannelManager - Protocol UniversalContactServer814 - tcp://g1-aux-p:4210 Closed  message:'Genesyslab.Platform.Commons.Connection.ConnectionException: Closing idle connection tcp://g1-aux-p:4210' Previous Channel State:'Closing'
16-12-18 16:13:45.168 [            1] INFO  ws.ToasterController - Add the message (MessageId00004 BroadcastMessage)
16-12-18 16:13:45.186 [            1] INFO  cture.ChainOfCommand - Start Execution of Chain of Command ShowMessageToasterWindow
16-12-18 16:13:45.186 [            1] INFO  cture.ChainOfCommand - Execute of Chain of Command ShowMessageToasterWindow -> Name:ShowMessageToasterWindow Type:Genesyslab.Desktop.Modules.Windows.Views.Toaster.ShowMessageToasterWindowCommand
16-12-18 16:13:45.186 [            1] INFO  ToasterWindowCommand - ShowMessageToasterWindowCommand
16-12-18 16:13:45.208 [            1] INFO  cture.ChainOfCommand - End of Execution of Chain of Command ShowMessageToasterWindow (  22.001 ms)
16-12-18 16:13:46.573 [.PCT.Invoker#4] INFO                  ESDK - Channel tcp://g1-aux-p:4210/ opened[/quote]

The chat server log shows as below

[quote]16:10:53.372 Std 04504 Connection to Contact Server 'UniversalContactServer814' at host 'g1-aux-p', port 4210 lost
16:10:53.372 Std 59441 UCS: Contact Server connection was disabled.
16:10:53.372 Std 59003 LCA status was changed to: SERVICE_UNAVAILABLE.
16:10:53.372 Std 59002 Application status was changed: server FORBIDs the creation of new chat sessions.
16:10:53.372 Std 59025 Application's runmode was requested to be changed to BACKUP
16:10:53.372 Std 59036 Connection manager mode was set to backup
16:10:53.372 Trc 59202 connection was closed for conn_id=572:8 (type=ESP)
16:10:53.372 Trc 59202 connection was closed for conn_id=580:7 (type=ESP)
16:10:53.372 Std 05151 Application's runmode changed to Backup
16:10:53.372 Std 59034 Closing server {esp} port (connection id 448)...
16:10:53.372 Std 59035 Server {esp} port has been closed (connection 448)
16:10:53.372 Std 59034 Closing server {chat-all} port (connection id 492)...
16:10:53.372 Std 59035 Server {chat-all} port has been closed (connection 492)
16:10:53.372 Std 59034 Closing server {chat-basic} port (connection id 496)...
16:10:53.372 Std 59035 Server {chat-basic} port has been closed (connection 496)
16:11:03.387 Trc 04500 Connecting to Contact Server 'UniversalContactServer814' at host 'g1-aux-p', port 4210
16:11:03.387 Std 59401 {UCS} connection protocol parameters details: tl=7, tr=11, mode=both
16:11:03.387 Std 04503 Connected to Contact Server 'UniversalContactServer814' at host 'g1-aux-p', port 4210
16:11:03.387 Std 59440 UCS: Contact Server connection was activated.
16:11:03.387 Std 59003 LCA status was changed to: RUNNING.
16:11:14.869 Std 59025 Application's runmode was requested to be changed to PRIMARY
16:11:14.869 Std 59036 Connection manager mode was set to primary
16:11:14.869 Std 59030 Reading {default} port=4240 from 'Ports': protocol={undefined}, security={}
16:11:14.869 Std 59030 Reading {ESP} port=4241 from 'Ports': protocol={undefined}, security={}
16:11:14.869 Std 59029 Adjust  {ESP} port=4241 with protocol={esp}
16:11:14.869 Std 59030 Reading {webapi} port=4242 from 'Ports': protocol={undefined}, security={}
16:11:14.869 Std 59029 Adjust  {webapi} port=4242 with protocol={chat-flex}
16:11:14.869 Std 59029 Adjust  {default} port=4240 with protocol={chat-basic}
16:11:14.869 Std 59031 Opening {default} port=4240 for listening ...
16:11:14.869 Std 04525 Port 4240 opened for listening
16:11:14.869 Std 59031 Opening {ESP} port=4241 for listening ...
16:11:14.869 Std 04525 Port 4241 opened for listening
16:11:14.869 Std 59031 Opening {webapi} port=4242 for listening ...
16:11:14.869 Std 04525 Port 4242 opened for listening
16:11:14.869 Std 59038 {default} port=4240 will be used in userdata of interaction
16:11:14.869 Std 05150 Application's runmode changed to Primary
16:11:14.869 Std 59001 Application status was changed: server PERMITs the creation of new chat sessions.
16:11:24.884 Trc 59201 new connection created with conn_id=492:9 (type=ESP)
16:11:24.884 Trc 59201 new connection created with conn_id=448:10 (type=ESP)
16:13:02.462 Std 04504 Connection to Contact Server 'UniversalContactServer814' at host 'g1-aux-p', port 4210 lost
16:13:02.462 Std 59441 UCS: Contact Server connection was disabled.
16:13:02.462 Std 59003 LCA status was changed to: SERVICE_UNAVAILABLE.
16:13:02.462 Std 59002 Application status was changed: server FORBIDs the creation of new chat sessions.
16:13:02.462 Std 59025 Application's runmode was requested to be changed to BACKUP
16:13:02.462 Std 59036 Connection manager mode was set to backup
16:13:02.462 Trc 59202 connection was closed for conn_id=448:10 (type=ESP)
16:13:02.462 Trc 59202 connection was closed for conn_id=492:9 (type=ESP)
16:13:02.462 Std 05151 Application's runmode changed to Backup
16:13:02.462 Std 59034 Closing server {chat-basic} port (connection id 488)...
16:13:02.462 Std 59035 Server {chat-basic} port has been closed (connection 488)
16:13:02.462 Std 59034 Closing server {esp} port (connection id 572)...
16:13:02.462 Std 59035 Server {esp} port has been closed (connection 572)
16:13:02.462 Std 59034 Closing server {chat-all} port (connection id 580)...
16:13:02.462 Std 59035 Server {chat-all} port has been closed (connection 580)
16:13:12.462 Trc 04500 Connecting to Contact Server 'UniversalContactServer814' at host 'g1-aux-p', port 4210
16:13:12.462 Std 59401 {UCS} connection protocol parameters details: tl=7, tr=11, mode=both
16:13:12.462 Std 04503 Connected to Contact Server 'UniversalContactServer814' at host 'g1-aux-p', port 4210
16:13:12.462 Std 59440 UCS: Contact Server connection was activated.
16:13:12.462 Std 59003 LCA status was changed to: RUNNING.[/quote]

« Last Edit: December 25, 2016, 12:02:32 PM by ryusuf »
Logged

Offline Kubig

  • Hero Member
  • *****
  • Posts: 2755
  • Karma: 44
Re: Workspace when logged in shows UCS out of service and back in service frequently
« Reply #1 on: December 19, 2016, 11:32:33 AM »
And what say UCS logs? Without them is not possible help you
Logged

Offline ryusuf

  • Full Member
  • ***
  • Posts: 108
  • Karma: 0
Re: Workspace when logged in shows UCS out of service and back in service frequently
« Reply #2 on: December 19, 2016, 11:56:17 AM »
Hi Kubig,

Couldn't find much when i compared the time stamps in UCS. Below is the log excerpt from UCS

[quote]
16:14:33.457 Std 29997 [SvcSrvW-7] <405> Error handling request '405', Connection is not opened
java.lang.IllegalStateException: Connection is not opened
at com.genesyslab.platform.commons.protocol.AbstractChannel.throwNotOpened(AbstractChannel.java:311)
at com.genesyslab.platform.commons.protocol.DuplexChannel.send(DuplexChannel.java:335)
at com.genesyslab.platform.commons.protocol.runtime.channel.RequestContextImpl.respond(RequestContextImpl.java:65)
at com.genesyslab.icc.util.esp.ServiceServerPSDKImpl$RequestHandler.run(ServiceServerPSDKImpl.java:714)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at com.genesyslab.util.concurrent16.NamedThreadFactory$1.run(NamedThreadFactory.java:55)
at java.lang.Thread.run(Thread.java:662)

16:14:35.501 Trc 29998 [PSDK.Timer] Polling connection tcp://g1-core-p:2030[Opened]/1
16:14:35.501 Trc 29998 [  worker #2] Addp packet received: p(276) from tcp://g1-core-p:2030[Opened]/1
16:14:36.047 Trc 29998 [ worker #13] Addp packet received: P(4) from tcp://g1-app-p:53793[Opened]/215
16:14:36.515 Trc 29998 [ worker #15] Addp packet received: P(12) from tcp://g1-aux-p:55420[Opened]/209
16:14:37.014 Trc 29998 [ worker #15] Addp packet received: P(19) from tcp://g1-aux-s:54001[Opened]/201
16:14:39.198 Trc 29998 [ worker #15] Addp packet received: P(3) from tcp://g1-aux-p:55427[Opened]/217
16:14:40.040 Trc 29998 [PSDK.Timer] Polling connection tcp://g1-core-p:8888[Opened]/0
16:14:40.040 Trc 29998 [  worker #1] Addp packet received: p(268) from tcp://g1-core-p:8888[Opened]/0
16:14:41.164 Trc 21124 [ESP:4210] Request (queued for 0 ms): Id=1351|Type=Request|AppName=EmailServer814|AppType=EMAIL_SERVER|Service=OMInteractions|Method=GetInteractions.
16:14:41.164 Dbg 21291 [SvcSrvW-2] Thread 'SvcSrvW-2' registers to shutdown notification.
16:14:41.164 Trc 21124 [SvcSrvW-2] <1351> Request (queued for 0 ms):
  Id=1351
  Type=Request
  AppName=EmailServer814
  AppType=EMAIL_SERVER
  Service=OMInteractions
  Method=GetInteractions
  Parameters=
    [
      TenantId=101
      MaxCount=200
      SearchCriteria=
      [
        AND=
        [
          EQUAL=
          [ [/quote]

Logged

Offline Kubig

  • Hero Member
  • *****
  • Posts: 2755
  • Karma: 44
Re: Workspace when logged in shows UCS out of service and back in service frequently
« Reply #3 on: December 19, 2016, 11:58:22 AM »
Try to add ADDP between the UCS and clients (chat, WDE, etc.) - it could help. I have encountered an issue, where the connection has been resetted by the network active element, because of the network status was not established.
Logged

Offline s.svr1111

  • Newbie
  • *
  • Posts: 7
  • Karma: 0
Re: Workspace when logged in shows UCS out of service and back in service frequently
« Reply #4 on: December 19, 2016, 01:30:24 PM »
Please answer these questions -
1. What is the redundancy for Interaction server?
2. Are you trying to login to chat only or voice + chat?



Sent from my iPhone using Tapatalk
Logged

Offline ryusuf

  • Full Member
  • ***
  • Posts: 108
  • Karma: 0
Re: Workspace when logged in shows UCS out of service and back in service frequently
« Reply #5 on: December 25, 2016, 12:00:52 PM »
Dears,

Got it resolved. The issue was with the incorrect DNS address in the server network. On removing it from the server, the issue no longer exists.  :) :)

Logged
Pages: [1]   Go Up
« previous next »