db.disconnection.Factory$5.loadObject(Factory.java:157)

[mic]

does anyne met these exceptions before?
what does it mean and how to solve it?  it causes the aggregation to be delayed

[mic]

2018-11-03 14:50:33,152 DEBUG Lib.Thread.Agg.Manager 35000 exiting from join() loop
2018-11-03 14:50:33,154 INFO  Agg.Diag    25000 Breaking Agg.Writer.0 connection, cancelling active statement
2018-11-03 14:50:33,158 INFO  Agg.Diag    25000 Breaking Agg.Writer.7 connection
2018-11-03 14:50:33,158 INFO  Agg.Diag    25000 Breaking Agg.Writer.6 connection
2018-11-03 14:50:33,158 INFO  Agg.Diag    25000 Breaking Agg.Writer.9 connection
2018-11-03 14:50:33,159 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,159 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,159 INFO  Agg.Diag    25000 Breaking Agg.Writer.5 connection
2018-11-03 14:50:33,159 INFO  Agg.Diag    25000 Breaking Agg.Writer.8 connection
2018-11-03 14:50:33,159 INFO  Agg.Diag    25000 Breaking Agg.Writer.1 connection
2018-11-03 14:50:33,159 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,159 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,160 INFO  Agg.Diag    25000 Breaking Agg.Writer.2 connection
2018-11-03 14:50:33,160 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,160 INFO  Agg.Diag    25000 Breaking Agg.Writer.4 connection
2018-11-03 14:50:33,160 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,160 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,160 INFO  Agg.Diag    25000 Exception in connection breaker, rollback: Closed Connection
2018-11-03 14:50:33,161 INFO  Agg.Diag    25000 Breaking Agg.Writer.3 connection, cancelling active statement
2018-11-03 14:50:33,162 DEBUG Lib.Thread.Agg.Keeper 35000 finished execution of command: STOP_AGG
2018-11-03 14:50:33,163 DEBUG Lib.Thread.Agg.Keeper 35000 got command: START_AGG
2018-11-03 14:50:33,165 DEBUG Lib.Thread.Agg.Manager 35000 exiting from join() loop
2018-11-03 14:50:33,165 DEBUG Lib.Thread.Agg.Keeper 35000 finished execution of command: START_AGG
2018-11-03 14:50:33,666 DEBUG ERROR        35000 Exception happened:
2018-11-03 14:50:33,666 DEBUG ERROR        35000 SQLState: null
2018-11-03 14:50:33,666 DEBUG ERROR        35000 Vendor:  0
2018-11-03 14:50:33,666 DEBUG ERROR        35000 java.sql.SQLException: The connection has been disconnected
2018-11-03 14:50:33,666 DEBUG ERROR        35000 Stack Trace:
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at db.disconnection.Factory$5.loadObject(Factory.java:157)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at db.disconnection.Factory$ProxyDisconnector$$EnhancerByCGLIB$$4a7b75be.rollback(<generated>)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at GIMAgg.process.Writer$Write.agg(Writer.java:231)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at GIMAgg.process.Writer$Write.access$300(Writer.java:148)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at GIMAgg.process.Writer$Msg$3.invoke(Writer.java:56)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at GIMAgg.process.Writer$Msg$3.invoke(Writer.java:54)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at GIMAgg.process.Writer.executeCommand(Writer.java:143)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at GIMAgg.process.Writer.executeCommand(Writer.java:30)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at common.thread.SimpleMonitor.run(SimpleMonitor.java:62)
2018-11-03 14:50:33,666 DEBUG ERROR        35000 at java.lang.Thread.run(Thread.java:745)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 Exception happened:
2018-11-03 14:50:33,667 DEBUG ERROR        35000 SQLState: null
2018-11-03 14:50:33,667 DEBUG ERROR        35000 Vendor:  0
2018-11-03 14:50:33,667 DEBUG ERROR        35000 java.sql.SQLException: The connection has been disconnected
2018-11-03 14:50:33,667 DEBUG ERROR        35000 Stack Trace:
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at db.disconnection.Factory$5.loadObject(Factory.java:157)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at db.disconnection.Factory$ProxyDisconnector$$EnhancerByCGLIB$$4a7b75be.rollback(<generated>)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at GIMAgg.process.Writer$Write.agg(Writer.java:231)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at GIMAgg.process.Writer$Write.access$300(Writer.java:148)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at GIMAgg.process.Writer$Msg$3.invoke(Writer.java:56)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at GIMAgg.process.Writer$Msg$3.invoke(Writer.java:54)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at GIMAgg.process.Writer.executeCommand(Writer.java:143)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at GIMAgg.process.Writer.executeCommand(Writer.java:30)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at common.thread.SimpleMonitor.run(SimpleMonitor.java:62)
2018-11-03 14:50:33,667 DEBUG ERROR        35000 at java.lang.Thread.run(Thread.java:745)
2018-11-03 14:50:33,667 ERROR Lib.Thread.Agg.Manager 20000 caught an exception. Monitor: Agg.Writer.0 Message: Agg.Writer.0: unable to execute command: Agg
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 SQLState: null
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 Vendor:  0
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 java.sql.SQLException: The connection has been disconnected
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 Stack Trace:
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at db.disconnection.Factory$5.loadObject(Factory.java:157)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at db.disconnection.Factory$ProxyDisconnector$$EnhancerByCGLIB$$4a7b75be.rollback(<generated>)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at GIMAgg.process.Writer$Write.agg(Writer.java:231)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at GIMAgg.process.Writer$Write.access$300(Writer.java:148)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at GIMAgg.process.Writer$Msg$3.invoke(Writer.java:56)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at GIMAgg.process.Writer$Msg$3.invoke(Writer.java:54)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at GIMAgg.process.Writer.executeCommand(Writer.java:143)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at GIMAgg.process.Writer.executeCommand(Writer.java:30)
2018-11-03 14:50:33,668 ERROR Lib.Thread.Agg.Manager 20000 at common.thread.SimpleMonitor.run(SimpleMonitor.java:62)
2018-11-03 14:50:33,669 ERROR Lib.Thread.Agg.Manager 20000 at java.lang.Thread.run(Thread.java:745)

[mic]

also i need to now how to speed up the aggregation, i have configured the GIM to extract data of 9 hours per job, but after running the extract and transform job manually many times, and then running the aggregation job, the delay still 9 hours.
as i understand, if the chunk size is equal to the amount of delayed time on SAP, then running only one extract and transform job then aggregate should compensate the delay.
However, this is not the case, i am running the aggregation since yesterday but the delay on SAP is still the same.

<html><head><meta name="viewport" content="width=device-width, minimum-scale=0.1"><title>Capture.PNG (338×248)</title></head><body style="margin: 0px; background: #0e0e0e;"><img style="-webkit-user-select: none;" src="file:///C:/Users/Michael/Desktop/Capture.PNG"></body></html>

[hsujdik]

Can you send the logs from before that line?

Also:

[quote]
also i need to now how to speed up the aggregation, i have configured the GIM to extract data of 9 hours per job, but after running the extract and transform job manually many times, and then running the aggregation job, the delay still 9 hours.
[/quote]

In fact, you have to decrease the value of the option gim-etl\extract-data-chunk-size (and not increase it). Try setting it to a lower value, such as 900 (seconds). In addition, check the value of the option gim-etl\extract-data-stuck-threshold and gim-etl\delayed-data-threshold. If ICONs are not populating properly, GIM might wait for those times to expire before proceeding with data transformation.

Just reinforcing that Info Mart and Interactive Insights are for historical reporting, and not real-time reporting.