I am continuing to troublshoot some 503 issues with my new server. I recently enabled the Dump Snapshot feature inside Server Monitor and whenever I have an Unresponsive Server alert and I am seeing tons of these in the snapshot. Anyone know what this means exactly??
"ajp-bio-8012-exec-384" prio=5 tid=1261 BLOCKED
at coldfusion.server.j2ee.sql.pool.JDBCPool.checkOut(JDBCPool.java:371)
at coldfusion.server.j2ee.sql.pool.JDBCPool.requestConnection(JDBCPool.j ava:825)
at coldfusion.server.j2ee.sql.pool.JDBCManager.requestConnection(JDBCMan ager.java:125)
at coldfusion.server.j2ee.sql.JRunDataSource.getConnection(JRunDataSourc e.java:135)
at coldfusion.sql.CFDataSource.getConnection(CFDataSource.java:42)
at coldfusion.sql.DataSrcImpl.getCachedConnection(DataSrcImpl.java:156)
at coldfusion.sql.DataSrcImpl.getConnection(DataSrcImpl.java:110)
at coldfusion.sql.SqlImpl.execute(SqlImpl.java:363)
at coldfusion.tagext.sql.QueryTag.executeQuery(QueryTag.java:1059)
at coldfusion.tagext.sql.QueryTag.doEndTag(QueryTag.java:688)
at cfpageInitQrygetPortalInfo2ecfm582265125.runPage(E:\pathToMyPage.cfm: 24)
ETC...
And something like this during another similar event:
"ajp-bio-8012-exec-127" prio=5 tid=325 BLOCKED
at coldfusion.server.j2ee.pool.ObjectPool.checkIn(ObjectPool.java:263)
at coldfusion.server.j2ee.sql.pool.JDBCPool.returnConnection(JDBCPool.ja va:851)
at coldfusion.server.j2ee.sql.pool.JDBCPool.connectionClosed(JDBCPool.ja va:324)
at coldfusion.server.j2ee.sql.JRunConnection.sendCloseEvent(JRunConnecti on.java:345)
at coldfusion.server.j2ee.sql.JRunConnectionHandle.close(JRunConnectionH andle.java:72)
at coldfusion.sql.DataSrcImpl.clear(DataSrcImpl.java:182)
at coldfusion.sql.DataSrcImpl.clearSqlProxy(DataSrcImpl.java:25)
at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:26)
at coldfusion.filter.CachingFilter.invoke(CachingFilter.java:62)
at coldfusion.CfmServlet.service(CfmServlet.java:219)
at coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:8 9)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl icationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF ilterChain.java:210)
at coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringS ervletFilter.java:42)
at coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46 )
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl icationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF ilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperV alve.java:224)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextV alve.java:169)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authentica torBase.java:472)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.j ava:168)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.j ava:98)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java: 928)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineVal ve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.jav a:414)
at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:204)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process( AbstractProtocol.java:539)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoin t.java:298)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:615)
at java.lang.Thread.run(Thread.java:744)
The issues I'm having sound very similar to what's going on here and here but so far I have reached no conclusions. WTH is going on?
I have a brand new 64-bit Win2008/IIS7 machine (well, VMware if it makes any diff) running CF10 with the latest Update 12 patch, etc. I even updated the JRE to the latest version (1.7.0_45 at the time of this writing). I have done the whole Tomcat connector thing, modfied it several times with higher pool sizes, timeouts, etc., reinstalled the connector serveral times (the last being when I updated to CF10 Update 12). The JVM is perfectly configured. I've tried some of Carl's tweaks to no avail. Anit from Adobe Support has been helping me, too, and has done remote desktop sessions and seen my server and says all the settings look good, so he is sort of at a loss too except to analyze my logs whenever I send them, but I am not getting any concrete data that I think will help yet, as I am very familiar with what to look for in general. I've been doing CF for 16 years and never encountered such a stubborn issue.