Weird behaviour of HPCC-JDBC Driver
Hi,
Our general usage scenario is :
Via a web application multiple users(at a time) are adding sub-files to super-files and also reading the super-files via the HPCC-JDBC driver on THOR.
Code snippet :
Behaviour of HPCC-JDBC java code is different everytime.We are facing different issues such as:
Issue 1:
Issue 2:
Issue 3:
Sometimes it works as required.
Where can be the cause?
Thanks and Regards!
Our general usage scenario is :
Via a web application multiple users(at a time) are adding sub-files to super-files and also reading the super-files via the HPCC-JDBC driver on THOR.
Code snippet :
- Code: Select all
info.put("ServerAddress", "10.101.2.170"); // your HPCC address
// here
info.put("LazyLoad", "true");
info.put("TraceToFile", "false");
info.put("TraceLevel", "boguslevel");
info.put("ReadTimeoutMilli", "30000"); // we have a couple of
// long running queries
info.put("TargetCluster", "thor"); // queries will run on
// this
// HPCC target cluster
info.put("QuerySet", "thor"); // published HPCC queries will run
// from this queryset
info.put("WsECLWatchPort", "8010"); // Target HPCC configured to
// run WsECLWatch on this
// port
// info.put("WsECLDirectPort", "8008"); // Target HPCC
// configured
// to run WsECLDirect on
// this port
info.put("EclResultLimit", "ALL"); // I want all records
// returned
info.put("PageSize", "20"); // GetTables and GetProcs will only
// return 20 entries
Behaviour of HPCC-JDBC java code is different everytime.We are facing different issues such as:
Issue 1:
- Code: Select all
local user login
You are authorized to proceed.293705
domain is Retail Banking
2013/02/14 02:46:40.935 - HPCC JDBC Driver registered.
2013/02/14 02:46:40.935 - HPCC JDBC Driver registered.
-----------------Driver Properties----------------------------------
ServerAddress: Target HPCC ESP Address (used to contact WsECLWatch, WsECLDirect, or WsECL if override not specified).
WsECLWatchAddress: WsECLWatch address (required if different than ServerAddress).
WsECLWatchPort: WsECLWatch port (required if HPCC configuration does not use default port).
WsECLAddress: WsECLAddress Address (required if different than ServerAddress).
WsECLPort: WsECL port (required if HPCC configuration does not use default port).
WsECLDirectAddress: WsECLDirect Address (required if different than ServerAddress).
WsECLDirectPort: WsECLDirect port (required if HPCC configuration does not use default port).
username: HPCC username (*Use JDBC client secure interface if available*).
password: HPCC password (*Use JDBC client secure interface if available*).
PageOffset: Starting HPCC data file or HPCC published queries displayed.
PageSize: Number of HPCC data files (DB tables) or HPCC published queries (DB Stored Procs) displayed.
QuerySet: Queryset from which published query (Stored Procedure) is chosen.
TargetCluster: Target cluster on which to execute ECL code.
TraceToFile: false -> System.out, true -> D:\Program Files\eclipse\HPCCJDBC.log
TraceLevel: Logging level (java.util.logging.level).
EclResultLimit: Default limit on number of result records returned.
LazyLoad: If disabled, all HPCC metadata loaded and cached at connect time; otherwise HPCC file, and published query info is loaded on-demand
ReadTimeoutMilli: HPCC requests connection read time out value in milliseconds.
ConnectTimeoutMilli: HPCC requests connection time out value in milliseconds.
--------------------------------------------------------------------
*****ldriver : [email protected]
2013/02/14 02:46:40.966 - HPCCConnection jdbc url:
2013/02/14 02:46:40.966 - HPCCConnection jdbc url:
2013/02/14 02:46:40.966 - Couldn't determine log level, will log at default level: INFO
2013/02/14 02:46:40.966 - Couldn't determine log level, will log at default level: INFO
2013/02/14 02:46:40.966 - HPCCDriver::connect10.101.2.170
2013/02/14 02:46:40.966 - HPCCDriver::connect10.101.2.170
2013/02/14 02:46:40.966 - HPCCDatabaseMetaData ServerAddress: 10.101.2.170 TargetCluster: thor eclwatch: http://10.101.2.170:8010
2013/02/14 02:46:40.966 - HPCCDatabaseMetaData ServerAddress: 10.101.2.170 TargetCluster: thor eclwatch: http://10.101.2.170:8010
2013/02/14 02:46:40.982 - HPCCDatabaseMetaData Fetching HPCC INFO: http://10.101.2.170:8010/WsSMC/Activity?rawxml_
2013/02/14 02:46:40.982 - HPCCDatabaseMetaData Fetching HPCC INFO: http://10.101.2.170:8010/WsSMC/Activity?rawxml_
2013/02/14 02:47:11.499 - Could not fetch HPCC info.
2013/02/14 02:47:11.499 - Could not fetch HPCC info.
2013/02/14 02:47:42.000 - Could not fetch cluster information.
2013/02/14 02:47:42.000 - Could not fetch cluster information.
2013/02/14 02:48:12.517 - Could not fetch cluster information.
2013/02/14 02:48:12.517 - Could not fetch cluster information.
2013/02/14 02:48:12.517 - HPCC file and published query info not pre-fetched (LazyLoad enabled)
2013/02/14 02:48:12.517 - HPCC file and published query info not pre-fetched (LazyLoad enabled)
2013/02/14 02:48:12.517 - Could not query HPCC metadata check server address, cluster name, wsecl, and wseclwatch configuration.
2013/02/14 02:48:12.517 - Could not query HPCC metadata check server address, cluster name, wsecl, and wseclwatch configuration.
2013/02/14 02:48:12.517 - HPCCDatabaseMetaData initialized
2013/02/14 02:48:12.517 - HPCCDatabaseMetaData initialized
2013/02/14 02:48:12.517 - HPCCConnection initialized - server: 10.101.2.170
2013/02/14 02:48:12.517 - HPCCConnection initialized - server: 10.101.2.170
2013/02/14 02:48:12.517 - HPCCConnection: createStatement( )
2013/02/14 02:48:12.517 - HPCCConnection: createStatement( )
2013/02/14 02:48:12.580 - HPCCStatementConstructor(conn)
2013/02/14 02:48:12.580 - HPCCStatementConstructor(conn)
2013/02/14 02:48:12.580 - HPCCStatementAttempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.580 - HPCCStatementAttempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.580 - INCOMING SQL: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.580 - INCOMING SQL: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.595 - Fetching file information: http://10.101.2.170:8010/WsDfu/DFUQuery?LogicalName=SAPPHIRE::SUPERFILE::BUZZMONITORING&rawxml_&filetype=Logical Files and Superfiles
2013/02/14 02:48:12.595 - Fetching file information: http://10.101.2.170:8010/WsDfu/DFUQuery?LogicalName=SAPPHIRE::SUPERFILE::BUZZMONITORING&rawxml_&filetype=Logical Files and Superfiles
2013/02/14 02:48:43.128 - Warning: Connection to HPCC timed out while fetching: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - Warning: Connection to HPCC timed out while fetching: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - HPCCStatement: execute()
2013/02/14 02:48:43.128 - HPCCStatement: execute()
2013/02/14 02:48:43.128 - Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:43.128 - Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:43.128 - HPCCStatement: executeQuery()
2013/02/14 02:48:43.128 - HPCCStatement: executeQuery()
2013/02/14 02:48:43.128 - Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:43.128 - Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
Exception caught =HPCCStatement: Cannot execute SQL command
Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
java.sql.SQLException: HPCCStatement: Cannot execute SQL command
Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
________________________________________
The contents of this e-mail and any attachment(s) may contain confidential or privileged information for the intended recipient(s). Unintended recipients are prohibited from taking action on the basis of information in this e-mail and using or disseminating the information, and must notify the sender and delete it from their system. L&T Infotech will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in this e-mail"
Issue 2:
- Code: Select all
java.sql.SQLException: HTTP Connection Response code: -1
Issue 3:
- Code: Select all
local user login
You are authorized to proceed.293705
domain is Retail Banking
*****ldriver : org.hpccsystems.jdbcdrive[email protected]
2013/02/14 05:20:25.689 - HPCCConnection jdbc url:
2013/02/14 05:20:25.689 - Couldn't determine log level, will log at default level: INFO
2013/02/14 05:20:25.689 - HPCCDriver::connect10.101.2.170
2013/02/14 05:20:25.689 - HPCCDatabaseMetaData ServerAddress: 10.101.2.170 TargetCluster: thor eclwatch: http://10.101.2.170:8010
2013/02/14 05:20:25.689 - HPCCDatabaseMetaData Fetching HPCC INFO: http://10.101.2.170:8010/WsSMC/Activity?rawxml_
2013/02/14 05:20:56.205 - Could not fetch HPCC info.
2013/02/14 05:21:26.721 - Could not fetch cluster information.
2013/02/14 05:21:57.222 - Could not fetch cluster information.
2013/02/14 05:21:57.222 - HPCC file and published query info not pre-fetched (LazyLoad enabled)
2013/02/14 05:21:57.222 - Could not query HPCC metadata check server address, cluster name, wsecl, and wseclwatch configuration.
2013/02/14 05:21:57.222 - HPCCDatabaseMetaData initialized
2013/02/14 05:21:57.222 - HPCCConnection initialized - server: 10.101.2.170
2013/02/14 05:21:57.222 - HPCCConnection: createStatement( )
2013/02/14 05:21:57.222 - HPCCStatementConstructor(conn)
2013/02/14 05:21:57.222 - HPCCStatementAttempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 05:21:57.222 - INCOMING SQL: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 05:21:57.237 - Fetching file information: http://10.101.2.170:8010/WsDfu/DFUQuery?LogicalName=SAPPHIRE::SUPERFILE::BUZZMONITORING&rawxml_&filetype=Logical Files and Superfiles
2013/02/14 05:22:27.753 - Warning: Connection to HPCC timed out while fetching: SAPPHIRE::SUPERFILE::BUZZMONITORING
java.sql.SQLException: HPCCStatement: Cannot execute SQL command
Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
at org.hpccsystems.jdbcdriver.HPCCStatement.executeHPCCQuery(HPCCStatement.java:110)
2013/02/14 05:22:27.753 - Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 05:22:27.753 - HPCCStatement: execute()
2013/02/14 05:22:27.753 - Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 05:22:27.753 - HPCCStatement: executeQuery()
2013/02/14 05:22:27.753 - Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
Exception caught =HPCCStatement: Cannot execute SQL command
Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
at org.hpccsystems.jdbcdriver.HPCCStatement.execute(HPCCStatement.java:255)
at org.hpccsystems.jdbcdriver.HPCCStatement.execute(HPCCStatement.java:245)
at SapphireClient.hpcc.actions.cHPCCResultsetMaster.ResultSet(cHPCCResultsetMaster.java:147)
at SapphireClient.web.actions.cBuzzRedirectAction.execute(cBuzzRedirectAction.java:39)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at com.opensymphony.xwork2.DefaultActionInvocation.invokeAction(DefaultActionInvocation.java:440)
at com.opensymphony.xwork2.DefaultActionInvocation.invokeActionOnly(DefaultActionInvocation.java:279)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:242)
at com.opensymphony.xwork2.interceptor.DefaultWorkflowInterceptor.doIntercept(DefaultWorkflowInterceptor.java:163)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.validator.ValidationInterceptor.doIntercept(ValidationInterceptor.java:249)
at org.apache.struts2.interceptor.validation.AnnotationValidationInterceptor.doIntercept(AnnotationValidationInterceptor.java:68)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.ConversionErrorInterceptor.intercept(ConversionErrorInterceptor.java:122)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:195)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:195)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.StaticParametersInterceptor.intercept(StaticParametersInterceptor.java:148)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at org.apache.struts2.interceptor.CheckboxInterceptor.intercept(CheckboxInterceptor.java:93)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at org.apache.struts2.interceptor.FileUploadInterceptor.intercept(FileUploadInterceptor.java:235)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.ModelDrivenInterceptor.intercept(ModelDrivenInterceptor.java:89)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.ScopedModelDrivenInterceptor.intercept(ScopedModelDrivenInterceptor.java:128)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at org.apache.struts2.interceptor.ProfilingActivationInterceptor.intercept(ProfilingActivationInterceptor.java:104)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at org.apache.struts2.interceptor.debugging.DebuggingInterceptor.intercept(DebuggingInterceptor.java:267)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.ChainingInterceptor.intercept(ChainingInterceptor.java:126)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.PrepareInterceptor.doIntercept(PrepareInterceptor.java:138)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.I18nInterceptor.intercept(I18nInterceptor.java:148)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at org.apache.struts2.interceptor.ServletConfigInterceptor.intercept(ServletConfigInterceptor.java:164)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.AliasInterceptor.intercept(AliasInterceptor.java:128)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at com.opensymphony.xwork2.interceptor.ExceptionMappingInterceptor.intercept(ExceptionMappingInterceptor.java:176)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
at org.apache.struts2.impl.StrutsActionProxy.execute(StrutsActionProxy.java:52)
at org.apache.struts2.dispatcher.Dispatcher.serviceAction(Dispatcher.java:468)
at org.apache.struts2.dispatcher.FilterDispatcher.doFilter(FilterDispatcher.java:395)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:225)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1001)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:312)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Sometimes it works as required.
Where can be the cause?
Thanks and Regards!
- prachi
- Posts: 46
- Joined: Mon Jul 23, 2012 11:50 am
1 post
• Page 1 of 1
Who is online
Users browsing this forum: No registered users and 1 guest