Thu Jun 30, 2022 8:31 pm
Login Register Lost Password? Contact Us

Please Note: The HPCC Systems forums are moving to Stack Overflow. We invite you to post your questions on Stack Overflow utilizing the tag hpcc-ecl (https://stackoverflow.com/search?tab=newest&q=hpcc-ecl). This legacy forum will be active and monitored during our transition to Stack Overflow but will become read only beginning September 1, 2022.



Weird behaviour of HPCC-JDBC Driver

Topics around the use of the JDBC driver for HPCC Systems
Post a reply

Weird behaviour of HPCC-JDBC Driver

Thu Feb 14, 2013 11:25 am Change Time Zone

Hi,
Our general usage scenario is :
Via a web application multiple users(at a time) are adding sub-files to super-files and also reading the super-files via the HPCC-JDBC driver on THOR.

Code snippet :
Code: Select all
info.put("ServerAddress", "10.101.2.170"); // your HPCC address
                                             // here
            info.put("LazyLoad", "true");
            info.put("TraceToFile", "false");
            info.put("TraceLevel", "boguslevel");
            info.put("ReadTimeoutMilli", "30000"); // we have a couple of
                                          // long running queries
            info.put("TargetCluster", "thor"); // queries will run on
                                          // this
                                          // HPCC target cluster
            info.put("QuerySet", "thor"); // published HPCC queries will run
                                    // from this queryset
            info.put("WsECLWatchPort", "8010"); // Target HPCC configured to
                                       // run WsECLWatch on this
                                       // port
            // info.put("WsECLDirectPort", "8008"); // Target HPCC
            // configured
            // to run WsECLDirect on
            // this port
            info.put("EclResultLimit", "ALL"); // I want all records
                                       // returned
            info.put("PageSize", "20"); // GetTables and GetProcs will only
                                 // return 20 entries



Behaviour of HPCC-JDBC java code is different everytime.We are facing different issues such as:

Issue 1:
Code: Select all
local user login
You are authorized to proceed.293705
domain is Retail Banking
2013/02/14 02:46:40.935 - HPCC JDBC Driver registered.
2013/02/14 02:46:40.935 - HPCC JDBC Driver registered.
-----------------Driver Properties----------------------------------
      ServerAddress: Target HPCC ESP Address (used to contact WsECLWatch, WsECLDirect, or WsECL if override not specified).
      WsECLWatchAddress: WsECLWatch address (required if different than ServerAddress).
      WsECLWatchPort: WsECLWatch port (required if HPCC configuration does not use default port).
      WsECLAddress: WsECLAddress Address (required if different than ServerAddress).
      WsECLPort: WsECL port (required if HPCC configuration does not use default port).
      WsECLDirectAddress: WsECLDirect Address (required if different than ServerAddress).
      WsECLDirectPort: WsECLDirect port (required if HPCC configuration does not use default port).
      username: HPCC username (*Use JDBC client secure interface if available*).
      password: HPCC password (*Use JDBC client secure interface if available*).
      PageOffset: Starting HPCC data file or HPCC published queries displayed.
      PageSize: Number of HPCC data files (DB tables) or HPCC published queries (DB Stored Procs) displayed.
      QuerySet: Queryset from which published query (Stored Procedure) is chosen.
      TargetCluster: Target cluster on which to execute ECL code.
      TraceToFile: false -> System.out, true -> D:\Program Files\eclipse\HPCCJDBC.log
      TraceLevel: Logging level (java.util.logging.level).
      EclResultLimit: Default limit on number of result records returned.
      LazyLoad: If disabled, all HPCC metadata loaded and cached at connect time; otherwise HPCC file, and published query info is loaded on-demand
      ReadTimeoutMilli: HPCC requests connection read time out value in milliseconds.
      ConnectTimeoutMilli: HPCC requests connection time out value in milliseconds.

--------------------------------------------------------------------
*****ldriver : [email protected]
2013/02/14 02:46:40.966 - HPCCConnection jdbc url:
2013/02/14 02:46:40.966 - HPCCConnection jdbc url:
2013/02/14 02:46:40.966 - Couldn't determine log level, will log at default level: INFO
2013/02/14 02:46:40.966 - Couldn't determine log level, will log at default level: INFO
2013/02/14 02:46:40.966 - HPCCDriver::connect10.101.2.170
2013/02/14 02:46:40.966 - HPCCDriver::connect10.101.2.170
2013/02/14 02:46:40.966 - HPCCDatabaseMetaData ServerAddress: 10.101.2.170 TargetCluster: thor eclwatch: http://10.101.2.170:8010
2013/02/14 02:46:40.966 - HPCCDatabaseMetaData ServerAddress: 10.101.2.170 TargetCluster: thor eclwatch: http://10.101.2.170:8010
2013/02/14 02:46:40.982 - HPCCDatabaseMetaData Fetching HPCC INFO: http://10.101.2.170:8010/WsSMC/Activity?rawxml_
2013/02/14 02:46:40.982 - HPCCDatabaseMetaData Fetching HPCC INFO: http://10.101.2.170:8010/WsSMC/Activity?rawxml_
2013/02/14 02:47:11.499 - Could not fetch HPCC info.
2013/02/14 02:47:11.499 - Could not fetch HPCC info.
2013/02/14 02:47:42.000 - Could not fetch cluster information.
2013/02/14 02:47:42.000 - Could not fetch cluster information.
2013/02/14 02:48:12.517 - Could not fetch cluster information.
2013/02/14 02:48:12.517 - Could not fetch cluster information.
2013/02/14 02:48:12.517 - HPCC file and published query info not pre-fetched (LazyLoad enabled)
2013/02/14 02:48:12.517 - HPCC file and published query info not pre-fetched (LazyLoad enabled)
2013/02/14 02:48:12.517 - Could not query HPCC metadata check server address, cluster name, wsecl, and wseclwatch configuration.
2013/02/14 02:48:12.517 - Could not query HPCC metadata check server address, cluster name, wsecl, and wseclwatch configuration.
2013/02/14 02:48:12.517 - HPCCDatabaseMetaData initialized
2013/02/14 02:48:12.517 - HPCCDatabaseMetaData initialized
2013/02/14 02:48:12.517 - HPCCConnection initialized - server: 10.101.2.170
2013/02/14 02:48:12.517 - HPCCConnection initialized - server: 10.101.2.170
2013/02/14 02:48:12.517 - HPCCConnection: createStatement(  )
2013/02/14 02:48:12.517 - HPCCConnection: createStatement(  )
2013/02/14 02:48:12.580 - HPCCStatementConstructor(conn)
2013/02/14 02:48:12.580 - HPCCStatementConstructor(conn)
2013/02/14 02:48:12.580 - HPCCStatementAttempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.580 - HPCCStatementAttempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.580 - INCOMING SQL: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.580 - INCOMING SQL: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:12.595 - Fetching file information: http://10.101.2.170:8010/WsDfu/DFUQuery?LogicalName=SAPPHIRE::SUPERFILE::BUZZMONITORING&rawxml_&filetype=Logical Files and Superfiles
2013/02/14 02:48:12.595 - Fetching file information: http://10.101.2.170:8010/WsDfu/DFUQuery?LogicalName=SAPPHIRE::SUPERFILE::BUZZMONITORING&rawxml_&filetype=Logical Files and Superfiles
2013/02/14 02:48:43.128 - Warning: Connection to HPCC timed out while fetching: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - Warning: Connection to HPCC timed out while fetching: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 02:48:43.128 - HPCCStatement: execute()
2013/02/14 02:48:43.128 - HPCCStatement: execute()
2013/02/14 02:48:43.128 -     Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:43.128 -     Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:43.128 - HPCCStatement: executeQuery()
2013/02/14 02:48:43.128 - HPCCStatement: executeQuery()
2013/02/14 02:48:43.128 -     Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 02:48:43.128 -     Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
Exception caught =HPCCStatement:  Cannot execute SQL command
      Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
java.sql.SQLException: HPCCStatement:  Cannot execute SQL command
      Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING



________________________________________
The contents of this e-mail and any attachment(s) may contain confidential or privileged information for the intended recipient(s). Unintended recipients are prohibited from taking action on the basis of information in this e-mail and using or disseminating the information, and must notify the sender and delete it from their system. L&T Infotech will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in this e-mail"


Issue 2:
Code: Select all
java.sql.SQLException: HTTP Connection Response code: -1



Issue 3:
Code: Select all
local user login
You are authorized to proceed.293705
domain is Retail Banking
*****ldriver : org.hpccsystems.jdbcdrive[email protected]
2013/02/14 05:20:25.689 - HPCCConnection jdbc url:
2013/02/14 05:20:25.689 - Couldn't determine log level, will log at default level: INFO
2013/02/14 05:20:25.689 - HPCCDriver::connect10.101.2.170
2013/02/14 05:20:25.689 - HPCCDatabaseMetaData ServerAddress: 10.101.2.170 TargetCluster: thor eclwatch: http://10.101.2.170:8010
2013/02/14 05:20:25.689 - HPCCDatabaseMetaData Fetching HPCC INFO: http://10.101.2.170:8010/WsSMC/Activity?rawxml_
2013/02/14 05:20:56.205 - Could not fetch HPCC info.
2013/02/14 05:21:26.721 - Could not fetch cluster information.
2013/02/14 05:21:57.222 - Could not fetch cluster information.
2013/02/14 05:21:57.222 - HPCC file and published query info not pre-fetched (LazyLoad enabled)
2013/02/14 05:21:57.222 - Could not query HPCC metadata check server address, cluster name, wsecl, and wseclwatch configuration.
2013/02/14 05:21:57.222 - HPCCDatabaseMetaData initialized
2013/02/14 05:21:57.222 - HPCCConnection initialized - server: 10.101.2.170
2013/02/14 05:21:57.222 - HPCCConnection: createStatement(  )
2013/02/14 05:21:57.222 - HPCCStatementConstructor(conn)
2013/02/14 05:21:57.222 - HPCCStatementAttempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 05:21:57.222 - INCOMING SQL: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 05:21:57.237 - Fetching file information: http://10.101.2.170:8010/WsDfu/DFUQuery?LogicalName=SAPPHIRE::SUPERFILE::BUZZMONITORING&rawxml_&filetype=Logical Files and Superfiles
2013/02/14 05:22:27.753 - Warning: Connection to HPCC timed out while fetching: SAPPHIRE::SUPERFILE::BUZZMONITORING
java.sql.SQLException: HPCCStatement:  Cannot execute SQL command
      Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
      at org.hpccsystems.jdbcdriver.HPCCStatement.executeHPCCQuery(HPCCStatement.java:110)
2013/02/14 05:22:27.753 - Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
2013/02/14 05:22:27.753 - HPCCStatement: execute()
2013/02/14 05:22:27.753 -     Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
2013/02/14 05:22:27.753 - HPCCStatement: executeQuery()
2013/02/14 05:22:27.753 -     Attempting to process sql query: SELECT Search_Keyword,Search_Date,TwitterUniqueID FROM sapphire::superfile::buzzmonitoring where UserID='293705' group by TwitterUniqueID order by Search_Date desc
Exception caught =HPCCStatement:  Cannot execute SQL command
      Invalid or forbidden table found: SAPPHIRE::SUPERFILE::BUZZMONITORING
      at org.hpccsystems.jdbcdriver.HPCCStatement.execute(HPCCStatement.java:255)
      at org.hpccsystems.jdbcdriver.HPCCStatement.execute(HPCCStatement.java:245)
      at SapphireClient.hpcc.actions.cHPCCResultsetMaster.ResultSet(cHPCCResultsetMaster.java:147)
      at SapphireClient.web.actions.cBuzzRedirectAction.execute(cBuzzRedirectAction.java:39)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      at java.lang.reflect.Method.invoke(Unknown Source)
      at com.opensymphony.xwork2.DefaultActionInvocation.invokeAction(DefaultActionInvocation.java:440)
      at com.opensymphony.xwork2.DefaultActionInvocation.invokeActionOnly(DefaultActionInvocation.java:279)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:242)
      at com.opensymphony.xwork2.interceptor.DefaultWorkflowInterceptor.doIntercept(DefaultWorkflowInterceptor.java:163)
      at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.validator.ValidationInterceptor.doIntercept(ValidationInterceptor.java:249)
      at org.apache.struts2.interceptor.validation.AnnotationValidationInterceptor.doIntercept(AnnotationValidationInterceptor.java:68)
      at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.ConversionErrorInterceptor.intercept(ConversionErrorInterceptor.java:122)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:195)
      at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:195)
      at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.StaticParametersInterceptor.intercept(StaticParametersInterceptor.java:148)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at org.apache.struts2.interceptor.CheckboxInterceptor.intercept(CheckboxInterceptor.java:93)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at org.apache.struts2.interceptor.FileUploadInterceptor.intercept(FileUploadInterceptor.java:235)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.ModelDrivenInterceptor.intercept(ModelDrivenInterceptor.java:89)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.ScopedModelDrivenInterceptor.intercept(ScopedModelDrivenInterceptor.java:128)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at org.apache.struts2.interceptor.ProfilingActivationInterceptor.intercept(ProfilingActivationInterceptor.java:104)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at org.apache.struts2.interceptor.debugging.DebuggingInterceptor.intercept(DebuggingInterceptor.java:267)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.ChainingInterceptor.intercept(ChainingInterceptor.java:126)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.PrepareInterceptor.doIntercept(PrepareInterceptor.java:138)
      at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:87)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.I18nInterceptor.intercept(I18nInterceptor.java:148)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at org.apache.struts2.interceptor.ServletConfigInterceptor.intercept(ServletConfigInterceptor.java:164)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.AliasInterceptor.intercept(AliasInterceptor.java:128)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at com.opensymphony.xwork2.interceptor.ExceptionMappingInterceptor.intercept(ExceptionMappingInterceptor.java:176)
      at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:236)
      at org.apache.struts2.impl.StrutsActionProxy.execute(StrutsActionProxy.java:52)
      at org.apache.struts2.dispatcher.Dispatcher.serviceAction(Dispatcher.java:468)
      at org.apache.struts2.dispatcher.FilterDispatcher.doFilter(FilterDispatcher.java:395)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:225)
      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
      at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)
      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
      at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1001)
      at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
      at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:312)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
      at java.lang.Thread.run(Unknown Source)



Sometimes it works as required.

Where can be the cause?

Thanks and Regards!
prachi
 
Posts: 46
Joined: Mon Jul 23, 2012 11:50 am
Top
Post a reply

Return to Java Tools

Who is online

Users browsing this forum: No registered users and 1 guest