Sat Aug 18, 2018 9:40 pm
Login Register Lost Password? Contact Us


Cassandra for Workunit Storage configuration help

Post questions specific to installation or configuration for the HPCC Systems platform

Wed Sep 28, 2016 1:02 pm Change Time Zone

Hmmm, ok - the protocol question was probably a red herring then.

You did start the cassandra service BEFORE you tried to start hpcc ?
richardkchapman
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 108
Joined: Fri Jun 17, 2011 8:59 am

Wed Sep 28, 2016 3:40 pm Change Time Zone

I didn't stop the cassandra service. it is still up and running.
Attached cassandra system log.
Attachments
system.log
(195.26 KiB) Downloaded 68 times
balajisampath
 
Posts: 63
Joined: Mon Jul 22, 2013 6:29 pm

Tue Oct 04, 2016 12:43 pm Change Time Zone

Still I couldn't make it work.Is there any workaround someone can suggest? Please let me know if any other information is needed.
balajisampath
 
Posts: 63
Joined: Mon Jul 22, 2013 6:29 pm

Tue Oct 04, 2016 1:49 pm Change Time Zone

I see this one line in the system.log.

INFO [main] 2016-09-28 12:34:07,106 CassandraDaemon.java:471 - Not starting RPC server as requested. Use JMX (StorageService->startRPCServer()) or nodetool (enablethrift) to start it

I'm not familiar enough with Cassandra to recommend a fix but I do see some articles out there on stackoverflow that might suggest some possible solutions.
clo
 
Posts: 51
Joined: Thu May 12, 2011 11:57 am

Wed Oct 05, 2016 2:55 pm Change Time Zone

Thank You clo

Looks like some issue with cassandra 3.x. Once I installed 2.1 I was able to make the configuration work.

Now I am unable run any workunit. Please refer attachment.
Looks like the below issue is not resolved
https://track.hpccsystems.com/browse/HPCC-15124

BTW my thor is down. attached the log file.

Please help
Attachments
1.jpg
Error message
1.jpg (142.81 KiB) Viewed 591 times
thormaster.2016_10_05.log
Thor log
(27.9 KiB) Downloaded 65 times
balajisampath
 
Posts: 63
Joined: Mon Jul 22, 2013 6:29 pm

Wed Oct 05, 2016 4:09 pm Change Time Zone

Are you trying to do all this on one of the vms we provide? If so, the resources on the vm itself might be limiting your progress.

It looks like the thor ran out of memory:

00000001 2016-10-05 13:11:13.586 4251 4251 "Opened log file //192.168.56.101/var/log/HPCCSystems/mythor/thormaster.2016_10_05.log"
00000002 2016-10-05 13:11:13.587 4251 4251 "Build community_6.0.4-1"
00000003 2016-10-05 13:11:13.587 4251 4251 "calling initClientProcess Port 20000"
00000004 2016-10-05 13:11:13.591 4251 4251 "Global memory size = 374 MB"
00000005 2016-10-05 13:11:13.591 4251 4251 "RoxieMemMgr: Setting memory limit to 392167424 bytes (1496 pages)"
00000006 2016-10-05 13:11:13.591 4251 4251 "RoxieMemMgr: posix_memalign (alignment=262144, size=394264576) failed - ret=12 (ENOMEM There was insufficient memory to fulfill the allocation request.)"
00000007 2016-10-05 13:11:13.591 4251 4251 "ERROR: 1303: /var/lib/jenkins2/workspace/CE-Candidate-6.0.4-1/CE/ubuntu-14.04-amd64/HPCC-Platform/thorlcr/master/thmastermain.cpp(753) : ThorMaster : RoxieMemMgr: Unable to create heap"
clo
 
Posts: 51
Joined: Thu May 12, 2011 11:57 am

Wed Oct 05, 2016 5:06 pm Change Time Zone

Yes I am using VM version. I got WU create error while executing in roxie which is up and running.
balajisampath
 
Posts: 63
Joined: Mon Jul 22, 2013 6:29 pm

Wed Oct 05, 2016 6:47 pm Change Time Zone

I think your underlying problem is still going to be that your VM doesn't have enough memory resource to be able to handle all the things you're trying to do. You can try to increase the amount of memory from the VM box manager, however I'll need to consult with a subject matter expert in order to give you better information.

For reference, what is the version of the hpccsystems platform are you using? Is it 32bit or 64bit?
clo
 
Posts: 51
Joined: Thu May 12, 2011 11:57 am

Thu Oct 06, 2016 12:23 pm Change Time Zone

it's 64 bit
VirtualBox version 5.1.6
HPCCSystemsVM-amd64-6.0.4-1
Cassandra 2.1
balajisampath
 
Posts: 63
Joined: Mon Jul 22, 2013 6:29 pm

Wed Oct 19, 2016 8:21 pm Change Time Zone

Increased the VM memory and now all looks good but, still getting the error message when I submit workunits. thor and roxie is up , cassandra is up and configured as workunti storage.

WsWorkunits.WUCreate

<h3>Cannot read property 'Workunit' of undefined</h3><p>TypeError: Cannot read property 'Workunit' of undefined at Object.load (http://192.168.56.101:8010/esp/files/ec ... js:651:441) at http://192.168.56.101:8010/esp/files/ec ... js:470:446 at g (http://192.168.56.101:8010/esp/files/ec ... c.js:103:1) at m (http://192.168.56.101:8010/esp/files/ec ... js:102:430) at k.resolve (http://192.168.56.101:8010/esp/files/ec ... js:104:332) at a (http://192.168.56.101:8010/esp/files/ec ... js:103:295) at g (http://192.168.56.101:8010/esp/files/ec ... js:103:124) at m (http://192.168.56.101:8010/esp/files/ec ... js:102:430) at k.resolve (http://192.168.56.101:8010/esp/files/ec ... js:104:332) at a (h...
... ... ...

below tables are created in cassandra
wustatistics wuexceptions workunits uniquesearchvalues
filessearchvalues wugraphs wutemporaries wugraphrunning
workunitssearch wufileswritten wufilesread
wuqueries wuvariables wugraphstate
wugraphprogress version wuresults
balajisampath
 
Posts: 63
Joined: Mon Jul 22, 2013 6:29 pm

PreviousNext

Return to Installation

Who is online

Users browsing this forum: No registered users and 1 guest

cron