Fri Dec 03, 2021 3:51 am
Login Register Lost Password? Contact Us


Installing thor on a shared cluster

Comments and questions related to the Enterprise Control Language

Tue Oct 25, 2011 8:16 pm Change Time Zone

So here is the situation. We have a cluster that is using other systems. It runs cassandra and hadoop. Is it possible to limit the Thor cluster so that it doesn't use all the CPU/memory?
nvasil
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 105
Joined: Mon Oct 17, 2011 6:48 pm

Thu Oct 27, 2011 6:37 pm Change Time Zone

Sure, THOR memory is set by the largememsize parameter in the config.

You could also use ulimit in linux.

Regards,

Bob
bforeman
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 1005
Joined: Wed Jun 29, 2011 7:13 pm

Thu Oct 27, 2011 6:46 pm Change Time Zone

Actually, thor's upper memory limit (per slave) is governed by globalMemorySize.
largeMemSize is mostly a legacy setting, but should be set at approximately 75% of the globalMemorySize setting.

You could use ulimit, but the processes would only be aware of it when the limit was hit I think, so keep things running smoothly, you'll want to use the settings above.
jsmith
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 81
Joined: Tue Jul 19, 2011 12:58 pm


Return to ECL

Who is online

Users browsing this forum: No registered users and 1 guest

cron