Tue Aug 21, 2018 11:48 pm
Login Register Lost Password? Contact Us


Support nodes

Topics related to recommendations or questions on the design for HPCC Systems clusters

Tue Jun 02, 2015 6:33 pm Change Time Zone

Hi,

Is there a rule of thumb for determining the no of support nodes required for a Thor cluster?

Would 1 support node be sufficient for a 10 node Thor cluster processing around 3 TB of data?

Thanks,
-David
jeeves
 
Posts: 68
Joined: Fri Sep 07, 2012 9:28 am

Tue Jun 02, 2015 8:05 pm Change Time Zone

David,
Would 1 support node be sufficient for a 10 node Thor cluster processing around 3 TB of data?
Probably, depending on how much continuous work you're doing with the system. For production systems it is good to have separation, even if that separation is achieved by having the infrastructure run in separate VMs on the same box.

For example, in our production environments we usually keep each support process (Dali, DFU Server, etc.) on it's own "box" (which may be physical or virtual, depending on the environment) for separation of duties and fastest performance. In some cases we have multiple servers setup for each of the support services. So we may have as many as 15-20 actual support nodes working to support a single HPCC environment containing multiple 400-node clusters and any number of additional clusters of other various sizes (200-node, 100-node, 50-node, etc.). This is how we daily deal with the multiple Petabytes of data that we work with.

HTH,

Richard
rtaylor
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 1370
Joined: Wed Oct 26, 2011 7:40 pm

Wed Jun 03, 2015 1:37 pm Change Time Zone

Richard,

Thanks for the answer. It helped.

Thanks,
-David
jeeves
 
Posts: 68
Joined: Fri Sep 07, 2012 9:28 am


Return to Clustering

Who is online

Users browsing this forum: No registered users and 1 guest