Tue Oct 26, 2021 12:03 am
Login Register Lost Password? Contact Us


HPCC on Azure

Questions related to node architecture, redundancy and system monitoring

Sun May 18, 2014 7:11 pm Change Time Zone

Hello

We are running HPCC on Azure and I am wondering if anyone can recommend a way to test internode communication speeds on a multinode THOR cluster?

We need to run this from time to time to track if we are seeing any significant skews in terms of speed due to sudden changes in network speed.

Any suggestions would be appreciated.

David
David Dasher
 
Posts: 56
Joined: Tue Feb 18, 2014 9:17 am

Mon May 19, 2014 1:54 pm Change Time Zone

Hi David,

I'm still checking with the HPCC development team, but on my level I just normally use the Graphs on each ECL process to identify any hot spots or skew. As long as your nodes are relatively homogeneous, there shouldn't be any significant speed difference between them. But you can also look at the cluster processes in the ECL watch Topology section and monitor the logs.

Regards,

Bob
bforeman
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 1005
Joined: Wed Jun 29, 2011 7:13 pm

Mon May 19, 2014 3:10 pm Change Time Zone

Hi Bob

Many thanks for your reply, I will take a good look.

We are mainly looking for a tool that can profile how fast the data is coming off disk for HPCC and also what kind of internode network speed between the Thor nodes.

Kind regards

David
David Dasher
 
Posts: 56
Joined: Tue Feb 18, 2014 9:17 am

Mon May 19, 2014 3:16 pm Change Time Zone

Hi David,

I forgot to mention, there is also a Timings section for every workunit you submit. Just click on the ECL Watch tab and then look for the Timings link. The timings page is VERY detailed :-)

Regards,

Bob
bforeman
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 1005
Joined: Wed Jun 29, 2011 7:13 pm


Return to System Health

Who is online

Users browsing this forum: No registered users and 1 guest