Thu Jul 07, 2022 7:06 am
Login Register Lost Password? Contact Us

Please Note: The HPCC Systems forums are moving to Stack Overflow. We invite you to post your questions on Stack Overflow utilizing the tag hpcc-ecl ( This legacy forum will be active and monitored during our transition to Stack Overflow but will become read only beginning September 1, 2022.

spray latency

Comments or questions specific to the features of ECL Watch

Wed Jan 25, 2012 8:55 pm Change Time Zone

I noticed the spray job sometimes takes a minute or two to start doing work. Is this something I can speed up?

By "doing work" I mean the percent done shows 0% for a little while and then it speeds through the file.
Posts: 86
Joined: Wed Jul 13, 2011 7:40 pm

Thu Jan 26, 2012 1:25 pm Change Time Zone

How are you spraying? Via the ECL watch, DFUPlus, or through the ECL Libraries?
ECL watch may give you a delay, but using DFUPlus or ECL code you cn perhaps speed things up a bit.


Community Advisory Board Member
Community Advisory Board Member
Posts: 1006
Joined: Wed Jun 29, 2011 7:13 pm

Thu Jan 26, 2012 3:09 pm Change Time Zone

That's good info, I'm mostly using ECL watch. I'll use the ECL libraries and report back if it has any latency.
Posts: 86
Joined: Wed Jul 13, 2011 7:40 pm

Tue Sep 17, 2013 11:37 am Change Time Zone

The type of file being sprayed is a significant factor on the "lag time" before initiating "work".

The fastest sprays will always be fixed length files.

Variable length files will always take longer to initiate.

The system calculates the file positions before beginning the spray, to avoid splitting the file a within record when it is distributing the file accross the cluster. It spins through the entire file first before initiating the spray. The larger the variable length the longer the calculation(s) will take.
Posts: 5
Joined: Tue Apr 03, 2012 2:49 pm

Return to ECL Watch

Who is online

Users browsing this forum: No registered users and 1 guest