Mon Nov 29, 2021 8:50 pm
Login Register Lost Password? Contact Us


ECL OUTPUT

Comments and questions related to the Enterprise Control Language

Tue Sep 25, 2018 4:01 pm Change Time Zone

I have an issue to print the count or the output of a dataset I just sprayed. The dataset is 174MB and is made of 46 fields. After uploading the file and spraying, I created a layout file for it. Then I tried to show either a count or the full output exactly like what is done in the HPCC Data Tutorial. But, I keep getting the following error:

System error: 1300: Graph graph1[1], diskcount[2]: SLAVE #1 [192.168.159.128:20100]: Memory limit exceeded: current 1, requested 5552, limit 2992 active(1) heap(1/3008), Memory limit exceeded: current 1, requested 5552, limit 2992 active(1) heap(1/3008) - handling file: /var/lib/HPCCSystems/hpcc-data/thor/cs4322/project/voters_8.csv._1_of_1 - caused by (1300, Memory limit exceeded: current 1, requested 5552, limit 2992 active(1) heap(1/3008))

How can solve that?
vzeufack
 
Posts: 41
Joined: Tue Sep 25, 2018 3:52 pm

Wed Sep 26, 2018 7:38 pm Change Time Zone

vzeufack,

It would help if you could post the code that generates that error message so we could see the exact syntax you're using.

HTH,

Richard
rtaylor
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 1604
Joined: Wed Oct 26, 2011 7:40 pm

Thu Sep 27, 2018 1:43 am Change Time Zone

Hi rtaylor,

I fortunately found the issue. The issue was about the way I outputed the dataset. I was using the following code:

“OUTPUT (“~file_scope::name”, layout, THOR”);

I just changed it to

OUTPUT (“~file_scope::name”, layout, CSV(HEADING(1)));

It works fine now. I still do not know why I was getting memory error when using THOR as parameter.
vzeufack
 
Posts: 41
Joined: Tue Sep 25, 2018 3:52 pm

Thu Sep 27, 2018 1:32 pm Change Time Zone

vzeufack,
I still do not know why I was getting memory error when using THOR as parameter.
It's likely due to the fact that the THOR option on OUTPUT doesn't have any second "layout" parameter (https://hpccsystems.com/training/documentation/ecl-language-reference/html/OUTPUT_Workunit_Files.html). You "confused" the compiler. :)

It would probably have worked if you'd coded it like this:
Code: Select all
OUTPUT ('~file_scope::name',  THOR)

HTH,

Richard
rtaylor
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 1604
Joined: Wed Oct 26, 2011 7:40 pm

Fri Sep 28, 2018 1:41 am Change Time Zone

OK Thanks!
vzeufack
 
Posts: 41
Joined: Tue Sep 25, 2018 3:52 pm


Return to ECL

Who is online

Users browsing this forum: Bing [Bot] and 1 guest

cron