Mon Jul 04, 2022 12:43 am
Login Register Lost Password? Contact Us

Please Note: The HPCC Systems forums are moving to Stack Overflow. We invite you to post your questions on Stack Overflow utilizing the tag hpcc-ecl (https://stackoverflow.com/search?tab=newest&q=hpcc-ecl). This legacy forum will be active and monitored during our transition to Stack Overflow but will become read only beginning September 1, 2022.



Determining size of workunit dataset

Comments or questions specific to the features of ECL Watch

Tue Mar 24, 2020 2:31 pm Change Time Zone

I'm running some large DISTRIBUTION functions and we have some concerns over the size of the output in the Workunit. Is there a way for me to tell the size of a workunit output? DISTRIBUTION does not give the option to save to a logical file. So as we move to the cloud, I want to make sure we limit the size of our outputs where possible.

Thanks,
Tim N, Sr Data Eng, LN
newportm
 
Posts: 22
Joined: Tue Nov 15, 2016 2:48 pm

Wed Mar 25, 2020 2:05 pm Change Time Zone

I don't think there is directly.

However, I would recommend taking a look at the DataPatterns bundle that is now merged into the standard library (Std.DataPatterns). It provides the functionality of DISTRIBUTION plus much more.
ghalliday
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 199
Joined: Wed May 18, 2011 9:48 am


Return to ECL Watch

Who is online

Users browsing this forum: No registered users and 1 guest

cron