Sat Feb 22, 2020 3:41 pm
Login Register Lost Password? Contact Us


DFUPlus Not Overwriting Files During Spray

Comments or questions specific to the features of ECL Watch

Wed Jun 01, 2016 10:03 pm Change Time Zone

Hello,

I've made some changes to files in the the dropzone, and I'm trying to respray them to update the changes. I'm using DFUPlus and I've changed the "overwrite" flag to "1", but all spray jobs fail. The error I'm getting says:
Failed: DFS Exception: 1: logical name nfl::2013::11::pa::2013111710.csv already exists.
The workunit for the failed spray operation registers that the overwrite flag is true (picture attached), so I don't understand why the server complains about the filename already existing. That's the intention! Below are the values passed to DFUPlus.

action=spray
server=<removed>
dstcluster=mythor
username=<removed>
password=<removed>
srcfile=/var/lib/HPCCSystems/mydropzone/nfl/2013/11/pa/2013111710.csv
dstname=nfl::2013::11::pa::2013111710.csv
format=delimited
separator=|
overwrite=1
nowait=0
autorecover=2

This is using client-tools version 5.6.2-1 and platform version 5.6.2-1 on Ubuntu 14.04 LTS.

Thanks,
Daniel
Attachments
OverwriteFail.png
(21.64 KiB) Downloaded 768 times
demills
 
Posts: 3
Joined: Mon Feb 01, 2016 2:03 am

Fri Jun 03, 2016 6:31 pm Change Time Zone

demills,

You should use JIRA (https://track.hpccsystems.com) to report the issue to the developers.

HTH,

Richard
rtaylor
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 1519
Joined: Wed Oct 26, 2011 7:40 pm

Fri Jun 03, 2016 7:19 pm Change Time Zone

Is the file used in a published query?

Publishing a query locks a file which would prevent overwriting it even with overwrite specified.

HTH,

Jim
JimD
 
Posts: 147
Joined: Wed May 18, 2011 1:35 pm

Fri Jun 03, 2016 11:07 pm Change Time Zone

JimD,

No, but these are sub-files of super-files. I've checked the "ECL Programmer's Guide" on working with super-files, and it only mentions deleting and adding new sub-files to super-files. Is overwriting sub-files allowed in 5.6.2?

Thanks,
Daniel
demills
 
Posts: 3
Joined: Mon Feb 01, 2016 2:03 am

Mon Jun 06, 2016 3:17 pm Change Time Zone

I try to reproduce this problem:

If the target file doesn't belong to any superfile, then it can be replaced by re-spray.

If it belongs to at least one master then the refusal behaviour is correct, the user can't replace existing subfile with re-spray. But the generated error message is not correct. I raised a JIRA ticket to fix it.
AttilaV
 
Posts: 14
Joined: Fri Sep 19, 2014 3:55 pm


Return to ECL Watch

Who is online

Users browsing this forum: No registered users and 1 guest