DFUPlus Not Overwriting Files During Spray

[demills]

Hello,

I've made some changes to files in the the dropzone, and I'm trying to respray them to update the changes. I'm using DFUPlus and I've changed the "overwrite" flag to "1", but all spray jobs fail. The error I'm getting says:

Failed: DFS Exception: 1: logical name nfl::2013::11::pa::2013111710.csv already exists.

The workunit for the failed spray operation registers that the overwrite flag is true (picture attached), so I don't understand why the server complains about the filename already existing. That's the intention! Below are the values passed to DFUPlus.

action=spray
server=<removed>
dstcluster=mythor
username=<removed>
password=<removed>
srcfile=/var/lib/HPCCSystems/mydropzone/nfl/2013/11/pa/2013111710.csv
dstname=nfl::2013::11::pa::2013111710.csv
format=delimited
separator=|
overwrite=1
nowait=0
autorecover=2

This is using client-tools version 5.6.2-1 and platform version 5.6.2-1 on Ubuntu 14.04 LTS.

Thanks,
Daniel

[rtaylor]

demills,

You should use JIRA (https://track.hpccsystems.com) to report the issue to the developers.

HTH,

Richard

[JimD]

Is the file used in a published query?

Publishing a query locks a file which would prevent overwriting it even with overwrite specified.

HTH,

Jim

[demills]

JimD,

No, but these are sub-files of super-files. I've checked the "ECL Programmer's Guide" on working with super-files, and it only mentions deleting and adding new sub-files to super-files. Is overwriting sub-files allowed in 5.6.2?

Thanks,
Daniel

[AttilaV]

I try to reproduce this problem:

If the target file doesn't belong to any superfile, then it can be replaced by re-spray.

If it belongs to at least one master then the refusal behaviour is correct, the user can't replace existing subfile with re-spray. But the generated error message is not correct. I raised a JIRA ticket to fix it.