DFUPlus Not Overwriting Files During Spray
Hello,
I've made some changes to files in the the dropzone, and I'm trying to respray them to update the changes. I'm using DFUPlus and I've changed the "overwrite" flag to "1", but all spray jobs fail. The error I'm getting says:
action=spray
server=<removed>
dstcluster=mythor
username=<removed>
password=<removed>
srcfile=/var/lib/HPCCSystems/mydropzone/nfl/2013/11/pa/2013111710.csv
dstname=nfl::2013::11::pa::2013111710.csv
format=delimited
separator=|
overwrite=1
nowait=0
autorecover=2
This is using client-tools version 5.6.2-1 and platform version 5.6.2-1 on Ubuntu 14.04 LTS.
Thanks,
Daniel
I've made some changes to files in the the dropzone, and I'm trying to respray them to update the changes. I'm using DFUPlus and I've changed the "overwrite" flag to "1", but all spray jobs fail. The error I'm getting says:
The workunit for the failed spray operation registers that the overwrite flag is true (picture attached), so I don't understand why the server complains about the filename already existing. That's the intention! Below are the values passed to DFUPlus.Failed: DFS Exception: 1: logical name nfl::2013::11::pa::2013111710.csv already exists.
action=spray
server=<removed>
dstcluster=mythor
username=<removed>
password=<removed>
srcfile=/var/lib/HPCCSystems/mydropzone/nfl/2013/11/pa/2013111710.csv
dstname=nfl::2013::11::pa::2013111710.csv
format=delimited
separator=|
overwrite=1
nowait=0
autorecover=2
This is using client-tools version 5.6.2-1 and platform version 5.6.2-1 on Ubuntu 14.04 LTS.
Thanks,
Daniel
- Attachments
-
OverwriteFail.png
- (21.64 KiB) Downloaded 768 times
- demills
- Posts: 3
- Joined: Mon Feb 01, 2016 2:03 am
demills,
You should use JIRA (https://track.hpccsystems.com) to report the issue to the developers.
HTH,
Richard
You should use JIRA (https://track.hpccsystems.com) to report the issue to the developers.
HTH,
Richard
- rtaylor
- Community Advisory Board Member
- Posts: 1619
- Joined: Wed Oct 26, 2011 7:40 pm
Is the file used in a published query?
Publishing a query locks a file which would prevent overwriting it even with overwrite specified.
HTH,
Jim
Publishing a query locks a file which would prevent overwriting it even with overwrite specified.
HTH,
Jim
- JimD
- Posts: 160
- Joined: Wed May 18, 2011 1:35 pm
JimD,
No, but these are sub-files of super-files. I've checked the "ECL Programmer's Guide" on working with super-files, and it only mentions deleting and adding new sub-files to super-files. Is overwriting sub-files allowed in 5.6.2?
Thanks,
Daniel
No, but these are sub-files of super-files. I've checked the "ECL Programmer's Guide" on working with super-files, and it only mentions deleting and adding new sub-files to super-files. Is overwriting sub-files allowed in 5.6.2?
Thanks,
Daniel
- demills
- Posts: 3
- Joined: Mon Feb 01, 2016 2:03 am
I try to reproduce this problem:
If the target file doesn't belong to any superfile, then it can be replaced by re-spray.
If it belongs to at least one master then the refusal behaviour is correct, the user can't replace existing subfile with re-spray. But the generated error message is not correct. I raised a JIRA ticket to fix it.
If the target file doesn't belong to any superfile, then it can be replaced by re-spray.
If it belongs to at least one master then the refusal behaviour is correct, the user can't replace existing subfile with re-spray. But the generated error message is not correct. I raised a JIRA ticket to fix it.
- AttilaV
- Posts: 14
- Joined: Fri Sep 19, 2014 3:55 pm
5 posts
• Page 1 of 1
Who is online
Users browsing this forum: No registered users and 1 guest