Using the DFU-Copy Command Line Option
Using the dfu-copy command line option makes publishing queries more efficient and helps to better manage cloud costs.
The latest developer video illustrates the use of the dfu-copy command line option which allows developers to utilize the DFU file service to copy and update data files to the HPCC Systems cluster without having to publish their query nor use the Roxie service to copy the data.
This provides ECL developers better information about the data by creating publisher workunits that provide more granular information specifically about each of the data files being copied. It also allows the developers to verify the integrity of the data deployed before actually publishing the query.
This can be especially helpful for container or cloud HPCC Systems deployments as there are typically costs involved with various activities.