Questions about PackageMaps & Roxie 7.6.52-1

[daviddasher]

Hi Tony

We are setting Overwrite and Activate package. I have pasted the code below.

Regarding the packages we have two variants inside the one package, one where indexes are only required to be built once a day and the other is the hourly data. I made a change last night where I moved 5 indexes into our daily build which would save 16gb being copied each hour. Of the 3 roxies I'm testing with two of them have accepted the next package and are loading the next set which is great (So hopefully a lot less data has helped), however, one remaining roxie started copying the indexes and suddenly stopped. In the logs for that machine I'm seeing this (Show in attachment and I have no idea why all lines are repeated), what is strange is the other roxies are reading from that Thor node without issue. The. roxie in question is showing as running, however, it won't start copying data again until I run

sudo service hpcc-init -c myroxie restart

Code: Select all

RequestLayout := RECORD
    STRING      packageMapData          {XPATH('Info')};
    BOOLEAN     overwritePackage        {XPATH('OverWrite')};
    BOOLEAN     activatePackage         {XPATH('Activate')};
    STRING      targetCluster           {XPATH('Target')};
    STRING      packageMapID            {XPATH('PackageMap')};
      STRING         Process                           {XPATH('Process')};
      STRING         DaliIp                           {XPATH('DaliIp')};
END;

request := DATASET
    (
        [
            {
                completePackage,
                TRUE,
                TRUE,
                Roxie_Clustername, // roxie clustername.
                Package_Name,
                        '*',
                        Dali_IP
            }
        ],
        RequestLayout
    );

ResponseLayout := RECORD
    STRING      code                    {XPATH('Code')};
    STRING      description             {XPATH('Description')};
END;

DeployPackage := SOAPCALL
    (
        request,
        RoxieUrl_WsPackageProcess,
        'AddPackage',
        RequestLayout,
        TRANSFORM(LEFT),
        DATASET(ResponseLayout),
        XPATH('AddPackageResponse/status')
    );

sequential(output(LoadDate), output(DailyLoadDate), output(DeployPackage));


[daviddasher]

Hi Tony

This statement from my previous message appears to be false, just after I posted all three boxes were still copying the previous hours data and none of them accepted the new package map and therefore I had to wait until the following hour for them to accept the next package map.

Of the 3 roxies I'm testing with two of them have accepted the next package and are loading the next set which is great

Thanks

David