Thor Architecture

[daviddasher]

Hello

We would like to know if it is possible to

Deploy two (or more) separate roxie package files to be active at the same time on a roxie.
• with indexes coming from two separate ip addresses
• where query names are in both package files so they can access indexes referenced from both packages.

We want separate out our index builds into two separate Thors but then deploy the indexes onto a single roxie. We have upwards of 200 indexes, some of which are relatively small but the build time still adds up. If you have any recommendations of how we can architect this differently.

Kind regards

David

[rtaylor]

David,

Since the 6.0 release, package files have had the ability to be split into multiple files (http://cdn.hpccsystems.com/releases/CE-Candidate-7.0.0/docs/EN_US/RoxieReference_EN_US-7.0.0-beta2.pdf#page=30).

If you're using superkeys in your queries, then updating the data for a query just means updating the correct part file for the package for the query that uses that data.

If your Roxie and Thor clusters are all in the same HPCC environment, that should be all you need to do. But if your Roxie is in its own separate environment, you'll need to remote copy the new index files from whichever Thor to the Roxie before you update the package.

Or did i misunderstand the issue?

HTH,

Richard

[daviddasher]

That's perfect, thanks Richard.

David