Thu Jun 30, 2022 4:36 pm
Login Register Lost Password? Contact Us

Please Note: The HPCC Systems forums are moving to Stack Overflow. We invite you to post your questions on Stack Overflow utilizing the tag hpcc-ecl ( This legacy forum will be active and monitored during our transition to Stack Overflow but will become read only beginning September 1, 2022.

Community Edition 4.2.0 ready for download

Latest news about general information and events

Thu Nov 14, 2013 5:18 pm Change Time Zone

The latest version of HPCC Systems Community Edition 4.2.0-1 is now available. Download:

This release includes many new features and improvements.

-> New ECL Watch further improvements (Technical Preview)
The highlights in 4.2 are:
• Queries pages now allows Query manipulation (Suspend/Unsuspend, Activate/Deactivate, Delete, etc)
• Multiple Fixed Spray options added (recfmv, recvmb, variable)
• Publish Workunit now supports specifying a Remote Dali (allowing use of a foreign Dali for DFS resolution)
• New ZAP (Zipped Analysis Package) button in ECL Watch. This button is on the workunits details page. When users experience problems that require investigation by the developers, pressing this button collects any log file and workunit information and zips it up so it can be emailed or added to a JIRA ticket. Users complete a form giving details of the circumstances leading up to the discovery of the problem. This feature is available in both the old and new ECL Watch.

-> ECL Visualisations
• A visualisations bundle is now available on github. This cellFormatter bundle makes use of the ability (in 4.0.2 and later) to display HTML and javascript code in eclwatch results pages, in order to simplify the display of various types of charts, graphs, and other diagrams in order to represent the relationships between data values in results.

• Embeddable web pages and manifest wildcard support. Users can use wildcards in the manifest to easily include a set of resources. It provides a URL format to use via WsWorkunits to access those resources directly from a browser. The resources can reference each other using relative paths. So for instance you can access a web page that references embedded javascript, css, jpg, etc.

-> Lookup join improvements
• Smart Join - This attempts to perform an in-memory LOOKUP join. If there is insufficient memory, smart join will automatically ensure that both sides are efficiently distributed and attempt to perform a LOCAL LOOKUP join. If there is still insufficient memory, smart join will become a LOCAL HASH join which is not limited by memory.
• Optimized Many Lookup - In 4.2, a MANY LOOKUP join with a high number of matching right-hand-side key values is much faster and more efficient.

-> Group join
• The GROUP JOIN syntax allows you to efficiently join two datasets on one condition, but have the result grouped by another condition. This is useful for efficiently solving some relationship matching problems.

-> Persist functionality improvements
• Persist file per code hash – In 4.2, more than one user using older or newer versions of the same persist can both rebuild and co-exist independently
• Improvements to the handling of the expiry of persist files – In 4.2 we now track the last access to a file and expire based on that.
• Refactoring of the persist handling – in 4.2, intermediate persist files can be safely deleted without causing persists that are dependent on them to rebuild unnecessarily.

-> ECL Plugin for Eclipse new features
The highlights for 4.2 are:
• Ability to submit/compile from editor to specific target
• Filtered “history” workunit tree (available in 4.2 gold)

-> Package map improvements
• Users can now specify which environment and or cluster to copy data from, from within the packagemap.
• Isolates packagemaps across target clusters by default making it easier to manage in a multi-cluster environment.

-> Roxie Monitoring Tool (Ganglia) Technical Preview
The initial release leverages Ganglia, an open-source, scalable, distributed monitoring system, to produce a graphical view of a Roxie cluster's servers. With this tool, users can:
• See System information at a glance (such as, Uptimes, CPU Usage, Free Memory, Load, Network Activity, etc.)
• View a grid of Roxie clusters
• Examine Roxie Metrics (such as, Query Count, Activities, Disk Reads, Retires, Restarts etc)
• Look at an overview of a cluster and drilldown to see information about a single node in that cluster
• Keep and interrogate a running historical record of all metrics> Use this to help with capacity planning, disaster recovery planning, troubleshooting, and preventative maintenance.

And more! Be sure to review the Release Notes and Known Limitations: ... imitations
Site Admin
Site Admin
Posts: 209
Joined: Thu Jan 27, 2011 10:58 am

Return to Announcements

Who is online

Users browsing this forum: No registered users and 1 guest