Archive of HPCC Community Edition – Release Notes and Known Limitations
Release Notes for Community Edition 4.2.12-2
================================
Known Limitations for 4.2.12
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the “~foreign::” notation, can only be published using the ecl command line tool and the –allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
All Release Notes for Community Edition 4.2.6-3 apply.
================================================================= Comprehensive list of changes from 4.2.12-2 (gold) to 4.2.12-1 (gold) ================================================================= Community Edition 4.2.12-2 HPCC-12839 Fix crash when row being looked up in a dictionary is aliased HPCC-12901 Fix spurious delete logical file timeout
Release Notes for Community Edition 4.2.12-1
================================
Known Limitations for 4.2.12
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the “~foreign::” notation, can only be published using the ecl command line tool and the –allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
All Release Notes for Community Edition 4.2.6-3 apply.
================================================================= Comprehensive list of changes from 4.2.10-1 (gold) to 4.2.12-1 (gold) ================================================================= ----- HPCC-12490 Ensure linked progress is released when connection is ---- HPCC-12490 Fix link progress --- HPCC-12490 Add getGraphsMeta() to explicitly get the meta info -- HPCC-12543 Create the deserializer object in the correct context - HPCC-12534 Prevent >1 file delete from deadlocking each other HPCC-12490 Correction to WUERR_WorkunitPublished id HPCC-12523 Prevent accidental wildcard lookups (for 4.2.x) HPCC-12518 Add support for Ubuntu 14.04 and 14.10
Release Notes for Community Edition 4.2.10-1
================================
Known Limitations for 4.2.10
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the “~foreign::” notation, can only be published using the ecl command line tool and the –allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
================================================================= Comprehensive list of changes from 4.2.8-1 (gold) to 4.2.10-1 (gold) ================================================================= -- HPCC-12309 Catch memory wrap and full hash table HPCC-12084 Remove unnecessary internal error HPCC-11972 Roxie data copying majority from remote Roxie and not buddy node HPCC-12198 Abort parsing earlier for invalid queries HPCC-12244 Fix xpath used to lookup WsEcl VIP configuration HPCC-12220 SuperHashTable kill not resetting tablecount HPCC-12158 Check ptree pointer before use in addClusterQueryStates - HPCC-12145 Jsocket printf causes invalid output from eclcc HPCC-12133 Change log level for Roxie failed to open file HPCC-12150 Check cached item pointer before using in getElementsPaged HPCC-12075 Allow to select a good landing zone for Upload/download HPCC-11968 Port back unique allocator change to 4.2.x HPCC-12079 Start Activity Cache timeout from cache creation completion HPCC-12085 Avoid malloc/free when updating the buffer callbacks
Release Notes for Community Edition 4.2.8-1 GOLD Release
All Release Notes for Community Edition 4.2.6-3 apply.
================================================================= Comprehensive list of changes from 4.2.6-1 to 4.2.8-1 (gold) ================================================================= ---- HPCC-12010 Fix deadlock in onActivity cache building HPCC-11988 Fix hthor calling helper functions too early HPCC-11995 Improve logging for getActivityInfo HPCC-11995 Improve logging for createActivityInfo --- HPCC-11690 Fix DEDUP,HASH crash if OOM freed empty bucket HPCC-11937 Fix race condition in smart join HPCC-11953 Throw error when RIGHT rows would be lost HPCC-11940 Avoid multiple control:queries calls for same queryset HPCC-11932 Roxie attach causing Roxie cluster to load empty package -- HPCC-11933 Fix WsSMC.setActivityResponse to not update Activity cache HPCC-11920 Prevent SKIPiness leaking outside an ONFAIL - HPCC-11756 Rebuild persist if input persist is newer HPCC-11666 Make filtering by referenced library case insensitive HPCC-11699 Add "LibraryName" to Query Set Filter HPCC-11666 Make Queries list filterable by referenced library HPCC-11515 Under-caching of dynamic filename resolution HPCC-11441 Fold IF() at parse time to avoid binding issues later HPCC-11464 Default string stored definitions to variable length
Release Notes for Community Edition 4.2.6-3 GOLD Release
All Release Notes for Community Edition 4.2.6-2 apply.
Community Edition 4.2.6-3 Gold HPCC-12010 Fix deadlock in onActivity cache building
Release Notes for Community Edition 4.2.6-2 GOLD Release
All Release Notes for Community Edition 4.2.6-1 apply.
HPCC-11933 Fix WsSMC.setActivityResponse to not update Activity cache
Release Notes for Community Edition 4.2.6-1
All Release Notes for Community Edition 4.2.4-5 apply.
================================
Known Limitations for 4.2.4
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the “~foreign::” notation, can only be published using the ecl command line tool and the –allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
================================================================= Comprehensive list of changes from 4.2.2-4 to 4.2.6-2 (gold) ================================================================= HPCC-11933 Fix WsSMC.setActivityResponse to not update Activity cache ------------ HPCC-11861 Copying query .so files can result in truncated .so files HPCC-11857 Roxie gives assert error if try to execute suspended query HPCC-11844 Fix inconsistency generated in expression tree HPCC-11825 Fix issues with some versions of ICU (post 5.0?) ----------- HPCC-11801 ERROR: Query suspended: Different version of file already loaded HPCC-11775 Fix unrelated bug spotted during review - Revert unfiltered test HPCC-11808 Missing alias information from control:queries HPCC-11775 Fix minor issues spotted in review - Improve efficiency of WUiterate in Sasha HPCC-11798 Allow MAXLENGTH on BUILD (forward compatibility) HPCC-11777 Fix CLocalEnvironment cache thread safeness ---------- HPCC-11760 Fix getTargetClusterInfo() in workunit.cpp HPCC-11637 Avoid multiple concourrent ECLWatch onActivity queries HPCC-11753 Backmerge of control:queries speedup broke formatting HPCC-11739 Roxie cluster priorities not set correctly HPCC-11698 WARNING: Remote file connect Too many open files HPCC-11713 Increase timeout and remove need to clone tree - Remove unused timeout - Final set of environment changes - Convert some connects to children of environment - Convert most connections to /Environment - Remove file based environment code (unused since 2010-03-29) --------- HPCC-11496 2nd attempt at avoiding contention on ClusterLock HPCC-11691 Roxie can core on control:unlockdali HPCC-11688 unused-files shouldn't check packagemaps active on other roxies HPCC-11687 Fire exception on connect if from stale client HPCC-11679 Catch exception in connection destructors HPCC-10684 Ensure old tracked session is removed from new HPCC-11653 Merge roxie endpoint results for control:queries HPCC-11590 Add configurable timeouts to WsEcl -------- HPCC-11628 Roxie copied some files to wrong places HPCC-11309 Ensure IDFUHelper cooperate with transactions HPCC-11288 Regression if inside transaction HPCC-11261 fileservice superfile actions can lockup on retry HPCC-11623 Query details should report files used in alphabetical order HPCC-11627 Requesting per-query logging can cause roxie cores HPCC-11618 Roxie core when detaching from dali ------- HPCC-11610 Control:reload may leave state hash incorrect HPCC-11607 Core processing control:reload HPCC-11607 Core processing control:reload HPCC-11592 ecl-queries-copy should copy the snapshot attribute HPCC-11538 Pull more data from hpcc-data2 location HPCC-11564 Add method to clone entire queryset from one target to another ------ HPCC-11339 WsWorkunits should respect compulsory flag HPCC-11588 Better timeout for Roxie's initial dali connect ----- HPCC-11565 Avoid calls to SDS manager for dangling connections HPCC-11563 Don't set RefFileNotFound for ReferencedFiles in packagemap HPCC-11562 queries-copy from local dali fails when authentication enabled ---- HPCC-11555 Remove contention on GeneratedDlls HPCC-11545 Use dirty flag for QueryFilesInUse cache HPCC-11443 Allow Roxie to specify remote cluster priorities HPCC-11544 Roxie restarted after dali disconnected HPCC-11541 Various IPT leaks, that also cause leaked locks HPCC-11459 Use new toXML formatting flags in getQueryInfo HPCC-11459 Flags to toXML to allow more control over formatting HPCC-11500 Control:queries should only return info for active package HPCC-11494 Roxie dali notification issues HPCC-11509 ESP cache of packagemap info leaking connections HPCC-11504 Referencing memory after freed in ccdqueue.cpp HPCC-11339 Remove unnecessary scoping on call to isCompulsory HPCC-11339 WsWorkunits should respect compulsory flag --- HPCC-11458 Fix clashing id HPCC-11458 Uses a new control ID for WHEN,BEFORE (fix stopSink error) HPCC-11477 Activities are being reset excessively HPCC-11445 Roxie not stopping unused sink activities HPCC-11496 Avoid create/delete ClusterLock to reduce contention HPCC-11494 Roxie dali notification issues HPCC-11491 Deletes causing subscription notifications to siblings HPCC-11478 IgnoreMissingFiles option not working in Roxie -- HPCC-11477 Activities are being reset excessively HPCC-11459 Fix OSX build break HPCC-11452 Ensure control:queries does not split lines HPCC-11459 Add flag to toXML to allow newlines only formatting HPCC-11440 State hash should be comparable across clusters HPCC-11430 Prevent stack fault when parameter not substituted - HPCC-11412 Excessive log file size in Roxie HPCC-11418 Roxie may stall for long periods under load HPCC-11391 Queries that are suspended only on slaves are not reported HPCC-11389 Ignore loopback interfaces when selecting the interface to use HPCC-11305 Add support for the compulsory attribute in packagemaps HPCC-11283 Use cluster ldap user when building queries using file cache HPCC-11304 Field translation options not working correctly HPCC-11310 Fix signature of addNamedQuery() in workunit.hpp HPCC-11284 Assert failure on certain (unusual) file names in Roxie queries HPCC-11187 ecl-queries-list should show wuid and snapshot info HPCC-11188 Copy query attributes when copying queries HPCC-11278 Fix core when calling WUListQueriesUsingFile with LDAP
Release Notes for Community Edition 4.2.4-5
All Release Notes for Community Edition 4.2.4-3 apply.
================================================================= Comprehensive list of changes from 4.2.4-4 to 4.2.4-5 ================================================================= HPCC-11309 - Ensure IDFUHelper cooperate with transactions HPCC-11288 - regression if inside transaction HPCC-11261 - add some comments HPCC-11261 - fileservice superfile actions can lockup on retry
Release Notes for Community Edition 4.2.4-3
All Release Notes for Community Edition 4.2.4-2 apply.
================================================================ Comprehensive list of changes from 4.2.4-2 Gold to 4.2.4-3 ================================================================ HPCC-11304 Field translation options not working correctly
Release Notes for Community Edition 4.2.4-2
All Release Notes for Community Edition 4.2.4-1 apply.
HPCC-11278 In an LDAP-enabled system, the ‘Used By’ feature that displays all the queries that use a particular logical file or superfile may return false negatives. (Message may incorrectly say “No Queries using this file.”)
================================================================ Comprehensive list of changes from 4.2.4-1 Gold to 4.2.4-2 ================================================================ HPCC-11278 Fix core when calling WUListQueriesUsingFile with LDAP HPCC-9129 Add new DOC: HPCC Monitoring and Reporting (Technical Preview).
Release Notes for Community Edition 4.2.4
All Release Notes for Community Edition 4.2.2 apply.
================================
Known Limitations for 4.2.4
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the “~foreign::” notation, can only be published using the ecl command line tool and the –allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
================================================================ Comprehensive list of changes from 4.2.2 Gold to 4.2.4 Gold ================================================================ Community Edition 4.2.4-rc4 HPCC-11195 Suppress creation of unread spill files in Roxie Community Edition 4.2.4-rc3 Release Candidate 3 HPCC-11236 Non Dlls should not be registered with the dllserver HPCC-11216 Fix default expiry for persist files HPCC-11235 Make timeout etc. on SOAPCALL more dynamic HPCC-11226 Add NULL check added to master in another commit HPCC-10983 Use a simpler method of preventing recursive hoisting HPCC-10983 Don't constant fold to avoid expression duplication in optimizer HPCC-11220 Remove references to Suse in docs HPCC-11212 Fix problems with SOAPCALL to a blank url. HPCC-11175 Add QueriesUsingFile support for super files HPCC-11175 Fix issues with cache of files in use info HPCC-11101 Fail publishing queries with foreign files in old eclwatch HPCC-11087 Track subs swapped as part of swap/promote HPCC-11080 DOCS:Value Types link broken HPCC-11082 Global LOOP with row condition must recheck finishing HPCC-10941 Add mechanism for finding queries that use a given file Community Edition 4.2.4-rc2 HPCC-10931 Roxie not putting data on right node in cyclic mode HPCC-11049 Roxie pulling from remote data location instead of buddy node HPCC-11061 Ensure Dali group created if missing HPCC-11041 Improve tracing when Roxie can not load file HPCC-11007 Failed wildcard spray, empty directory, assert HPCC-11025 Fix various MP close socket issues HPCC-11007 Failed wildcard spray, empty directory, assert Community Edition 4.2.4-rc1 HPCC-10965 Open Legacy ECL Watch Fails on FF HPCC-10989 Prevent "global" graph layout HPCC-9551 Roxie rtprio limits HPCC-10917 Prevent MP deadlock if broken socket on RANK_ALL HPCC-10141 DOCS:Install ClientTools on Multiple platforms HPCC-10894 Prevent spurious loop continuation HPCC-10933 Excessive "Reset without stop" tracing HPCC-10698 Avoid deadlock if retrying lock on superfiles HPCC-10978 Fix windows build break by removing use of strncasecmp HPCC-10925 Allow new process group creation to be configured HPCC-10925 Allow abort when compiling to kill gcc process HPCC-10922 Add an option to improve cse for if conditions in child queries HPCC-10910 Check aborting after first attempt to connect to slave HPCC-10921 Fix HASH/HASH64 on constant strings HPCC-10910 Ensure abort is checked before spawning a child
Release Notes for Community Edition 4.2.4-rc4
All Release Notes for Community Edition 4.2.4-rc2 apply.
================================================================ Comprehensive list of changes from 4.2.4-rc2 Gold to 4.2.4-rc4 ================================================================ Community Edition 4.2.4-rc4 Release Candidate 4 HPCC-11195 Suppress creation of unread spill files in Roxie Community Edition 4.2.4-rc3 Release Candidate 3 HPCC-11236 Non Dlls should not be registered with the dllserver HPCC-11216 - Fix default expiry for persist files HPCC-11235 Make timeout etc. on SOAPCALL more dynamic HPCC-11226 Add NULL check added to master in another commit HPCC-10983 Simplify code following review HPCC-10983 Use a simpler method of preventing recursive hoisting HPCC-10983 Don't constant fold to avoid expression duplication in optimizer HPCC-11220 Remove references to Suse in docs HPCC-11212 Fix problems with SOAPCALL to a blank url. HPCC-11175 Add QueriesUsingFile support for super files HPCC-11175 Fix issues with cache of files in use info HPCC-11101 Fail publishing queries with foreign files in old eclwatch HPCC-11087 - Track subs swapped as part of swap/promote HPCC-11080 DOCS:Value Types link broken HPCC-11082 - Global LOOP with row condition must recheck finishing HPCC-10941 Add mechanism for finding queries that use a given file
Release Notes for Community Edition 4.2.4-rc2
All Release Notes for Community Edition 4.2.2-1 apply.
================================================================ Comprehensive list of changes from 4.2.2 Gold to 4.2.4-rc2 ================================================================ Community Edition 4.2.4-rc2 Release Candidate 2 HPCC-10931 Roxie not putting data on right node in cyclic mode HPCC-11049 Roxie pulling from remote data location instead of buddy node HPCC-11061 Ensure Dali group created if missing HPCC-11041 Improve tracing when Roxie can not load file HPCC-11007 Failed wildcard spray, empty directory, assert HPCC-11025 Fix various MP close socket issues HPCC-11007 Failed wildcard spray, empty directory, assert Community Edition 4.2.4-rc1 Release Candidate 1 HPCC-10965 Open Legacy ECL Watch Fails on FF HPCC-10989 Prevent "global" graph layout HPCC-9551 Roxie rtprio limits HPCC-10917 Prevent MP deadlock if broken socket on RANK_ALL HPCC-10141 DOCS:Install ClientTools on Multiple platforms HPCC-10894 Prevent spurious loop continuation HPCC-10933 Excessive "Reset without stop" tracing HPCC-10698 Avoid deadlock if retrying lock on superfiles HPCC-10978 Fix windows build break by removing use of strncasecmp HPCC-10925 Allow new process group creation to be configured HPCC-10925 Allow abort when compiling to kill gcc process HPCC-10922 Add an option to improve cse for if conditions in child queries HPCC-10910 Check aborting after first attempt to connect to slave HPCC-10921 Fix HASH/HASH64 on constant strings HPCC-10910 Ensure abort is checked before spawning a child
Release Notes for Community Edition 4.2.2-1
All Release Notes for Community Edition 4.2.0-4 apply.
============================================================ Comprehensive list of changes from 4.2.0 Gold to 4.2.2-1 Gold ============================================================ HPCC-10882 Allow cast real to string if string preserves whole value HPCC-10899 Fix spilt results records getting lost HPCC-10829 Removing files from roxie may not remove files from hpcc-data2 HPCC-10896 Lookup Join leaking rows in hash table. HPCC-10864 change cli --no-foreign to --allow-foreign HPCC-10864 Command option to fail publish if query has foreign files HPCC-10895 Document "allow-foreign" option in CLI HPCC-8430 Document addScopes utility in LDAP section HPCC-9551 Allow Roxie to set thread priorities HPCC-10877 More issues in stepped keyed limits HPCC-10844 Fix some memory leaks in the code generator HPCC-10839 New ECL Watch Deselection broken HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10819 Inline set sometimes incorrectly output in loop graph HPCC-10849 Disable through spills for roxie - they only cause problems HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10834 DOCS: Standardize capitalization of Thor, Roxie HPCC-10806 DOCS: Clarify uninstall instructions to use the package name HPCC-10688 EclWatch misreporting partially suspended queries HPCC-10800 Deleting files from one cluster may leave incorrect dali info HPCC-10818 Fix problem with MANY LOOKUP in a child loop/query HPCC-10798 Fix publishing query not adding cluster to local files HPCC-10801 Update error message to provide hint of workaround HPCC-10799 FIX potential invalid C++ for EXISTS(a+b) HPCC-10486 Add daliadmin option to set file redundancy HPCC-10742 Ensure in-progress partial output is removed HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10595 Don't display ecl-packagemap-validate success on warnings HPCC-10780 Fix Queries Page URL structure HPCC-10794 Sasha search fails to find some workunits HPCC-10691 Increase libxslt template stack depth HPCC-10779 Caching nohits will interfere with dynamic files HPCC-10730 DOCS: Compiler Override in ECL IDE HPCC-10653 Problems in recreateCloneSource if dali not available HPCC-10768 Rollback consistent Thor file locking for 4.2.2 HPCC-10633 ZAP report doesn't contain archive on legacy system HPCC-10685 Fix typo in ecl roxie detach section HPCC-10665 Add missing params to File.copy docs HPCC-10756 DOCS:Fix ID tag for HTML export HPCC-10628 Fixed typo in EVENTEXTRA docs HPCC-10732 Call sendRoxieControlAllNodes() to send control:querystats HPCC-10571 Add RemoveOwnedSubFiles to docs HPCC-10470 Roxie Graphs are not getting merged correctly HPCC-10683 Fix WU connection leak in WsWorkunits and a warning in ESP log HPCC-10684 Prevent close of old + start of new session clashing HPCC-10693 Allow CSV,HEADING read in child query. HPCC-10686 Need to check subfile after lock retry HPCC-10653 Problems in recreateCloneSource if dali not available HPCC-10671 Ensure activities hash table is cleared when query load fails HPCC-10682 Add namespace to avoid two classes with same name clashing HPCC-10660 Improve efficiency of subscription session remove HPCC-10651 Roxie dali cache ineffective on subfiles resolved via package HPCC-10650 createSingleFileClone don't remove files unless changed HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10610 Add DBGLOG trace of call into createSingleFileClone HPCC-10517 Fix Package subfile nodes sometimes added to DALI as empty HPCC-10594 Block access to foreign dali from logicalfilelist HPCC-10620 Ensure logical file meta data is checked HPCC-10608 Fix compressed file symbol not showing in ECLWatch HPCC-10490 Rename a variable based on review HPCC-10490 Show primary clusters for XRef HPCC-10516 Roxie should ignore SubFile value="" in a package SuperFile HPCC-10610 ecl-packagemap-add support for specifying a src file prefix HPCC-10590 Ignore ~ in subfile name from package HPCC-10547 Ensure that the lock is released (when contended) for atleast 5s HPCC-10547 Retain timeout for repeat=true (just in case) HPCC-10386 Playground Sample Has Corrupted Chars HPCC-10533 Fix EnvGen segmentation fault HPCC-10547 Reduce contention for persist locks by timing out quicker HPCC-10602 OVERWRITE option broken in roxie HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10206 Increase timeout accessing GeneratedDlls information HPCC-10564 Roxie is not caching dali lookups effectively HPCC-10513 Fix missing persist dependencies for stored filenames HPCC-10568 DOCS:Update Date HPCC-10570 Fix confusion over DeleteOwnedSubFiles/RemoveOwnedSubFiles HPCC-10564 Roxie is not caching dali lookups effectively Rename deleteFilter to deleteExclusions HPCC-10532 Serialize progress information so backward compatible. HPCC-10514 Spurious boolean, causing premature timeouts HPCC-10481 Dynamic group leaves groupType uninitialized HPCC-10482 Associated files being deleted too early HPCC-10255 Sasha not archiving/restoring associated files HPCC-10530 Query deleted mid-flight may never terminate (and may spam dali) HPCC-10493 Bad request message on using ZAP button HPCC-10515 Use POST to send ZAP Report request HPCC-10498 Fix problems copying bundles with nested directories. HPCC-10511 Code using dmetaphone or saltlib may get undefined symbols HPCC-10302 Fix eclagent deadlock if fileservices calls in apply HPCC-10489 Fix problem when dataset param is projected to base record HPCC-10407 Logical file does not open HPCC-10361 Prevent assignements that can SKIP from being lost HPCC-10462 Fix problem retrying add/remove ops in transactions HPCC-10411 Catch out of bounds AddSuperFile @ pos HPCC-10405 Change WU State column for better display HPCC-10465 Global merge bug if varrecs and late detection HPCC-10440 Ensure padded part copies have matching timestamps HPCC-10481 Default replicate dir causing problems HPCC-10406 Add sort by columns in queryset HPCC-10421 Fix "internal" build HPCC-10439 DOCS:VMWare Version HPCC-10429 Fix ecl-bundle selftest to check for the correct symbol HPCC-10364 Generate mergeAggregate() for hash aggregate if input is grouped. HPCC-10319 Fix attr problems if a subfile is empty super HPCC-10333 Embedded Python may encounter undefined symbols HPCC-10398 Fix persist_replicate mismatch HPCC-10384 Potential spillable row stream race condition crash HPCC-10387 Z.A.P does not include three parameters needed HPCC-10345 Disable Banner Setup for non-admin if authentication is set HPCC-10372 DeleteSuperFile possible crash HPCC-10374 Fix sorted loader issue effecting global sort HPCC-10301 Read enough data for mime header process when uploading files
Release Notes for Community Edition 4.2.2-rc12
All Release Notes for Community Edition 4.2.2-rc8 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc8 to 4.2.2-rc12 ============================================================ HPCC-10877 More issues in stepped keyed limits HPCC-10844 Fix some memory leaks in the code generator HPCC-10839 New ECL Watch Deselection broken HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10819 Inline set sometimes incorrectly output in loop graph HPCC-10849 Disable through spills for roxie - they only cause problems HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10834 DOCS: Standardize capitalization of Thor,Roxie HPCC-10806 DOCS: Clarify uninstall instructions to use the package name HPCC-10688 EclWatch misreporting partially suspended queries HPCC-10800 Deleting files from one cluster may leave incorrect dali info HPCC-10818 Fix problem with MANY LOOKUP in a child loop/query HPCC-10798 Fix publishing query not adding cluster to local files HPCC-10801 Update error message to provide hint of workaround HPCC-10799 FIX potential invalid C++ for EXISTS(a+b) HPCC-10486 Add daliadmin option to set file redundancy HPCC-10742 Ensure in-progress partial output is removed HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10595 Don't display ecl-packagemap-validate success on warnings HPCC-10780 Fix Queries Page URL structure HPCC-10794 Sasha search fails to find some workunits HPCC-10691 Increase libxslt template stack depth HPCC-10779 Caching nohits will interfere with dynamic files HPCC-10730 DOCS: Compiler Override in ECL IDE HPCC-10653 Problems in recreateCloneSource if dali not available HPCC-10768 Rollback consistent Thor file locking for 4.2.2 HPCC-10633 ZAP report doesn't contain archive on legacy system HPCC-10685 Fix typo in ecl roxie detach section HPCC-10665 Add missing params to File.copy docs HPCC-10756 DOCS:Fix ID tag for HTML export HPCC-10628 Fixed typo in EVENTEXTRA docs HPCC-10732 Call sendRoxieControlAllNodes() to send control:querystats HPCC-10571 Add RemoveOwnedSubFiles to docs HPCC-10470 Roxie Graphs are not getting merged correctly HPCC-10683 Fix WU connection leak in WsWorkunits and a warning in ESP log HPCC-10684 Prevent close of old + start of new session clashing HPCC-10693 Allow CSV,HEADING read in child query. HPCC-10686 Need to check subfile after lock retry HPCC-10653 Problems in recreateCloneSource if dali not available
Release Notes for Community Edition 4.2.2-rc8
All Release Notes for Community Edition 4.2.2-rc5 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc5 to 4.2.2-rc8 ============================================================ HPCC-10671 Ensure activities hash table is cleared when query load fails HPCC-10682 Add namespace to avoid two classes with same name clashing HPCC-10660 : Improve efficiency of subscription session remove HPCC-10651 Roxie dali cache ineffective on subfiles resolved via package HPCC-10650 createSingleFileClone don't remove files unless changed HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10610 Add DBGLOG trace of call into createSingleFileClone HPCC-10517 Fix Package subfile nodes sometimes added to DALI as empty HPCC-10594 : Block access to foreign dali from logicalfilelist HPCC-10620 : Ensure logical file meta data is checked HPCC-10608 Fix compressed file symbol not showing in ECLWatch HPCC-10490 Rename a variable based on review HPCC-10490 Show primary clusters for XRef
Release Notes for Community Edition 4.2.0-4
All Release Notes for Community Edition 4.2.0-3 apply.
============================================================ Comprehensive list of changes from 4.2.0-3 to 4.2.0-4 ============================================================ HPCC-10533 Fix EnvGen segmentation fault
Release Notes for Community Edition 4.2.2-rc5
All Release Notes for Community Edition 4.2.2-rc3 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc3 to 4.2.2-rc5 ============================================================ HPCC-10516 Roxie should ignore SubFile value="" in a package SuperFile HPCC-10610 ecl-packagemap-add support for specifying a src file prefix HPCC-10590 Ignore ~ in subfile name from package HPCC-10547 Ensure that the lock is released (when contended) for atleast 5s HPCC-10547 Retain timeout for repeat=true (just in case) HPCC-10386 Playground Sample Has Corrupted Chars HPCC-10533 Fix EnvGen segmentation fault HPCC-10547 Reduce contention for persist locks by timing out quicker HPCC-10602 OVERWRITE option broken in roxie HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10206 Increase timeout accessing GeneratedDlls information HPCC-10564 Roxie is not caching dali lookups effectively HPCC-10513 Fix missing persist dependencies for stored filenames HPCC-10568 DOCS:Update Date HPCC-10570 Fix confusion over DeleteOwnedSubFiles/RemoveOwnedSubFiles HPCC-10564 Roxie is not caching dali lookups effectively
Release Notes for Community Edition 4.2.0-3
All Release Notes for Community Edition 4.2.0-3 apply.
============================================================ Comprehensive list of changes from 4.2.0-2 to 4.2.0-3 ============================================================ HPCC-10532 Serialize progress information so backward compatible.
Release Notes for Community Edition 4.2.2-rc3
All Release Notes for Community Edition 4.2.2-rc1 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc2 to 4.2.2-rc3 ============================================================ Rename deleteFilter to deleteExclusions HPCC-10532 Serialize progress information so backward compatible. HPCC-10514 - Spurious boolean, causing premature timeouts HPCC-10481 - Dynamic group leaves groupType uninitialized HPCC-10482 - Associated files being deleted too early HPCC-10255 - Sasha not archiving/restoring associated files
Release Notes for Community Edition 4.0.6-rc2
All Release Notes for Community Edition 4.0.6-rc1 apply.
============================================================ Comprehensive list of changes from 4.0.6-rc1 to 4.0.6-rc2 ============================================================ HPCC-10481 - Dynamic group leaves groupType uninitialized
Release Notes for Community Edition 4.2.2-rc2 2
All Release Notes for Community Edition 4.2.2-rc1 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc1 to 4.2.2-rc2 ============================================================ HPCC-10530 Query deleted mid-flight may never terminate (and may spam dali) HPCC-10493 Bad request message on using ZAP button HPCC-10515 Use POST to send ZAP Report request HPCC-10498 Fix problems copying bundles with nested directories. HPCC-10511 Code using dmetaphone or saltlib may get undefined symbols
Release Notes for Community Edition 4.2.2-rc1
All Release Notes for Community Edition 4.2.0-2 apply.
============================================================ Comprehensive list of changes from 4.2.0 Gold to 4.2.2-rc1 ============================================================ HPCC-10302 Fix eclagent deadlock if fileservices calls in apply HPCC-10489 Fix problem when dataset param is projected to base record HPCC-10407 Logical file does not open HPCC-10361 Prevent assignements that can SKIP from being lost HPCC-10462 Fix problem retrying add/remove ops in transactions HPCC-10411 Catch out of bounds AddSuperFile @ pos HPCC-10405 Change WU State column for better display HPCC-10465 Global merge bug if varrecs and late detection HPCC-10440 Ensure padded part copies have matching timestamps HPCC-10481 Default replicate dir causing problems HPCC-10406 Add sort by columns in queryset HPCC-10421 Fix "internal" build HPCC-10439 DOCS:VMWare Version HPCC-10429 Fix ecl-bundle selftest to check for the correct symbol HPCC-10364 Generate mergeAggregate() for hash aggregate if input is grouped. HPCC-10319 Fix attr problems if a subfile is empty super HPCC-10333 Embedded Python may encounter undefined symbols HPCC-10398 Fix persist_replicate mismatch HPCC-10384 Potential spillable row stream race condition crash HPCC-10387 Z.A.P does not include three parameters needed HPCC-10345 Disable Banner Setup for non-admin if authentication is set HPCC-10372 DeleteSuperFile possible crash HPCC-10374 Fix sorted loader issue effecting global sort HPCC-10301 Read enough data for mime header process when uploading files
Release Notes for Community Edition 4.2.0-2
All Release Notes for Community Edition 4.2.0-1 apply.
============================================================ Comprehensive list of changes from 4.0.2-1 Gold to 4.2.0-2 ============================================================ HPCC-10423 Fix regression xpath('') shouldn't output xml tag HPCC-10413 Reinstate non-sequential subfile orders
Release Notes for Community Edition 4.2.0-1
================================
Known Limitations for 4.2.0-1
================================
- HPCC-10319 If the first subfile of superfile is am empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for of SORT and INDEX.
- HPCC-10284 In the Tech Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
============================================================ Comprehensive list of changes from 4.0.2-2 Gold to 4.2.0-GOLD ============================================================ Community Edition 4.2.0-1 Gold HPCC-9039 Add IE 11 Support for GraphControl HPCC-10383 IE8 Issue with TreeMap and set "selectedItems" HPCC-10371 Reopening a WU Details page fails HPCC-10325 ECL Watch does not show full list HPCC-10315 Add unicode version of fn_hyphen_match Community Edition 4.2.0-rc3 Release Candidate 3 HPCC-10225 Display graph timings in HH:MM:SS.mm format HPCC-10261 Ensure that option -Xrs is always enabled in the JVM. HPCC-10360 Fix Thor roxiemem spill priority order HPCC-10287 Catch subfiles have correct @num sequence HPCC-10359 Embedded R fails if there are ^M characters in the source HPCC-10288 Add RemoveOwnedSubFiles (for 4.2) HPCC-10272 Fix banner dialog prompt HPCC-10307 R integration terminates process if R syntax invalid HPCC-10321 Rename onWUReportBugInfo to onWUReportZapInfo HPCC-10358 Rename WUGetBugInfo to WUGetZAPInfo, etc HPCC-10304 Rename ws_workunit "onWUReportBug" to "onWUCreateZAPInfo" HPCC-10359 Embedded R fails if there are ^M characters in the source HPCC-10266 Disable banner usage from non-admin users HPCC-10352 Pass PID in the web link for downloading eclagent log HPCC-10347 ECL Watch "Open in New Window" fails HPCC-10327 Ubuntu 13.10 dependency issue HPCC-10323 ESP incorrectly checks for errors querying file perms HPCC-10287 Add check for inadequencies of transaction impl. HPCC-10309 Fix bug where EXISTS(a+b+c) evaluated as EXISTS(c) HPCC-10288 Add RemoveOwnedSubFiles HPCC-10287 Catch out of order supers when removing a subfile HPCC-9912 Document LOCAL option on DATASET n TRANSFORM ** Community Edition 4.2.0-rc2 Release Candidate 2 HPCC-7899 Add Z.A.P button HPCC-10290 ZAP report should distinguish compiler warnings and errors HPCC-10273 Add logical files in query set page HPCC-10292 ZIP from Zap has path info HPCC-10279 esdl_srv_engine should return HTTP exceptions HPCC-10224 Fix CSocket::name returning non terminated strings HPCC-10270 SprayVariable has incorrect parameters HPCC-10286 Add dependency for Ubuntu 13.10 (Saucy) HPCC-10280 DOCS:Add ID Attribute HPCC-10256 Add "Refresh Data" Button to Graph Page HPCC-10283 Ensure GLOBAL(,OPT) is processed correctly inside a library HPCC-10278 Create ZAP report feature not handling multiple logfiles HPCC-9683 Fix performance and memory usage issue for huge dataset HPCC-10276 Add jsonp support to WsEcl HPCC-10237 Don't move CHOOSEN() over a grouped count project HPCC-10265 Fix problems processing action dependencies HPCC-10264 After publishing using a remote dali, roxie requires remote dali HPCC-10275 "Compiled" Workunit not showing as completed HPCC-10274 Add workunit xml file to ZAP Report zip file HPCC-10129 DOCS:Std Lib Fix table formatting HPCC-10240 Fix example following review feedback HPCC-10262 Base Store cached data could "leak" between instances HPCC-10240 Prevent a TABLE() aggregate being converted to a non aggregate HPCC-10228 Roxie should lock subfiles, not just rely on superfile lock HPCC-10029 Add Dictionary Example to ECL Playground HPCC-9622 Disable failing hthor test when6b.ecl HPCC-10253 WsWorkunits::onGet should return exceptions to the client HPCC-10238 Remove ECLPLus interactive mode from docs ***** Community Edition 4.2.0-rc1 Release Candidate 1 HPCC-10251 Fix windows build break HPCC-9415 Use epoll, add EPOLLRDHUP define for Centos5.x HPCC-9918 CsvRecordSize class doesn't handle well the quoted and variable length datasets. HPCC-9307 Allow roxie to have dependencies within a subgraph HPCC-9415 Use epoll, fix critical section around init HPCC-10227 Use key cache in indexread/count HPCC-9244 Improved LOOKUP,MANY scheme HPCC-10107 Csv auto discovery should work with utf8 files. HPCC-10241 New ECL Watch + IE8 HPCC-9671 Add Published Query Pages HPCC-9307 Clean up the code HPCC-10204 Ensure that a contextClassLoader that uses the classpath is available to Java classes. HPCC-10203 Add manifest resource support for wildcards and relative URLS HPCC-10242 Fix preflight not working for roxie server and thor master HPCC-10244 Fix ID tags to produce HTML version HPCC-9906 Support DATASET(n, transform, LOCAL) HPCC-10239 Windows Build break in WsDeploy HPCC-9307 initial work and refactoring of action lists HPCC-9965 Add a ,UNSTABLE flag to a JOIN HPCC-10099 DOCS:JavaScript Embed HPCC-9192 Doc:PackageMgmt page HPCC-10176 Add Create Bug Report to ECL WU Details HPCC-9882 Do not check the return from removeEntry() HPCC-10174 Add Remote Dali Option HPCC-10140 Edits based on code review HPCC-10231 KeyedJoin hitting spurious limits HPCC-9322 Allow active name to be used with ecl-unpublish HPCC-9976 Add banner support to new ECL Watch HPCC-10159 Document SMART option for JOIN HPCC-9898 ConfigMgr - Fix thor topology cluster add / del HPCC-7899 Add "Report bug" button in eclwatch WU page HPCC-10140 Document Virtual Logicalfilename HPCC-10226 Document change to EXPIRE semantics HPCC-10124 ConfigMgr - Add new components and services from buildset HPCC-9322 Allow active name to be used with ecl-unpublish HPCC-9947 Improve the warning for an invalid use of NOTHOR HPCC-9968 New EXPIRE semantics HPCC-10004 DOCS:XREF Warning HPCC-9992 Implement __PLATFORM__ to query the target platform HPCC-9320 Preliminary minor refactoring for using global graph results HPCC-10169 Integrate ClientTools on Windows 32bit with Jenkins HPCC-10222 Perform proper field validation. HPCC-9898 ConfigMgr - delete multiple roxie servers HPCC-10130 Set accessedTime for all files HPCC-10055 Add Error/Warning Log for Toaster Messages HPCC-10022 Allow the max number of persist instances to be set HPCC-9913 Fix forcing value to bool warning in ccdquery.cpp HPCC-10195 Remove unused m_allowHttpNil flag from CSoapPrimitiveField HPCC-9934 Add SprayFixed Input HPCC-10032 Add schema generator support for xpath('') HPCC-9970 Default persist files to expiring after 14 days HPCC-9686 Add ability to fetch named results to ESPWorkunit HPCC-9803 New ECL Watch does not support existing visualisations HPCC-10021 ConfigMgr - Allow esp service to target a default cluster HPCC-9812 Ability to spray from any source in new ECL Watch HPCC-9966 Graph control disappears when switching HTML tabs HPCC-10146 Job status when blocked HPCC-9882 Check and return exception message from removeEntry() HPCC-10188 Rename Properties to attributes for consistency HPCC-10053 Display "busy" indicator on multi search HPCC-7898 Link release notes HPCC-10121 Match with the settings created by pull request #4952 HPCC-10121 Fix merge conflict HPCC-9861 Fix ECL regeneration of functions with multiple calls. HPCC-10196 Suggested improvement of for cpan mod installations HPCC-10147 Add comments to examples to indicate the expected errors HPCC-10194 Handle NULL results from Java functions HPCC-10028 removeEntry() should pass the error message to the caller HPCC-10177 Add code to restrict the number of persist instances HPCC-10184 Potential memory leak in uncompress routine HPCC-10185 Graph numeric properties sort as strings HPCC-10136 Fix ECL in FUNCTIONMACRO_Example.ecl HPCC-9941 Document FORWARD option on MODULE HPCC-10147 Initial implementation of JOIN(..., GROUP(x,y)) HPCC-10177 Add code to restrict the number of persist instances HPCC-10092 Configmgr - add attribute serverForArchivedECLWU to esp HPCC-10130 Set accessedTime for all files HPCC-10164 Don't substitute constants into ATMOST join conditions HPCC-10028 removeEntry() should pass the error message to the caller HPCC-9941 Document FORWARD on MODULE HPCC-9415 Disable by default for now HPCC-9415 New epoll implementation with common base class HPCC-10183 ECL Record Layout metadata is not reported for XML files in hthor HPCC-10181 Add Compile Time to WUQueryDetails response HPCC-9722 DOCS:Non-Windows Client Tools HPCC-9521 Refactor CDfsLogicalFileName to make it purely representational of a logical file, avoid it resolving/looking up HPCC-10175 Remove Roxie test page option from HPCC Platform HPCC-10093 Read compressed file size from DFU attributes HPCC-9547 packagemap-validate warning when library redefines query files HPCC-10028 removeEntry() should pass the error message to the caller HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10113 Dedup RHS if keep and no atmost/abortlimit HPCC-9870 Docs:JVM Settings HPCC-10127 Configmgr - Location section missing in esp.xml HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10157 DOCS: Language Reference Links HPCC-10015 Add WUID wildcard search for WUQuery HPCC-10034 Move all JSON validation and pretty printing to client side HPCC-9404 Test DEDUP, KEEP(RIGHT) HPCC-10134 LogicalToPhysical file was not working HPCC-9982 Jobs run on hthor should fail if they need to rebuild a thor persist HPCC-10108 No way to disable quote processing and use the CSV quick partitioning HPCC-10149 Fix regression test, and check for KEEP(1), LIMIT(n) HPCC-8902 #workunit ('cluster', 'xxx') not supported by eclccserver HPCC-10108 No way to disable quote processing and use the CSV quick partitioning HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10161 Add option in eclagent to force persist rebuilds, for debugging HPCC-10160 EclAgent core if PERSIST names invalid thor cluster HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor HPCC-10149 More tests, and don't optimize KEEP(1),LIMIT(n) HPCC-8245 Ensure smartjoin test order consistent HPCC-8245 Be careful handling stop case HPCC-10156 Add WsTopology method ListTargetClusters HPCC-8245 Split row-owning vs non-owning into 2 implementations HPCC-10149 Optimize JOIN(l,r,...,t(LEFT),ATMOST(1),LEFT OUTER) HPCC-8245 Ensure flushedRowMarkers is clear at start HPCC-8528 Modify the code after pull request comments HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10022 Ensure duplicate persists within a query are still caught HPCC-10153 Add PublishedBy/IsLibrary to WUListQueries response HPCC-10074 Automate Eclipse Help HPC-8245 Avoid deadlock potential whilst flushing HPCC-10061 Remove duplicated test case HPCC-10006 Stop compound aggregation of CHOOSEN with start count HPCC-10145 Spurious warnings when git.sh fetches from remote repo HPCC-8528 Add #!/bin/bash in install scripts HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10106 Persist should ignore other persists when determining rebuild HPCC-9847 ECLCC crash due to dynamic record type within a MODULE HPCC-10143 Corrections to ECL documentation HPCC-9916 Don't allow setting daliip or sourceCluster at subfile level HPCC-9916 Allow source DALI and ProcessCluster overide in packagemap HPCC-9723 Add PACKAGE_FILE_NAME_PREFIX HPCC-8528 change permission HPCC-10061 Move test case into runtime regression suite HPCC-10022 Option to generate a persist for each unique ECL hash HPCC-8245 Switch to TAKsmart HPCC-8245 Smart Lookup Join HPCC-10031 Don't create index count if index read has ONFAIL limit HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor HPCC-8528 Creat/remove symbolic links with ClientTools installend/Uninstall HPCC-10126 htpasswd Authentication Modify Users Issue HPCC-9723 change Package name to allow multiple clienttools installed HPCC-10106 Persist should ignore other persists when determining rebuild HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10061 Don't remove subsorts if the input has no known sort order HPCC-10131:Add support for optional 'jvmlibpath' property in environment.conf; add additional error checking to JVM initialization. HPCC-10012 Add support for centos builds with -with-plugins variant HPCC-9956 Fix build break in windows introduced by previous commit. HPCC-10111 Add -showpaths to eclcc verbose help text HPCC-10111 In Windows, eclcc -showpaths has mixed folder separators HPCC-9403 fix non-default user home directory related issues HPCC-9773 Change group variable from $user to $group in chown. HPCC-10096 Use correct queryset name to get Activated status HPCC-10110 Docs:ConfigMgr Roxie HPCC-10113 Lookup join incorrectly handling KEEP(1) HPPC-10068 Various changes following review and new test case HPCC-9956 Reduce log file prints for pre_connect ENETUNREACH errors HPCC-10054 Enable "Enter" to complete search and forms HPCC-10106 Rebuild Persists if input files change, ignore other persists HPCC-10106 Ensure the #option is always in the workunit HPCC-10095 Help Icon Issues HPCC-10040 Increase maxRecordSize value to avoid "End of record not found..." exception during XML spray HPCC-10106 Rebuild Persists if input files change, ignore other persists HPCC-10090 Docs:VM Steps HPCC-9481 CSV record definition auto discovery HPCC-10068 Implement syntax for JOIN(,SMART) HPCC-9650 Sorting fails when same column is clicked several times HPCC-10052 Add missing stop in previous commit. HPCC-3315 Spot cluster 'realCluster' mismatch HPCC-9842 Add Java Samples to ECL Playground HPCC-10097 Regression test javaembed crashing intermittently HPCC-10083 Some slave exceptions detected too late HPCC-10078 Not return error when calling WUQueryDetails for hthor query HPCC-9378 Remove DISTRIBUTE from the RHS of a global lookup join HPCC-10080 Add Activated flag to WUListQueries response HPCC-9984 Compile direct from a version control system HPCC-9950 Fixed typo found in code review HPCC-9950 Clarify ecl bundle parameter docs HPCC-10045 Remove invalid error checking from debug builds. HPCC-8624 Ensure activities that read a logical keep lock HPCC-10052 Fix NWayInput/NWaySelect HPCC-10046 Optimize aggregate on single row datasets HPCC-9833 Fix exception leaking in ESP ECLWatch service code HPCC-10059 Add options to git hook to control time between fetches, etc HPCC-10072 Avoid roxiemem allocator cache deadlock HPCC-10072 Avoid roxiemem allocator cache deadlock HPCC-9984 Compile direct from a version control system HPCC-9975 Evaluate(module) does not like enum HPCC-10071 Allow eclcc regression suite cores to be configured HPCC-10070 Update needed to eclcc regression test instructions in sourcedoc.xml HPCC-10069 Typo correction to error messages 3101 and 3124 HPCC-10066 Add missing "Open in new window" buttons HPCC-10067 Minor JavaScript Error/Warnings HPCC-10064 Graph Syncing Issues HPCC-10065 Unable to open LFDetailsWidget in a new window HPCC-10063 Hide Timing Tree Map Help on Graph View HPCC-9034 Add Package Maps GUI to EclWatch HPCC-9249 Revised display message based on code review HPCC-10049 Retrieve data for displaying cumulative Roxie graphs HPCC-10044 Rename a method based on code review HPCC-10044 Add IsLibrary, PublishBy, etc to WUQuerysetDetails/WUQueryDetails HPCC-10060:Improve memory and thread handling of embedded Java code HPCC-9935 Add version number to new request item HPCC-10043 Add option to eclcc to restrict compilation to repository HPCC-9387 Add legacy import support to ecl publish, deploy, and run HPCC-9460 First Name and Last Name missing from My Account user area HPCC-9974 Add self-test option to ecl-bundle HPCC-9955 ECL Rec Layout metadata is not reported for CSV files in hthor HPCC-10048 Fix uninitialised variable in XREFDirectoryBuilder::getDirectory HPCC-9489 Add support to roxie for a checking memory allocator HPCC-9489 Add support to roxie for a checking memory allocator HPCC-9463 Use CInterfaceOf for a hashtable base class HPCC-10039 Prevent error messages from being truncated HPCC-9406 Some counts missing in roxie workunit graph progress HPCC-9364 Fix assert(mergeOrder) on stepped index read in a child query HPCC-9853 Fix clang warning/error on precedence of && HPCC-9853 Fix various warnings (a couple may have revealed minor bugs) HPCC-9800 Remove unused checkPrimaries option in Roxie HPCC-9946 Add support for JVM settings in environment.conf HPCC-10001 If classpath not set use default HPCC-10042 Edits to Configmgr Doc HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-9481 CSV record definition auto discovery HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-10038 failIfNoSourceFile parameter missing in DFUPlus help text. HPCC-10037 Word swap due to incorrect grammar HPCC-10035 Expose compressedSize at logical file level HPCC-9616 Add __ECL_LEGACY_MODE__ to provide information to ecl Simplify ensure, remove need for doCacheAdd flag Remove unused/unneeded remove() and clear() HPCC-9827 Base roxiemem allocator cache on flags as well HPCC-10003 Update status info to indicate what is compiling HPCC-9855 Documentation for DATASET(n,TRANSFORM()) HPCC-10000 Ensure hash values are converted to integers HPCC-10013 Correct usage syntax of listworkunits HPCC-9977 Document "eclcc -Me" option and add to usage HPCC-9481 CSV record definition auto discovery HPCC-9286 Allow multiple optional atmost conditions. HPCC-9999 Correctly export functions so hql.dll links on windows HPCC-9835 avoid issues with transaction actions causing crash HPCC-9961 Expose contents of @kind DFU attribute in WsDFU/DFUInfo HPCC-9919 Fix core accessing uncompressed workunit resources HPCC-8867 Fill in @kind file attribute for all files HPCC-9553 Support typedefs as the base type for ENUM definitions HPCC-9682 Rename a method based on review HPCC-9682 Add WsWorkunits method to return paged QuerySet Queries HPCC-9249 Return user/IP for paused queue to WsSMC/Activity response HPCC-9935 Add SourceFormat to ESP FileSpray/SprayFixed request HPCC-9503 Return action results when DFU WU restored HPCC-9905 Remove unnecessary code from the master branch HPCC-9701 Refactor meta calculation into separate properties HPCC-9900 DFUPlus does not support escape option for CSV spray HPCC-9779 Add an internal option to generate the ecl for a subgraph HPCC-9589 Remove colocal/parent extract from some child activities HPCC-9791 XML file spray logging improvement HPCC-9810 Add test case for transfer to/from unicode HPCC-9589 Introduce pseudo tables flags for xml/nlp parse HPCC-9790 Use a hash table to quickly resolve expressions HPCC-9791 XML file spray logging improvement HPCC-9762 Optimize COUNT(ITERATE(ds)) to COUNT(ds) HPCC-9743 Speed up #APPEND and #LOOP processing HPCC-9759 Remove the globalFold option (default always on) HPCC-9610 Improve implicit projection of child queries HPCC-9707 Correct indentation/move inline functions to main file HPCC-9707 Ensure scalar and set datasets are always hoisted Update BUNDLES.rst HPCC-9252 Fix issues found with huge allocators HPCC-9645 Fix problems with adding newAtom to selects from child rows HPCC-9667 Don't use buildTempExpr for getresults (can clone rows) HPCC-9640 Optimize NORMALIZE(ds, 0) and NORMALIZE(ds, 1) HPCC-9252 Reduce the locking window when allocating rows from a heap HPCC-9252 Avoid freeing empty pages in a heap which contains none. HPCC-9593 Added documentation pertaining to cmake structure HPCC-9593 Added documentation pertaining to cmake structure HPCC-9600 Use library classes for exists and count HPCC-9602 Avoid temporary variables when returing simple expressions HPCC-9627 Remove unused resourcing link type HPCC-9597 Combine multiple ds[1]. into a single row HPCC-9607 IPropertyTree exception on using STD.System.Workunit. HPCC-9609 Tidy up dataLinkStart calls HPCC-9598 Generate .row as a PROJECT instead of a 1 row NORMALIZE HPCC-9252 Improve the locking contention in roxiemem HPCC-9592 Generate a simpler graph for IF(cond, , ds) HPCC-9557 DFUPLUS spray: Cannot specify no quote character HPCC-9528 Regression Suite won't work with relative suiteDir path HPCC-9543 Fix crash caused by fix for issue 9467 HPCC-9509 Don't allow SELFJOIN,ALL to be created HPCC-9532 Fix code generator for reading dataset from another wuid HPCC-9504 Add README.1st file into testing/regress directory to describe how to run Regression Suite HPCC-8237 Add options to stress test callback usage in roxiemem HPCC-8312 Rationalise the use of property and attribute HPCC-9455 Add eclcc documentation in rst format HPCC-9471 Change the parameter to queryAttribute to an enum HPCC-8515 Running standalone with dalisrvers=... has issues. HPCC-9428 Remove @ sign from Deleting File confirmation HPCC-9465 Fix various issues picked up in the code review HPCC-9442 Avoid ensureCapacity call on fixed size disk read HPPC-9465 Use the preserved case for embedded language parameters HPCC-9465 Preserve the case of parameters for external functions HPCC-9446 Remove legacy @slaves from stock environment HPCC-8869 Revise based on review comments HPCC-9467 Thor needs to provide user credentials HPCC-8869 Refactor Eclwatch activity code HPCC-8869 Moves the existing onActivity code into three methods HPCC-9238 Use a record of string to display fixed length datasets HPCC-9430 Remove incorrect active datasets for unusual cases HPCC-9438 Fix problem with unusual joins against null datasets. HPCC-8728 lack of info. spraying large file(s) whilst partitioning HPCC-9411 Information needed about unloadable roxie queries HPCC-9266 DFU server logging excessive when spraying multiple files HPCC-9411 Information needed about unloadable roxie queries HPCC-9218 Further DFS refactoring solving some superfile issues Remove CCsvMatcher. Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method. HPCC-8316 Clean up the code to remove lots of workflow loops HPCC-9090 Add base 64 encode/decode functions to the ecllibrary HPCC-9248 Option to expand hash distribute and match existing distribution HPCC-9394 Remove unsafe (but unused) code in ccdfile.cpp HPCC-9258 Make Roxie UDP ports configurable HPCC-9239 Generate subsort optimizations HPCC-9324 Error handler missing after malloc() call several places in eclrtl.cpp HPCC-8477 DFU server is CPU bound for the first phase of CSV files Added error handler implemetation to rtlMalloc() and rtlRealloc() functions. HPCC-9224 WsEcl support for starting workunits asynchronously HPCC-8248 Allow frunssh to use more threads by default HPCC-7866 Use CInterfaceOf instead of double inheritance HPCC-9132 Improve spotting lightweight denormalize HPCC-8770 Show eclserver in Topology/TargetCluster page HPCC-9165 Allow XREF to run without suspending coalescer HPCC-9174 Allow functions that extend strings to be defined HPCC-9175 Optimize unnecessary copies of unicode strings HPCC-3207 Clarify closedown process
Release Notes for Community Edition 4.0.6-rc1 (Release Candidate 1)
All Known Limitations for Community Edition 4.0.4-1 still apply apply.
============================================================= Comprehensive list of changes from 4.0.4-1 to 4.0.6-rc1 ============================================================= HPCC-10481 - Default Replicate dir causing problems HPCC-10372 – Fixed DeleteSuperFile possible crash
Release Notes for Community Edition 4.0.4-1
================================
Known Limitations for 4.0.4-1
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages for Centos 5 does not support embedding JavaScript.
********************************************************************************************************************** Comprehensive list of changes from 4.0.2-x to 4.0.4-1 Gold ********************************************************************************************************************** HPCC-10287 Add check for inadequencies of transaction *** Community Edition 4.0.4-rc1 Release Candidate 1 HPCC-10288 Add RemoveOwnedSubFiles HPCC-10287 Catch out of order supers when removing a subfile HPCC-9912 edits from review HPCC-9912 Edits based on code review HPCC-9941 Document FORWARD option on MODULE HPCC-9941 Document FORWARD on MODULE HPCC-9912 Edits based upon review HPCC-9912 Document LOCAL option on DATASET n TRANSFORM HPCC-9722 DOCS:Non-Windows Client Tools HPCC-9870 Docs:JVM Settings HPCC-10127 Configmgr - Location section missing in esp.xml HPCC-9870 Docs:JVM Settings HPCC-10157 DOCS: Language Reference Links HPCC-10134 LogicalToPhysical file was not working HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor HPCC-10074 Automate Eclipse Help HPCC-10012 Add support for centos builds with -with-plugins variant HPCC-10110 Docs:ConfigMgr Roxie HPCC-10090 Docs:VM Steps HPCC-10090 Docs:VM Steps HPCC-10052 Add missing stop in previous commit. HPCC-9950 Fixed typo found in code review HPCC-9950 Clarify ecl bundle parameter docs HPCC-10045 Remove invalid error checking from debug builds. HPCC-10052 Fix NWayInput/NWaySelect HPCC-10046 Optimize aggregate on single row datasets HPCC-10072 Avoid roxiemem allocator cache deadlock HPCC-10048 Fix uninitialised variable in XREFDirectoryBuilder::getDirectory HPCC-9946 Add support for JVM settings in environment.conf HPCC-10001 If classpath not set use default HPCC-10042 Edits to Configmgr Doc HPCC-9855 Documentation for DATASET(n,TRANSFORM()) HPCC-10000 Ensure hash values are converted to integers HPCC-9977 Document "eclcc -Me" option and add to usage HPCC-9835 avoid issues with transaction actions causing crash HPCC-8867 Fill in @kind file attribute for all files
Release Notes for Community Edition 4.2.0-rc2
================================
Known Limitations for 4.2.0-rc2
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
============================================================ Comprehensive list of changes from 4.0.2-2 Gold to 4.2.0-rc2 ============================================================ ** Community Edition 4.2.0-rc2 Release Candidate 2 HPCC-7899 Add Z.A.P button HPCC-10290 ZAP report should distinguish compiler warnings and errors HPCC-10273 Add logical files in query set page HPCC-10292 ZIP from Zap has path info HPCC-10279 esdl_srv_engine should return HTTP exceptions HPCC-10224 Fix CSocket::name returning non terminated strings HPCC-10270 SprayVariable has incorrect parameters HPCC-10286 Add dependency for Ubuntu 13.10 (Saucy) HPCC-10280 DOCS:Add ID Attribute HPCC-10256 Add "Refresh Data" Button to Graph Page HPCC-10283 Ensure GLOBAL(,OPT) is processed correctly inside a library HPCC-10278 Create ZAP report feature not handling multiple logfiles HPCC-9683 Fix performance and memory usage issue for huge dataset HPCC-10276 Add jsonp support to WsEcl HPCC-10237 Don't move CHOOSEN() over a grouped count project HPCC-10265 Fix problems processing action dependencies HPCC-10264 After publishing using a remote dali, roxie requires remote dali HPCC-10275 "Compiled" Workunit not showing as completed HPCC-10274 Add workunit xml file to ZAP Report zip file HPCC-10129 DOCS:Std Lib Fix table formatting HPCC-10240 Fix example following review feedback HPCC-10262 Base Store cached data could "leak" between instances HPCC-10240 Prevent a TABLE() aggregate being converted to a non aggregate HPCC-10228 Roxie should lock subfiles, not just rely on superfile lock HPCC-10029 Add Dictionary Example to ECL Playground HPCC-9622 Disable failing hthor test when6b.ecl HPCC-10253 WsWorkunits::onGet should return exceptions to the client HPCC-10238 Remove ECLPLus interactive mode from docs ***** Community Edition 4.2.0-rc1 Release Candidate 1 HPCC-10251 Fix windows build break HPCC-9415 Use epoll, add EPOLLRDHUP define for Centos5.x HPCC-9918 CsvRecordSize class doesn't handle well the quoted and variable length datasets. HPCC-9307 Allow roxie to have dependencies within a subgraph HPCC-9415 Use epoll, fix critical section around init HPCC-10227 Use key cache in indexread/count HPCC-9244 Improved LOOKUP,MANY scheme HPCC-10107 Csv auto discovery should work with utf8 files. HPCC-10241 New ECL Watch + IE8 HPCC-9671 Add Published Query Pages HPCC-9307 Clean up the code HPCC-10204 Ensure that a contextClassLoader that uses the classpath is available to Java classes. HPCC-10203 Add manifest resource support for wildcards and relative URLS HPCC-10242 Fix preflight not working for roxie server and thor master HPCC-10244 Fix ID tags to produce HTML version HPCC-9906 Support DATASET(n, transform, LOCAL) HPCC-10239 Windows Build break in WsDeploy HPCC-9307 initial work and refactoring of action lists HPCC-9965 Add a ,UNSTABLE flag to a JOIN HPCC-10099 DOCS:JavaScript Embed HPCC-9192 Doc:PackageMgmt page HPCC-10176 Add Create Bug Report to ECL WU Details HPCC-9882 Do not check the return from removeEntry() HPCC-10174 Add Remote Dali Option HPCC-10140 Edits based on code review HPCC-10231 KeyedJoin hitting spurious limits HPCC-9322 Allow active name to be used with ecl-unpublish HPCC-9976 Add banner support to new ECL Watch HPCC-10159 Document SMART option for JOIN HPCC-9898 ConfigMgr - Fix thor topology cluster add / del HPCC-7899 Add "Report bug" button in eclwatch WU page HPCC-10140 Document Virtual Logicalfilename HPCC-10226 Document change to EXPIRE semantics HPCC-10124 ConfigMgr - Add new components and services from buildset HPCC-9322 Allow active name to be used with ecl-unpublish HPCC-9947 Improve the warning for an invalid use of NOTHOR HPCC-9968 New EXPIRE semantics HPCC-10004 DOCS:XREF Warning HPCC-9992 Implement __PLATFORM__ to query the target platform HPCC-9320 Preliminary minor refactoring for using global graph results HPCC-10169 Integrate ClientTools on Windows 32bit with Jenkins HPCC-10222 Perform proper field validation. HPCC-9898 ConfigMgr - delete multiple roxie servers HPCC-10130 Set accessedTime for all files HPCC-10055 Add Error/Warning Log for Toaster Messages HPCC-10022 Allow the max number of persist instances to be set HPCC-9913 Fix forcing value to bool warning in ccdquery.cpp HPCC-10195 Remove unused m_allowHttpNil flag from CSoapPrimitiveField HPCC-9934 Add SprayFixed Input HPCC-10032 Add schema generator support for xpath('') HPCC-9970 Default persist files to expiring after 14 days HPCC-9686 Add ability to fetch named results to ESPWorkunit HPCC-9803 New ECL Watch does not support existing visualisations HPCC-10021 ConfigMgr - Allow esp service to target a default cluster HPCC-9812 Ability to spray from any source in new ECL Watch HPCC-9966 Graph control disappears when switching HTML tabs HPCC-10146 Job status when blocked HPCC-9882 Check and return exception message from removeEntry() HPCC-10188 Rename Properties to attributes for consistency HPCC-10053 Display "busy" indicator on multi search HPCC-7898 Link release notes HPCC-10121 Match with the settings created by pull request #4952 HPCC-10121 Fix merge conflict HPCC-9861 Fix ECL regeneration of functions with multiple calls. HPCC-10196 Suggested improvement of for cpan mod installations HPCC-10147 Add comments to examples to indicate the expected errors HPCC-10194 Handle NULL results from Java functions HPCC-10028 removeEntry() should pass the error message to the caller HPCC-10177 Add code to restrict the number of persist instances HPCC-10184 Potential memory leak in uncompress routine HPCC-10185 Graph numeric properties sort as strings HPCC-10136 Fix ECL in FUNCTIONMACRO_Example.ecl HPCC-9941 Document FORWARD option on MODULE HPCC-10147 Initial implementation of JOIN(..., GROUP(x,y)) HPCC-10177 Add code to restrict the number of persist instances HPCC-10092 Configmgr - add attribute serverForArchivedECLWU to esp HPCC-10130 Set accessedTime for all files HPCC-10164 Don't substitute constants into ATMOST join conditions HPCC-10028 removeEntry() should pass the error message to the caller HPCC-9941 Document FORWARD on MODULE HPCC-9415 Disable by default for now HPCC-9415 New epoll implementation with common base class HPCC-10183 ECL Record Layout metadata is not reported for XML files in hthor HPCC-10181 Add Compile Time to WUQueryDetails response HPCC-9722 DOCS:Non-Windows Client Tools HPCC-9521 Refactor CDfsLogicalFileName to make it purely representational of a logical file, avoid it resolving/looking up HPCC-10175 Remove Roxie test page option from HPCC Platform HPCC-10093 Read compressed file size from DFU attributes HPCC-9547 packagemap-validate warning when library redefines query files HPCC-10028 removeEntry() should pass the error message to the caller HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10113 Dedup RHS if keep and no atmost/abortlimit HPCC-9870 Docs:JVM Settings HPCC-10127 Configmgr - Location section missing in esp.xml HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10157 DOCS: Language Reference Links HPCC-10015 Add WUID wildcard search for WUQuery HPCC-10034 Move all JSON validation and pretty printing to client side HPCC-9404 Test DEDUP, KEEP(RIGHT) HPCC-10134 LogicalToPhysical file was not working HPCC-9982 Jobs run on hthor should fail if they need to rebuild a thor persist HPCC-10108 No way to disable quote processing and use the CSV quick partitioning HPCC-10149 Fix regression test, and check for KEEP(1), LIMIT(n) HPCC-8902 #workunit ('cluster', 'xxx') not supported by eclccserver HPCC-10108 No way to disable quote processing and use the CSV quick partitioning HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10161 Add option in eclagent to force persist rebuilds, for debugging HPCC-10160 EclAgent core if PERSIST names invalid thor cluster HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor HPCC-10149 More tests, and don't optimize KEEP(1),LIMIT(n) HPCC-8245 Ensure smartjoin test order consistent HPCC-8245 Be careful handling stop case HPCC-10156 Add WsTopology method ListTargetClusters HPCC-8245 Split row-owning vs non-owning into 2 implementations HPCC-10149 Optimize JOIN(l,r,...,t(LEFT),ATMOST(1),LEFT OUTER) HPCC-8245 Ensure flushedRowMarkers is clear at start HPCC-8528 Modify the code after pull request comments HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10022 Ensure duplicate persists within a query are still caught HPCC-10153 Add PublishedBy/IsLibrary to WUListQueries response HPCC-10074 Automate Eclipse Help HPC-8245 Avoid deadlock potential whilst flushing HPCC-10061 Remove duplicated test case HPCC-10006 Stop compound aggregation of CHOOSEN with start count HPCC-10145 Spurious warnings when git.sh fetches from remote repo HPCC-8528 Add #!/bin/bash in install scripts HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10106 Persist should ignore other persists when determining rebuild HPCC-9847 ECLCC crash due to dynamic record type within a MODULE HPCC-10143 Corrections to ECL documentation HPCC-9916 Don't allow setting daliip or sourceCluster at subfile level HPCC-9916 Allow source DALI and ProcessCluster overide in packagemap HPCC-9723 Add PACKAGE_FILE_NAME_PREFIX HPCC-8528 change permission HPCC-10061 Move test case into runtime regression suite HPCC-10022 Option to generate a persist for each unique ECL hash HPCC-8245 Switch to TAKsmart HPCC-8245 Smart Lookup Join HPCC-10031 Don't create index count if index read has ONFAIL limit HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor HPCC-8528 Creat/remove symbolic links with ClientTools installend/Uninstall HPCC-10126 htpasswd Authentication Modify Users Issue HPCC-9723 change Package name to allow multiple clienttools installed HPCC-10106 Persist should ignore other persists when determining rebuild HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10077 Spray compressed does not set @compressedSize on file parts HPCC-10061 Don't remove subsorts if the input has no known sort order HPCC-10131:Add support for optional 'jvmlibpath' property in environment.conf; add additional error checking to JVM initialization. HPCC-10012 Add support for centos builds with -with-plugins variant HPCC-9956 Fix build break in windows introduced by previous commit. HPCC-10111 Add -showpaths to eclcc verbose help text HPCC-10111 In Windows, eclcc -showpaths has mixed folder separators HPCC-9403 fix non-default user home directory related issues HPCC-9773 Change group variable from $user to $group in chown. HPCC-10096 Use correct queryset name to get Activated status HPCC-10110 Docs:ConfigMgr Roxie HPCC-10113 Lookup join incorrectly handling KEEP(1) HPPC-10068 Various changes following review and new test case HPCC-9956 Reduce log file prints for pre_connect ENETUNREACH errors HPCC-10054 Enable "Enter" to complete search and forms HPCC-10106 Rebuild Persists if input files change, ignore other persists HPCC-10106 Ensure the #option is always in the workunit HPCC-10095 Help Icon Issues HPCC-10040 Increase maxRecordSize value to avoid "End of record not found..." exception during XML spray HPCC-10106 Rebuild Persists if input files change, ignore other persists HPCC-10090 Docs:VM Steps HPCC-9481 CSV record definition auto discovery HPCC-10068 Implement syntax for JOIN(,SMART) HPCC-9650 Sorting fails when same column is clicked several times HPCC-10052 Add missing stop in previous commit. HPCC-3315 Spot cluster 'realCluster' mismatch HPCC-9842 Add Java Samples to ECL Playground HPCC-10097 Regression test javaembed crashing intermittently HPCC-10083 Some slave exceptions detected too late HPCC-10078 Not return error when calling WUQueryDetails for hthor query HPCC-9378 Remove DISTRIBUTE from the RHS of a global lookup join HPCC-10080 Add Activated flag to WUListQueries response HPCC-9984 Compile direct from a version control system HPCC-9950 Fixed typo found in code review HPCC-9950 Clarify ecl bundle parameter docs HPCC-10045 Remove invalid error checking from debug builds. HPCC-8624 Ensure activities that read a logical keep lock HPCC-10052 Fix NWayInput/NWaySelect HPCC-10046 Optimize aggregate on single row datasets HPCC-9833 Fix exception leaking in ESP ECLWatch service code HPCC-10059 Add options to git hook to control time between fetches, etc HPCC-10072 Avoid roxiemem allocator cache deadlock HPCC-10072 Avoid roxiemem allocator cache deadlock HPCC-9984 Compile direct from a version control system HPCC-9975 Evaluate(module) does not like enum HPCC-10071 Allow eclcc regression suite cores to be configured HPCC-10070 Update needed to eclcc regression test instructions in sourcedoc.xml HPCC-10069 Typo correction to error messages 3101 and 3124 HPCC-10066 Add missing "Open in new window" buttons HPCC-10067 Minor JavaScript Error/Warnings HPCC-10064 Graph Syncing Issues HPCC-10065 Unable to open LFDetailsWidget in a new window HPCC-10063 Hide Timing Tree Map Help on Graph View HPCC-9034 Add Package Maps GUI to EclWatch HPCC-9249 Revised display message based on code review HPCC-10049 Retrieve data for displaying cumulative Roxie graphs HPCC-10044 Rename a method based on code review HPCC-10044 Add IsLibrary, PublishBy, etc to WUQuerysetDetails/WUQueryDetails HPCC-10060:Improve memory and thread handling of embedded Java code HPCC-9935 Add version number to new request item HPCC-10043 Add option to eclcc to restrict compilation to repository HPCC-9387 Add legacy import support to ecl publish, deploy, and run HPCC-9460 First Name and Last Name missing from My Account user area HPCC-9974 Add self-test option to ecl-bundle HPCC-9955 ECL Rec Layout metadata is not reported for CSV files in hthor HPCC-10048 Fix uninitialised variable in XREFDirectoryBuilder::getDirectory HPCC-9489 Add support to roxie for a checking memory allocator HPCC-9489 Add support to roxie for a checking memory allocator HPCC-9463 Use CInterfaceOf for a hashtable base class HPCC-10039 Prevent error messages from being truncated HPCC-9406 Some counts missing in roxie workunit graph progress HPCC-9364 Fix assert(mergeOrder) on stepped index read in a child query HPCC-9853 Fix clang warning/error on precedence of && HPCC-9853 Fix various warnings (a couple may have revealed minor bugs) HPCC-9800 Remove unused checkPrimaries option in Roxie HPCC-9946 Add support for JVM settings in environment.conf HPCC-10001 If classpath not set use default HPCC-10042 Edits to Configmgr Doc HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-9481 CSV record definition auto discovery HPCC-9984 Compile direct from a version control system HPCC-9984 Compile direct from a version control system HPCC-10038 failIfNoSourceFile parameter missing in DFUPlus help text. HPCC-10037 Word swap due to incorrect grammar HPCC-10035 Expose compressedSize at logical file level HPCC-9616 Add __ECL_LEGACY_MODE__ to provide information to ecl Simplify ensure, remove need for doCacheAdd flag Remove unused/unneeded remove() and clear() HPCC-9827 Base roxiemem allocator cache on flags as well HPCC-10003 Update status info to indicate what is compiling HPCC-9855 Documentation for DATASET(n,TRANSFORM()) HPCC-10000 Ensure hash values are converted to integers HPCC-10013 Correct usage syntax of listworkunits HPCC-9977 Document "eclcc -Me" option and add to usage HPCC-9481 CSV record definition auto discovery HPCC-9286 Allow multiple optional atmost conditions. HPCC-9999 Correctly export functions so hql.dll links on windows HPCC-9835 avoid issues with transaction actions causing crash HPCC-9961 Expose contents of @kind DFU attribute in WsDFU/DFUInfo HPCC-9919 Fix core accessing uncompressed workunit resources HPCC-8867 Fill in @kind file attribute for all files HPCC-9553 Support typedefs as the base type for ENUM definitions HPCC-9682 Rename a method based on review HPCC-9682 Add WsWorkunits method to return paged QuerySet Queries HPCC-9249 Return user/IP for paused queue to WsSMC/Activity response HPCC-9935 Add SourceFormat to ESP FileSpray/SprayFixed request HPCC-9503 Return action results when DFU WU restored HPCC-9905 Remove unnecessary code from the master branch HPCC-9701 Refactor meta calculation into separate properties HPCC-9900 DFUPlus does not support escape option for CSV spray HPCC-9779 Add an internal option to generate the ecl for a subgraph HPCC-9589 Remove colocal/parent extract from some child activities HPCC-9791 XML file spray logging improvement HPCC-9810 Add test case for transfer to/from unicode HPCC-9589 Introduce pseudo tables flags for xml/nlp parse HPCC-9790 Use a hash table to quickly resolve expressions HPCC-9791 XML file spray logging improvement HPCC-9762 Optimize COUNT(ITERATE(ds)) to COUNT(ds) HPCC-9743 Speed up #APPEND and #LOOP processing HPCC-9759 Remove the globalFold option (default always on) HPCC-9610 Improve implicit projection of child queries HPCC-9707 Correct indentation/move inline functions to main file HPCC-9707 Ensure scalar and set datasets are always hoisted Update BUNDLES.rst HPCC-9252 Fix issues found with huge allocators HPCC-9645 Fix problems with adding newAtom to selects from child rows HPCC-9667 Don't use buildTempExpr for getresults (can clone rows) HPCC-9640 Optimize NORMALIZE(ds, 0) and NORMALIZE(ds, 1) HPCC-9252 Reduce the locking window when allocating rows from a heap HPCC-9252 Avoid freeing empty pages in a heap which contains none. HPCC-9593 Added documentation pertaining to cmake structure HPCC-9593 Added documentation pertaining to cmake structure HPCC-9600 Use library classes for exists and count HPCC-9602 Avoid temporary variables when returing simple expressions HPCC-9627 Remove unused resourcing link type HPCC-9597 Combine multiple ds[1]. into a single row HPCC-9607 IPropertyTree exception on using STD.System.Workunit. HPCC-9609 Tidy up dataLinkStart calls HPCC-9598 Generate .row as a PROJECT instead of a 1 row NORMALIZE HPCC-9252 Improve the locking contention in roxiemem HPCC-9592 Generate a simpler graph for IF(cond, , ds) HPCC-9557 DFUPLUS spray: Cannot specify no quote character HPCC-9528 Regression Suite won't work with relative suiteDir path HPCC-9543 Fix crash caused by fix for issue 9467 HPCC-9509 Don't allow SELFJOIN,ALL to be created HPCC-9532 Fix code generator for reading dataset from another wuid HPCC-9504 Add README.1st file into testing/regress directory to describe how to run Regression Suite HPCC-8237 Add options to stress test callback usage in roxiemem HPCC-8312 Rationalise the use of property and attribute HPCC-9455 Add eclcc documentation in rst format HPCC-9471 Change the parameter to queryAttribute to an enum HPCC-8515 Running standalone with dalisrvers=... has issues. HPCC-9428 Remove @ sign from Deleting File confirmation HPCC-9465 Fix various issues picked up in the code review HPCC-9442 Avoid ensureCapacity call on fixed size disk read HPPC-9465 Use the preserved case for embedded language parameters HPCC-9465 Preserve the case of parameters for external functions HPCC-9446 Remove legacy @slaves from stock environment HPCC-8869 Revise based on review comments HPCC-9467 Thor needs to provide user credentials HPCC-8869 Refactor Eclwatch activity code HPCC-8869 Moves the existing onActivity code into three methods HPCC-9238 Use a record of string to display fixed length datasets HPCC-9430 Remove incorrect active datasets for unusual cases HPCC-9438 Fix problem with unusual joins against null datasets. HPCC-8728 lack of info. spraying large file(s) whilst partitioning HPCC-9411 Information needed about unloadable roxie queries HPCC-9266 DFU server logging excessive when spraying multiple files HPCC-9411 Information needed about unloadable roxie queries HPCC-9218 Further DFS refactoring solving some superfile issues Remove CCsvMatcher. Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method. HPCC-8316 Clean up the code to remove lots of workflow loops HPCC-9090 Add base 64 encode/decode functions to the ecllibrary HPCC-9248 Option to expand hash distribute and match existing distribution HPCC-9394 Remove unsafe (but unused) code in ccdfile.cpp HPCC-9258 Make Roxie UDP ports configurable HPCC-9239 Generate subsort optimizations HPCC-9324 Error handler missing after malloc() call several places in eclrtl.cpp HPCC-8477 DFU server is CPU bound for the first phase of CSV files Added error handler implemetation to rtlMalloc() and rtlRealloc() functions. HPCC-9224 WsEcl support for starting workunits asynchronously HPCC-8248 Allow frunssh to use more threads by default HPCC-7866 Use CInterfaceOf instead of double inheritance HPCC-9132 Improve spotting lightweight denormalize HPCC-8770 Show eclserver in Topology/TargetCluster page HPCC-9165 Allow XREF to run without suspending coalescer HPCC-9174 Allow functions that extend strings to be defined HPCC-9175 Optimize unnecessary copies of unicode strings HPCC-3207 Clarify closedown process
HPCC VM Image with Virtual Box
When importing the 32-bit or 64-bit HPCC VM Image into Virtual Box on a Windows machine, you must open up the network settings before you start the VM due to an issue with network adapters
After importing the Image, open the Settings for the Image. Navigate to Network settings and select the tab for Adapter 2.
Verify the following settings:
- Enable Network Adapter is checked
- Attached to: Host-only Adapter
- Name: VirtualBox Host-Only Ethernet Adapter
Make sure that the Name for Adapter 2 changes from ‘vboxnet0’ to ‘VirtualBox Host-Only Ethernet Adapter’
Once confirmed, press the OK button and start the VM.
Release Notes for Community Edition 4.0.2-2 and 4.0.2-1
================================
Known Limitations for 4.0.2
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
============================================================ Comprehensive list of changes from 4.0.0-9 to 4.0.2-2 Gold ============================================================ Community Edition 4.0.2-2 Gold HPCC-10010 Set uninitialized stopped flag HPPC-10010 Fix race condition in multicore join helper Community Edition 4.0.2-1 HPCC-9250 XPATH can no longer be ambiguous Community Edition 4.0.2-rc3 Release Candidate 3 HPCC-9349 HTTPCALL still failing due to missing line in commit HPCC-9940 Remove invalid consistency check code (only affected debug) HPCC-9904 ensure detach checks if allowed to delete file HPCC-9930 Updated list of dependencies for installing from source HPCC-9938 Spelling & Grammar in Documentation HPCC-9909 Typos in compiler error messages Community Edition 4.0.2-rc2 Release Candidate 2 HPCC-9879 Fix cores with unicode find strength functions on null strings HPCC-9902 Use the build version as the ecl version reported by eclcc HPCC-9933 Bundle tool does not properly support multi-file bundles HPCC-9867 CSV spray incorrectly splitting records with nested quotes Remove CCsvMatcher. Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method. HPCC-8477 DFU server is CPU bound for the first phase of CSV files HPCC-9893 Fix core caused by invalid inline dataset syntax HPCC-9924 Avoid timeout causing HD resend HPCC-9901 Generic Filter Widget HPCC-9905 Fix problems with embeded functions returning datasets HPCC-8844 Document LOCAL keyword Community Edition 4.0.2-rc1 Release Candidate 1 HPCC-9337 --source-process option to specify where to copy data from HPCC-9900 DFUPlus does not support escape option for CSV spray HPCC-9915 Fix missing export declaration from new function HPCC-9897 Bundles should have a method to indicate minimum platform version HPCC-9841 Deleting files from cluster other than original fails HPCC-9910 Undefined symbol with dictionary using INTEGER type HPCC-9881 Add default context menu support HPCC-9763 Use newly generated UNORDERED flag for join helper HPCC-9746 Don't match expressions to constant transform values. HPCC-9897 Bundles should have a method to indicate minimum platform version HPCC-9869 Make packages easier to manage on multiple targets HPCC-9869 check id parameter to getPckageMapById IDE-305 Missing parameter in documentation for Std.Str.SplitWords() HPCC-9837 EVALUATE topic in Lang Ref has "See Also" references that are not links HPCC-9380 Document STD Library fileservices LogicalFileList param HPCC-9891 Generate meta info even if syntax errors HPCC-9883 OSX RPATH Fixing for Plugins HPCC-9890 Dynamic loading assumes .so extension (so can fail on OSX) HPCC-9874 Improve WsEcl JSON formatting for xml types used by ECL HPCC-9864 Does not pull data from buddy nodes HPCC-9884 Roxie does not copy files from remote if local orphan exists HPCC-9841 Deleting files from cluster other than original fails HPCC-9651 Move Timings TreeMap to new Graphs list HPCC-9869 Add support for explicitly using packagemaps shared globally HPCC-9869 Make packages easier to manage on multiple targets HPCC-9860 Avoid holding session crit whilst destroying subs HPCC-9858 Split out the embed catch tests HPCC-9821 Allow raw HTML + JavaScript in result cells HPCC-9840 Allow "Open in New Page" for each details page. HPCC-9854 Enable prototyping in JSBin HPCC-9857 Configmr - Crashes if referencing a missing HW node
Release Notes for Community Edition 4.0.2-rc2 (Release Candidate 2)
================================
Known Limitations for 4.0.2-rc2
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
============================================================ Comprehensive list of changes from 4.0.0-9 to 4.0.2-rc2 ============================================================ Community Edition 4.0.2-rc2 Release Candidate 2 HPCC-9879 Fix cores with unicode find strength functions on null strings HPCC-9902 Use the build version as the ecl version reported by eclcc HPCC-9933 Bundle tool does not properly support multi-file bundles HPCC-9867 CSV spray incorrectly splitting records with nested quotes Remove CCsvMatcher. Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method. HPCC-8477 DFU server is CPU bound for the first phase of CSV files HPCC-9893 Fix core caused by invalid inline dataset syntax HPCC-9924 Avoid timeout causing HD resend HPCC-9901 Generic Filter Widget HPCC-9905 Fix problems with embeded functions returning datasets HPCC-8844 Document LOCAL keyword Community Edition 4.0.2-rc1 Release Candidate 1 HPCC-9337 --source-process option to specify where to copy data from HPCC-9900 DFUPlus does not support escape option for CSV spray HPCC-9915 Fix missing export declaration from new function HPCC-9897 Bundles should have a method to indicate minimum platform version HPCC-9841 Deleting files from cluster other than original fails HPCC-9910 Undefined symbol with dictionary using INTEGER type HPCC-9881 Add default context menu support HPCC-9763 Use newly generated UNORDERED flag for join helper HPCC-9746 Don't match expressions to constant transform values. HPCC-9897 Bundles should have a method to indicate minimum platform version HPCC-9869 Make packages easier to manage on multiple targets HPCC-9869 check id parameter to getPckageMapById IDE-305 Missing parameter in documentation for Std.Str.SplitWords() HPCC-9837 EVALUATE topic in Lang Ref has "See Also" references that are not links HPCC-9380 Document STD Library fileservices LogicalFileList param HPCC-9891 Generate meta info even if syntax errors HPCC-9883 OSX RPATH Fixing for Plugins HPCC-9890 Dynamic loading assumes .so extension (so can fail on OSX) HPCC-9874 Improve WsEcl JSON formatting for xml types used by ECL HPCC-9864 Does not pull data from buddy nodes HPCC-9884 Roxie does not copy files from remote if local orphan exists HPCC-9841 Deleting files from cluster other than original fails HPCC-9651 Move Timings TreeMap to new Graphs list HPCC-9869 Add support for explicitly using packagemaps shared globally HPCC-9869 Make packages easier to manage on multiple targets HPCC-9860 Avoid holding session crit whilst destroying subs HPCC-9858 Split out the embed catch tests HPCC-9821 Allow raw HTML + JavaScript in result cells HPCC-9840 Allow "Open in New Page" for each details page. HPCC-9854 Enable prototyping in JSBin HPCC-9857 Configmr - Crashes if referencing a missing HW node
Release Notes for Community Edition 4.0.0-9
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-8 to 4.0.0-9 ======================================== HPCC-9769 Java embed not working on Centos5
Release Notes for Community Edition 4.0.0-8
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-6 to 4.0.0-8 ======================================== HPCC-9839 Fix regression failing to check crcResources option HPCC-9802 Add exception release HPCC-9802 Delete logical file using removeEntry(), not detach() HPCC-9828 Resolve package watcher notification/reload deadlock
Release Notes for Community Edition 4.0.0-6
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-5 to 4.0.0-6 ======================================== HPCC-9771 Configmgr - crashes when deleting 'null' roxie server HPCC-9795 Roxie needs to figure out numChannels
Release Notes for Community Edition 4.0.0-5
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-4 to 4.0.0-5 ======================================== HPCC-9784 - Fix workunit output limit regression
Release Notes for Community Edition 4.0.0-4
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-1 to 4.0.0-4 ======================================== HPCC-9745 Add getDaliServers() back into the ICodeContext
Release Notes for Community Edition 4.0.0-1
================================
Known Limitations for 4.0.0-1
================================
- If you are embedding source code for a case-sensitive language, such as R, you must pass your variables as all lowercase in your code. (even though ECL is case-insensitive.)
- If you are installing bundles from a compressed file (such as zip or .tgz) on a Mac, you must first extract the files.
- You cannot have multiple versions of Client Tools installed on a Linux machine.
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/4.0.0/clienttools/bin
- When running the VM image in VMware player, it may display an incorrect IP address for ECL Watch. If that does occur, login to the VMware shell using the default credentials (user:hpccdemo) and use the ifconfig command to see the actual IP address for the eth1 adapter. Enter that address (adding :8010 for the port) in your browser and ECL IDE.
Note: The following issues do not affect deb-based systems.
- For RPM based systems, you must first uninstall any previous versions before installing Community Edition 4.0.0.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the –nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:
Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
============================================================ Comprehensive list of changes from 3.10.x to 4.0.0-1 ============================================================ HPCC-9050 Need to update the helper version number since incompatible HPCC-9050 Allow ROLLUP condition to selectively use rolled up row for LEFT HPCC-9063 Fix regression handling non dynamic filenames in roxie HPCC-9045 WSFileIO is not accessible by non-admin users HPCC-9061 Invalid "context" qualifier HPCC-9056 Build break in thor (Windows) HPCC-8597 Update Replace Master HPCC-9058 Temporarily disable failing tests in thor HPCC-8990 Regression suite failures with no active dali connection available HPCC-9015 Restore previous ROLLUP semantics HPCC-9047 Replace 'children' property with 'childNodes' in javascript HPCC-8597 Update Replace Master HPCC-9012 Minimum version of python changed to 2.6 HPCC-8953 Add roxie support for JSON/HTTP queries HPCC-9014 Roxie Manual Correction Add missing ENVIRONMENT_API HPCC-9042 Correct Rembed using incorrect variable for found HPCC-9041 Quotes around R_INCLUDE_DIRS causing issue with cmake<2.8.8 HPCC-9024 Fix FindR.cmake when related to Rembed plugin HPCC-8954 Update Spray CSV HPCC-8797 Configmgr - Guard against special characters in Comp Names HPCC-9036 Remove "Legacy" pages HPCC-9035 Support NAS flat configuration HPCC-9015 Restore previous ROLLUP semantics Ensure no overflow when calculating fpos HPCC-9026 Pull distributor restart issues HPCC-8981 ConfigMgr - Add NAS Translation to Hardware HPCC-8954 Update Spray CSV HPCC-8992 Various problems in key sampling used by merge HPCC-9021 Non-locking mode for single-node / dev roxies HPCC-9027 Roxie file handle errors HPCC-9028 Roxie not handling OPT flag correctly on dynamically-resolved files HPCC-9029 Roxie can core if write to file when no workunit HPCC-8955 Document changes to "packagemap validate" HPCC-8999 Move new Features in ECL Watch HPCC-8954 Update Spray CSV HPCC-8788 Require Python 2.7 to build pyembed HPCC-9016 Centos 5 build error finding R libraries HPCC-9000 Variable length record display issues HPCC-8954 Update Spray CSV HPCC-9010 Check query tree branch before using it HPCC-9011 Check user object before checking its password expiration HPCC-8887 Text running too close to table border in Graph window HPCC-8539 Add configuration option to specify dali client MP port range IDE-246 Add warning to getECLPluginDefinition HPCC-9003 Check inside expression attributes for evaluation in thor. HPCC-8991 STEPPED is supported by thor so remove the error HPCC-8850 enhance package validation to check for files that aren't mapped HPCC-8954 Update Spray CSV HPCC-8792 Log disk space at thor startup HPCC-8864 Add comment/nas/content/live/hpccsystems clearup HPCC-7928 Ensure each branch of a SEQUENTIAL is independent HPCC-8981 Configmgr - nicSpeed missing in Computer Types HPCC-8797 Configmgr - Guard against special characters in Comp Names HPCC-8761 Revise based on review HPCC-8662 Configmgr - Add NAS translation to Hardware HPCC-8981 Configmgr - nicSpeed missing in Computer Types HPCC-8764 Ensure temps don't clash if sharing filing system Correct return type HPCC-8909 Avoid thor recycling if registration error detected HPCC-8909 Throw error if Thor slaves and master have different build versions HPCC-8977 Clean Warning in mime.cpp HPCC-8761 Add HTTP 304 support to HTTP requests HPCC-8053 Superfile lock contention causing superfile corruption HPCC-8987 MoveExternalFile error misleading HPCC-2695 More clang warnings HPCC-8352 Remove out of date export declarations HPCC-8809 LdapPassword needs new splash page after HPCC-8888 Rename Spray CSV to Spray Variable in EclWatch display HPCC-8984 WU With target of "compile" is not marked as completed HPCC-7946 CATCH(expr,msg) won't compile HPCC-8765 Plugin cmake macros to clean up optional plugins HPCC-8849 QuerySet action commands should verify query exists HPCC-8900 cli should allow wu compile state of compiled or completed HPCC-8926 Fix ecl-queries still using queryset instead of target HPCC-7946 CATCH(expr,msg) won't compile Add an assert to ensure limit is <=32bit HPCC-2998 Move helper to thorcommon and delete unused class HPCC-8978 Issues with SOAPCALL in child queries. HPCC-2998 Remove getRecordSize(NULL) from result reading HPCC-219 Remove unused function (with incorrect hold parameter) HPCC-8765 Plugin cmake macros to clean up optional plugins HPCC-8976 Fix suspect code in CSocket::write_multiple HPCC-8669 Extend NAS mapping options HPCC-8973 Fix build break with huge page support HPCC-8080 Correction of command line argument handling HPCC-2998 Some calls to getRecordSize(NULL) remain HPCC-8586 Remove code that tries to percolate maxlength when projecting HPCC-2998 Some calls to getRecordSize(NULL) remain HPCC-8877 Show WU state on Activity page HPCC-8969 Enforce an absolute hard limit on dali results HPCC-8665 Fix the types of link counted arguments to out of line functions HPCC-8971 Optimize SEQUENTIAL of a single action. HPCC-8865 Document Escape Character in SprayVariable ECL library function HPCC-8843 Incorrect argument named in docs for Std.File.CreateSuperFile HPCC-219 Not reporting errors due to locked files HPCC-8964 Don't generate a JFindexfromactivity keyed join for thor HPCC-8928 Optimize a few minor uses of NOT(expression) HPCC-8966 Provide a context for GetGlobalUniqueIds HPCC-8960 Uninitialized variable in dadfs (rename physical) HPCC-8934 Minor changes following code review HPCC-8957 Compressed files being published with incorrect crc HPCC-8932 workunits are incompatible, so increase the version number HPCC-8816 Show 'Delete Query' result and redirect to QuerySet HPCC-8951 Incorrect extension for proxy plugins HPCC-8932 Move getMinRecordSize() to IRecordSize HPCC-8950 Control:activeQueries crashes a stand alone roxie server instance HPCC-8951 Incorrect extension for proxy plugins HPCC-8918 Payload syntax => should work the same for indexes HPCC-8949 Ecl packagemap add needs to add each package one time HPCC-8948 Allow 'slaveDaliClient' as job option HPCC-8934 Add support for huge pages to roxiemem HPCC-8937 Add a flag to skip existing superfile check hpcc-8905 Fix minisort OOM and deadlock HPCC-8925 XMLDECODE decodes & to nothing HPCC-3155 RemotePull.xml HPCC-8939 Fix problems with IN ('a','b') hpcc-8905 Fix minisort OOM and deadlock HPCC-8944 Add missing case entry for record calculation HPCC-8828 Add new metrics to Roxie hpcc-8930 Child graph could have missing progress data HPCC-8352 Move DBZaction into eclrtl and more cleaning up HPCC-8683 Problems with PLUGIN attribute on a service definition HPCC-2678 Document NOFOLD HPCC-8036 Java/Python language support in ECL HPCC-8435 Clean up hierarchy of PTreeReader init and reset methods HPCC-8352 Update comments to clarify the code HPCC-8559 Remove legacy thor support HPCC-8352 Allow divide by zero action to be configured HPCC-8897 Pass cacheHint to use paged cache when querying workunits HPCC-8184 Add calls to Roxie to bypass dafilesrv for network attached storage HPCC-8927 Lazy open should default to smart mode HPCC-8629 Document ESP HTPASSWD HPCC-3155 Std.File.RemotePull compression docs HPCC-8910 Rename EclWatch Copy URL menu to View URL HPCC-8828 Add new metrics to Roxie HPCC-8924 Prevent simple recursive computerTypes causing stack faults HPCC-8186 Generate precompiled header at eclccserver startup time HPCC-8923 Roxie not checking workunit version matches HPCC-8922 Fix problems casting constant decimals to booleans HPCC-8861 Refactor LogicalFiles HPCC-8913 Remove a deprecated and unused IResultSet interface HPCC-8562 Remove some redundant #options HPCC-8418 Fix Schema for sets with xpaths 'name' and 'name/' HPCC-8562 Remove TAKrawiterator - no longer generated HPCC-8562 Fix error generating a SERIALIZE/DESERIALIZE activity HPCC-8562 Always enable linked counted rows HPCC-8562 Remove a couple more options HPCC-8562 Refactor out a couple more options HPCC-8562 Always support LCR and used LCR for temporaries HPCC-8562 Remove support for legacy thor from the code generator HPCC-8549 Document all the DICTIONARY syntax changes. more edits HPCC-8418 Schema generation should ignore xpaths that are too long HPCC-8901 Add priorityValue to the workunit information HPCC-8898 #EXPORT not handling decimal types correctly HPCC-8729 Improve workunit iterator efficiency HPCC-8435 PTree Reader interface names should not reference XML HPCC-8811 Revise based on review comments HPCC-8435 Common up JSON and XML Pull Parser code HPCC-8435 Implement JSON Pull Parser and PTree creation HPCC-8549 Document all the DICTIONARY syntax changes. Edits HPCC-8627 Add new ESP HTPASSWD style MD5 authentication Cache and reuse postfilter HPCC-8482 Remove unreachable code HPCC-8862 Add support for csv escape characters to sprayVariable HPCC-8585 Ensure Priority is cloned into the workunit HPCC-8892 Error on key build, with excessively large key+payload HPCC-8811 Return WUIDs in WsWorkunits/WUResubmit soap response HPCC-8549 Document all the DICTIONARY syntax changes. HPCC-8543 Document the new { default(value) } attribute on a field HPCC-8882 Provide rudimentary documentation for eclrtl and thorhelper HPCC-8895 DICTIONARY should keep first row with a given key Add results of postfilter to cache. HPCC-8896 Dict_keyed test failing regression suite in translation mode HPCC-8882 Move commonext into thorhelper and thorutil HPCC-8882 Switch use using the Roxie macros and remove a cloned class HPCC-8882 Make eclrtl depend on roxiemem and remove row callback HPCC-8882 Common up and clean up rowset releasing code. HPCC-8482 Delay reporting errors in field mappings until actually used HPCC-8891 ECLPlayground broken HPCC-8810 Generate an RtlDictionaryTypeInfo for dictionary fields HPCC-8556 Refactor const char * query functions from helpers HPCC-8882 Remove unused dependencies from eclcc HPCC-8882 Remove unnecessary XXX_API qualifiers HPCC-8882 Add const to some addCluster() arguments HPCC-8882 Add a dependency from thorhelper to dalibase HPCC-8890 Avoid early abort losing original error HPCC-8555 reinstate getOptInt from mismerge HPCC-8886 Update dojo to 1.8.3 HPCC-8882 Clean up source following review HPCC-8882 Merge roxiehelper into thorhelper HPCC-8882 Remove unused dependency or roxiehelper on dalibase HPCC-8882 Use the roxie class for an owned row in the stepping code HPCC-8882 Move workflow.cpp from eclrtl.so to workunit.so HPCC-8881 Move roxierow into thorhelper dll HPCC-8878 Improve the error message if MAXLENGTH is too small HPCC-8638 Update the regression test cases HPCC-8638 Allow the internal CSV buffer to dynamically resize HPCC-8870 Fix a minor possibility of corrupting memory in csv unquoting HPCC-8806 Rename Delete Query to Deactivate on Queries Active tab HPCC-8860 Ecl packagemap needs to return an error for invalid dali ip HPCC-8760 Revise one more time HPCC-8863 Fix cores generating independent dictionaries. HPCC-8583 Make ESPWorkunit a singleton to support MVC paradigm HPCC-2839 Separate Package Validation warnings from erors HPCC-2839 Command line tool to validate package content HPCC-8555 Rationalise ICodeContext and remove legacy functions HPCC-8554 Combine derived helpers that are split into multiple interfaces HPCC-8840 Internal error on STORED dictionary HPCC-8836 Core on stored dataset with child dictionary HPCC-8589 Add tests for dictionary in key payload in keyed join HPCC-8839 Include sizes in key-row size error message HPCC-8873 Fix archive instructions HPCC-8819 Allow LOCAL to prefix a definition (like SHARED/EXPORT) HPCC-8661 Add support for DICTIONARYs in the payload of a key HPCC-8745 Implement inline dictionaries as compile time constants HPCC-8834 Package base resolutions should not depend on declaration order HPCC-8760 Revise based on review HPCC-8826 Build errors on java plugin in EE build HPCC-8743 Implement dictionary support in Thor HPCC-8492 INDEPENDENT on dataset with child dictionary gives internal error HPCC-8824 Remove compile warning reported from gcc HPCC-8821 Don't optimize 1 character compare on ebcdic strings HPCC-8789 Pausenow could fail to abort and lose spills HPCC-8760 Upgrade ESP to upload multiple files per http request HPCC-8486 Optimize DICTIONARY(null-dataset) HPCC-8564 Added override settings for nproc to limits.conf HPCC-8490 Can't convert dictionary to dataset in output spec HPCC-8794 Handle ESP Exceptions HPCC-8726 Fix regression errors on KEYED(key-field in ) HPCC-8790 Reversed sequence and maturity in stageVer var HPCC-8783 Refactor and split ccdserver.cpp HPCC-8735 Avoid seperate call to fetch total # workunits HPCC-8814 OUTPUT(dictionary) was not working HPCC-8815 Remove deserializer from getDictionaryResult HPCC-8813 The test aggsqx3.ecl key is out of date HPCC-8727 ONCE dictionaries should not be serialized to the slaves HPCC-8744 Optimize dictionary lookups of single fixed length fields HPCC-8807 Implement typedefs for dictionary and datasets HPCC-8808 Fix issues with truncation of lookup values HPCC-8808 Fix issues with truncation of lookup values HPCC-8802 Implement RECORDOF(dictionary) Modify (void ** &)rows to *(void ***)(&rows) HPCC-8787 Refresh Page with a Invalid Hash String HPCC-8748 Start treating constant rows as link counted HPCC-8795 WU Query Page Add Context Menu HPCC-8608 Remove FilesBaseDN reference HPCC-8785 Distinguish between local execute and local data acts HPCC-8786 Graph "Advanced/Show SVG" broken HPCC-8465 Implement THISNODE(dictionary) and serialize to slaves HPCC-8498 In roxiemem, check that pointer being linked/released is in the heap HPCC-8781 Improved ONCE handling for roxie/hthor HPCC-8608 Remove FilesBaseDN reference HPCC-8727 ONCE dictionaries should not be serialized to the slaves HPCC-8775 Remove duplicate definition of prototypeAtom HPCC-8774 Always defined type_t as an enum HPCC-8773 Add a control:closedown command to Roxie HPCC-8772 Fix core when serializing a row that didn't need it HPCC-8656 Double nested datasets only show first "outer" row HPCC-8749 Support common directory for loading java classes HPCC-8718 Update comments to document the problem and new thinking HPCC-8738 Delete the original embedding examples HPCC-8739 Minor improvements to IR output for help with debugging HPCC-8732 Core on second embedded javascript query in Roxie HPCC-825 Change Resubmit and Restart buttons to be less confusing HPCC-8720 Add support for SET OF simpletype to embed plugins HPCC-8550 Spurious warnings using #option ('compileOptions') HPCC-8720 Add support for SET OF simpletype to embed plugins HPCC-8551 Move tests to regression suite HPCC-8720 Add support for SET OF simpletype to embed plugins HPCC-8723 Configmr - htpasswdFile is not set HPCC-8720 Add support for SET OF simpletype to embed plugins HPCC-8713 Re-instate xmlsize functionality HPCC-8030 R/Java/JavaScript/Python language support in ECL HPCC-8551 Fix additional issues with serialization HPCC-8542 Ensure skew min/max present HPPC-8551 Refactor the serialization functions HPCC-8019 Use resizeRow to scale row tables HPCC-8630 Configmr - Add htpasswd Option to ESP Authentication HPCC-8567 Issues when graph control is missing HPCC-8544 Remove deprecated DATASET syntax from regression test examples HPCC-8289 Use allocator caching HPCC-8626 Add new option GenerateFullFieldUsage HPCC-8635 Logical File displays wrong contents HPCC-8607 Add ssl support to the ecl command line tools HPCC-8288 Cache allocators HPCC-8567 Issues when graph control is missing. HPCC-8621 Reinstate typedef for hash64_t when compiling on windows HPCC-8604 Add JavaScript Layout HPCC-8582 Add Back/Forward Support HPCC-8197 Configmgr - Rename 'Swap Master' to 'Replace Master' HPCC-8569 Confimgr - Adding hardware to a blank environment fails HPCC-8518 Optimize JOIN(transform(LEFT),LEFT OUTER,LOOKUP) to PROJECT HPCC-8544 Remove deprecated syntax DATASET HPCC-8335 Fix more issues with DEFAULT on field HPCC-8335 Fix example and internal error checking when cast no_null HPCC-8335 Option on a field to control the default value HPCC-8535 Fix cast of a string constant to very large string type HPCC-8532 Fix meta annotations and type/scope generation in the IR HPCC-8361 Provide a function to convert a type to IR text HPCC-1845 Fix graph loading time Change timeout on graph control to 15 seconds after review of 30 seconds is a configurable option and not default timeout. HPCC-8507 Improve some xml read errors HPCC-8497 Remove warning about unused parameter HPCC-8361 Improvements to IR generator HPCC-8489 Update the example to match a fix in the inline syntax HPCC-8500 Rename variable from encryptkey to decrypt key HPCC-8410 Fix link error compiling with visual studio HPCC-8493 Add option to suppress roxie single-node optimizations HPCC-8361 Fix linux compile errors HPCC-8297 Provide a callback mechanism when resizing a row HPCC-8361 Add support for selftest HPCC-8489 Can't initialize child dictionary from inline spec HPCC-8361 Initial implementation of new IR processor HPCC-8429 Implement DATASET(dictionary) HPCC-8426 Support DICTIONARYs created in child queries HPCC-8410 Move daregress to CPPUNIT HPCC-8483 Add build options to simplify coverage analysis HPCC-8364 Move doRemove methods to files HPCC-8457 Add hthor support for reading/writing dictionary to workunit HPCC-7984 ECL Watch 4 HPCC-8453 Add dictionary tests to regression suite HPCC-8457 Add hthor support for reading/writing dictionary to workunit HPCC-8329 Dictionary support HPCC-1845 Fix graph loading time HPCC-8411 Improve conditonal assignments of datasets HPCC-8196 Configmgr - Roxie 'replace' functionality not working HPCC-8390 Renaming to MsgHeader, using struct copy HPCC-8390 Change strategy to use inner struct HPCC-8384 Silence most unused parameter warnings HPCC-8390 Don't rely on offsetof HPCC-8392 Silence silly empty body warning HPCC-8387 Fix NULL-to-bool conversion HPCC-8386 Fix extraneous or missing parenthesis HPCC-8383 Add using to access declaration HPCC-8301 DFS refactory: removal and auto-commit HPCC-7991 Avoid uninitialized valgrind warning HPCC-8158 Set maxCompileThreads >1 by default HPCC-8059 Memory leaks HPCC-7983 Avoid circular link leak for null inputs HPCC-8310 Verify KeyedJoin,local matches index HPCC-8278 Cache memory allocators HPCC-3309 Ensure child graphs are executed sequentially HPCC-8303 Allow resizeRow to indicate how much data should be copied. HPCC-2351 Ensure APPLY actions are in separate subgraphs HPCC-2351 Use new sequential flag for roxie graphs HPCC-2351 Add a new sequential flag for a graph HPCC-8279 Merge removeEntry and removePhysical HPCC-7929 Configmr - Tooltips too long and multiples HPCC-8228 Use countX instead of lenX for a link counted dataset parameter HPCC-8021 Confimgr - Adding multiple ACL Access rules fails HPCC-8050 RemoveEntry/Physical in transactions HPCC-8181 Added more info on ecl packagemap validate from code review HPCC-8044 Redesign WU Details Page HPCC-8181 Add ecl packagemap validate to docs HPCC-8066 Allow LINKCOUNTED as a better keyword for _LINKCOUNTED_ HPCC-8044 Redesign WU Details Page HPCC-8215 Regenerate HEADING correctly instead of as HEADER HPCC-8172 Fix build break from previous commit HPCC-8172 CMake warning about missing file HPCC-2966 Configmgr - Should warn if duplicate IPs assigned HPCC-7850 Configmgr - Roxie componenet needs to have LDAP tab HPCC-8048 Add Remove Super File to transactions HPCC-8049 Add Rename Physical to transactions HPCC-8072 Common up widget "stub" files HPCC-8126 ECLPlayground Link is Broken HPCC-8111 Revert unneeded change to esp/files/CMakelists.txt HPCC-8077 Workunit Timings Changes HPCC-8072 Common up widget "stub" files HPCC-7930 Rename ecl-package to ecl-packagemap HPCC-7867 Add timings "TreeMap" to graph web page. HPCC-7848 Add activity and edge indexes to the graph web page Language Reference and Standard Library Reference updates GH-2562 Change license to Apache GH-3235 Add new ECL Source view to ECL Watch GH-2562 Change license to Apache GH-3253 ECL Playground Initial Selection Blank GH-3240 Add result view for Source Files GH-3237 Add WU Timers TreeMap View GH-3237 Added missing dojox files. GH-3158 New Graph Web Page GH-3149 DOJO 1.8 Remove setActive, add cache lookups to transaction HPCC-9071 Language version increased to 4.0.0 HPCC-9075 Clean up unused Roxie configuration settings HPCC-9070 False positive from dict15c test on thor HPCC-9068 Embedded scripting plugins need to syntax check without dll HPCC-9069 Spurious minor regression suite differences HPCC-8022 Configmgr - Cannot make one ACL list base of another Remove unused temporary variable HPCC-8799 WsEcl support for JSON via HTTP-GET and FORM-ENCODED-POST HPCC-9117 Stopping of dafilesrv generates odd message HPCC-9088 Python errors prevent start of ESP in 4.0.0rc2 HPCC-9124 Avoid issues with out of date precompiled headers HPCC-9113 Running workunit not refreshing tabs HPCC-9079 Enable "Close" on tabs HPCC-9056 Build break in thor (Windows) HPCC-9094 Ensure space is allocated for the length of a child dataset HPCC-7999 Invalid syntax reported by OpenLDAP HPCC-9100 Ignore foreign info when resolving file in package HPCC-9115 Fedora389 LDAP returns NULL errstring HPCC-9085 Improve method names and remove unneeded IMPLEMENT_IINTERFACE HPCC-9085 Fix Roxie JSON handling of array item names HPCC-9105 Add missing const which was causing a compile error. HPCC-9104 Add -checkVersion option to eclcc to control ecl version checking EPE-22 Redirect Eclipse plugin to use new ECL Watch HPCC-9092 Win32 + OSX Package Name Wrong HPCC-9099 Fix a few leaks in exception handling code HPCC-9098 Fix release of an exception that could be rethrown HPCC-9096 Include "ecl packagemap validate" section into Roxie Ref HPCC-9084 Add comment clarifying transfer of ownership HPCC-9089 Improve Roxie basic JSON formatting HPCC-9084 Delimit JSON across multiple Roxie ouputs HPCC-9122 Add 'delimited' as s synonym for 'csv' in the dfuplus formats HPCC-9159 Add missing plugin proxies HPCC-9152 Add validateStore option to daliadmin HPCC-9160 Plugins that don't export pluginDefinition block get unloaded HPCC-9154 Remove logging of daliUser usage HPCC-9063 Fix regression handling non dynamic filenames in roxie HPCC-9108 Solve problem not commoning up selectors HPCC-8617 Update ConfigMgr docs HPCC-9148 Eclccserver does not support controlling permissions HPCC-9148 Eclccserver does not support controlling permissions HPCC-9146 Archiving failing to archive generated dlls HPCC-9076 Attempt to read temp file that has not yet been registered HPCC-9072 Fix issue with null act and multiple outputs HPCC-9140 Remove ERROR with no parameters. HPCC-9101 Allow daliadmin import to have a qualifier on the tail HPCC-9139 Segfault in eclagent using BLOB fields HPCC-9112 Large sets of files sprayed using wildcard may be truncated HPCC-9078 The default system will not start on a 32-bit VM with 10 GB memory HPCC-9137 Add note re:Fedora repository HPCC-9135 multi-part boundary line check should include extra '-' HPCC-9135 crlf before mime boundary line should not in file content HPCC-9083 Document ECLWatch Tech Preview HPCC-9051 Add the RoxieControlAccess tag to authenticated features HPCC-9120 Fix global rollup early stop deadlock HPCC-9013 enter bad pwd for expired user still prompts for pwd change HPCC-9127 Fix global merge regression HPCC-9106 Incorrect determination of password expiration prompt HPCC-9114 XMLParse gives spurious errors on CDATA sections that end ]]]> HPCC-8076 Document new escape option on CSV files HPCC-9062 Limit remote location list by cluster HPCC-9205 SprayVariable file fix HPCC-9177 Configmgr - Allow dashes in the name field HPCC-9202 DFS transaction remove/add regression HPCC-9200 Install improvements HPCC-9190 Roxie should not reconnect to dali if restarts while lockDali HPCC-9186 Roxie cores writing dataset to workunit HPCC-9033 Track number of ATMOST triggers in Roxie HPCC-9198 Hyperlink + Open Tab fails on FireFox HPCC-9194 Document NOXPATH attribute HPCC-9187 Missing check for ecl-queries-copy --overwrite option HPCC-9177 Configmgr - Allow eclccserver option to contain dashes HPCC-9182 CSafeSocket write should handle buffer size of 0 HPCC-9182 Make common routine for adding to FlushingStringBuffer queue HPCC-8914 Implemennt NOXPATH flag on OUTPUT HPCC-8954 Change to Spray Delim. HPCC-9121 Add Wuid filter by field to filter by Fixes HPCC-9121 HPCC-9169 Rename SHUFFLE (a temporary name) to subsort HPCC-8067 LINKCOUNTED is not documented HPCC-9184 Roxie queue name not found in /Status/Servers list after re-attach HPCC-9189 Disable udpResendEnabled logic HPCC-9182 Prevent adding empty FlushingStringBuffer block to queue HPCC-9184 Roxie queue name not found in /Status/Servers list after re-attach HPCC-9109 Add hyperlink to enable single click open HPCC-9149 Add details about Eclcc Options HPCC-9183 change the 'cluster stopped' to 'cluster not attached' HPCC-7896 Roxie CRoxiePackageSetManager holds lock for too long HPCC-9126 DFU Workunits Refactor HPCC-9172 Fix mismatching records from datasets in MAP/CASE HPCC-9178 Remove several references to UNKNOWN_USER HPCC-9136 Modified based on review HPCC-9046 Browse ECLWorkunits: sorting should be case-insensitive HPCC-9185 Always return a maxlength > minLength HPCC-9145 Fix some memory leaks HPCC-9136 Remove Roxie Queries options from ECLWatch UI HPCC-9022 Allow testsocket to read query from stdin HPCC-8959 No publish "success" feedback HPCC-9163 Get cloned remote file descriptor once per CResolvedFile HPCC-9125 Add a check to ensure eclcc and gcc use the same include version HPCC-9022 Allow testsocket to read query from stdin HPCC-9173 Ubuntu 13.04 Build Fails HPCC-9054 Make sure documentation of indexes includes discussion of the BLOB attribute. HPCC-9147 Change error to warning on mismatch major version HPCC-8956 Add documentation for #option ('divideByZero') HPCC-9064 Document the changes to the ROLLUP semantics HPCC-8888 Rename Spray CSV to Spray Delimited in EclWatch display HPCC-9153 UNIMPLEMENTED on OSX HPCC-9125 Add a check to ensure eclcc and gcc use the same include version HPCC-8929 Add Copy URL Instructions HPCC-9237 Fix misplaced XML end tag in LR module HPCC-9226 Fix build break on Centos HPCC-9221 Deleting package from roxie will cause query to hang HPCC-9236 WU Lists calling the server for each row HPCC-9235 Avoid restart distributor delays HPCC-9166 Add ECLWatch WU Filters doc HPCC-9097 Added plugins flag to file name on rpm based systems HPCC-9226 CmdProcess lockup on failure, and does not use path HPCC-9197 Leave generated xml tag open until attributes have been added HPCC-9217 Remove legacy implementations of editdistance functions HPCC-9214 Include remoteSubFiles when replicating CResolvedFile on slave HPCC-9208 Correctly catch errors returned by pssh and prevent core HPCC-9076 Rollback fix HPCC-9211 Improve LRM parameter text formatting for readability HPCC-9197 Escape content when converting WsECL form to XML HPCC-7879 Interface example not self contained, add comment HPCC-9164 Add Delimited format to DFUPlus docs HPCC-9209 Add missing cast so max timing isn't truncated HPCC-8127 LIMIT ignores a filter on the right recset if specified in the join condition HPCC-9193 Clarify Page 30 Inst&RunHPCC HPCC-8880 TOXML not documented in ECL Language Reference HPCC-7875 Enhance OUTPUT documentation to hint that 'format' does a project HPCC-2284 Reduce size of the continuation info for Roxie indexes HPCC-9273 Add --pmid parameter to ecl cli docs HPCC-9262 Change parameter name that allows users set the pacakgeMap id HPCC-9282 Ensure the correct name for an expression is extracted HPCC-9280 Detail Pages missing information at startup HPCC-9279 REGRESSION - ESP cored when trying to view a file HPCC-9277 Excessive tracing in lookupFileName HPCC-9262 Allow user to optionally set the pacakgeMap id HPCC-9251 Incorrect check of dali UNKNOWN USER HPCC-9256 Email module in std library missing import HPCC-9246 SOAPCALL may lose records in 4.0.0-rc6 HPCC-9245 Packagemap needs to support mixed case package ids HPCC-9097 Correct issue with package naming for windows and mac HPCC-9010 Check query tree branch before using it HPCC-9240 Workunit monitoring is "lumpy" and too aggressive HPCC-9255 WsEcl should use IWorkUnit::setXmlParams to set stored values HPCC-9276 Make DFUDetails Page more consistent visually. Revert HPCC-9335 Track end of file from inputs used in stepped join HPCC-9334 Graph view shows odd characters Rename soap references to generic Wsc referenes HPCC-9349 Add HTTPCALL implementation in Thor HPCC-9381 Roxie file resolution tracing HPCC-9339 Ecl packagemap validate results need to be clearer HPCC-9351 Regression suite distribute,skew test HPCC-9363 Ecl publish to foreign ip can't resolve superkeys HPCC-9366 diskaggregate leaking threads HPCC-9332 Recursively add input files for other non-persist workflow items HPCC-9335 Smart stepping join continues to request rows after end of file HPCC-9335 Add some GRAPH based stepping tests HPCC-9335 Fix potential core if the input doesn't support stepping HPCC-9360 Add subgraph with properties grid to graph page HPCC-9361 Graph Page Sync Issue HPCC-9335 Improvements to single stepping nested merge joins HPCC-9305 Auto open DFU Workunits on file action HPCC-9340 Ecl packagemap delete needs a message when successful HPCC-9350 Fix DISTRIBUTE,SKEW assert HPCC-9305 Auto open DFU Workunits on file action HPCC-9343 ecl roxie reload --help incorrect HPCC-9267 LZBrowseWidget HPCC-9055 Ability to close "Details" tab once opened HPCC-9301 Dojo 1.9 + Chrome + GraphControl Disappearing HPCC-9299 Upgrade to dojo 1.9.0 HPCC-9210 Create generic ESPRequest.Store HPCC-9204 Migrate to dgrid HPCC-9204 Switch from dojox/grid to dgrid HPCC-9335 Track end of file from inputs used in stepped join HPCC-9333 Fix possible loss of records in sort HPCC-9331 Missing activity logging if local graph HPCC-9265 Lightweight selfjoin hint(parallel_match) issue HPCC-9263 Correct the output of "ecl packagemap" HPCC-9329 Add text search test cases into CE regression suite HPCC-9328 Fix misue of a queryProp, should be getPropBool HPCC-9225 Allow WsEcl caller to specify jobname HPCC-9326 onStartCalled not set if nullact causing assert HPCC-9300 HashJoin serialization race condition HPCC-9264 Avoid possible deadlocks if error gathering lookup RHS HPCC-9437 Add option for high resolution timing in log files HPCC-9350 Fix DISTRIBUTE,SKEW assert HPCC-9431 Allow constant folder to resolve functions in eclrtl HPCC-9443 Race condition can cause roxie to core when updating packages HPCC-8847 Visibility and module inheritance HPCC-9432 Use 'cat' not 'echo' Std,System.Util.CmdProcess in the example HPCC-9441 Fix case issues in Client Tool docs (eclplus & dfuplus) HPCC-9410 Add superfile information to control:getQueryXrefInfo HPCC-8842 Delete spurious semicolon after an if condition HPCC-9408 Document changes to the way MODULE inheritances works HPCC-9435 Report a better error if eclcc fails to open stdin HPCC-9426 Unprojected disk read with virtuals allocated too little memory HPCC-8379 Show suspended roxie query on EclWatch HPCC-9383 Better support common fuzzy package matching pre-publish HPCC-3130 changing perms on eclwatch takes 5 minutes to take affect HPCC-9418 Refactor Certify docs HPCC-9117 Stopping of dafilesrv generates odd message HPCC-9215 DALI should not check LDAP for non managed scopes HPCC-9382 Add EBCDIC support to HexView HPCC-9241 Returns results after action button is clicked on WUs page HPCC-9385 Fix thread pool runningCount() HPCC-9417 Fix XPATH being ignored for nested records HPCC-9223 Improve error message when there are no active packages HPCC-9414 Add XML/JSON responses to FileSpray/UploadFile HPCC-9320 Add WUID web links to Browse Queries page HPCC-9338 Add --no-files option to ecl-publish HPCC-9391 Refactor DataHandling docs HPCC-9347 Relocate Spray forms HPCC-9356 Add depth and distance fields to Graph Page HPCC-9409 Protect access to delayed inputs with a critical section HPCC-9412 Input fields in dijit.Toolbar lock up the web page HPCC-9355 Allow pasting of XGMML HPCC-9006 Soapplus xml comparison issue HPCC-9007 Soapplus comparison not comparing root node HPCC-9306 Don't allow restarted workunits to take the wrong branch HPCC-9399 Add stepped dedup to hthor and clean up roxie code HPCC-9399 Support smart stepping through a dedup activity HPCC-8938 Exception can cause sort partition deadlock HPCC-8842 Fix problems with module inheritance HPCC-9269 Dynamic file resolution does not use package files HPCC-9393 ATMOST stats inaccurate HPCC-9392 Roxie inactive file handle closer is broken HPCC-9344 Ecl queries list socket creation needs longer timeout HPCC-9303 Use thread pool for DFS requests HPCC-9384 The testsearch2.ecl query in regression suite needs key updating HPCC-9568 Configmgr - remove extra roxie info HPCC-9571 Configmgr - Farm tab on roxie not working HPCC-9611 Can't run more than one thor job that uses Java HPCC-8804 New ECL Watch homepage (Tech Preview) HPCC-9570 SOAPCALL returning "Request too large for buffer fragment" HPCC-9594 Rembed fails in thor HPCC-9612 Roxie is ignoring slaveThreads setting HPCC-9587 Ubuntu 12.04 32bit eclcc cores on constant folding HPCC-9341 Add ecl-publish support for suspend and delete previous HPCC-9606 Update images in ECL Watch Tech Prev doc HPCC-9605 Remove spurious 20s sleep at slave start HPCC-9596 Core in dali if environment contains nodes without @computer set HPCC-9582 New feature: evaluate(module, attribute) HPCC-9579 Standalone Roxie coring HPCC-9560 ensure spilling occurs if rehash fails HPCC-9535 Rationalize Roxie topology info HPCC-9551 Roxie cannot set thread priorities to positive values HPCC-9567 Ignore (unreliable) numDataCopies value in overloaded mode HPCC-9559 ecl-packagemap-query-files command to show query file mappings HPCC-9563 XML_CATALOG not being set correctly HPCC-9555 Fix possible crash when hashdedup spills HPCC-9419 Remove an extra check HPCC-9523 Fix potential hashdedup deadlock HPCC-9558 Spot and handle deleted WU HPCC-9419 Revise based on review comments HPCC-9535 Rationalize Roxie topology info HPCC-332 Cmake version dependency HPCC-2345 Debug fails to build package HPCC-9546 ecl-roxie-unused-files command HPCC-9419 Set ClusterPartDiskMapSpec in File Copy HPCC-9419 Pass data2 through ClusterPartDiskMapSpec for overloaded HPCC-9550 Control:getQueryXrefInfo not showing super keys HPCC-8854 Performance Improvements HPCC-9549 Library cannot be resolved unless uses same package as query HPCC-9544 ecl-packagemap-add should report unresolved files HPCC-9515 Add support to move rows from one heaplet to another. HPCC-9539 Expose SuperFile info from WsWorkunits::WUQueryDetails HPCC-9451 Docs:Clear Permission Cache button in ECL Watch HPCC-9420 Pass offset setting to remote copy HPCC-9420 Rename three variables HPCC-9445 Fix leak reporting for packed allocators HPCC-9535 Rationalize Roxie topology info HPCC-9468 Main Graph Depth HPCC-9491 Move CFileChangeWriteLock,avoid refs to Owned HPCC-9487 ESP should set IE=edge for certain ECLIDE HTTP responses HPCC-9420 Pass Roxie directory settings to file copy function HPCC-9487 ESP should set IE=edge for certain ECLIDE HTTP responses HPCC-9520 Update VM Resource page Docs HPCC-9525 Segmentation fault when remote copy HPCC-9514 Merge contents of sourcedoc.xml and remove it. HPCC-9473 TOPN activity crashes if LIMIT depends on context HPCC-9508 Add eclipse code layout settings file to project HPCC-9411 Information needed about unloadable roxie queries HPCC-9518 Issues with reporting on suspended queries HPCC-9486 Configmgr - Handle new level attribute HPCC-9511 Remove references to roxieconfig from configmgr tooltips HPCC-9516 Backslash in doc needs special handling for HTM/CHM docs output HPCC-9505 Add roxiemem activity mem tracing on OOM HPCC-9496 PackageMap Validate not checking RefFileInPackage flag HPCC-9514 Add initial documentation about roxiemem HPCC-8803 Directories hpcc-data2 and hpcc-data3 don't get used HPCC-9506 Improved memory statistics reporting HPCC-9491 Ensure lock checked in multiple cluster case HPCC-9484 Ubuntu 13.04 support HPCC-4476 Fix KEYED substring matching against a field from the index HPCC-9494 Clean up unused roxiemanager code HPCC-9488 Better handling of changes to config files HPCC-9490 Protect against finalizing row with too much data written HPCC-9482 Add compile time check for returning variable length rows HPCC-9482 Fix code for calls to external c++ functions returning rows. HPCC-9389 Add testsocket control:querypackageinfo support HPCC-8803 Directories hpcc-data2 and hpcc-data3 don't get used HPCC-9453 keyed join, onfail causing record loss HPCC-8803 Directories hpcc-data2 and hpcc-data3 don't get used HPCC-9483 Valgrind complains about remotefile's hashtable of endpoints HPCC-9480 A GROUP ROLLUP was incorrectly marked as having grouped output. HPCC-9397 Roxie remote file resolution issues HPCC-8446 Added ability to run single query in regress HPCC-9478 Nested global loop crash HPCC-9397 Roxie remote file resolution issues HPCC-9448 Add soapplus to Client Tools build HPCC-9449 Add Landing Zone Page to ECLWatch Docs HPCC-9444 Location of files for the Programmers Guide was incorrect HPCC-9447 If libRembed is present, eclcc malfunctions on some systems HPCC-9629 New language features to support bundles HPCC-9569 ConfigMgr - remove extra roxie info HPCC-9687 Ambiguous xpath error from EclWatch displaying Roxie queries HPCC-9688 Version 4.0 rc14 configmgr cannot display old roxie configurations HPCC-9569 ConfigMgr - remove extra roxie info HPCC-9619 Add missing key files HPCC-9664 dfu copy of files generating odd names HPCC-9620 Document ecl roxie --unused-files HPCC-9674 Edit duplicate sentence in Packages Chapter HPCC-9625 New options in ecl publish: no-files,suspend-prev,delete-prev HPCC-9639 Roxie may segfault on startup if previous 4.0 build used HPCC-9665 Uninitialized variable in dadfs.cpp HPCC-9646 Compile warning in thorsoapcall.cpp HPCC-9641 Use DEFAULT() attributes for omitted values in inline tables. HPCC-9660 Fix optimization of a DENORMALIZE with an empty rhs HPCC-9502 Option when spraying wildcards to fail if no matches HPCC-9545 ecl-packagemap-validate option to check subfiles exist in dfs HPCC-8053 Timeouts can cause superfile update inconsistencies HPCC-9631 KeyedJoin may miss cached IKeyIndex's HPCC-9621 IE8 + XP ECL Watch Issues HPCC-9638 Filter "Clear" does not reset some drop down controls HPCC-9636 OUTPUT(module) not outputting DICTIONARY attributes HPCC-9628 Eclcc hangs at end if libarchive dynamically unloaded HPCC-9572 Fix hash dedup row leak after spill event HPCC-9729 IE Does not work with new ECL Watch HPCC-9724 Default bundle directory should be per user HPCC-9713 Bad installation message when installing on Ubuntu 13.04 HPCC-9704 Add libarchive support to WIN32 HPCC-9052 Document Direct Access to Roxie using either SOAP or JSON HPCC-9584 Document evaluate(module, attributeId) feature HPCC-9678 Document ecl bundle commands HPCC-9710 R embedding gives spurious stack errors in Roxie HPCC-9642 Update ECL Watch Tech Preview docs HPCC-9709 Core in ecl-publish install if package not already installed HPCC-9708 Hook plugin libarchiveFile cores under windows HPCC-9699 Java embed is not working on Ubuntu 13.04 HPCC-9603 Add information into Language Guide under IN HPCC-9700 Warning "Explicit file /opt/HPCCSystems/share/Bundles" not found HPCC-9540 Standard Library Ref - CountWordsused instead of WordCount HPCC-9500 ECL Sample in ECL Language Reference does not compile HPCC-9698 Can't run more than one thor job that uses R HPCC-9643 Update VM Docs to include Virtual Box support
Release Notes for Community Edition 3.10.8-9
All Known Limitations in 3.10.8-2 are still valid
======================================== Changes from 3.10.8-8 to 3.10.8-9 ======================================== HPCC-9350 - Fix DISTRIBUTE,SKEW assert
Release Notes for Community Edition 3.10.8-8
All Known Limitations in 3.10.8-2 are still valid
======================================== Changes from 3.10.8-6 to 3.10.8-8 ======================================== HPCC-9417 Fix XPATH being ignored for nested records HPCC-9409 Protect access to delayed inputs with a critical section
Release Notes for Community Edition 3.10.8-6
This version contains a few changes from 3.10.8-4. All Known Limitations in 3.10.8-3 are still valid
======================================== Changes from 3.10.8-4 to 3.10.8-6 ======================================== e9fe20d Community Edition 3.10.8-6 Gold bc125c8 HPCC-9392 Roxie inactive file handle closer is broken 2599f26 Community Edition 3.10.8-5 Gold 5986b84 HPCC-9363 Ecl publish to foreign ip can't resolve superkeys 6ebf76c HPCC-9366 diskaggregate leaking threads
Release Notes for Community Edition 3.10.8-4
This version contains one change from 3.10.8-3. All Known Limitations in 3.10.8-3 are still valid
======================================== Changes from 3.10.8-3 to 3.10.8-4 ======================================== HPCC-9333 - Fix possible loss of records in sort
Release Notes for Community Edition 3.10.8-3
This version contains one change from 3.10.8-2. All Known Limitations in 3.10.8-2 are still valid
======================================== Changes from 3.10.8-2 to 3.10.8-3 ======================================== HPCC-9300 - HashJoin serialization race condition
Release Notes for Community Edition 3.10.8-2
================================
Known Limitations for 3.10.8-2
================================
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.2/clienttools/bin
If you install the full platform, this step is not needed to use the client tools.
- Under certain circumstances, the ECL IDE can display an error message when submitting ECL code from a read-only file. The error message says that it cannnot save the file because Access is denied. This message can be safely ignored. (IDE-263)
============================================================ Comprehensive list of changes from 3.10.6-1 to 3.10.8-2 ============================================================ HPCC-9120 Fix global rollup early stop deadlock HPCC-9127 Fix global merge regression HPCC-9114 XMLParse gives spurious errors on CDATA sections that end ]]]> HPCC-9056 Build break in thor (Windows) HPCC-9094 Ensure space is allocated for the length of a child dataset HPCC-9100 Ignore foreign info when resolving file in package HPCC-9105 Add missing const which was causing a compile error. HPCC-9098 Fix release of an exception that could be rethrown HPCC-9096 Include "ecl packagemap validate" section into Roxie Ref HPCC-9045 WSFileIO is not accessible by non-admin users HPCC-9014 Roxie Manual Correction HPCC-9015 Restore previous ROLLUP semantics Ensure no overflow when calculating fpos HPCC-9026 Pull distributor restart issues HPCC-8992 Various problems in key sampling used by merge HPCC-9021 Non-locking mode for single-node / dev roxies HPCC-9027 Roxie file handle errors HPCC-9028 Roxie not handling OPT flag correctly on dynamically-resolved files HPCC-9029 Roxie can core if write to file when no workunit HPCC-8955 Document changes to "packagemap validate" HPCC-9000 Variable length record display issues HPCC-9003 Check inside expression attributes for evaluation in thor. HPCC-8850 enhance package validation to check for files that aren't mapped HPCC-8981 Configmgr - nicSpeed missing in Computer Types HPCC-8053 Superfile lock contention causing superfile corruption HPCC-8987 MoveExternalFile error misleading HPCC-8849 QuerySet action commands should verify query exists HPCC-8900 cli should allow wu compile state of compiled or completed HPCC-8926 Fix ecl-queries still using queryset instead of target Add an assert to ensure limit is <=32bit HPCC-8080 Correction of command line argument handling HPCC-8877 Show WU state on Activity page HPCC-8969 Enforce an absolute hard limit on dali results HPCC-8865 Document Escape Character in SprayVariable ECL library function HPCC-8843 Incorrect argument named in docs for Std.File.CreateSuperFile HPCC-8964 Don't generate a JFindexfromactivity keyed join for thor HPCC-8957 Compressed files being published with incorrect crc HPCC-8816 Show 'Delete Query' result and redirect to QuerySet HPCC-8951 Incorrect extension for proxy plugins HPCC-8949 Ecl packagemap add needs to add each package one time HPCC-8948 Allow 'slaveDaliClient' as job option HPCC-8937 Add a flag to skip existing superfile check HPCC-8939 Fix problems with IN ('a','b') HPCC-8905 Fix minisort OOM and deadlock HPCC-8944 Add missing case entry for record calculation HPCC-8930 Child graph could have missing progress data HPCC-8897 Pass cacheHint to use paged cache when querying workunits HPCC-8927 Lazy open should default to smart mode HPCC-8910 Rename EclWatch Copy URL menu to View URL HPCC-8924 Prevent simple recursive computerTypes causing stack faults HPCC-8923 Roxie not checking workunit version matches HPCC-8922 Fix problems casting constant decimals to booleans HPCC-8418 Fix Schema for sets with xpaths 'name' and 'name/' HPCC-8418 Schema generation should ignore xpaths that are too long HPCC-8811 Revise based on review comments HPCC-8862 Add support for csv escape characters to sprayVariable HPCC-8585 Ensure Priority is cloned into the workunit HPCC-8892 Error on key build, with excessively large key+payload HPCC-8811 Return WUIDs in WsWorkunits/WUResubmit soap response HPCC-8890 Avoid early abort losing original error HPCC-8870 Fix a minor possibility of corrupting memory in csv unquoting HPCC-8806 Rename Delete Query to Deactivate on Queries Active tab HPCC-8860 Ecl packagemap needs to return an error for invalid dali ip HPCC-2839 Separate Package Validation warnings from erors HPCC-2839 Command line tool to validate package content HPCC-8839 Include sizes in key-row size error message HPCC-8873 Fix archive instructions Fix build error HPCC-8819 Allow LOCAL to prefix a definition (like SHARED/EXPORT) HPCC-8834 Package base resolutions should not depend on declaration order HPCC-8821 Don't optimize 1 character compare on ebcdic strings HPCC-8564 Added override settings for nproc to limits.conf HPCC-8181 Added more info on ecl packagemap validate from code review HPCC-8181 Add ecl packagemap validate to docs HPCC-9159 Add missing plugin proxies HPCC-9152 Add validateStore option to daliadmin HPCC-9063 Fix regression handling non dynamic filenames in roxie HPCC-9146 Archiving failing to archive generated dlls HPCC-9072 Fix issue with null act and multiple outputs HPCC-9139 Segfault in eclagent using BLOB fields HPCC-9112 Large sets of files sprayed using wildcard may be truncated HPCC-9205 SprayVariable file fix HPCC-9202 DFS transaction remove/add regression HPCC-9190 Roxie should not reconnect to dali if restarts while lockDali HPCC-9189 Disable udpResendEnabled logic HPCC-9163 Get cloned remote file descriptor once per CResolvedFile HPCC-9173 Ubuntu 13.04 Build Fails HPCC-9235 Avoid restart distributor delays HPCC-9226 CmdProcess lockup on failure, and does not use path HPCC-9197 Leave generated xml tag open until attributes have been added HPCC-9214 Include remoteSubFiles when replicating CResolvedFile on slave HPCC-9208 Correctly catch errors returned by pssh and prevent core HPCC-9197 Escape content when converting WsECL form to XML HPCC-9137 Add note re:Fedora repository HPCC-9051 Add the RoxieControlAccess tag to authenticated features HPCC-9264 Avoid possible deadlocks if error gathering lookup RHS
Release Notes for Community Edition 3.10.6-1
============================================================
Change from 3.10.4-1 to 3.10.6-1
============================================================
- HPCC-9015 Restore previous ROLLUP semantics
Release Notes for Community Edition 3.10.4-1
================================
Known Limitations for 3.10.4-1
================================
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.2/clienttools/bin
If you install the full platform, this step is not needed to use the client tools.
============================================================ Comprehensive list of changes from 3.10.2-1 to 3.10.4-1 ============================================================ HPCC-8908 Std distributor not reset in child query, lost recs HPCC-8911 Deadlock adding duplicate subfile to super HPCC-8907 Fix potential core/internal error constant folding CASE HPCC-8889 getEnv cores on roxie when no packages are defined HPCC-8866 Allow PackageId match to query name without version HPCC-8855 Expose some options to #option HPCC-8875 Enable core files for eclccserver HPCC-8817 Add code to handle AgentQueue for Thor HPCC-8817 Fix hthor running WU not shown on Activity page HPCC-8857 Add an example HPCC-8856 Fix problems with inactive selectors HPCC-8857 Don't create aliases for CSV attributes(!) HPCC-8668 Roxie takes a significantly long time loading data HPCC-8777 Allow ecl packagemap delete and activate to work properly HPCC-8834 Package base resolutions should not depend on declaration order HPCC-8612 Add Date and Copyright Info HPCC-8767 ESP users should be able to reset expired passwords HPCC-8823 Fix of Scheduler Doc switch order of receiver/sender stop in cancel Remove unecessary and dangerous call to stop() in destructor HPCC-8812 Fix broken web link for Change password HPCC-8676 Add publishedBy and suspendedBy attributes to Query Entry HPCC-8805 Fix query selection problem on BrowseQueries page Remove unnecessary extra stop broadcast HPCC-8608 Remove FilesBaseDN reference HPCC-8625 Roxie was not handling multiple QuerySet case correctly HPCC-8717 Revised based on the last comment HPCC-8800 Potential lookupjoin deadlock HPCC-8717 Avoid multiple calls to SDS connect() for JobQueue in EclWatch HPCC-8715 Compress graphs and handle graphs/results more efficiently. HPCC-8721 Delete workunit temporaries HPCC-8762 Ecl packagemap list/info needs to support authentication HPCC-8763 Remove dkc option from dfuplus usage text HPCC-8755 Fix Auto Refresh on ECL WU Details page HPCC-8756 Remove DKC action from DFUPlus docs HPCC-8753 Reset persist calculation when re-executing a workflow item HPCC-8758 Stall in LOOKUP JOIN within LOOP HPCC-8733 cmake STREQUAL should be protected from empty strings HPCC-8737 Roxie loses queries if it starts before dali is ready HPCC-8666 Submit workunit should reschedule even if workflow not reset HPCC-8177 Enhance Queries/Browse function HPCC-8648 Add ecl-queries-list support for showing only inactive queries HPCC-8632 Reduce multiple SDS connect() calls for environment info HPCC-8697 Build errors on EE on Ubuntu 12.10 HPCC-8688 Generate rows with constant sets as compile time constants HPCC-8678 Add ecl cli support for adding comments published queries HPCC-1960 Standalone diskwrite makes bad filename HPCC-8679 Add ecl cli support for specifying a repository snapshot HPCC-8682 Fix deadlock with BUILDINDEX in LOOP HPCC-8677 Remove calls to setPasswordsFromSDS from ESP/EclWatch HPCC-8673 Fix memory leaks when running Get Roxie Metrics HPCC-8643 Fix memory leaks in ESP EclWatch services HPCC-8671 Variable name misspelling causes error in eclwatch HPCC-8633 Add mutex to control data access for preflight result HPCC-8445 Add Certify doc HPCC-8645 Configmgr - Add attribute in XML view fails in IE HPCC-8637 Make thorslave dali connection optional. HPCC-8594 Fix splitter activity timings + missing indexread timing HPCC-8537 Skip title line when parsing space usages in preflight HPCC-8600 Add ecl command line support for query priority HPCC-8461 Configmgr - Fix filesBasedn of Dali and ESP to match LDAP HPCC-8253 Need to return active status when doing ecl package list HPCC-8137 Add Programmers Guide to Set.
Release Notes for Community Edition 3.10.2-1
================================
Known Limitations for 3.10.2-1
================================
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.2/clienttools/bin
If you install the full platform, this step is not needed to use the client tools.
- If you have installed the Client Tools and IDE on your Windows workstation, you do not need to install the Graph Control separately. However, you must restart your browser to use the newly installed Graph Viewer.
============================================================ Comprehensive list of changes from 3.10.0-1 to 3.10.2-1 ============================================================ HPCC-8570 Created common function for kill HPCC-8526 RtlDatasetBuilder wasn't updating self when it was reallocated HPCC-8610 Ensure all Eclagent logfiles get recorded in workunit HPCC-8599 Roxie may core when removing a file from file cache HPCC-8563 Ensure groups/clusters are consistently lowercased. HPCC-8552 Speed up MP broadcast on congested network HPCC-8570 Moved location of rm of pid file in killed HPCC-8570 Remove Sentinel check to stop process HPCC-8598 Added support for Ubuntu 12.10 Quantal HPCC-8599 Roxie may core when removing a file from file cache HPCC-8581 Display long strings at the last column(s) of Results table HPCC-8601 Debug values being passed as stored values in deployArchive HPCC-8567 ECLPlayground Sample Drop Down Error HPCC-8595 Avoid stall if hashdist is spilling and runs out of disk HPCC-8596 Problems dealing with CSV headers in mixed width supers HPCC-8547 Interleaved mixed width subfiles exposing mapSubPart bug HPCC-8254 Ensure child datasets are freed up by compound read activities HPCC-2951 Docs: HTTPCALL added to Language Reference HPCC-7950 Fix minor compile error introduced by previous change HPCC-7950 Use common HpccPackage classes in roxie HPCC-8226 Dali cannot resolve backup location HPCC-8546 Configmgr doesn't work in IE 8 HPCC-8485 result_lib.xslt not escaping some xml strings HPCC-8577 Unecessarily slow thor start/stop times HPCC-8495 openWorkUnit() should return NULL for a NULL or empty wuid HPCC-8545 Open Workunit not work for archived WU in ECLWatch HPCC-8566 Fix XML Schema generation skips top level attributes HPCC-8541 Add examples illustrating calling Python and Java from ECL HPCC-8514 Fix ESDL parameter defaults not being set properly HPCC-8459 Fix incorrect ESP log when file not deleted HPCC-8531 Use the keep going attribute for eclcc regression suite HPCC-8506 Implement SecureSocket::readtms to support HTTPS SOAPCALL HPCC-8516 Fix problem with ROWS(RIGHT) in keyed denormalize HPCC-8521 Fix file cloning while copying queries not resolving indexes HPCC-8660 Fixed redirection HPCC-8655 Fix ESP crash when running WUGetDependancyTrees HPCC-8660 Adding tracing to hpcc_common HPCC-8653 Add tracing to show time hpcc-init is taking HPCC-8413 Stepped join don't split results of previous graph iterations HPCC-8413 Fix problems with STEPPED JOIN accessing non existant results HPCC-8576 Minor change to tooltip for globalMemorySize HPCC-8605 Ensure log files are recorded to the workunit HPCC-8692 Fix OSX build issues HPCC-8664 Addition tracing for MP MultiPacket error
Release Notes for Community Edition 3.10.0-1
================================
Known Limitations for 3.10.0-1
================================
Notice: If you installed the ECL IDE from the download available before 2 p.m. EST January 10, 2013, then you should uninstall it, download the latest installer, and reinstall. The newer installer fixes the online help section of the IDE.
-
- If you have installed a release candidate version of the ECL IDE and Client Tools and would like to upgrade to the final release version, the upgrade can fail because Windows will detect that the HPCC Client Tools is already installed. The workaround is to uninstall first.
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.0/clienttools/bin
If you install the full platform, this step is not needed to use the client tools.
============================================================ Comprehensive list of changes from 3.8.6 to 3.10.0-1 ============================================================ HPCC-8512 Ensure all set results are tagged as root - not just the first HPCC-8442 Using libXSLT to process esp_service.xsl fails HPCC-8494 Fix incompatibility in the message format for ftslave HPCC-8449 Relax an internal consistency check causing an assert HPCC-8464 Add a #option('removeXpathFromOutput') to remove xpaths HPCC-8450 WsEcl navigation not checking getQueryRegistry return HPCC-8393 Client Tools Installs to wrong folder on Linux HPCC-8441 Ensure link counted datasets are cleared when serializing keys HPCC-8448 Fix potential core on an invalid keyed join HPCC-8437 Don't generate DISTRIBUTE activities inside child graphs HPCC-8433 Regression in hashdedup, possible div 0 HPCC-8432 Clienttools package name fixed on Windows HPCC-8432 Clienttools package name fixed on Linux HPCC-8101 Access to workunit is denied HPCC-8420 Ensure that slaves being killed belong to correct thor HPCC-8414 Fix schema and display of child datasets using xpath('n') HPCC-8367 Modify Preflight script for backward compatibility HPCC-8412 XREF memory configuration regression HPCC-8395 Avoid MP issue, caused by new lookupjoin HPCC-8393 Client Tools Installs to wrong folder on Linux. HPCC-8358 ESP Soap arrays of structures not xml decoding input strings HPCC-8389 HashDist grouped input regression HPCC-8360 Global lookup join regression HPCC-8252 Macro comments for expected results don't match results HPCC-8246 Denormalize has incorrect comments in code. HPCC-8306 Merge stopping early on groups inputs. HPCC-8298 Ensure only the dfsgroup request is captured HPCC-8304 Regression causing spilling hthor sort to lose records HPCC-8299 Fix error modfying a shared rowset HPCC-8300 Allow stringlib.hpp to be included by other plugins HPCC-8026 Fix View Log file in Last N Hours option HPCC-8291 All definitions of EclDefinition in plugins must be static HPCC-8292 Recover from errors starting esp when reading plugin symbols HPCC-8287 Avoid rsync prompt in thor slave script HPCC-8286 Make sure the IXmlToRowTransformer is cached as a member HPCC-8264 Ensure that row allocators are cached for xmltorowtranslators HPCC-8282 Fix a couple of issues compiling with visual studio HPCC-8274 Fix compile issue introduced by HPCC-3681 HPCC-3310 Add rsync to cmake dependencies HPCC-3310 Avoid multiple ssh calls to same node, starting thor HPCC-8185 Protect against corrupt or truncated end of dali delta HPCC-8199 Packagemap list and info needs to return loaded information HPCC-8274 Improve bad MP packet tracing HPCC-8268 Fix internal error triggered by MIN(ds, value, KEYED) HPCC-8189 JobQueue updating dali too frequently HPCC-8255 Csv headings deadlock HPCC-8250 Activities derived from disk read asserting on multiway files HPCC-8151 Group dedup all, was stripping end of group markers. HPCC-8236 Avoid spilling callback deadlock HPCC-8229 Fix occasional crash generating code to cast a string to data HPCC-8235 Ensure end-of-groups stripped for sorted join input HPCC-8052 nested ChildDatasets + ECL Playground generated results HPCC-8234 Avoid deadlock on balanced splitter HPCC-8224 Fast compression issues HPCC-8220 Configmgr - Pluging path is not populated HPCC-8225 Fix global ENTH deadlock issue HPCC-8052 nested ChildDatasets + ECL Playground generated results HPCC-8094 Group Hash Dedup support HPCC-3097 Rationalize row reader/writer helpers HPCC-8212 Implement grouped hash dedup for hthor and roxie HPCC-8034 Add example of grouped hash dedup to the regression suite HPCC-7980 Translate remote file dafilesrv access to local HPCC-7944 Add setting, to allow master memory to be specified HPCC-8221 ESP wasn't correctly loading plugin definitions HPCC-8052 nested ChildDatasets + ECL Playground generated results HPCC-8216 Csvread,opt heading crash HPCC-8213 Disable sub-file checking on internal build HPCC-2558 Fix problems deleting workunit .so/.cpp files HPCC-8120 Firstn deadlock HPCC-8129 Fix bug generating an optimized hash function on a child dataset HPCC-3192 change fileServices spray functions to pass on maxConnections HPCC-8202 Fix potential crash on exit in scheduleadmin HPCC-7970 Fix some confusion with units when setting timing info HPCC-8156 column width calculations inacurate HPCC-8159 Add option to generate precompiled header for eclcc-generated code HPCC-8052 nested ChildDatasets not showing up in ECL Playground generated results HPCC-7970 Include eclcc timing information in workunits HPCC-8052 nested ChildDatasets not showing up in ECL Playground generated results HPCC-8193 Roxie file resolution issues HPCC-8180 Roxie issues reloading changed files HPCC-8159 Add option to generate precompiled header for eclcc-generated code HPCC-8194 CRoxiePackageSetManager does not initialize stateHash HPCC-8188 Correct spelling in usage section for ecl roxie HPCC-3095 Format result columns from XML Schema HPCC-8159 Prepare for use of precompiled headers in eclcc-generated code HPCC-8176 Regression in library resolve code HPCC-8174 Global loop regression HPCC-8102 Rename eclccserver maxCompileThreads option HPCC-8132 Global loop again race condition HPCC-8103 Fix missing hyperlinks for results in WU Details page HPCC-8130 Fixed IFS issue related to spaces in path in profile HPCC-8130 Loading of profile regression on start of platform HPCC-7975 Add std.system.thorlib.platform HPCC-8129 Fix bug generating an optimized hash function on a child dataset HPCC-8174 Global loop regression HPCC-8102 Rename eclccserver maxCompileThreads option HPCC-8132 Global loop again race condition HPCC-8103 Fix missing hyperlinks for results in WU Details page HPCC-7975 Add std.system.thorlib.platform HPCC-8129 Fix bug generating an optimized hash function on a child dataset HPCC-8002 Fix a couple of issues pick up by msvc HPCC-8114 Make missing return an error HPCC-8118 Build error under clang HPCC-8114 Check gcc c++ version before using -Werror= HPCC-8064 Roxie passing NULL for IUserDescriptor HPCC-8114 Make missing return an error HPCC-8113 Crash in thor when sorting very large arrays HPCC-7943 Indicate replicate optional HPCC-8002 Fix windows compile break HPCC-8032 Fix compile error from previous submit HPCC-8032 Fix regression in non-grouped input hash aggregate HPCC-3306 Stop code generator swapping a DISTRIBUTE and a COUNT PROJECT HPCC-7956 HPCC-7956 Implement grouped version of hash aggregate HPCC-8026 Fix linux compile error passing StringBuffer to ... argument HPCC-8087 Add DFU server name into DFU WU xml and diaplay in EclWatch HPCC-7943 Indicate replicate optional HPCC-8013 Ecl Packagemap add needs to add logical file info to dali HPCC-8095 Remove many refs to UNKNOWN_USER HPCC-8013 Ecl Packagemap add needs to add logical file info to dali HPCC-8086 Complete Monitorinterval setting HPCC-8026 Update View Log based on HPCC-8081 Fix compilation errors from HPCC-8014 HPCC-8079 Compile errors related to IUserDescriptor refactoring HPCC-8078 System won't compile under Clang HPCC-8032 Roxie and hthor support for grouped hash aggregate HPCC-2253 Implement Syntax for grouped hash aggregate HPCC-3139 Make ecl cli bash_completion command specific HPCC-2964 Configmgr - Allow swapping of Thor Master HPCC-8013 Ecl Packagemap add needs to add logical file info to dali HPCC-7944 Add setting, to allow master memory to be specified HPCC-7973 New choose activity, thor implementation HPCC-7860 ECL Plugin for Eclipse docs lists graph control as prerequisite HPCC-7979 Ensure persistent settings reset at end of job HPCC-8062 Fix Typo in doc Refactor hashdist(send) to use thread pool of senders Add option to allow receiver to spill disk HPCC-8002 Tidy/remove legacy HDD meta scheme HPCC-3092 Add ESCAPE option to CSV dataset HPCC-1744 Added sub uninstall to match the sub install HPCC-8014 Require IUserDescriptor in all HPCC calls HPCC-2964 Configmgr - Allow swapping of Thor Master HPCC-8017 Expand huge allocations into adjacent free blocks on resizeRow HPCC-3213 Clear workunit variables before submitting in WURun HPCC-7930 Rename ecl-package to ecl-packagemap HPCC-7930 Rename ecl-package to ecl-packagemap HPCC-8051 Fix warnings caused by implicit cast in jdebug.hpp HPCC-8045 Refactoring daregress HPCC-3154 Improve XmlSchema availability options through WsWorkunits HPCC-8038 Add out-of-order check to subfiles HPCC-7990 Compilation error using DICTIONARY with spanMultipleCpp HPCC-0559 Set time out value for deleting logical file HPCC-8003 Std.System.Util.CmdProcess() fails with undefined symbol fsCmdProcess2 HPCC-1835 Configmgr - Enable deletion of components with same names HPCC-7873 Remove call to reset a workunit which was in the wrong place HPCC-2950 Added SOAPACTION option to SOAPCALL docs HPCC-8025 The complete-uninstall script should not remove unrelated packages HPCC-7937 Throw an error on ambiguous prop tree get HPCC-7982 Memory leaks in thor keyed join activity HPCC-7998 Fix WsEcl handling of view resource of type xml HPCC-7998 Fix WsEcl handling of repository based Result views HPCC-7986 Lookup join core and all join regression HPCC-3017 Configmgr - Context menu display issue on multiselect HPCC-1835 Confimgr - Enable deletion of components with same names HPCC-2802 Add instructions to use Unity Launcher icon HPCC-7825 Additional edits to Roxie file copy section HPCC-8015 Typo in roxie help message HPCC-7825 Document roxie file copy settings HPCC-8016 Ensure global sort order recalculated when grouped order lost HPCC-8011 xmlsize crash fix HPCC-2942 Configmgr - Add custom attributes HPCC-2942 Configmgr - Add custom attributes HPCC-8004 Wrong user descriptor when accessing Distributed Superfile HPCC-7997 Fix retrieveWebServicesInfo support for QueryMainDefinition HPCC-7948 Display CsvEscape option in logical file page HPCC-7964 Configmgr - When updating ldap filesBasedn, propagate change HPCC-7995 Various minor valgrind-reported issues HPCC-7992 Add support for beyond compare 3 comparison to regress suite HPCC-7989 Add missing dependency on XML::Simple HPCC-7977 Fix incorrect filenames in documentation directory HPCC-2390 Update ROLLUP documentation for clarity on matching rules HPCC-7965 Modify based on code review. HPCC-7974 Fix ecl-package commands using incorrect return type HPCC-7978 ecl commands should set QueryMain explicitly HPCC-7962 Fix problems with ecl --main option HPCC-7981 Memory leak in memoryUsageReporter HPCC-7965 Set correct content type for xml/xslt to avoid log failure HPCC-7941 Update ConfigMgr Images and Docs HPCC-7852 Share the same IWUClusterInfo with reloadCluster() HPCC-7852 Display an error when a query is published and suspended HPCC-7948 Add CsvEscape option to EclWatch UI/dfuwu/ftbase HPCC-7969 False positives from distmerge.ecl in regression suite HPCC-7972 False positives in roxie regression suite on when6c.ecl HPCC-7953 Roxiemem unit tests fail if all run together HPCC-7966 Spurious errors reported by remote.ecl in regression test HPCC-7971 Fix typo in fromxml.xml regression suite key HPCC-0954 Added documentation for CATCH function HPCC-7941 Update ConfigMgr Images and Docs HPCC-2884 he NOSORT option of JOIN not complete HPCC-2346 two log directories for dafilesrv created on startup HPCC-7963 Configmgr - Missing && breaking build HPCC-7955 Configmgr - Disassociating ldap from esp causes seg fault HPCC-7961 Fix problems with eclcc handling of -main HPCC-7954 Configmgr - improper popup when changing ESP service bindings HPCC-7955 Configmgr - Disassociating ldap from esp causes seg fault HPCC-3327 Row arrays limited to 500 million rows Add some loop in child query tests HPCC-2885 not all LIMIT options are documented on JOIN HPCC-7917 Add CLI support for a --help option HPCC-7941 Update ConfigMgr Images and Docs HPCC-7931 Edits from code review HPCC-7941 Update ConfigMgr Images and Docs HPCC-3034 Make publishing and copying of queries aware of packages HPCC-7939 Confusing code in checkLogicalName HPCC-2960 Configmgr - Navigator multiselect can cause display issues HPCC-2960 Configmgr - Navigator multiselect can cause display issues HPCC-7940 ECLWatch Users screen should be sortable on PWD Expiry columns HPCC-2882 Comparison operator silent about sets HPCC-7931 In ecl CLI, package action renamed to packagemap HPCC-2804 Do not inline distributed dataset HPCC-2804 Test negative rows HPCC-2197 Ecl package command line parameters need to be more consistent HPCC-2804 Continue to hoist no_dataset_from_row to reduce impact HPCC-2804 Inline dataset_from_transform HPCC-7935 Use temp_files for regression temp dir HPCC-0633 Add support for loopagain support HPCC-7934 Disable udpResendEnabled by default HPCC-7808 Fix a few issues with DISTRIBUTE(,SKEW) HPCC-7821 Fix ReferencedFileList handling of SuperFile within SuperFile HPCC-2883 Description of HASH option for JOIN HPCC-2679 Document WHEN's "failure" HPCC-2825 document SOAPCALL TIMELIMIT option HPCC-2832 SOAPCALL timeout now a double HPCC-7923 Update ConfigMgr Images and Docs HPCC-2939 Configmgr - IE context menu in navigator causes tree view jump HPCC-2197 Ecl package command line parameters need to be more consistent HPCC-7882 Update docs to reflect changes to ecl CLI HPCC-7856 Include macros with parameters-with-defaults in dependencies HPCC-7920 Core in dafilesrv if sent a VER command in authenticated mode HPCC-2058 Add a ,UNORDERED option to an index read HPCC-7888 Reinstate lost dllsToSlaves=false changes HPCC-7919 Report errors that prevented loading a Roxie query HPCC-2309 Configmgr - Entering LDAP ou info is error-prone HPCC-7918 Configmgr - Save As from context menu locks up browser HPCC-7916 Add ecl roxie commands HPCC-3153 Filter WU names before showing on Browse Workunits page HPCC-3365 Add params for per-query memory and time limits from CLI HPCC-7913 Regression in control:reload caused by HPCC-7897 fix HPCC-7910 Fix building unittests under windows HPCC-7892 Roxie should default to predictable order HPCC-7909 Compile failure on OSX HPCC-7890 Default to outputting multiple c++ files HPCC-7897 Use ReadWriteLock to reduce impact of lock on query lookup table HPCC-2880 Report files currently in use by cluster HPCC-7861 Fix field xpath('') causing invalid XML HPCC-7828 Replacement Images for ECLWatch HPCC-7872 add 3 Std.Str funcs: ExcludeFirstWord ExcludeLastWord ExcludeNthWord HPCC-2197 Ecl package command line parameters need to be more consistent HPCC-7888 Ensure query dlls in separate dir HPCC-7891 colprefix inx with 0 rows hitting assert HPCC-7828 Replacement Images for ECLWatch HPCC-7887 rowarray.ensure(0) debug assert HPCC-7886 Issue warnings and retry on thread start timeout HPCC-7868 PackageSet needs a unique id HPCC-7877 Fix ECL CLI errors referring to Cluster rather than Target HPCC-3263 Flag libraries when published to QuerySets HPCC-7828 Replacement Images for ECLWatch HPCC-3326 Thor Lookup Join improvements HPCC-7880 Additional thor memory tracing HPCC-0674 Add new word remove functions to Std.Str HPCC-3198 Remove 'Run ECL' link from EclWatch HPCC-7870 Convert 'Slave Number' input to integer before comparison HPCC-7869 Roxie cores in regression suite HPCC-0716 Include superfile into addSuper transactions HPCC-3266 Add Clustername to Std.System.Thorlib HPCC-2958 Configmr - buildset for dropzone is mixed HPCC-7820 Add LDAP scope for the per-user temp file location HPCC-7851 Use StringArray sort() HPCC-7864 Standalone mode broken in Roxie in 3.10 HPCC-2941 Configmgr - XML view should be labelled XML View HPCC-7862 Initialize and Terminate JLIB in Treeview executable HPCC-7851 Sort published job alphabetically in WsECL HPCC-7859 Fix unity installer Remove setActive, add cache lookups to transaction HPCC-3162 Fix windows StringArray export and template instantiation HPCC-3134 Configmgr - Need finer granularity when copying Hardware HPCC-3312 Support setting per-query memory and time limits from CLI HPCC-3314 Configmgr - Need finer granularity when copying Hardware HPCC-3198 Remove 'Run ECL' link in EclWatch HPCC-7836 Changes to docs to remove or replace IE-7 HPCC-3206 Display Delete access denied when no access to a scope HPCC-3078 Add preflight option to display usage of mounted disks HPCC-3187 Remove JDBC Driver from HPCC-Platform source line HPCC-7823 Add element to extend reuse of file HPCC-7823 Added informalexample tag to ECLR modules HPCC-3162 Hide DelimToStringArray HPCC-7831 filterprojects fail in child queries HPCC-3039 Add how to use INI file & Env Variable details to ecl CLI chapter HPCC-3324 ESP can crash if multiple queries received together HPCC-3292 Don't update workunit jobname when publishing from CLI HPCC-3297 Show usage when ecl queries copy is called with no parameter HPCC-2704 Use const methods in IReferencedFile interface HPCC-3116 Deschedule WU even if the WU is not found HPCC-3286 Provide new helper function to estimate row memory consumption HPCC-3210 Ensure temp files are under user scope HPCC-7816 Update CONTRIBUTORS file to reference Jira issues HPCC-7815 Remove redundant/wrong default dir HPCC-7810 Add chapter about Packages to Roxie Manual HPCC-3278 Fix File Spray rate displayed in DFU Workunit Details page HPCC-1874 Modify code to avoid using dynamic array allocation HPCC-7807 Change commit-msg tests to Jira HPCC-1874 Configmgr - Enable deletion of attributes HPCC-3136 Configmgr - Improper notification of config file change - After generating a configuration using the wizard. Selecting advanced view will no longer refresh configuration. HPCC-2394 Don't ignore xpath within ECL IFBLOCK when outputing XML HPCC-2938 Fix Configmgr - Component tree collapses HPCC-2636 Refactor Preflight code to avoid multiple SSH calls to same node HPCC-3281 getPlatform() should not cache HPCC-2122 Add ability to pause DFU queue HPCC-2704 Setup and copy files to roxie when copying/publishing queries HPCC-3294 Implementation of CHOOSE(expr, ds, ds, ds) HPCC-3274 Add proxies for EE-only plugins to CE builds HPCC-3199 Added new actions and options to Client Tools manuals. HPCC-3281 Fix for exception thrown in helper HPCC-3199 Add --no-activate option to ecl publish and change default HPCC-3216 Add more info to int/string in IR HPCC-2255 Improve WsECL error messages when roxie communication fails HPCC-3157 Update query publishing and ws_ecl to use target as queryset name HPCC-3157 Roxie using target cluster names to load QuerySets HPCC-2705 Add cli support for ecl roxie reload HPCC-3255 added -- to target and server parameters in sample code HPCC-3255 removed one more @ from sample code HPCC-3255 remove @ from sample code HPCC-3255 Change examples to use ecl run instead of eclplus HPCC-3221 Fix typo when regressing an unadopted change HPCC-2562 Change license to Apache HPCC-2169 Add wildcard support to ecl unpublish for queryids HPCC-3246 Fix Configmgr - IE specific display issues - IE specific issues prevent proper rendering of webpage - Fix use of commas in javascript - Fix javascript comparison HPCC-3209 Remove some un-needed code and simplify HPCC-3137 Fix Configmgr - XML View doesn't handle quotes(") - Use XSLT to escape single quotes so javascript properly handles string HPCC-2562 Change license to Apache HPCC-3221 Various memory optimizations for eclcc HPCC-3218 Remove timing info from eclcc tests HPCC-3209 Add Block input form to WsECl HPCC-3232 ESP to cache password expiry policy HPCC-2827 Configmgr - Provide msg when validation finds no issue - A pop message will indicate when validation completes with no issues HPCC-0658 Add user option to eclplus HPCC-3223 Fix Submit button problem on preflight result page HPCC-3200 Return StringBuffer reference from appendJSONValue HPCC-2879 Add spray test HPCC-3203 Script error on ECLWatch from within ECL IDE HPCC-2706 Add cli support for comparing state across roxie nodes HPCC-2333 Modify code based on review HPCC-3005 Fix ECLAgent::getPlatform() problem HPCC-3196 Fix internal error submitting functional definition HPCC-3182 32bit Windows build failure HPCC-2734 platform command line usage changes based on comments HPCC-3183 Improve git commit message hook HPCC-3176 Wformat-security warning on ws_dfuService HPCC-3172 Avoid spurious error on empty inline wildcard superfiles HPCC-2806 Add ecl-roxie cli supporting attaching/detaching roxie from dali HPCC-2734 Rationalize cluster name command line usage HPCC-2333 Outdated Optional packages still display in EclWatch HPCC-3120 Bad error when viewing WU result on WU Details page Standardize title format for all modules in Standard Library Reference HPCC-3133 Fix dict2 key, skip Thor for now HPCC-2768 Some code in unicodelib plugin is not in proper namespace HPCC-3066 Roxie not releasing files fully after running workunit. Added default chkconfig parameters Add dictionary support to ECL HPCC-3098 Misleading git tag displayed on internal builds Fix ESP allowing JSON and XML responses to be redirected Improve JSON exception handling and numeric string handling for WsECL HPCC-3081 Thor slave not shown when group name not set wsecl escaping of json strings HPCC-2788 rogue error following disk full HPCC-3070 superfile deleted when removing its subfiles Changes based on feedback and improved error message Error message alerts only when there is an issue More verbose error message Minor spacing change based on feedback. Minor optimization based on feedback. Incorporate changes based on feedback - Common up and refactor code for Hardware and Software copy - Refactor iterator syntax - Remove unused variable - Remove extraneous code HPCC-3009 LOCAL on a keyed join causes Roxie to misbehave HPCC-2956 Roxie support for HTTPCALL activity Fix build break on strict compilers HPCC-2675 Implementation of spilling hash dedup HPCC-2629 Configmr - Save As Button HPCC-3027 Roxie logs capured in .stderr file Initial work on trasnformer to common up some selectors Remove redundant code Fix whitespace issue Minor fixes to selector sequence for implicit project Remove selSeq from no_dataset_from_transform Further clean up the rows handling to use a single stack Fix problem with selSeq being redefined Even closer to worFix problem with implicit project using merging transform Improve the code to spot differences between expressions Use an expr attr instead of an attr so it gets transformed Fix problems where LEFT substituion was incorrectly short circuited Clean up conditional code Resolve rebasing merge conflicts Work towards efficiently disambiguating left Fix eclcmd build issue remove outer Response and Results tags from EclDirectEx result xml HPCC-3029 Changes based on code review. - Don't attempt to create incomplete expression. - Handle null or empty fragment. HPCC-2629 Configmgr - save as button - Add a 'Save Environment As' button to toolbar. - 'Save Environment As' can only be used in read-only mode - 'Save Environment As' loads the saved environment file Fix double output of SOAP struct array root tag HPCC-3029 Don't always treat expression fragments as table.field. Either prefix or postfix can be literal strings, or numeric field. eclcc memory - more savings Move usedTables to a separate base class Optimize some representations of no_select eclcc memory savings - move type field Change a few more common classes to use CInterfaceOf Reducing eclcc memory consumption Improve consistency of help text Unified ClientTools Packaging for OSX, Linux and Windows. Changed default install location for ClientTools (???/HPCCSystems/3.8.0/clienttools) Added third party dlls to windows + OSX install. Removed invalid dependencies from DFU Plus Removed OSSDIR from child projects and appended it to CMAKE_INSTALL_PREFIX as needed. Required folders now calculated relative to eclcc. Include examples. Replace const char** with PointerArrayOf Add COMPRESSED(FIRST) and COMPRESSED(ROW) tests Improve ws_workunits cluster parameter validation Consistently use queryname to generate root tags in WsEcl Add pure specifiers to some internal functions. HPCC-2849 Move Total Thor Time to end of Timings HPCC-2955 Spaces not trimmed from workunit id Add --no-reload option to ecl-publish and ecl-queries-copy HPCC-2989, more null ptr HPCC-2998 Remove some getRecordSize(NULL) calls Additional small regression in recent esp serialization refactoring HPCC-2974 Remove extra ? in View Data File HPCC-2161 Package add queryset shortcut parameter should be -qs HPCC-2979 Return type warning is universal HPCC-2161 Only one package can be active per queryset / packagemap Allow roxiemem heap flags to be passed HPCC-2940 Confimgr - XML View doesn't properly handle '' - Modify XSLT javscript generation to escape '' characters HPCC-1836 Configmgr - Navgtr window jump in IE onclick - When clicking on an item in the tree in the navigator window the scroll position will no longer reset to the top - When clicking on an item in the context menu in the navigator window the scroll position will no longer reset to the top HPCC-2836 - buildindex var row,col_prefix fix HPCC-2900 fix white space issues. ESP code generation parameter order for BaseEspStruct::toStr Fix based on review. Properly handle duplicately named components. Not more than 10 files per log line Daliadmin fix checksuperfile usage Minor for-loop restructure based on feedback. Fix for out of bounds array index based on feedback Proper handling of multiple config files matching staged configuration. - All will be highlighted. Fix and enhancement for configmgr pull request #2601 and for issue HPCC-2386 - Add highlight to indicate staged envrionment in table triggered from open environment button - Fix IE specific display - Removed ForEach loop since only 1 iteration is needed - Cleaned up StringBuffer assignment - Add check for NULL pointer and will throw an exception if encountered Fix for pull request #2593 - Fix for center context menu not accepting clicks HPCC-2649 Configmgr - duplicate component - Add 'Duplicate Componenet/Service' to context menu - Duplicate components and assign unique name HPCC-2287 CSV options not visible in DFU workunit Some more examples of nested conditional execution Clean up the code and start use more specific flags Update the way some throw flags are set Simplify the context flag for tracking skips HPCC-1887 Configmgr on component rename focus is lost - When renaming components, the screen refreshes but focus will be on the newly renamed component HPCC-1629 Spray file default target file name HPCC-2859 Remove h2h from HPCC-Platform/plugins/ HPCC-2888 add superfile operations to esp log Move repetitive JSON comma delimiting code into a shared function ForEach first redundant Simplify loadSubFiles Remove fixmissing flag Expect rounding of the last digit Rename TempDecimal to Decimal Use ASSERT(check(cond, fmt, args)) Split BCD tests, init with zero New option to generate a detailed log file HPCC-2807 Added version scheme used for platform/clienttools to docs. Use the same module initialisation under windows. Add template classes for implementing the linkcounts. Add an option to rerun a query to eclcc regression script HPCC-2828 - Clean up code using DelayedSizeMarker Improvements to the eclcc regression script Commit of fix of auto-conflict resolved file. added some XML fixes rebased into 3.10.x ResolvedConflicts: More normalization of the use of drop list, and some include fixes phase I of drop list normalization HPCC-2600 First phase SQL Join support (code review changes) HPCC-2800,Disable URIPARSER by default Split off candidate-3.10 branch Customer request to modify SOAPCALL timeout granularity Add a size() HPCC-2815 DelayedSizeMarker mb size patch HPCC-2390 rollup matching transform result, not left Add ifdef wrapper for CppUnit Fix Clang errors Comment typos Conditional URI test execution Re-Enable unittests HPCC-2721 configmgr - ldap systemUser drops prepended backslash Add additional backslash ('') for javascript to properly display backslash Allow multiple include dirs HPCC-2600 First phase SQL Join support Support single join (inner or outer) Join clause turns off index file use EclEngine utilizes maps for quick lookup of corresponding table->index and source dataset name ECL code is more centralized, support for multiple files enabled. HPCCPrepStatement - now contains cache for multiple index files. HPCCResultSet - contains structure with all available columns (from all tables in query) - index turned off for join queries (temporary) All expression fragments now contain parent table, and field name. HPCC-2795 noreturn specific to newer compilers Remove unnecessary extern C Implement URI backbone Fix minor issues reported by eclipse Silence Clang error on private assignment operator HPCC-2390 ROLLUP - more test cases HPCC-2390 ROLLUP should compare previous input row Fix internal assert on (obscure) side-effects in workflow HPCC-2576 Output debug settings (-f values) to archive HPCC-2763 Fix valgrind error running compiler test suite HPCC-2764 Core dumps possible if mix debug/release .so's Fix crash on linux generating a field usage report Allow RIGHT ONLY joins against indexes HPCC-2748 Minor memory leak Provide a function for estimating allocated row capacity Add ESP support for JSON formatted responses Introduce extra hash dedup helper functions Release more example regression tests Release some example regression test files Treat a query containing a single row as output(row) Missing file from pull commit #0def97c73ad3d104e5eb0b153f9429b8a86e1c0d Fix scoping issues with #GETDATATYPE Fix handling of impure conditions and case/map Address some of the issues from the code review More minor optimations to child query code Add Ubuntu Unity Launcher icon Clone record count information onto the graph results Reimplement the way child queries are commoned up. Noreturn in start-stop-daemon Fix clang -Wreturn-type Fix clang -Wsizeof-pointer-memaccess Fix clang -Wdeprecated Default inline is GCC only Split use/decl, else, more comments Add ExpressionDumper basic logic Fix some issues detected by Valgrind Fix a few example files to avoid newly introduced error Old Thor shouldn't have TBDs Mark when* TBD in thor Skip library2a in hthor Add new test case to verify catch behaviour with splitters Moved chunksize to a define. Adding missing reserve of space for memorybuffer. changed loop to no longer worry about a file under the chunkSize as it is handled in read. Corrections based on code review of richardkchapman and jakesmith. Add OSX build section to README HPCC-2660 CATCH,SKIP in Roxie not aborting upstream activities HPCC-2660 CATCH,SKIP in Roxie not aborting upstream activities HPCC-2656 thorlib.nodes() always returns 1 on Roxie More output to library2a.ecl HPCC-2624 remote.ecl mismatch test in Roxie regression suite HPCC-2654 Skip library tests in hthor regression suite HPCC-2515 Improve behaviour of getWuid() in Roxie Pass ecl command line -foptions to eclcc and to deploy workunit HPCC-2640 pipe8.ecl test filing in Roxie Move ESPstruct "NamedValue" to a common ecm file Moved chunksize to a define. Index need to be big_endian unsigned Remove hard-coded locale settings in init scripts Add missingt call (which currently has no effect) Fix a minor issue with the selectors for ROLLUP(GROUP) HPCC-2607 - avoid issues with UTF8 locale Adding missing reserve of space for memorybuffer. changed loop to no longer worry about a file under the chunkSize as it is handled in read. Add ecl completion Corrections based on code review of richardkchapman and jakesmith. HPCC-2612 Spurious regression suite error from teststd.ecl Better file completion Draft bash completion ECL tools HPCC-2610 HPCC-2596 added chunking of file read. HPCC-2596 added chunking of file read. Changed options to -f<option>=<value> and -X<name>=<value>. HPCC-2393 Error on keyed child index Disable intindex until we fix it HPCC-2387 configmgr - Give indication of staged configuration - In the wizard summary and advaned view highlight matching configuration file matching staged configuration file - Add tooltip to explain highlighting HPCC-2596 added support for creation of md5sum from file. Add options to 'ecl run' for setting debug and stored variables HPCC-2596 added support for creation of md5sum from file. Fix dllsToSlaves option Fix potential use of NULL pointer in printf %s HPCC-2202 Incorrect output from xml output(row) Compress query init and trace timing HPCC-2549 Add pwd expiry column to ECLWatch users screen Skip applyaction while HPCC-2351 is not fixed Stop GRAPH(expr) always hoisting (debug operator) Only create expression if actually used Short circuit constant replacer Optimization: Add member function to avoid cloning Mark regress query with IFACTION TBD Avoid cloning expression when can just link instead Optimize handling of no_self on rhs of an assign diskread optimization Optimize (and fix) appending a row to a dataset Add usage message to Roxie Make catch3 Roxie-only test Skipping unimplemented Thor tests as TBD Minor refactor of child query spotting code Clean up code and remove unused function Remove code that is no longer required GH#2328 edited ECLPlus docs to use standalone ecl only, instead of .file Add comment on how to debug symbols Adding output to avoid premature optimisation on LEFT case Allow dynamic counts Allow dataset to have its arguments optimised Optimise NORMALIZE to DATASET Add create superfile inside transactions Fix assert when ebcdic string used in filename Fix regression in eclcc accessing a uninitialised member Minor changes following on from code review Clear warnings in regression Add include path to regressions Add compiler+options to log New option -freportFieldUsage to track fields used Final fixes and minor optimization Minor clean up of the enumerated type Extend implicit row projection to nested rows Better error handling, using external diff recommit of Version.xml.in Release extra tests for nested selects Added support for striped tables in docs Modified the Version source files commit of Re-revised Version.xml Fix typo in dali regression suite Added some code for CHM production to Version docs Pagination fix for Installing_and_RunningTheHPCCPlatform.xml
Release Notes for 3.8.6
=============================================
Known Limitations for Community Edition 3.8.6
=============================================
-
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.Centos/Red Hat/SuSe
sudo rpm -e
Ubuntu/Debian
sudo dpkg -r
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.Centos/Red Hat/SuSe
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
-
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
-
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
-
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
-
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
-
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv start
This only has to be done once.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
-
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821)
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
- Querying a corrupt superfile could produce inconsistent results instead of an error message. However, the source of the superfile corruption has been fixed in 3.8.4 (HPCC-7908)
=============================================
Comprehensive List of changes from 3.8.4 to 3.8.6
=============================================
HPCC-8027 skew percentages not visible in graph HPCC-8018 - Dynamic array causes Windows build failure HPCC-7884 Detect superfile error on reload subs HPCC-8001 Modify example to ensure group aggregate not generated HPCC-8001 Stop generating grouped hash aggregate activities HPCC-7996 Introduce memory manager spill threshold option HPCC-7942 Fix problem with LIMIT(0) on an JOIN(,ALL) HPCC-7880 Additional thor memory tracing HPCC-7861 Fix field xpath('') causing invalid XML HPCC-7888 Ensure query dlls in separate dir HPCC-7904 Allow xref max memory to be configured HPCC-7884 Detect superfile error on reload subs HPCC-3328 Increase dafilesrv file handle hard limit HPCC-8110 GETENV should fall back to calling OS getenv() HPCC-8112 Added support for environment profile to hpcc_setenv HPCC-8130 Fixed IFS issue related to spaces in path in profile HPCC-8130 Loading of profile regression on start of platform
=========================================
Release Notes for 3.8.4-1
=============================================
Known Limitations for Community Edition 3.8.4-1
=============================================
-
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.Centos/Red Hat/SuSe
sudo rpm -e
Ubuntu/Debian
sudo dpkg -r
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.Centos/Red Hat/SuSe
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
-
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
-
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
-
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
-
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
-
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv start
This only has to be done once.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
-
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821)
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
- Querying a corrupt superfile could produce inconsistent results instead of an error message. However, the source of the superfile corruption has been fixed in 3.8.4 (HPCC-7908)
=============================================
Comprehensive list of changes in 3.8.4-1
=============================================
gh-3151 Fix Thor's setIORetryCount setting gh-3115 Core in eclagent testing Std.File.MonitorFile gh-3138 fix missing error deleting subfile gh-2940 Confimgr - XML View doesn't properly handle '' gh-3094 Fix Configmgr - Writing modified optional attributes was reverting their value gh-2731 not disable 'retain superfile structure' gh-3076 Add Slave Number column on Cluster pages gh-2995 Chrome Drop Down displays behind Graph Control gh-3106 CONTRIBUTORS file updated to reflect requirement for issue ref. gh-3101 Give warning when DICTIONARY used as an identifier gh-3007 Configmgr-should check for dafilsrv + ftslave when adding thor slave gh-3023 Fix error calling MakeAbsoluteSD gh-3024 Allow set permissions for repository root gh-2933 - Ensure pid files are removed on reboot gh-3055 FIX minor typo in error messages gh-3050 Correction to docs -- add uninstall instructions for Ubuntu. gh-2860 https connection to EclWatch failed gh-2949 Fix password expiration issue with openLdap gh-2886 Made edits to DFUPlus doc: add transferbuffersize=nnn, format=recfmv, format=recfmvb gh-2834 variable length indexwrite fix gh-2829 OSX Load Plugins Issue Dynamic loading of libraries was failing in eclcc on OSX gh-2786 LDAPConfig to filter out DC entries for DNS gh-2715 FileActors example not extracting episode numbers gh-2478 wrong order of machines in preflight page Change multimap to BoolHash and set the BoolHash using Network Address, process name, process type and process number Which define unique preflight request for system component. gh-3321 Fix memory leak for large blocks in memory manager gh-3313 Memory fragmentation issues gh-3280 Update license to match latest version gh-3280 Fix problems projecting nested records gh-3248 Fixes font issues in the Eclipse, CHM and PDF documentation outputs gh-3242 xalan libraries resolved to wrong folder ======================================================================================== HPCC-7843 Temporarily dump stack trace dereferencing NULL user HPCC-7838 stack dump changes break in string function HPCC-7834 Temporarily dump stack trace if default dali user HPCC-3298 Fix problems accessing SHARED symbols HPCC-7813 Add sub-del test in daregress HPCC-7817 Memory leak in Std.Uni.GetNthWord HPCC-3286 Update to use new getExepctedFootprint() HPCC-3336 Update to reflect review comments HPCC-7812 DFS loadDefaultBases race condition HPCC-3286 Minisort could spill and lose records HPCC-3299 Fix missing export from Std.System.Util HPCC-7811 Fix DFS filename rename issue
=========================================
Release Notes for 3.8.2.2
=============================================
Comprehensive list of changes in 3.8.2-2
=============================================
GH-3321 Fix memory leak for large blocks in memory manager GH-3313 Fix Memory fragmentation issues
=========================================
Release Notes for 3.8.2
Known Limitations for 3.8.2
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.Centos/Red Hat/SuSe
sudo rpm -e <package_filename>
Ubuntu/Debian
sudo dpkg -r <package_filename>
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.Centos/Red Hat/SuSe
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv start
This only has to be done once.
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
- The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821)
=============================================
Comprehensive List of changes from 3.8.0 to 3.8.2
=============================================
gh-3161 Pass user descriptor when checking logical files gh-3163 Dali iterateFiles/ldap optimizations gh-3083 logical rename, not renaming physicals correctly gh-2418 LDAP Dali dont use NULL user descriptor gh-3088 Fix possible memory manager deadlock gh-3073 Fix schemas not matching results when using xpaths gh-3075 Add result_lib.xslt support for displaying attributes gh-3054 Fix incorrect 'Cluster Stopped' display for hThor and Roxie gh-3063 Fix possible crash in esp gh-3040 promoteSuperFile fix gh-3047 Consistently use queryname to generate root tags in WsEcl gh-2821 ECL Playground IE8 Issue: gh-2991 hThor file published group name gh-2821 ECL Playground: IE7 + IE8 Loading Issue. gh-2834 variable length indexwrite fix gh-2990 rowarray removeRows crash gh-2779 Remove default daliadmin file logging gh-2784 Config Manager populate ldapserver basedn gh-2760 Invalid links to download resources. gh-2747 FIx empty page from Users link for non-admin gh-3188 Fix ws_ecl resource leak after calling resolveQueryAlias
=========================================
Release Notes for 3.8.0
Known Limitations for 3.8.0
-
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command: sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv startThis only has to be done once.
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
- If you are upgrading from a previous 3.8 rc version on any system that uses rpm for installation (Centos, OpenSuse), you may see a message such as:package hpccsystems-platform-community-3.8.06rc.x86_64 (which is newer than hpccsystems-platform-community-3.8.01.x86_64) is already installedThe workaround would be to run rpm -e on the previously installed package and then rpm –Uvh the new package. On Debian systems where you would be using dpkg you will get a warning: downgrading, but the installation completes.
-
- The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821)
- There is an issue that causes the maximum length of a variable length key/payload indexwrite to be 4k. When building an index with a key/payload row that exceeds 4K, an assert in ctfile.cpp will result. (gh-2834)
===============================
Comprehensive List of changes in 3.8.0
===============================
#2336 Spill loop #2352 Page Loaded Results #2057 Configmgr reload config if environment file changes Modify memory cleanup to use Owned object. Add delete to clean up memory allocated as result of call to CFile::monitorDirectory Replace mutexs with critical sections Replace locks/unlocks with local synchronization objects Use single thread for configfile monitoring. #2349 Archive-dependency #2216 Deleting external temp file dependencies inside CQ #2353 Centos6 Dependencies #2274 Added el6 dependency list. Mark link with _dependsOn if different nesting level #2340 Spot invalid files in progress file Added missing dojox files. #2332 Graph progress #2338 Row count 64 #2216 Add dependency on libarchive #2323 Child query varfilename #2348 ecljdbc aggreate fn work Adds eclfunction classes to keep track of ECL function properties Clean up several sections of code (removes unneeded comments,etc.) Sends cluster param #2208 Sink timings were not handled properly #2341 ESP addlogicalfile #2316 Add logical file to new supefile in ECL Watch Fixed Url reference for DFUWorkunits in the ECL Watch Activity Page #2319 loop sync optimization #1083 use 64bit row count on 32/64 systems #2335 pkg filecopy nodaliip #2334 Fix references to EE Use a spill result for a dataset hoisted from a loop #2325 Ecl package copyFiles needs to properly read dali ip param #2293 Modify Enterpise Edition Only message to a friendlier Coming Soon message Minor changes, reflecting comments Minmize graph progress Refactor watchdog and implement MP version Updated Doc Changes for 3.8 Changes to remove references to optional packages for 3.8 #2241 Page Loaded Results #2321 pkg error reporting #2318 treemaker #2301 Provide the input meta for a graph loop result output #2315 child query varfilename handling Catch another possible progress serialization crash 2196 Ecl package needs to return error messages to user Adding Initial Genesis User Guide docs to 3.8x branch Removal and rename of HDFS_Stream. Commit to 3.8.x Loop subgraph init optimzation loading an empty xml stream, created wrong root node type Generate .ldaprc file using configgen #2312 prev grouprollover fix not quite right #2308 Roxie selftest regression causing core Global group regression #2291 Move dbgassertex to jlib so it can be used elsewhere #2285 graph progress crash #2257 Allow graph results to have spill priority #2272 Add progress of loop (counter) #2282 Fix issue with childif and graph progress #2286 Added CMakeLists.txt files for HDFS_to_HPCC_Connector doc Removed unused "context". Mixin is more efficient than delegate. Remove misleading CThorExpandingRowArray constructor Remove blocking progress crit #2220 pkg delete crash #2238 loopresult issue #2230 ecljdbc jar build ECLPlayground: Page loaded results. #2277 HDFSConnector Guide Revisions #2275 emptyloop #2278 Typo corrections and minor updates to ECL LRM Prevent FROMXML being forced to execute inside a graph #2279 Fix join nosort primary regression #2239 selfjoin child stall #2280 Fix global merge on 1node regression #2276 Created guide for HDFS connector Fix loop empty error, if any slaves sill processing #2258 pkg copyfile crash #2229 Restructured path variables to avoid long relative path per code review Global patch of loop subgraphs Fix issues with distributed results in child queries #2270 Fix compilation error in x86_64 #2267 Failed libxslt transforms causing core in libxml #2229 ECLJDBC driver inherits platform's cmake version variables and values. Using sizeof(record, max) to determine records' max length, which is used to determine termination threshold in case of data format error. The H2H feature now logs to the standard hpccsystems log location. HPCC environment.conf variables are used to determine appropriate location. #2260 Fix hashjoin regression caused by 2195 #2247 ecl package copyFiles crashes if no user / password specified #2240 Dali audit logfile #2227 ldapNeverExpires #2249 replace streaming labels #2248 pkg copyfile daliip #2244 ecl package command line needs to process daliip parameter #2242 Removed all "stream" references #2181 ecl package delete can cause esp to core #2231 Wrong Dali audit logfile name constructed Fix selfjoin global child query stall #2235 leaks ECLPlayground: Formatting changes only. Fix some global group issues and leaks New ESP accounts should have expiring passwords #2200 ldap Names #2178 ECL Playground #2223 Fixed a few memory leaks #2195 Up Thor version number Switch Thor to RoxieMM and use new swapping paradigm Move roxierow to roxiemem #2214 superattr-blank #2209 roxiePipe #2206 nullnew #2213 superfile desc's ignoring blank attrs #2205 Use logfile creator for roxiePipe logfile #2184 actinitrace #2210 Fix a complie warning in ws_dfu #2212 Fix problem incorrectly removing COUNTER from PROJECT Keep 'SmcAccess' and better display of permissions page Fix problems with new returning null on linux Improved error reporting when LDAP object name exists #2065 Replace 'SMC' in ECLWatch/ConfigMgr UI Releasing crit too early #2193 Fix regression if memory leak option is enabled #2194 Remove 'break' from if stmt #2191 precise-workaround-2187 #2188 precise-workaround-2187 #2189 Report "ESP Password Expired" to user #2173 pkg_activate ECL Playground: Load from existing WU. #2180 child flags #2187 hpcc-init fails to stop thor on Ubuntu 12.04 #2159 FEATURE - support for reading directly from zip and other archives #2185 SelfJoin object leak, cause error if spilled Restructure child dataset flags so they are more useful #2183 pkg_delete_nofileneeded Protect against potential act. init race #2182 Pkg file delete should not require a local copy of the pkg file #2179 Fix internal error on complex nested field selection #2166 Add the ability to properly activate / deactive package sets #2167 dfs-daregress #2165 Dataset count range starts at 1 #2171 Fix problem using unsigned numbers in #line Revert superfile regression, hint what to do to fix later #2163 FEATURE - hook-based git file reading #2154 FEATURE - hook-based git file reading #2132 ECLPlayground #2386 Fix various problems with the checking allocator #2385 archive-dependency-2216 #2378 ECLPlayground: Fixed issue when hosted within an iFrame. #2366 #2384 Incorrect libarchive dependency in lucid/maverick #2362 Ensure clearAggregate() fields are assigned in order #2374 archive-dir-2383 #2379 The name EclLimit can be misconstrued therefore the property more accurately describes its function #2363 zip files in local directory cause eclcc to assert #2367 Housekeeping, remove redundant code/files #2373 Unlock access to File monitor singleton #2364 Fix compile problem with CWsDeployFileInfo #2361 #2281-cherry-pick Final fixes and minor optimization Minor clean up of the enumerated type Extend implicit row projection to nested rows #2493 Use the correct loop bound for checking alignment #2482 derivedmodule Update based on review comments Ensure the allocations from the roxie heap are aligned #2486 Restructure SQL parser #2477 callbackrecurse #2465 gh2460 #2480 Can't access archived workunits #2466 Add sum() support Add sum() function description Add sum() and sum() group by support #2483 Remove Relogin function from ESP #2419 rowtable-opt #2484 Correct libarchive dependency on Squeeze Fix the tracing message so it is clearer #2437 validate cluster #2470 Correct libarchive dependency on Squeeze #2451 row project bug #2449 Issue_2415 #2472 xml exception #2463 Fix configmgr crash when passing an invalid sourcefile in query string #2461 #2435 floating context menu #2464 Add missing options to DFUPlus docs Fix error overriding a transform in a module #2479 Fix crash comparing varunicode constants Fix stack fault if memory callback allocates memory #2458 centos6deps Fix HTML returned for exceptions when xml response requested Improve ws_workunit and EclDirect cluster name validation and default behavior #2411 Distiguish between clusters and querysets, and validate #2445 fixed naming issue in el6 dep file. #2460 dropzones not selectable for file upload #2435 configmgr - Close context menu on top doc click #2455 ECL Playground doc to fix image refs #2453 ECLPlayground: Warnings not displaying. Fixes problem where rows could lose fields #2518 Ensure reuse of a file inherits all nescessary flags #2423 issue2219_2 #2448 packagingDir #2505 thorlog #2476 resolve some thor log issues #2491 issue1945 #2457 playground link #2514 issue2495 #2502 Thor duplicate port check #2506 bindcrash #2501 packedrecord #2511 ldap Make Dali filesBasedn required #2512 Updated docs and images to reflect ECLwatch changes ESP not logging failed permissions check #2503 Truncated Archive when download #2499 Implicit table alias support (regression fix) Acknowledge table alias sans "AS" keyword. Protect against a crash with invalid ECL #2498 SP columnfix Ensure stop_slaves is build into package #2471 problems with multithor init scripts Fix problem with inline dataset and packed records #2489 fix getprocs and getproccolumns #2494 Create placeholder class for development The placeholder "HPCCVersionTracker.java" class is overwritten by CMAKE process with appropriate HPCC Version #2448 Added plugins and corrected improper warnings on install. * #2522 Support NetworkAddress_Port as input and add a popup help For legacy workunit, allows a user to enter ip of slave. #2585 Issue defining topology with same name and prefix in any order. #2583 Get thor slave log on node getting wrong log getLogs not returning logs in legacy #2552 configmgr javascript exception #2577 multistop-issue need to sort before uniqing #2570 multislave stop issues #2575 More Housekeeping document changes regarding the document build issue gh-2548 EclWatch: Issues displaying incomplete results. #2573 Start slave-multispeedup #2565 Slow startup when slavesPerNode > 1 #2535 n-waymerge fix #2569 Rollback misreleased mergededup.ecl (from #2563) #2571 Fix problem stopping local slaves #2567 Add getWuidVersion method #2548 Housekeeping changes regarding the Document Build #2533 n-way merge fail #2476 Add methods for adding/retreiving logs to workunit #2508 superfile support #2559 Fix broken hpcc_setenv, due to Mac changes #2554 eclcc Fix a couple of memory leaks Fix unhandled javascript exception. Check to ensure variable has been assigned before using it. #2537 mac build error #2528 dyn lib support #2542 test Ct_package #2541 added ecllibrary to all packages built. #2517 Create_test_pkg #2526 multithreaded_doc_build #2531 LDAP server prompts foir DaFileSrv & FTSlave Fix build error on OSX in archive reader #2524 configmgr issues in IE #2459 Added target properties for includer files and images. Change paramter type to const char* based on review feedback. #2490 Add config to exclude ldapServer from comps_on_all_nodes configuration setting #2527 Added support for mac to hpcc_setenv #2459 Clean up of docMacros.cmake to correct -j build failures. #2508 Superfile support Fix DFUFile.getSubfilescount() issue. DFUFile.containsSubfiles() now uses getSubfile #2523 Add IE specific javascript to clear context menu. #2508 Add superfile support Create dfufile container class (HPCCLogicalFiles) * #2500 Create test package for jdbc driver #2648 from Mac Packaging #2643 standalone regression #2642 #2642 Standalone hthor programs fail to start #2593 Improve context menu UI #2634 Regression suite failing on library tests #2588 Single Document Builder Factory #2620 Improve Get Slave Log for Workunit #2588 Reuse thread safe DocumentBuilderFactory object. #2618 file page support Add pagesize property, defaults to 100 Don't fetch all files every time a single file's metadata is needed. Cache individual file's metadata Improve search #2617 Replace getDebugValue() with getLogs() #2540 changes based on code review. #2476 Cluster name cannot be hard coded #2616 start_slave-fix Soft link to thorslave causing problems #2586 parse optional modifiers #2603 JComp incorrectly quotes source file name #2595 Fix ESP cores when WU ID not found #1633 modified Installing_and_RunningTheHPCCPlatform.xml * #2709 Roxie dali connection #2701 MAC Packaging #2650 Connect timeout #2696 Cache the Collator between calls to unicode editdistance Better handling of invalid unicode status #2697 Split of Client Tools User's Guide into two variations. #2682 subs-remove-issue Ensure Dali subscription removed on exception #2692 Documentation pagination fixes #2666 Improve context_menu_ui #2676 MAC Client Tools eclcc default folders on OSX eclcc is unable to locate plugins and ECL Library when installed as part of Client Tools on OSX #2689 connect to dali timeout #2667 Roxie dali connection #2681 Ensure SDS client connection removed #2673 unicode wild match #2667 Roxie dali connection registerClientProcess escalating delay to connect Optimize prefix join on unicode fields #2593 Fix for center context menu not accepting clicks #2619 update wsecldirect default port Adds configurable connection timeoutval * #2728 ECLPlayground Override default target. #2738 EclPlayground docs add target drop list #2733 Ensure stdout is flushed for stand alone roxie #2714 dfs del #2726 Roxie standalone program delay #2712,Fixing unconditional deletion of super, avoid lock on add/del subfiles in DFU #2722 update to options of ECLCC in Client Tools manual #2702 roxie query cleanup #2717 Mac Package name wrong + rpath issue. #2719 Fix invalid assert assertex(required < choosenLimit) #2711 Ability to verify same queries are on all roxie nodes Remove potential double // in dllserver records
=========================================
Release Notes for 3.6.2
Known Limitations in 3.6.2
- Relogin from ECLWatch is currently not supported in Firefox.
- Due to changes in the authentication methods on ubuntu 10.10 and above, ulimit allowances from pam are not enabled by default. To allow the hpcc user to set limits correctly, this pam module must be enabled.It can be enabled on a default ubuntu install with the following steps:
- Sudo vi /etc/pam.d/common-session
- Append the following line to the file.session required pam_limits.so
- Thor queries may fail with port errors in local configurations.For configurations where the EclAgent process is configured to run on the same nodes as slaves and there are multiple slaves per box (slavesPerNode >1) you may, if unlucky, hit a port in use error when running queries. You can avoid this issue by ensuring EclAgent doesn’t run on the same node as slaves or by changing the thor slave base port, to a number that will keep it well away from any other component ports (for example, 20000).
- The code generator incorrectly tracks the sort order and distribution of a LOOP or GRAPH as matching the input dataset, rather than the intersection of the input dataset and the loop/graph body. This could potentially cause incorrect optimizations to be done on the output of a LOOP.
- If LDAP is turned on in Dali for File Scope security, you get an error when trying to view a data file using the View Data File feature in ECL Watch.
—————————————————
Comprehensive list of changes in 3.6.2
—————————————————
GH#2187 provides a workaround to a regression in Ubuntu’s killall command that prevented Thor from stopping correctly under Ubuntu 12.04 GH#1985 ChooseN issues in child queries GH#1942 Added temporary ulimit settings for dafilesrv. GH#1991 Use correct architecture dependent hadoop lib path based on Hadoop uris GH#1980 Support checking against tags for multiple editions GH#1978 Fix Build break httptransport GH#1972 Add useradd/groupadd to esp files GH#1911 ESP should not log password GH#1957 Ensure manifest object is valid before using GH#1930 sendEmail rejecting some valid server addresses GH#1933 fix useradd groupadd_html GH#1938 Fix useradd.html and groupadd.html Add useradd.html and groupadd.html to CE GH#1871 ldapsecurity link failure when USE_OPENLDAP=0 GH#1806 Thor and Dali created via Advanced view will not have optional attributes. GH#1916 Fix expansion of SELF.x used on the rhs of an assign GH#1902 Add test case to regression suite to cover lookupjoin leak GH#1910 Add support for Include statements in manifest files GH#1855 soap calls to wsecl not checking credentials GH#1900 Roxie memory leaks not always properly cleaned up GH#1719 Roxie regression suite assumes local server GH#1865 Roxie can core when query deployed GH#1822 Fix xref attach/remove files GH#1834 Remove validation before starting ConfigMgr GH#1646 Roxie groups only updated on new env. GH#1873 Fix ecl command line should default to not limiting results GH#1891 Implement LOG(MIN) and LOG(expr) for SOAPCALL GH#1890 Fold filenames to ensure they are consistent GH#1885 Remove more traces of (now unnecessary) hack in prefix join GH#1889 Disk aggregate and index aggregate could corrupt memory GH#1880 Fix resource permissions display on FireFox GH#1876 op78Lookup join stop race deadlock GH#1868 Grouped HashAggregate deserialization error GH#1875 Prefix join core - previous fix not correct Fix problem with constant folding inline tables GH#1913 ldapsecurity link failure when USE_OPENLDAP=0 GH#1914 Thor and Dali created via Advanced view will not have optional attributes. GH#1937 hiddenselector GH#1904 Roxie regression-suite GH#1906 Roxie databuffer-leak GH#1857 Fix 'Page Not Found' error when change password GH#1831 Recent change broke Dali start if clean GH#1646 Detect new environment cluster group changes GH#1851 Fix some build errors on Mac OSX from recent changes GH#1786 Added creation of PDF docs to CMake. GH#1686 missing WsWorkunit support for WUActionExecuteExisting GH#1728 Add ecl queries support for showing suspended given cluster GH#1595 Remove unused configuration option syncCluster GH#1646 Detect new environment cluster group changes GH#1825 LDAP / esp addition in community OSS code GH#1779 ecl command line does not support setting result limits GH#1774 Fix soap to WsEcl for calling roxie queries broken GH#1663 Display component name for thorslaves GH#1775 Splitter, child recs issue GH#2001 docs-Update Permissions section and added image GH#1956 eclwatch link to component configuration file fails GH#1983 Group delete fix GH#1993 Ecl Watch Crash when searching WUs by Ecl text GH#1867 Roxie reload core GH#1805 Child query reading XML dataset failure GH#1579 Add sections for ecl package commands GH#1769 Added stagever to the release version in the RPM. GH#1731 Set Thor slaves attribute to number of slaves times slaves per node GH#1718 Changed from awk with delim _ to bash expansions to allow for component names with _ in them GH#1695 remove prependeing roxie cluster to logical files GH#1683 assertex(diff >= 0) failing in global smart steppingAdd soapcall logging tests to regression suite GH#1596 configmgr - popup for password verify doesn't have focusAllow dataset as well as LEFT inside the LOG() expr Added some comments to clarify getRHS GH#1869 Multislave setups were ignoring nodeGroup Roxie core in self-join with prefix match optimization GH#1850 branching-strategy GH#1786 Move package code to community release GH#1830 Select cluster order on Activity page GH#1826 syncCluster Keep environment persist to disk if external Fix checkEclVersionCompatible checks subminor against wrong value GH#1784 Guard against no spares on manual swap GH#1804 PackageCommandsinECL GH#1375 Add a comment to clarify the code GH#1375 Access graph results directly if available GH#1843 execute_existing GH#1807 ecl_queries_cluster GH#1839 version_compatible GH#1756 Remove ThorCluster prop @slaves GH#1787 wsecl_roxiexml GH#1789 limit2 GH#1772 add_stagever GH#1763 Fix ecl command line not showing server side compilation errors GH#1741 Add getCount(xpath) utility method to IPT GH#1736 Increase the ecl language version to 3.6.0 GH#1725 Remove default memory setting values from thor.xsd GH#1716 Change memory size defaults + allow configurable GH#1700 When generating form for STORED SETS use textarea GH#1412 fix some more swapnode related problems GH#1592 Constant fold assert(condition or true) GH#1573 slave PID file is compenentname_slave_slavenum GH#1573 Remove Thor slaves and spares from configgen output GH#1580 Add -listdropzones option to configgen GH#1607 Fix problem with COUNTER not tracked inside [] GH#1562 Fix preflight display for thor under Target Cluster GH#1577 Compound filter group diskread could lose records GH1555 thorloopresult GH#1566 Fix potential aggregate child query issue GH#1547 Ensures slaves file exists - backupnode/stop thor GH#1697 no prepend clustername GH#1689 roxie-gss-assert GH#1642 Fix Preflight not work for Multinode thor slaves GH#1660 show compiling GH#1658 pw verify focus Fix activity page not showing contents of eclccserver queue GH#1637 Results with nested records not deserialized GH#1621 assertfold GH#1522 copy_queries GH#1918 Fix dali backupComputer issue GH#2019 Thor status link broken due to missing xslt` GH#2011 Datastream should be build and packaged independent from the platform GH#2010 Join overflow partition crash` GH#2004 Remove debug code from index.xslt GH#1995 Encrypt attributes of view type password GH#2103 Prevent crash if cache destroyed before files. Roxie caching local files too long GH #2101 Roxie assert error on partially suspended queries GH#2100 Roxie file cache was not checking timestamps GH#2099 Roxie generated filenames for index parts were incorrect GH#2072 filesbasedn not being set in esp.xml GH#2080 Thor tmpfile threading GH#2024 Thor could core in CGraphTempHandler::registerFile GH#1154 Changed formatting used for version tag in config time generated files. GH#2043 Added section about backing up data including use of backupnode to Data Handling manual added user security section info to installing and running doc added ldap config info to installing and running doc GH#2024 Move thor base ports, to avoid clash GH#2027 Meta informaiton for a loop/graph was wrong GH#1918 Fix dali backupComputer issue GH#2135 Enable the Roxie package file processing ESP service
=========================================
Release Notes for 3.6.0
Known Limitations in 3.6.0
- If a Thor cluster is re-configured in an environment and deployed to the cluster, the HPCC cluster will not use the new Thor topology if it mismatches the previous layout. Instead it will issue warning(s) within the Dali logs. Similarly, if the new environment, with mismatched Thor cluster layouts are pushed to Dali using the ‘updtdalienv’ cmd tool, it will issue warnings if there are mismatches. This is primarily to prevent any swapnode that have occurred in the interim from being lost.In order to force an update to reflect the new deployed environment, it is necessary to use:updtdalienv -fThe ‘-f’ will force the Thor cluster layouts in the environment to take precedence over the existing environments in Dali.
Alternatively, to force an update of an individual ThorCluster (if there are many), the ‘swapnode’ cmd line can be use,. For Example:
swapnode reset
- If you have any 6.6.0.x version of the ECL IDE installed, it might require you to first uninstall that version before installing this version of the ECL IDE.
- If you have an existing configuration in your ECL IDE and upgrade the server it is pointing to, you must change the compiler entry to use the ver_3_6 folder.For example: C:Program Files (x86)HPCC SystemsHPCCbinver_3_6eclcc.exe
- If you want to point a configuration in the ECL IDE server running 3.4.2 or older, make sure the compiler setting in preferences is using the ver_3_0 folder.For example: C:Program Files (x86)HPCC SystemsHPCCbinver_3_0eclcc.exeNote: The ver_3_0 or ver_3_6 corresponds to the language version not the release version. This can be found using the command: eclcc –version
- If you attempt to open an XML file in Configuration Manager and the file does not have hpcc ownership, the Configuration Manager could crash.
———————————————-
Comprehensive list of changes in 3.6.0
———————————————-
gh-1503 Remove typo gh-1492 Change the way Thor fetches its group gh-1426 preserve -Wl, for gcc and add options after object gh-1491 roxie-queries-gh1460 gh-1460 Roxie should indicate suspended in control:queries gh-1468 viewunicode Fix bug in viewing unicode indexes gh-1478 hashagg-localfix gh-1476 Fix regression in hashagg,local gh-1185 Backupnode log redirection gh-1430 SOAP Namespace missing trailing '/' gh-1458 dfuserver Add isReplicated() method update CMakeLists.txt to create link to exectuable on path gh-622 set defaultCopies and ensureReplicate gh-1431 Keep object file for eclcc -c gh-1428 ws_wu_release_IWUQuery gh-1443 linkoption gh-1346 ecl command to list queries gh-1441 Rename ConfigMgr esp instance name to create the logfiles in the appropriate directory Fix deadlock in WsWorkunits gh-1435 backupnode gh-1426 Implement -Wl, and related changes gh-1440 subproject_install gh-1251 added abbility to run subproject install scripts. gh-1438 squeeze_support gh-1436 Added check for Debian 6.x and dependency list for squeze. gh-1185 start_backupnode not working gh-1424 Fix possible deadlock regression in splitter gh-1419 Remove deprecated sdsfix Protect against mismatched master and slave builds gh-1410 macrosubmit Fix problem submitting macros as queries gh-1402 Fix problem with missing toplevelkey indicator gh-1406 Report problems with invalid use of ROW(dataset) gh-1399 Fix regression from splitter-progress-fix gh-1358 Roxie memory leaks gh-1385 splitter-progress-fix gh-1337 control:lockDali command was not working gh-341 Remove ability to add plugins via ConfigMgr gh-1343 Add checkbox "No separator" to Spray csv input gh-1283 EclWatch Config button not display esp.xml gh-1373 csvcomp-sizebug
=========================================
Release Notes for 3.4.2
Known Limitations in 3.4.2
- gh-622 Replication of logical files can occasionally fail
- gh-1123 A race condition can cause Thor slaves to fail on first start
———————————————-
Comprehensive list of changes in 3.4.2
———————————————-
1335 deadlock fix - Fix deadlock stopping merge distribute 1161 Rollback flawed memory frag. Protection 1325 Fix crash in eclcc on invalid use of RIGHT 1302 Hashdistribute not handling grouped input 1296 Turn off parallel subgraph handling 1287 Fix issue handling ipv4 addresses with .0 1289 Prevent superfile from being added to itself 1282 gh-1277 Fixed problems of Event Scheduler and deschedule 1218 Add support for support nodes in ConfigMgr Wizard. 1281 Improve error message in ftslave for wrong IP 1196 Allow user to override settings for software components 1186 WsEcl not escaping some XML before calling XSLT 1099 Fix compile issue for old gcc 1099 Detect process affinity and limit threads 1159 Fix graph executor, needs to block if running 1233 Check Cluster Info 1198 Check return from getTargetClusterInfo to prevent core in workunit.dll 1232 Ecl WU Details crashed when cluster not found 1239 Fix regression in roxiemem when resizing rowsets 1184 Add support for support nodes in envgen. 1161 Linux build issues 1226 Superfile resolution from packages may cor 1161 detect low allocator memory 1215 prepare race buildfix 1204 Fix potential seh in eclminus 1207 Set initial size for allocator to min not max remove redundant if (fixedSize) check Set initial size for allocator to min not max Set initial size for allocator to min not max 1159 Fix graph prepare threading issue 1102 Fix problems with AGGREGATE,MERGE transform 1079 Allow descending sort orders for MERGE,SORTED 1111 Potential keyed join deadlock 1112 Compute aggregrate merge on slave 1 (not master) 1105 Spill reference count issue 1104 Hash Aggregrate failing in child query 1042 Thor delay traversing dependencies 282 Update to correct eclserver log name 1029 Roxie debugger stopped working 1022 Fix problems with merged scope becoming inconsistent 1016 Check that git tags match build tag Add option to use git describe to generate BUILD_TAG Use _spawnvp instead of _execvp on windows for ecl command line 981 oneiric 1009 Remove deprecated roxieconfig and references to it 1006 Remove eclServer attribute in eclWatch 998 Fix link errors when creating standalone executable 982 Add dependency file for oneiric build 928 Moved all remaining ${SERV} to /etc/init.d/ and removed sysvconfig as a dep for Debian Lenny. 928 Moved internal calls to dafilesrv init to /etc/init.d 957 IfNull regression 912 Always call getInterfaceIp to find the host IP 439 hpcc user should be a system account 936 Added psmisc to Lenny dependency list. 932 Fix bug casting utf8 constants to longer lengths 923 Fix problems with unknown modules if import unused 907 Page Not Found error when ShowQuery for a file 910 Fix problem with import all on legacy queries 459 improving recovery on bad input 877 Fix problem compiling files not in the include path 820 Exception when click XLS on Thor Usage 864 Update process names so EclWatch can display correct process status 848 Wizard should not generate eclagent for Roxie Cluster Topology 859 Fix issue with status page and shared thors 851 Thor graph execute race condition 843 Thor Usage Graph show NaN% 844 Preflight checking for wrong Roxie process name 817 Fix Graph not found error. 815 Show correct icon for publish dialog. 747 Remove inappropriate const Add appendQuoted fix Fix issues where a thor is in >1 target cluster Fix some issues in activity/usage page 492 Added script to generate a clean deb file. 835 Bad path set to installed rpath for binaries. 836 Fix invalid pointer access in generated code 834 Add time information when running a single test 831 g++ script needs to be executable 830 ECL Command line enhancements 392 WsEcl display of exceptions from query 818 RemoveGroupAdd 186 Remove extra file: groupadd.html 821 Preflight calls old code for EE 824 Add string conversion functions to date module 807 Removing ESP User 153 preflight command should not specify EspUser
=========================================
Release Notes for 3.4
This release, version 3.4.0, has many new features, a number of bug fixes, and some new tools. In addition, two additional operating systems are now supported.
—————————
Significant Features
—————————
- Support for additional Linux distros — Ubuntu 11.10 (Oneiric Ocelot) and Debian 5 (lenny)
- Better EE compatibility.
- Roxie queue support.
- New ecl command line tool. This is installed with your ECL IDE. Instructions can be found in the Client Tools manual.
- Thor bug fixes. (see list below)
- std.date – date support in the standard library. See the date.ecl file in the ecllibrary folder installed with the ECL IDE
- Custom output visualization capabilities. See the Visualizing ECL Results PDF for instructions. The PDF file contains a link to download examples.
Known Limitations in 3.4
- Internet Explorer 9 may ask you to login more than once.
- When upgrading from 3.2 to 3.4, it is important to ensure that the eclagent is not attached to the roxie section in the Topology.
————————————
Comprehensive list of changes
————————————
936 Added psmisc to Debian lenny dependency list. 932 Fix casting utf8 constants to longer lengths 923 Fix problems with unknown modules if import unused 907 Page Not Found error when ShowQuery for a file 910 Fix problem with import all on legacy queries 459 improving recovery on bad input 877 Fix problem compiling files not in the include path 820 Exception when click XLS on Thor Usage 220 Update process names so EclWatch can display correct process status 848 Wizard should not generate eclagent for Roxie Cluster Topology 859 Fix issue with status page and shared thors 851 Thor graph execute rate condition 843 Thor Usage Graph show NaN% 844 Preflight checking for wrong Roxie process name 817 Graph not found error. 747 Remove inappropriate const Add back appendQuoted fix 492 Fix issues where a thor is in >1 target cluster 835 Bad path set to installed rpath for binaries. 836 Fix invalid pointer access in generated code 492 Added script to generate a clean deb file. Fix some issues in activity/usage page 834 Add time information when running a single test 831 g++ script needs to be executable 830 ECL Command line enhancements 815 Show correct icon for publish dialog. 826 wsecl_display_exceptions 392 WsEcl display of exceptions from query 818 RemoveGroupAdd 824 libdate2 Add string conversion functions to date module 821 Preflight calls old LN code for EE 186 Remove extra file:groupadd.html 807 RemovingESPUser 153 LN preflight command should not specify EspUser 492 Moved to relative pathing for install. 809 Added sysvconfig to Lenny dep list. 781 ref. correct targets/queues on activity page 808 wsecl_query_state WsEcl to support showing Aliases or Queries and will respect supspended query state. 172 Enable addition of EclServer to Topology 803 User-Agent not set if no LDAP enabled 781 ref. correct targets/queues on activity page 799 main 800 g++ installed to wrong place 705 Slow compiles of generated stubs 795 Unused ESP client wrapper libs 795 Remove extra file: useradd.html 794 wucreate_owner 725 workunit owner not being set 457 Improve WU Publish successfail error reporting. 159 Load eclServer if component type is eclServerType 499 Changed error message when host cannot be Pinged. 205 Updated maintainer line to have correct format. 239 Updated install output asking user to run keygen with sudo. 779 Moved redirection of stdout to start_slave instead of in the frunssh call. 763 lcrflag 783 Fix broken backupnode 777 remove Replicate option for hthor spray 771 nwayselectbug 774 slowsashastop 775 a helper method to get HThor group names 683 Reduce length verify timeout 108 Remove EE specific components from cgencomplist files 772 NWaySelect late initialization causing crash 108 Move buildsetEE.xml.in to EE source line Adds support for -main to remote compiling 764 install-ecl 762 ecl command not on path 745 superfile Switches over to using Legacy to differentiate thor Add back compatibility check to super files 760 pipeflat 759 legacyoption 761 Release example files for previous issues Remove legacy LCR option 704 Allow FLAT (and THOR) on PIPE 205 Added chmod command to generate_bash macro. 755 Add missing optimization for set of dataset[const] 752 init_eclserver 754 thorqueuelogging 717 Incorrect queuename in tracing + status Remove unwanted file init_eclserver 750 fix typo, add expect, libldap deps 443 Lost the permissions settiongs on the default ssh key 443 Correcting typo's and two missing xslt files. 742 dfuprogress Improve ftslave logging (for very large transfers) 741 regresssuite Update test to match new data comparison rules. 711 ws_workunts causing esp cores 443 More regressions from cmake refactoring 443 Typo in one of the refactored files 715 libdate Use directory wildcards for cases where we want to deploy subtrees 728 bug84019 730 ecl_credentials 731 jobname Some WUUpdate values not being set ecl command line user credential support ECL command line support for external commands 84019 When using wizard, assign esp to the the first ip 722 hthor file resolution issues 205 Refactoring of CMake install system Should indicate a 'diabled in this version' feature 714 roxie-package-value Package file format inconsistencies 713 issue610 712 from Switch special eclcc debug flags to use - not colon Fix set of string problems and move code to plugin 707 ee-rpms More issues when building as subproject 706 ee-rpms Incorrect paths for generated files when included as a subproject 703 New ECL Command Line tool 701 Fix a regression compiling a non archive from stdin 700 Package file resolution issues 699 roxie-package2 Package id resolution should be case insensitive 698 Optimize DEDUP(ds, LEFT.x = RIGHT.x) in thor 697 roxie-dali Deleted a char by accident 652 Roxie dali caching 678 loopissues 691 Include options from dfu superfile copy to contents 690 Fix problems with AGGREGATE on complex datasets 694 FIX Roxie not getting queryset name properly from Dali packagemap definition 695 Spill file fails creation 692 Fix if condition for New and New Range to act on "Computer" type only. 689 Add support for Ubuntu 11.10 (oneiric) 581 Enable Roxie queues in ConfigMgr and Wizard 687 Build error using gcc 4.6 684 Fix problem creating an archive from an archive 685 thorlib.group() gives internal error in eclagent 642 ensure correct file is compiled Loop/Graph issues 675 Thor LOOP could deadlock on exception 677 Protect LOOP maxIterations from going negative 676 GRAPH/LOOP counter invalid via helper call 672 aggregate 671 More info certification process Fix access to context information from SUM/MAX Add explanation to external, foreign, multi, query 670 colocal 669 Prevent compiler log files from clashing with eclcc Fix locality of activities within nested thor loops 666 Roxie locks up when trying to overwrite a file Fix problems with merged scope becoming inconsistent Remove eclServer attribute in eclWatch Fix link errors when creating standalone executable Use _spawnvp instead of _execvp on windows for ecl command line Add dependency file for oneiric build 928 Moved all remaining ${SERV} to /etc/init.d/ and removed sysvconfig as a dep for lenny. 928 Moved internal calls to dafilesrv init to /etc/init.d IfNull regression 439 hpcc user should be a system account 936 Added psmisc to lenny dependency list.
=========================================
Known Limitations in 3.2.2.1
- #651 It is possible that Thor will not start the first time on a clean system. If you stop and start again, this will not occur.
- #219 Not reporting errors due to locked files
- #205 Ubuntu 11 desktop reports ‘low quality package’ if you use the software manager to install the packages.
- #663 In ECL Watch, the Buildset column is not displayed on the Systems Server page.
Release Notes – Changes from 3.2.0.2 to 3.2.2.1
- #331 Updated naming convention to Debian policy.
- #558 Full keyed join failure
- #563 Local result buffers too small
- #544 Pause and Pause Now button not shown
- #255 Fix count spill issue
- #509 Prototype for out of line functions
- #516 Import clashes with filename
- #524 WHEN fails if used in child graph
- #363 Invalid assignment for parentContextSz
- #267 Stand alone temp files in wrong location #500 Add GNU AFFERO GENERAL PUBLIC LICENSE text
- #494 Piperead was prevented from running in child graph
- #489 Fix race condition in smart buffering
- #488 Disk smart lookahead not dealing with large records
- #366 Leading ‘.’ in filename should not cause ESP to crash
- #476 Fixes SEH with very large data values
- #423 Allow ConfigMgr to open read-only files without crashing
- #452 Cannot do multiple selection with shift button
- #449 Potential for splitter deadlock or crash
- #415 Problems for adding files to existing superfile
- #432 Restores support for some legacy file extensions
- #87 Added creation of Full Name with useradd and usermod.
- #88 Changed sudoers prefix to HPCC from OSS.
- #419 Full keyedjoins could lose pending matched groups
- #401 More fix for truncating large file when uploading file
- #402 Lost exceptions from master activities
- #377 Reports the correct line number at eof
- #357 Roxie not using the CSV separator info from Dali
- #398 Avoid truncating large file when uploading file #270 Add -g option to g++ compile step on debug build
- #345 Check user input in Local Path using dropzone path
- #631 Fixed Ordered Hash Aggregate in 64-bit (Memcpy copied size32_t instead of pointer)
=========================================
Known Limitations in Community Edition 3.2.0.2 * If you modify a DFU workunit in ECL Watch, the spray will not work. It will prompt for a file location even though it’s already there. A new Spray task will work fine.. * Issue # 219 Not reporting errors due to locked files * Issue #205 Ubuntu 11 desktop reports 'low quality package' if you use the software manager to install the packages. * In ECL Watch, the Buildset column is cut off * In ECL Watch, the Upload/download feature truncates files if you attempt to upload a second file before the first one completes, *************************************** Known Limitations in VM Edition 3.2.0.2 * If you modify a DFU workunit in ECL Watch, the spray will not work. It will prompt for a file location even though it’s already there. A new Spray task will work fine.. * Issue # 219 Not reporting errors due to locked files * In ECL Watch, the Buildset column is cut off * In ECL Watch, the Upload/download feature truncates files if you attempt to upload a second file before the first one completes,
*************************************** Release Notes 3.2.0.2 * Implement Context Sensitive Help for ECL Language and Standard libraries in the ECL IDE * Fix g++ compiler warnings in Roxie subdirectory; Fix some warnings from g++ Return a string buffer, and notify user on error condition Rename getCurrentDirectory() to appendCurrentDirectory() to make the semantics clear Build warnings * Sequence was not included in the package file names in release mode * Version numbers displayed from environment.xml are usually out of date * New push/run scripts added. This is a rollup of all commits for the branch script_updates. Removing old script files. Added new scritps for pushing files and running commands. Setting perms on /etc/HPCCSystems to be owned by hpcc. Adding in script files to install. Updating install to make sure perms are right and fixing copyright utf8 logo. * Fixed issue presented by link dereferencing if /etc/HPCCSystems is a symlink. * Changing if syntax that has issues on shell and older versions of bash. * Removed force of changing permissions as it is not needed and breaks sub dirs in the directory. Removed invalid lines from the buildCmd function * DALI - improve --help handling * JLIB - fix thread unsafeness in dumping namecount table (not enabled by default anyway) * VerifyUser method is needed by ECL IDE * Problem with UNICODE inputs for DOXIE * Excessive logging from doWUQueryForArchivedWUs * Make Pause/PauseNow buttons conditionally appear for ThorLCR * Make xmllib compile on newer versions of xerces Old function marked as deprecated in xerces documentation. * Eclagent log showing 2 WU's Filter out extra log lines using both sequence number and WUID * Restructure some of the regression batch files * New workunits not being picked after lock out The submitWorkUnit() will not work without releasing the lock. * All slaves subscribing to all channels (check localSlave) * JLIB - avoid some ptree leaks if exceptions, e.g. parsing xpaths * Adding a simple cluster install script that uses expect to * THOR - fix multislave+ssh setup (remove rogue parameter from frunssh call) * codegen: Fix problem not tracking dependencies of a variable filename * exclude partitions * Report an error on non-local use of COMBINE in thor * Add missing files from the compiler regression suite * exclude partitions * Add function to set the position inside ECLWatch menu tree Code functions commoned up * Move the code for Browsing Resource from ws_roxiequeryservice to ws_smc * ESP should be able to redefine an existing menu link Also clean several lines using setProp(). * Report an error on non-local use of COMBINE in thor * Add missing files from the compiler regression suite * Run spawned program locally on windows (temporary fix) * Preserve file part TLK * Remove legacy code from the grammar * Remove some experimental features from the ecl grammar which are no longer supported. It also rounds out the implementation of inline function definitions (which are primarily used by the FUNCTIONMACRO command). For detailed documentation see the bug report. It corrects the encoding of a couple of example files, adds a couple of test cases, and fixes a problem with the make file when no warnings are generated. * Resolve definitions with no scope in an archive When searching for a definition "x" in the root of an archive the code should have been looking for an Attribute tag inside a Module tag (with a blank name). Instead it was incorrectly searching for a global Attribute tag (not inside any tag). This meant that the text for queries that came from definitions in the root of the source tree didn't get displayed in esp. I think the format changed in the past and this function wasn't updated to reflect the correct structure. * Updating Deps system used for building packages. Updating CMake to load os specific dependencies from an external file. Added suse11.4 dep files along with update to disable make package if dep file does not exist. Added a template deps file that is used if the os does not have a deps file. Fixing spacing. Moved to using a --noarch flag to getpackagerevisionarch.sh in order to have one dep file per distribution. Updating template file to remove usage of _ * Changed method of output redirect in remote install. remote-install-engine.sh used an incorrect output redirection that at times would cause an error display on run that was of no bearing to the action. Moved output redirect from 2>&1 1>/dev/null to 1>/dev/null 2>&1 * Fix a mistake for the 'sort' attribute of menu folder tree There is a mistake in previous changes . Before those changes, the 'sort' attribute of a menu folder tree was set only when requested. One of my changes forced the 'sort' attribute to be true, which is incorrect. Now, the old code is switched back. * Fix autoCopyBackup=false issue If autoCopyBackup is disabled, Thor does not pick up replicate (unless it's local e.g. via mount) * Updating password setting procedure for hpcc user. * Added a passwd command to the add_user funciton in hpcc_common. passwd -d ${USER} Fixing indent issue. * Fixed arg parsing for hpcc-run.sh Corrected an issue with the arg parsing loop to allow for only one argument to be passed to the command along with verifying that the argument is one of the allowed commands. * Changed dependency list to not include -dev Updated ubuntu dependency lists to no longer use: libboost-regex-dev libicu-dev libldap2-dev * method to allow clients to change Dali throttle limits Default is 10 concurrent requests, and throttling by 1000ms. Which means that if there are >10 active requests from a client to Dali, it will delay up to max 1s (if one becomes free it will delay less) Some clients may want to raise this level if expected to have more concurrent activities. Esp is an example, where under some configurations, blocking if >10 actives sessions may be undesirable. * Replace the call to listSubFiles for performance The existing code calls listSubFiles to get data about subfiles. The listSubFiles does an extra lookup which slows down the system. The new code will reuse the existing IDistributeFile instance to get names of subfiles. * Improve dataset too large error message Add result name or sequence number to message * Changed configmgr to run as hpcc Updated the call to start-stop-daemon to have configmgr run as hpcc instead of root allowing all files created under /etc/HPCCSystems/source to be owned by hpcc. * Fixed issue where IFS was being set and not reverted. The bash internal file separator was not being unset/reset correctly. This caused issues with hpcc-run.sh when using a regex replace to remove the dali ipaddress from the list of cluster ip addresses. * Replace the call to listSubFiles for performance * Fixed issue where IFS was being set and not reverted. * Updated hpcc-run to allow for correct run order. Previously hpcc-run was starting and stopping all component in order based on the ip's in the environment.xml as returned by configgen and parsed by sort | uniq. added code to locate which node has Dali along with remove the ip from the list of ip's and then run the commands in the correct order. Start - dali node > other nodes Stop - other nodes > dali node also added code to change how restart works. Previously restart would run on each node in ascending order. I have changed this to run a for loop setting cmd to stop and then start when a restart command is given. * Fixing tabs. * Fixed issue where commands were only working on reboot. Updated setting of IP for dali operations. * Set and show Compiled state for WUActionCompile WU * Existing code sets and displays a Completed state for a workunit even if a user wants to just do compile using Compile buttons in ECL IDE. The user may not be able to distinguish between the WU's they have submitted and those they have only compiled. eclccserver code sets the Compiled state if the action is WUActionCompile. ECLWatch dispays the state in WU Details page. To avoid people thinking it is 'stuck' in compiled state, I add an Action field on the top of the state field. The Action is read from WU xml. For this situation, the Action shows Compile. * Fix eclagent hang on locked index file IndexWriteActivity incorrectly calls resolveLFN, which locks the file, then calls expandLogicalFilename before attempting to delete. This fix removes the incorrect call and replaces with expandLogicalFilename, allowing the file to be deleted. * build break in dasds.cpp * Compiler warnings from modern g++ Fix a number of compiler warnings related to use of ... with format strings that don't (or might not) match the supplied parameters. Most were most likely harmless but a couple looked like they would cause unintended results. g++ does not like use of printf etc with a variable for the format string parameter (because it will behave unpredicatably if the string passed to it contains a %). I don't like using appendf with a single constant string parameter (because it's inefficient). * Get rid of the SVN $HeadURL keyword expansions Remove all $HeadURL entries in the code. Use BUILD_TAG in place of any $HeadURL: output to logs. Update include paths and include build-info.h as needed. Clean up some unnecessary blank lines. * Ordered IPT impl.+cleanup createPTree* Add an optional ordered IPropertyTree implementation. Rationalize the various createPTree* methods. * Added which_pidof function and usage. Added which_pidof function to hpcc_common along with its usage where ever pidof was called. Updated which_service to follow the same format as which_pidof using the command on the users path before using a direct path. * added call to basename in the expect call to install. added basename usage to remove directory information from the function that generates the expect call to install the package via remote-install-engine.sh. * Fix message misspellings in eclagent Fix misspelled words and incorrect method names in log messages and exception strings. * Improve dataset too large error message * set perms correctly on configmgr directories Directories were being created with ownership of root. This was causing configmgr to fail to start as configmgr is running as the user hpcc. Added chown for config file and source directory. * Fix issue with dfu jobs left running If an exception occured within runWU within dfu server, it would leave the dfu workunit tracked as running (within /Status/Server in Dali). Consequently queuedJobs as used by EclWatch would still think the jobs were running and list them as such on the Activity page * Speed up regex and add algorithm option Reenables some old code in 64bit that was previously disabled because it used too much stack in 32bit. It also allows a HINT to be specified on a PARSE to allow the stack or heap implementation to be selected. Add HINT(ALGORITHM('stack')) to select the recursive stack based version Add HINT(ALGORITHM('heap')) to select the heap based version. * Clean up example files, remove spaces Remove trailing spaces from examples that shouldn't have been there. * Clean up the public regression suite Removes some internal paths from the regression suite batch file, makes the comparison program configurable, and moves all settings to one file * Check for invalid strings Check for null and empty strings before attempting a string comparision. Tested and found that Roxie starts normally and empty RoxieServerProcess nodes are not being generated. Roxie rename fails due to null string comparision * set perms correctly on configmgr directories * Get rid of the SVN $HeadURL keyword expansions Remove the declaration of the CBuildVersion class from the header file. The previous fix for this issue inadvertently left this behind. Any code that still referenced it would have given link errors. Fix missing include in sourcedoc.xml Delete the reference to the (deleted) directory roxie/roxieconfig Fix missing include in sourcedoc.xml * Improve ecl/regress documentation Update sourcedoc.xml so it uses the docbook format for lists and examples. * Corrected permissions on config directory for HPCC. Permissions for a group member to access a folder owned by another user that has group rights must be 775 in order to write new files to the directory. The default permissions set when creating a directory are 755 which allows group members to read and execute items in the directory, but not create new files. * Fix eclagent hang on locked index file Taking the fix since I'm sure it improves the situation. We should do the work on cleaning up the filename processing sooner rather than later. * Fix loopback problems with ftslave Changes the consistency check from isHost to isLocal to allow an ftslave instance to be started on a loopback ip as well as the real network ip * Force install-cluster.sh to deploy new keys. When the newkey option was given to install-cluster.sh it was failing to install the newkey to the head node because of the default keys allowing valid ssh. Checking that a newkey is wanted and then forcing the keys to install on all nodes was required. * Environment.conf added to remote install payload and install. environment.conf should be deployed to all nodes in a cluster when install-cluster.sh is run because of the nature of the file having a chance to have changes needed for a users cluster. * Fix linux compile problem template confusion, call to kill needed qualifier to own template * Enable index activities in stand alone Enable stand alone index activities to access index files by generating a well formed local filename, and by enabling dautils to return a file descriptor. * Enable index activities in stand alone * Correct some spelling mistakes and typos Ran sources through spell checker and corrected various spelling mistakes and typos. Not exhaustive, didn't look at all dirs. * Remove spurious space in middle of code * install-cluster.sh fails if run from home directory If run from the home directory of the admin user that you name, install-cluster.sh would copy the tgz file it created over itself, install it, then delete it. It will then fail to install on the other nodes. Change the location where the tgz file is created to /tmp/ to avoid this Also delete the tgz file when done. * Fix csvSeparator typo A sprayed CSV file that published a @csvSeparator attribute was not being picked up by Thor due to a typo * Fix badly formatted pipewrite exception An exception generated by pipewrite if the process returned an error code, had a rogue extra parameter, which was likely to cause it to crash in printf formatting * minor tidy of inconsistent exceptions * Fix badly formatted pipewrite exception * Use g++ -Wformat option to detect errors Adds __attribute__(format) on some printf-like functions to allow g++ to detect format errors. Fixes a number of format errors that were detected as a result. There are other functions outside jlib that should get similar treatment Additional fixes based on feedback from review. Also removed the -Werror for now as there are some retrun value chacks yet to be resolved. * Visual Studio 2010 build issues Avoid issues in VS2010 where a custom build step uses a batch file. The bison and flex build commands we use may be implemented as batch files that set up environment variables to enable bison to locate any files it needs before passing parameters on to the executable. In such cases the custom build steps generated for VS2010 by CMake need to use CALL to call the nested batch file otherwise only the first custom build step of any project will be executed. Also, some errors in the dependencies for generated files caused VS2010 to attempt to rebuild the same file several times in parallel. This could lead to internal errors in hidl or unnecessary rebuilds. These are fixed in this patch. * Improve dataset too large error message * Add dataset sequence/name to error message to help analyze * More fixes to -Wformat errors Introduce more checkes on vararg type functions in thor Clearup all 'warning: format not a string literal and no format arguments' Adds __attribute((format)) where appropriate to Roxie functions to allow g++ to detect incorrect usage of printf-style parameters. * Preserve file part TLK The change made in commit 23ba18b will cause dfuserver to core when spraying from a non-distributed file, as the distributedSource will be NULL. This patch adds a test for that case. * Set YUI loader base to local path Set YUI loader base to local path to avoid loading files from the default base of http://yui.yahooapis.com. Also, load "MIN" version of files rather than the "raw" version. Clean up svn references in cmake files Unneeded references to svn removed from the hpcc project. * Check for NULL object Issue occurs when trying to build a new environment via the Wizard. The code causing the problem was added as part of the "envgen" tool that lets users generate an environment via the command line. The envgen tool lets the user specify override directories via a command line option. Since the same code is used to generate the environment both via the Wizard and the envgen tool and the override directories object is NULL in the case of the Wizard, ConfigMgr crashes when trying to generate an environment via the Wizard. Hence, added fix to check for NULL object before accessing the override directories. * Add more debugging/postmortem information to ESP log Existing ESP log contains a log line to trace ESP processing time for each HTTP request. The code is modified to add more information into the log line if there is an exception or the request takes a long time to process. The information includes user (if available), IP, and HTTP/SOAP request. * Thor script error, causing restart fail A missing space in a bash expression causing run_thor to fail when thormaster exited. As a result Thor would not auto restart * Unable to start thor on multinode system Some late fixes from 3.0.4 were lost from 3.1 These fixes are not perfect because the IFS is being modified and not restored - other code is relying on this fact. However while we argue about the correct fix we should get 3.1 in sync with 3.0.4 * Unrecognized interface resolved as 0.0.0.0 If the interface named in environment.conf does not exist, the code was supposed to fall into using hostname when resolving the '.' net address. However due to a flaw in the logic it will actually use 0.0.0.0, and various components will fail to start as a result. This patch splits the 'test' and 'retrieve' functionality into separate functions to make them easier to follow, and adds the ability to use a wildcard in the interface specification. When searching for an interface ip, loopback interfaces are always searched AFTER non-loopback ones. With this fix in place, the most appropriate value for interface= in environment.conf is * * Add more printf style format checking * Fix copyrights in *.ecl Copyrights should use (c) rather than unicode. Fix copyrights on some CMakeLists.txt files Some CMakeLists.txt files had been checked in with an abbreviated copyright message. * Added support for building on Debian Lenny Adds the required dependency list to build a package on Debian Lenny. Fixes the distrocheck to handle Debian Lenny (and others) better, and be more consistent with the distro checking code in getpackagerevisionarch.sh * Update the broken stylesheet for SOAP Test page Three fixes: (1) pass http request headers using hidden field when the 'showhttp' flag is set to false; (2) not use the response header if the 'showhttp' = false; (3) clear the user/password code since the authentication will be passed by web browser when needed. * IDFUWorkUnit::submit() to standalone functions. Move IDFUWorkUnit::submit() to a standalone function named "submitDFUWorknit()". Modeled after the submitWorkunit() function for ECL workunits it will release the IDFUWorkunit interface before putting the workunit on a queue. This should help prevent race conditions related to having locked workunits on a queue. * Update the broken stylesheet for SOAP Test page * Add checkboxes to the Select Computers Dialog Add checkboxes to make selection of computers via the "Select Computers" dialog box in ConfigMgr more user friendly. User can still double click a single row to mimic row selection and pressing the ok button. To check the select box for a bunch of rows, user can select some rows and use context menu to select or unselect those rows. Also, rename "Add Computers" to "Add Hardware" and rename the table varibles to be consistent with their usage. * Remove duplicate message definitions Remove some code which had been moved from hqlcerrors to hqlerrors * Clean code for WsSMC, WSTopology, ws_machine (1) remove code lines which have been commented out; (2) remove most of debug lines; (3) modify debug log lines which should only be used at high log levels; (4) modify debug log lines which should have 'WARNING' in the front of the log lines. * Set Thor/@localThor correctly Set Thor/@localThor to true if all thor slaves are on the same node as the thor master, otherwise set it to false. Check the nodes based on the ip address of the nodes rather than name of the node to handle manual editing. * complete-uninstall.sh is redhat only The utility script sbin/complete-uninstall.sh had a few issues: - assumed a rpm-based system - incorrect copyright message - assumed (non-standard) location of hpcc home directory - was not shipped Change the script to handle uninstalls of .deb files too, and use option on userdel to handle home directory removal more cleanly. Add the file back to the install set. * Some files have bad copyright messages Many files in the initfiles directory had temporary copyright messages appropriate only until the code was released. Some files intended as the defaults for user-edited configuration files should not have any copyright. This patch replaces them with the proper copyright blocks. * Stack buffer overrun in holeIntFormat Example: Add example of row transfer to eclcc tests Fix a number of problems in holeIntFormat - a width parameter > 500 would overwrite stack - maxlen parameter not being used - using a variable format string so could not be checked - space filling code would have no effect * Renumber errors that have been moved, and cleanup Renumber some errors that have been moved from hqlcerrors to hqlerrors so they use the range for that dll, and clean up a couple of other instances. * More issues detected by format check option Fix some more issues detected by the format check option, this time ones that were inside #ifdef _DEBUG and so missed last time around. Example: Add example of row transfer to eclcc tests * Strip symbols from executables in packages Add the option CPACK_STRIP_FILES to our CMake script so that symbols are stripped from the rpm/deb packages. This reduced the size of the deb package from 66Mb to 23Mb. Leave the symbols in if not building a Release package. * Complete-uninstall.sh is redhat only * Remove duplicate message definitions Roxie not processing continuation data properly When reading from disk rather than in-memory (preload), data from flat or CSV files from fileparts other than the first may appear truncated if there is more data to be returned from slaves than can be returned in a single chunk. There was some confusion about what BufferedDirectReader::tell() should return - it was returning a file position in the entire underlying file, where the corresponding 'seek' to continue reading was assuming the position was relative to those parts of the file managed by this node. With this patch, tell() refers to the position in the stream rather than in the complete logical file, which is consistent with how the code in ccdactivities expects it to behave. Roxie not processing continuation data properly * Added the creation of sentinel files to dali and sasha. daserver and saserver were not creating senteniels for automatic restart. Instead, the sentinel files were being created in the init_dali and init_sasha scripts. Cleaned up extra spaces in init_dali script. Move createSentinelTarget to using getenv for SENTINEL in order to create the sentinel IFile object. This allows the component init_ scripts to export SENTINEL and control the name of their sentinel file. Added removeSentinelFile function to be able to handle removal of sentinel files that exist. Added usage of createSentinelTarget to the following components. - agentexec - dafilesrv - daserver - dfuserver - eclccserver - eclscheduler - esp - roxie - saserver - thormaster Added removeSentinelFile usage to: - agentexec - dafilesrv - daserver - dfuserver - eclccserver - eclscheduler - esp - roxie - saserver - thormaster Updated init_roxie to no longer pass the sentinel file on the command line. Removed unneeded log line when creating sentinel file. Added missing removal of sentinel file at the start of esp. Updated createSentinelFile to have better logging along with exception catching/throw when file cannot be create/written. Updated all component init scripts to look for comp.sentinel instead of comp_sentinel.txt. Updated init system to look for files with "*sentinel" in their name for the sentinel file. Updated missed _sentinel.txt lines in init_esp, init_roxie, init_sasha, and stop_thor. Remove old and unneeded init files. Cleaned up old style start/stop scripts to use new sentinel scheme and evironment variable. Added handling of NULL sentinelFile to removeSentinelFile and writeSentinelFile. Rebased to cleanup commit messages, and fixed a couple of issues: - formatting in jfile.cpp - referencing %roxiedir too early in stopccd.bat - exceptions leaked in removeExceptionFile/writeExceptionFile - typos in ccdmain and eclccscheduler meant would not compile * Remove test code uploaded by mistake * Added bash vars and environment.conf usage to complete-uninstall. Moved complete-uninstall.sh to complete-uninstall.sh.in and add it to config time processor list. Moved all directory and user removal to using environment vars from environment.conf. Corrected type in function name set_environmentvars. * Clean up sentinel creation All currently used init scripts will now delete the sentinel file at startup to avoid loops if the program fails to load entirely. Also fix missing copyright on init scripts, and ensure that programs create sentinel files at appropriate points (i.e. once all possible startup errors have been checked and the process is in its ready state. Have not cleaned up issues in the legacy startup scripts - I propose to move them out of the repo shortly. * Added the creation of sentinel files to dali and sasha. Still needs some work, but should be much better with these changes than before. * Remove dynamic format strings from eclcc Change some code that triggered the gcc printf format warnings so they now use constant strings. * Report missing attribute on no line, not line 1 * Minor change to eclcc regress batch file Use the base name instead of the full pathname as the filter for the regression comparison. * Remove legacy startup scripts from repository Create 3.2 release candidate branch Removed references to init_start/stop_thor that should no longer be in install file. init_start/stop_thor where still referenced in thor.install and should not have been as they have been removed from the source tree. * Fix EclWatch File Download on multi-node system The problem only happens on multi-node system (ECLWatch and dropzone are not in the same machine). When a user wants to download a file using ECLWatch Upload/download File menu, the file download should be done by clicking the file on the Upload/download page. The old code does not work because network IP is not used as a part of the input of createIFile(). The fix creates a RemoteFilename object using both IP and file path/name. Then, the RemoteFilename object is used as the input of createIFile(). Now, the fie download works. * Default 64bit regex to use stack implementation. * Fix problems with count on temporary file Counts on temporary files have problems because the filename is implicitly mangled with the wuid. This wasn't being taken into account. Add code to output some more flags from the code generator, and code in hthor to use those flags. Note, this is likely to still require a similar fix in thor. * Updated init system to always use our installed start-stop-daemon. Cleaned up the start-stop-daemon to remove logic that would prevent it from building on os'es that already have start-stop-daemon installed. Refactor start-stop-daemon further Merge branch 'issue171' into candidate-3.2.x Remove files that are no longer used * Fix copyrights Fix all copyrights in initfiles directory that were using the short form with missing language and incorrect symbol. Remove some dead files encountered along the way. Fix copyright notices on all sourcedoc.xml files to be consistent Clean up remaining short-form copyright messages Copyright changes merged into 3.2 branch * Thor sentinel file was not being created Recent changes to sentinel file creation missed one file (because of over-convoluted chain of files involved in thor startup, but that's another bug). As a result thor would not automatically restart on closedown. Use the proper environment variable name so that thor will create the sentinel file. * START-STOP-DAEMON environment variable needs renaming * bash does not like - in an environment variable name. Rename to use underscores in place of -. Also the code in hpcc-common to set the variable was using the wrong path. * jptree serialization format change means reads from old dali fails. The change made to jptree to introduce the ordered tree flag causes serialization issues when talking to a dali that saved data using the previous flag values. This change restores the binary flag to its previous value, and uses a previously unused value for the new ordered flag. Dali information saved by systems between the previous change and now may be invalidated, but this should only affect developer-built private systems as the change has never been released in any official build. jptree serialization format change means reads from old dali fails * Ensure imported modules added to archive Previously a module entry was only added to the archive if a definition from it was used in the query. This change ensures it a blank entry will be created. * Code assumes read() will read full requested amount Various code in jlib was assuming that read() and pread() would never return less than the requested amount except at end-of-file. The Posix standard states that they may do so if a signal is received during the read operation after some data has been retrieved. Testing on Lustre suggests that this ican sometimes happen. We previously had code in to handle cases where calls to pread() were interrupted before data had been read, but they would not help all cases. The calls to ::read / ::pread were not as well isolated as they should have been (and there were also calls to _read to confuse the issue). Refactor the code to common up calls to ::read as much as possible, and add logic to retry interrupted reads. read full requested amount. * Regress change variable change from int to unsigned A previous change from int to unsigned meant that an array index x-2 became a very high number when it underflowed. * Added missing directory creation and chown to configmgr script. Configmgr would fail to start if /var/{run,lock}/HPCCSystems did not exist, or was not owned by hpcc. * Added error check for package install failure to remote install. Added expect to package requirement for all distributions. * Fixes row invariant filters on csv files Fixes a bug with csv read in hthor, where the canMatchAny() was not being tested before reading the disk file. This meant row invariant filters were ignored. * Fix regression reading multi byte utf8 Fixes a bug reading utf8 files, where the size of the field was being passed to a function instead of the number of utf8 characters. Probably a regression post 702. * Return WUID inside DFU WU responses WUID was returned inside DFU WU responses since it is needed for SOAP requests. But, the code lines for returning WUID in DFU WU responses were removed by mistake when we worked on Isuue #172. This fix adds the code lines back. * Added User check to the remote install engine used in install cluster. New checkUser function using the id command allows for the checking of the user creation. Added stderr redirection of id command to /dev/null Update build version ready for 3.2.2 closedown * Check user input in Local Path using dropzone path When a file is sprayed, the Local Path field is pre-populated using a dropzone directory. A user has to input a file under that directory or select a file using the Choose File button. The existing code verifies the file selection by comparing the Local Path field with pre-populated value of the dropzone directory. If they are the same, an error message will be shown. But, when the spray request comes from a modified DFU WU, the Local Path field is pre-populated using the full path of the file input by the user. The existing code does not handle that. This fix changes the code to remember the value of the dropzone directory and compare the Local Path field with the value of dropzone directory. * Add -g option to g++ compile step on debug build eclcc generated executables for Linux are not getting debug symbols included, even though the debug command line option is set. Fix the problem by adding -g to linux compile step * Code assumes read() will read full requested amount * typo in code to ensure full reading could core A typo in the code for ensureing that read/pread read the full amount even when interrupted by signals could result in a heap corruption, as the byte before the buffer might get overwritten. Code was checking a 64-bit unsigned -1 value against a 32-bit one, and thus comparing 0xffffffffffffffff versus 0x00000000ffffffff and not getting a match In fact neither type was right - the return value is ssize_t (which is signed) * Roxie not using the CSV separator info from dali Roxie was not picking up the SEPARATOR, QUOTE and TERMINATOR settings from dali when reading a CSV file. Add a queryProperties method to the IResolvedFile interface, and use it to track the properties from an IDistributedFile. While the full IDistributedFile info is not serialized to slaves in the delayed resolution cases, the properties need to be. * Reports the correct line number at eof Previously an implicit n was added to the end of the source file, which meant that any error at the end of the file reported the error on the next (non-existant line number). It also fixes a potential problem where the position was not initialised for an EOF token.
Release Notes – Changes from 3.0.3 to 3.0.4
- Resolved an issue that would prevent proper ssh key installation
- Resolved an issue where Thor won’t start if hostname was not set.
- Resolved the false warning the install-cluster.sh script (too many arguments)
- Resolved an issue in the init system that could prevent Thor slaves nodes from starting
- Added chmod 775 for the config directory to allow group writes to the directory.
- The install-cluster.sh script now uses basename to install
- Resolved issue in the hpcc-run.sh script where it could not communicate with some nodes.
- Resolved and issue where startup could fail id Dali was not on the lowest IP
NOTE: The ECL IDE ver. 3.0.2 is still valid for this version of the platform.
Known Limitations (for Community Edition version 3.0.4)
If you compile ECL code using the command line compiler, you may experience a slowdown if the source code has a long directory path to the compiler. This will be addressed in a future release.
=========================================
Release Notes – Changes from 3.0.2 to 3.0.3
- Now supports Ubuntu ver 11.04.
- A new script, install-cluster.sh, is now available to make installation on larger clusters easier.
- Fixed an issue that could cause a multi-node Roxie not to start under some conditions.
NOTE: The ECL IDE ver. 3.0.2 is still valid for this version of the platform.
Known Limitations (for Community Edition version 3.0.3)
Under certain circumstances, the install-cluster.sh script can issue this false warning:
/tmp/remote_install/remote-install-engine.sh: line 104: [: too many arguments
This message can be safely ignored.
=========================================
Release Notes – Changes from 3.0.1 to 3.0.2
- In WsECL, constructed namespaces for workunit results now ensure spaces are removed to ensure valid URNs.
- Roxie and WsECL now construct namespaces for unnamed outputs in a consistent manner.
- In ECL Watch, Search Roxie Queries would fail if a Workunit (WU) was missing.
- A Roxie Query with a missing WU could cause WsECL to core.
- The Browse Resources page now works correctly in ECL Watch.
Known Limitations
- If you create a Roxie cluster in Config Manager’s Advanced View, you must edit the Environment XML file before trying to start the cluster. If you use the wizard, you will not encounter this issue.Config Manager’s Advanced View creates a superfluous section in the environment XML file that prevents a Roxie Cluster from starting. After using Advanced View, open the XML file in a text editor and delete the superfluous section. The section to delete is an extra RoxieServerProcess with a blank netaddress as shown below:
<RoxieServerProcess aclName="" computer="" dataDirectory="/var/lib/HPCCSystems/hpcc-data/roxie" listenQueue="200" netAddress="" numThreads="30" port="9876" requestArrayThreads="5"/>
- On Ubuntu, the dafilesrv component does not stop upon uninstallation of the hpccsystems-platform. The user will have to manually kill the process.