Release Notes for Community Edition 4.2.12-2
================================
Known Limitations for 4.2.12
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the "~foreign::" notation, can only be published using the ecl command line tool and the --allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
All Release Notes for Community Edition 4.2.6-3 apply.
=================================================================
Comprehensive list of changes from 4.2.12-2 (gold) to 4.2.12-1 (gold)
=================================================================
Community Edition 4.2.12-2
HPCC-12839 Fix crash when row being looked up in a dictionary is aliased
HPCC-12901 Fix spurious delete logical file timeout
Release Notes for Community Edition 4.2.12-1
================================
Known Limitations for 4.2.12
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the "~foreign::" notation, can only be published using the ecl command line tool and the --allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
All Release Notes for Community Edition 4.2.6-3 apply.
=================================================================
Comprehensive list of changes from 4.2.10-1 (gold) to 4.2.12-1 (gold)
=================================================================
-----
HPCC-12490 Ensure linked progress is released when connection is
----
HPCC-12490 Fix link progress
---
HPCC-12490 Add getGraphsMeta() to explicitly get the meta info
--
HPCC-12543 Create the deserializer object in the correct context
-
HPCC-12534 Prevent >1 file delete from deadlocking each other
HPCC-12490 Correction to WUERR_WorkunitPublished id
HPCC-12523 Prevent accidental wildcard lookups (for 4.2.x)
HPCC-12518 Add support for Ubuntu 14.04 and 14.10
Release Notes for Community Edition 4.2.10-1
================================
Known Limitations for 4.2.10
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the "~foreign::" notation, can only be published using the ecl command line tool and the --allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
=================================================================
Comprehensive list of changes from 4.2.8-1 (gold) to 4.2.10-1 (gold)
=================================================================
--
HPCC-12309 Catch memory wrap and full hash table
HPCC-12084 Remove unnecessary internal error
HPCC-11972 Roxie data copying majority from remote Roxie and not buddy node
HPCC-12198 Abort parsing earlier for invalid queries
HPCC-12244 Fix xpath used to lookup WsEcl VIP configuration
HPCC-12220 SuperHashTable kill not resetting tablecount
HPCC-12158 Check ptree pointer before use in addClusterQueryStates
-
HPCC-12145 Jsocket printf causes invalid output from eclcc
HPCC-12133 Change log level for Roxie failed to open file
HPCC-12150 Check cached item pointer before using in getElementsPaged
HPCC-12075 Allow to select a good landing zone for Upload/download
HPCC-11968 Port back unique allocator change to 4.2.x
HPCC-12079 Start Activity Cache timeout from cache creation completion
HPCC-12085 Avoid malloc/free when updating the buffer callbacks
Release Notes for Community Edition 4.2.8-1 GOLD Release
All Release Notes for Community Edition 4.2.6-3 apply.
================================================================= Comprehensive list of changes from 4.2.6-1 to 4.2.8-1 (gold) ================================================================= ---- HPCC-12010 Fix deadlock in onActivity cache building HPCC-11988 Fix hthor calling helper functions too early HPCC-11995 Improve logging for getActivityInfo HPCC-11995 Improve logging for createActivityInfo --- HPCC-11690 Fix DEDUP,HASH crash if OOM freed empty bucket HPCC-11937 Fix race condition in smart join HPCC-11953 Throw error when RIGHT rows would be lost HPCC-11940 Avoid multiple control:queries calls for same queryset HPCC-11932 Roxie attach causing Roxie cluster to load empty package -- HPCC-11933 Fix WsSMC.setActivityResponse to not update Activity cache HPCC-11920 Prevent SKIPiness leaking outside an ONFAIL - HPCC-11756 Rebuild persist if input persist is newer HPCC-11666 Make filtering by referenced library case insensitive HPCC-11699 Add "LibraryName" to Query Set Filter HPCC-11666 Make Queries list filterable by referenced library HPCC-11515 Under-caching of dynamic filename resolution HPCC-11441 Fold IF() at parse time to avoid binding issues later HPCC-11464 Default string stored definitions to variable length
Release Notes for Community Edition 4.2.6-3 GOLD Release
All Release Notes for Community Edition 4.2.6-2 apply.
Community Edition 4.2.6-3 Gold HPCC-12010 Fix deadlock in onActivity cache building
Release Notes for Community Edition 4.2.6-2 GOLD Release
All Release Notes for Community Edition 4.2.6-1 apply.
HPCC-11933 Fix WsSMC.setActivityResponse to not update Activity cache
Release Notes for Community Edition 4.2.6-1
All Release Notes for Community Edition 4.2.4-5 apply.
================================
Known Limitations for 4.2.4
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the "~foreign::" notation, can only be published using the ecl command line tool and the --allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
=================================================================
Comprehensive list of changes from 4.2.2-4 to 4.2.6-2 (gold)
=================================================================
HPCC-11933 Fix WsSMC.setActivityResponse to not update Activity cache
------------
HPCC-11861 Copying query .so files can result in truncated .so files
HPCC-11857 Roxie gives assert error if try to execute suspended query
HPCC-11844 Fix inconsistency generated in expression tree
HPCC-11825 Fix issues with some versions of ICU (post 5.0?)
-----------
HPCC-11801 ERROR: Query suspended: Different version of file already loaded
HPCC-11775 Fix unrelated bug spotted during review
- Revert unfiltered test
HPCC-11808 Missing alias information from control:queries
HPCC-11775 Fix minor issues spotted in review
- Improve efficiency of WUiterate in Sasha
HPCC-11798 Allow MAXLENGTH on BUILD (forward compatibility)
HPCC-11777 Fix CLocalEnvironment cache thread safeness
----------
HPCC-11760 Fix getTargetClusterInfo() in workunit.cpp
HPCC-11637 Avoid multiple concourrent ECLWatch onActivity queries
HPCC-11753 Backmerge of control:queries speedup broke formatting
HPCC-11739 Roxie cluster priorities not set correctly
HPCC-11698 WARNING: Remote file connect Too many open files
HPCC-11713 Increase timeout and remove need to clone tree
- Remove unused timeout
- Final set of environment changes
- Convert some connects to children of environment
- Convert most connections to /Environment
- Remove file based environment code (unused since 2010-03-29)
---------
HPCC-11496 2nd attempt at avoiding contention on ClusterLock
HPCC-11691 Roxie can core on control:unlockdali
HPCC-11688 unused-files shouldn't check packagemaps active on other roxies
HPCC-11687 Fire exception on connect if from stale client
HPCC-11679 Catch exception in connection destructors
HPCC-10684 Ensure old tracked session is removed from new
HPCC-11653 Merge roxie endpoint results for control:queries
HPCC-11590 Add configurable timeouts to WsEcl
--------
HPCC-11628 Roxie copied some files to wrong places
HPCC-11309 Ensure IDFUHelper cooperate with transactions
HPCC-11288 Regression if inside transaction
HPCC-11261 fileservice superfile actions can lockup on retry
HPCC-11623 Query details should report files used in alphabetical order
HPCC-11627 Requesting per-query logging can cause roxie cores
HPCC-11618 Roxie core when detaching from dali
-------
HPCC-11610 Control:reload may leave state hash incorrect
HPCC-11607 Core processing control:reload
HPCC-11607 Core processing control:reload
HPCC-11592 ecl-queries-copy should copy the snapshot attribute
HPCC-11538 Pull more data from hpcc-data2 location
HPCC-11564 Add method to clone entire queryset from one target to another
------
HPCC-11339 WsWorkunits should respect compulsory flag
HPCC-11588 Better timeout for Roxie's initial dali connect
-----
HPCC-11565 Avoid calls to SDS manager for dangling connections
HPCC-11563 Don't set RefFileNotFound for ReferencedFiles in packagemap
HPCC-11562 queries-copy from local dali fails when authentication enabled
----
HPCC-11555 Remove contention on GeneratedDlls
HPCC-11545 Use dirty flag for QueryFilesInUse cache
HPCC-11443 Allow Roxie to specify remote cluster priorities
HPCC-11544 Roxie restarted after dali disconnected
HPCC-11541 Various IPT leaks, that also cause leaked locks
HPCC-11459 Use new toXML formatting flags in getQueryInfo
HPCC-11459 Flags to toXML to allow more control over formatting
HPCC-11500 Control:queries should only return info for active package
HPCC-11494 Roxie dali notification issues
HPCC-11509 ESP cache of packagemap info leaking connections
HPCC-11504 Referencing memory after freed in ccdqueue.cpp
HPCC-11339 Remove unnecessary scoping on call to isCompulsory
HPCC-11339 WsWorkunits should respect compulsory flag
---
HPCC-11458 Fix clashing id
HPCC-11458 Uses a new control ID for WHEN,BEFORE (fix stopSink error)
HPCC-11477 Activities are being reset excessively
HPCC-11445 Roxie not stopping unused sink activities
HPCC-11496 Avoid create/delete ClusterLock to reduce contention
HPCC-11494 Roxie dali notification issues
HPCC-11491 Deletes causing subscription notifications to siblings
HPCC-11478 IgnoreMissingFiles option not working in Roxie
--
HPCC-11477 Activities are being reset excessively
HPCC-11459 Fix OSX build break
HPCC-11452 Ensure control:queries does not split lines
HPCC-11459 Add flag to toXML to allow newlines only formatting
HPCC-11440 State hash should be comparable across clusters
HPCC-11430 Prevent stack fault when parameter not substituted
-
HPCC-11412 Excessive log file size in Roxie
HPCC-11418 Roxie may stall for long periods under load
HPCC-11391 Queries that are suspended only on slaves are not reported
HPCC-11389 Ignore loopback interfaces when selecting the interface to use
HPCC-11305 Add support for the compulsory attribute in packagemaps
HPCC-11283 Use cluster ldap user when building queries using file cache
HPCC-11304 Field translation options not working correctly
HPCC-11310 Fix signature of addNamedQuery() in workunit.hpp
HPCC-11284 Assert failure on certain (unusual) file names in Roxie queries
HPCC-11187 ecl-queries-list should show wuid and snapshot info
HPCC-11188 Copy query attributes when copying queries
HPCC-11278 Fix core when calling WUListQueriesUsingFile with LDAP
Release Notes for Community Edition 4.2.4-5
All Release Notes for Community Edition 4.2.4-3 apply.
================================================================= Comprehensive list of changes from 4.2.4-4 to 4.2.4-5 ================================================================= HPCC-11309 - Ensure IDFUHelper cooperate with transactions HPCC-11288 - regression if inside transaction HPCC-11261 - add some comments HPCC-11261 - fileservice superfile actions can lockup on retry
Release Notes for Community Edition 4.2.4-3
All Release Notes for Community Edition 4.2.4-2 apply.
================================================================ Comprehensive list of changes from 4.2.4-2 Gold to 4.2.4-3 ================================================================ HPCC-11304 Field translation options not working correctly
Release Notes for Community Edition 4.2.4-2
All Release Notes for Community Edition 4.2.4-1 apply.
HPCC-11278 In an LDAP-enabled system, the 'Used By' feature that displays all the queries that use a particular logical file or superfile may return false negatives. (Message may incorrectly say "No Queries using this file.")
================================================================ Comprehensive list of changes from 4.2.4-1 Gold to 4.2.4-2 ================================================================ HPCC-11278 Fix core when calling WUListQueriesUsingFile with LDAP HPCC-9129 Add new DOC: HPCC Monitoring and Reporting (Technical Preview).
Release Notes for Community Edition 4.2.4
All Release Notes for Community Edition 4.2.2 apply.
================================
Known Limitations for 4.2.4
================================
- HPCC-11274 A Roxie query using a foreign file referenced using the "~foreign::" notation, can only be published using the ecl command line tool and the --allow-foreign option.
- HPCC-10319 If the first subfile of superfile is an empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for SORT and INDEX.
- HPCC-10284 In the Technical Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
================================================================ Comprehensive list of changes from 4.2.2 Gold to 4.2.4 Gold ================================================================ Community Edition 4.2.4-rc4 HPCC-11195 Suppress creation of unread spill files in Roxie Community Edition 4.2.4-rc3 Release Candidate 3 HPCC-11236 Non Dlls should not be registered with the dllserver HPCC-11216 Fix default expiry for persist files HPCC-11235 Make timeout etc. on SOAPCALL more dynamic HPCC-11226 Add NULL check added to master in another commit HPCC-10983 Use a simpler method of preventing recursive hoisting HPCC-10983 Don't constant fold to avoid expression duplication in optimizer HPCC-11220 Remove references to Suse in docs HPCC-11212 Fix problems with SOAPCALL to a blank url. HPCC-11175 Add QueriesUsingFile support for super files HPCC-11175 Fix issues with cache of files in use info HPCC-11101 Fail publishing queries with foreign files in old eclwatch HPCC-11087 Track subs swapped as part of swap/promote HPCC-11080 DOCS:Value Types link broken HPCC-11082 Global LOOP with row condition must recheck finishing HPCC-10941 Add mechanism for finding queries that use a given file Community Edition 4.2.4-rc2 HPCC-10931 Roxie not putting data on right node in cyclic mode HPCC-11049 Roxie pulling from remote data location instead of buddy node HPCC-11061 Ensure Dali group created if missing HPCC-11041 Improve tracing when Roxie can not load file HPCC-11007 Failed wildcard spray, empty directory, assert HPCC-11025 Fix various MP close socket issues HPCC-11007 Failed wildcard spray, empty directory, assert Community Edition 4.2.4-rc1 HPCC-10965 Open Legacy ECL Watch Fails on FF HPCC-10989 Prevent "global" graph layout HPCC-9551 Roxie rtprio limits HPCC-10917 Prevent MP deadlock if broken socket on RANK_ALL HPCC-10141 DOCS:Install ClientTools on Multiple platforms HPCC-10894 Prevent spurious loop continuation HPCC-10933 Excessive "Reset without stop" tracing HPCC-10698 Avoid deadlock if retrying lock on superfiles HPCC-10978 Fix windows build break by removing use of strncasecmp HPCC-10925 Allow new process group creation to be configured HPCC-10925 Allow abort when compiling to kill gcc process HPCC-10922 Add an option to improve cse for if conditions in child queries HPCC-10910 Check aborting after first attempt to connect to slave HPCC-10921 Fix HASH/HASH64 on constant strings HPCC-10910 Ensure abort is checked before spawning a child
Release Notes for Community Edition 4.2.4-rc4
All Release Notes for Community Edition 4.2.4-rc2 apply.
================================================================ Comprehensive list of changes from 4.2.4-rc2 Gold to 4.2.4-rc4 ================================================================ Community Edition 4.2.4-rc4 Release Candidate 4 HPCC-11195 Suppress creation of unread spill files in Roxie Community Edition 4.2.4-rc3 Release Candidate 3 HPCC-11236 Non Dlls should not be registered with the dllserver HPCC-11216 - Fix default expiry for persist files HPCC-11235 Make timeout etc. on SOAPCALL more dynamic HPCC-11226 Add NULL check added to master in another commit HPCC-10983 Simplify code following review HPCC-10983 Use a simpler method of preventing recursive hoisting HPCC-10983 Don't constant fold to avoid expression duplication in optimizer HPCC-11220 Remove references to Suse in docs HPCC-11212 Fix problems with SOAPCALL to a blank url. HPCC-11175 Add QueriesUsingFile support for super files HPCC-11175 Fix issues with cache of files in use info HPCC-11101 Fail publishing queries with foreign files in old eclwatch HPCC-11087 - Track subs swapped as part of swap/promote HPCC-11080 DOCS:Value Types link broken HPCC-11082 - Global LOOP with row condition must recheck finishing HPCC-10941 Add mechanism for finding queries that use a given file
Release Notes for Community Edition 4.2.4-rc2
All Release Notes for Community Edition 4.2.2-1 apply.
================================================================ Comprehensive list of changes from 4.2.2 Gold to 4.2.4-rc2 ================================================================ Community Edition 4.2.4-rc2 Release Candidate 2 HPCC-10931 Roxie not putting data on right node in cyclic mode HPCC-11049 Roxie pulling from remote data location instead of buddy node HPCC-11061 Ensure Dali group created if missing HPCC-11041 Improve tracing when Roxie can not load file HPCC-11007 Failed wildcard spray, empty directory, assert HPCC-11025 Fix various MP close socket issues HPCC-11007 Failed wildcard spray, empty directory, assert Community Edition 4.2.4-rc1 Release Candidate 1 HPCC-10965 Open Legacy ECL Watch Fails on FF HPCC-10989 Prevent "global" graph layout HPCC-9551 Roxie rtprio limits HPCC-10917 Prevent MP deadlock if broken socket on RANK_ALL HPCC-10141 DOCS:Install ClientTools on Multiple platforms HPCC-10894 Prevent spurious loop continuation HPCC-10933 Excessive "Reset without stop" tracing HPCC-10698 Avoid deadlock if retrying lock on superfiles HPCC-10978 Fix windows build break by removing use of strncasecmp HPCC-10925 Allow new process group creation to be configured HPCC-10925 Allow abort when compiling to kill gcc process HPCC-10922 Add an option to improve cse for if conditions in child queries HPCC-10910 Check aborting after first attempt to connect to slave HPCC-10921 Fix HASH/HASH64 on constant strings HPCC-10910 Ensure abort is checked before spawning a child
Release Notes for Community Edition 4.2.2-1
All Release Notes for Community Edition 4.2.0-4 apply.
============================================================ Comprehensive list of changes from 4.2.0 Gold to 4.2.2-1 Gold ============================================================ HPCC-10882 Allow cast real to stringif string preserves whole value HPCC-10899 Fix spilt results records getting lost HPCC-10829 Removing files from roxie may not remove files from hpcc-data2 HPCC-10896 Lookup Join leaking rows in hash table. HPCC-10864 change cli --no-foreign to --allow-foreign HPCC-10864 Command option to fail publish if query has foreign files HPCC-10895 Document "allow-foreign" option in CLI HPCC-8430 Document addScopes utility in LDAP section HPCC-9551 Allow Roxie to set thread priorities HPCC-10877 More issues in stepped keyed limits HPCC-10844 Fix some memory leaks in the code generator HPCC-10839 New ECL Watch Deselection broken HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10819 Inline set sometimes incorrectly output in loop graph HPCC-10849 Disable through spills for roxie - they only cause problems HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10834 DOCS: Standardize capitalization of Thor, Roxie HPCC-10806 DOCS: Clarify uninstall instructions to use the package name HPCC-10688 EclWatch misreporting partially suspended queries HPCC-10800 Deleting files from one cluster may leave incorrect dali info HPCC-10818 Fix problem with MANY LOOKUP in a child loop/query HPCC-10798 Fix publishing query not adding cluster to local files HPCC-10801 Update error message to provide hint of workaround HPCC-10799 FIX potential invalid C++ for EXISTS(a+b) HPCC-10486 Add daliadmin option to set file redundancy HPCC-10742 Ensure in-progress partial output is removed HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10595 Don't display ecl-packagemap-validate success on warnings HPCC-10780 Fix Queries Page URL structure HPCC-10794 Sasha search fails to find some workunits HPCC-10691 Increase libxslt template stack depth HPCC-10779 Caching nohits will interfere with dynamic files HPCC-10730 DOCS: Compiler Override in ECL IDE HPCC-10653 Problems in recreateCloneSource if dali not available HPCC-10768 Rollback consistent Thor file locking for 4.2.2 HPCC-10633 ZAP report doesn't contain archive on legacy system HPCC-10685 Fix typo in ecl roxie detach section HPCC-10665 Add missing params to File.copy docs HPCC-10756 DOCS:Fix ID tag for HTML export HPCC-10628 Fixed typo in EVENTEXTRA docs HPCC-10732 Call sendRoxieControlAllNodes() to send control:querystats HPCC-10571 Add RemoveOwnedSubFiles to docs HPCC-10470 Roxie Graphs are not getting merged correctly HPCC-10683 Fix WU connection leak in WsWorkunits and a warning in ESP log HPCC-10684 Prevent close of old + start of new session clashing HPCC-10693 Allow CSV,HEADING read in child query. HPCC-10686 Need to check subfile after lock retry HPCC-10653 Problems in recreateCloneSource if dali not available HPCC-10671 Ensure activities hash table is cleared when query load fails HPCC-10682 Add namespace to avoid two classes with same name clashing HPCC-10660 Improve efficiency of subscription session remove HPCC-10651 Roxie dali cache ineffective on subfiles resolved via package HPCC-10650 createSingleFileClone don't remove files unless changed HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10610 Add DBGLOG trace of call into createSingleFileClone HPCC-10517 Fix Package subfile nodes sometimes added to DALI as empty HPCC-10594 Block access to foreign dali from logicalfilelist HPCC-10620 Ensure logical file meta data is checked HPCC-10608 Fix compressed file symbol not showing in ECLWatch HPCC-10490 Rename a variable based on review HPCC-10490 Show primary clusters for XRef HPCC-10516 Roxie should ignore SubFile value="" in a package SuperFile HPCC-10610 ecl-packagemap-add support for specifying a src file prefix HPCC-10590 Ignore ~ in subfile name from package HPCC-10547 Ensure that the lock is released (when contended) for atleast 5s HPCC-10547 Retain timeout for repeat=true (just in case) HPCC-10386 Playground Sample Has Corrupted Chars HPCC-10533 Fix EnvGen segmentation fault HPCC-10547 Reduce contention for persist locks by timing out quicker HPCC-10602 OVERWRITE option broken in roxie HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10206 Increase timeout accessing GeneratedDlls information HPCC-10564 Roxie is not caching dali lookups effectively HPCC-10513 Fix missing persist dependencies for stored filenames HPCC-10568 DOCS:Update Date HPCC-10570 Fix confusion over DeleteOwnedSubFiles/RemoveOwnedSubFiles HPCC-10564 Roxie is not caching dali lookups effectively Rename deleteFilter to deleteExclusions HPCC-10532 Serialize progress information so backward compatible. HPCC-10514 Spurious boolean, causing premature timeouts HPCC-10481 Dynamic group leaves groupType uninitialized HPCC-10482 Associated files being deleted too early HPCC-10255 Sasha not archiving/restoring associated files HPCC-10530 Query deleted mid-flight may never terminate (and may spam dali) HPCC-10493 Bad request message on using ZAP button HPCC-10515 Use POST to send ZAP Report request HPCC-10498 Fix problems copying bundles with nested directories. HPCC-10511 Code using dmetaphone or saltlib may get undefined symbols HPCC-10302 Fix eclagent deadlock if fileservices calls in apply HPCC-10489 Fix problem when dataset param is projected to base record HPCC-10407 Logical file does not open HPCC-10361 Prevent assignements that can SKIP from being lost HPCC-10462 Fix problem retrying add/remove ops in transactions HPCC-10411 Catch out of bounds AddSuperFile @ pos HPCC-10405 Change WU State column for better display HPCC-10465 Global merge bug if varrecs and late detection HPCC-10440 Ensure padded part copies have matching timestamps HPCC-10481 Default replicate dir causing problems HPCC-10406 Add sort by columns in queryset HPCC-10421 Fix "internal" build HPCC-10439 DOCS:VMWare Version HPCC-10429 Fix ecl-bundle selftest to check for the correct symbol HPCC-10364 Generate mergeAggregate() for hash aggregate if input is grouped. HPCC-10319 Fix attr problems if a subfile is empty super HPCC-10333 Embedded Python may encounter undefined symbols HPCC-10398 Fix persist_replicate mismatch HPCC-10384 Potential spillable row stream race condition crash HPCC-10387 Z.A.P does not include three parameters needed HPCC-10345 Disable Banner Setup for non-admin if authentication is set HPCC-10372 DeleteSuperFile possible crash HPCC-10374 Fix sorted loader issue effecting global sort HPCC-10301 Read enough data for mime header process when uploading files
Release Notes for Community Edition 4.2.2-rc12
All Release Notes for Community Edition 4.2.2-rc8 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc8 to 4.2.2-rc12 ============================================================ HPCC-10877 More issues in stepped keyed limits HPCC-10844 Fix some memory leaks in the code generator HPCC-10839 New ECL Watch Deselection broken HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10819 Inline set sometimes incorrectly output in loop graph HPCC-10849 Disable through spills for roxie - they only cause problems HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10834 DOCS: Standardize capitalization of Thor,Roxie HPCC-10806 DOCS: Clarify uninstall instructions to use the package name HPCC-10688 EclWatch misreporting partially suspended queries HPCC-10800 Deleting files from one cluster may leave incorrect dali info HPCC-10818 Fix problem with MANY LOOKUP in a child loop/query HPCC-10798 Fix publishing query not adding cluster to local files HPCC-10801 Update error message to provide hint of workaround HPCC-10799 FIX potential invalid C++ for EXISTS(a+b) HPCC-10486 Add daliadmin option to set file redundancy HPCC-10742 Ensure in-progress partial output is removed HPCC-10784 Keyed limits on stepped indexreads can be miscalculated HPCC-10595 Don't display ecl-packagemap-validate success on warnings HPCC-10780 Fix Queries Page URL structure HPCC-10794 Sasha search fails to find some workunits HPCC-10691 Increase libxslt template stack depth HPCC-10779 Caching nohits will interfere with dynamic files HPCC-10730 DOCS: Compiler Override in ECL IDE HPCC-10653 Problems in recreateCloneSource if dali not available HPCC-10768 Rollback consistent Thor file locking for 4.2.2 HPCC-10633 ZAP report doesn't contain archive on legacy system HPCC-10685 Fix typo in ecl roxie detach section HPCC-10665 Add missing params to File.copy docs HPCC-10756 DOCS:Fix ID tag for HTML export HPCC-10628 Fixed typo in EVENTEXTRA docs HPCC-10732 Call sendRoxieControlAllNodes() to send control:querystats HPCC-10571 Add RemoveOwnedSubFiles to docs HPCC-10470 Roxie Graphs are not getting merged correctly HPCC-10683 Fix WU connection leak in WsWorkunits and a warning in ESP log HPCC-10684 Prevent close of old + start of new session clashing HPCC-10693 Allow CSV,HEADING read in child query. HPCC-10686 Need to check subfile after lock retry HPCC-10653 Problems in recreateCloneSource if dali not available
Release Notes for Community Edition 4.2.2-rc8
All Release Notes for Community Edition 4.2.2-rc5 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc5 to 4.2.2-rc8 ============================================================ HPCC-10671 Ensure activities hash table is cleared when query load fails HPCC-10682 Add namespace to avoid two classes with same name clashing HPCC-10660 : Improve efficiency of subscription session remove HPCC-10651 Roxie dali cache ineffective on subfiles resolved via package HPCC-10650 createSingleFileClone don't remove files unless changed HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10610 Add DBGLOG trace of call into createSingleFileClone HPCC-10517 Fix Package subfile nodes sometimes added to DALI as empty HPCC-10594 : Block access to foreign dali from logicalfilelist HPCC-10620 : Ensure logical file meta data is checked HPCC-10608 Fix compressed file symbol not showing in ECLWatch HPCC-10490 Rename a variable based on review HPCC-10490 Show primary clusters for XRef
Release Notes for Community Edition 4.2.0-4
All Release Notes for Community Edition 4.2.0-3 apply.
============================================================ Comprehensive list of changes from 4.2.0-3 to 4.2.0-4 ============================================================ HPCC-10533 Fix EnvGen segmentation fault
Release Notes for Community Edition 4.2.2-rc5
All Release Notes for Community Edition 4.2.2-rc3 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc3 to 4.2.2-rc5 ============================================================ HPCC-10516 Roxie should ignore SubFile value="" in a package SuperFile HPCC-10610 ecl-packagemap-add support for specifying a src file prefix HPCC-10590 Ignore ~ in subfile name from package HPCC-10547 Ensure that the lock is released (when contended) for atleast 5s HPCC-10547 Retain timeout for repeat=true (just in case) HPCC-10386 Playground Sample Has Corrupted Chars HPCC-10533 Fix EnvGen segmentation fault HPCC-10547 Reduce contention for persist locks by timing out quicker HPCC-10602 OVERWRITE option broken in roxie HPCC-10592 Roxie needs to cache dali lookups that fail to match HPCC-10206 Increase timeout accessing GeneratedDlls information HPCC-10564 Roxie is not caching dali lookups effectively HPCC-10513 Fix missing persist dependencies for stored filenames HPCC-10568 DOCS:Update Date HPCC-10570 Fix confusion over DeleteOwnedSubFiles/RemoveOwnedSubFiles HPCC-10564 Roxie is not caching dali lookups effectively
Release Notes for Community Edition 4.2.0-3
All Release Notes for Community Edition 4.2.0-3 apply.
============================================================ Comprehensive list of changes from 4.2.0-2 to 4.2.0-3 ============================================================ HPCC-10532 Serialize progress information so backward compatible.
Release Notes for Community Edition 4.2.2-rc3
All Release Notes for Community Edition 4.2.2-rc1 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc2 to 4.2.2-rc3 ============================================================ Rename deleteFilter to deleteExclusions HPCC-10532 Serialize progress information so backward compatible. HPCC-10514 - Spurious boolean, causing premature timeouts HPCC-10481 - Dynamic group leaves groupType uninitialized HPCC-10482 - Associated files being deleted too early HPCC-10255 - Sasha not archiving/restoring associated files
Release Notes for Community Edition 4.0.6-rc2
All Release Notes for Community Edition 4.0.6-rc1 apply.
============================================================ Comprehensive list of changes from 4.0.6-rc1 to 4.0.6-rc2 ============================================================ HPCC-10481 - Dynamic group leaves groupType uninitialized
Release Notes for Community Edition 4.2.2-rc2 2
All Release Notes for Community Edition 4.2.2-rc1 apply.
============================================================ Comprehensive list of changes from 4.2.2-rc1 to 4.2.2-rc2 ============================================================ HPCC-10530 Query deleted mid-flight may never terminate (and may spam dali) HPCC-10493 Bad request message on using ZAP button HPCC-10515 Use POST to send ZAP Report request HPCC-10498 Fix problems copying bundles with nested directories. HPCC-10511 Code using dmetaphone or saltlib may get undefined symbols
Release Notes for Community Edition 4.2.2-rc1
All Release Notes for Community Edition 4.2.0-2 apply.
============================================================ Comprehensive list of changes from 4.2.0 Gold to 4.2.2-rc1 ============================================================ HPCC-10302 Fix eclagent deadlock if fileservices calls in apply HPCC-10489 Fix problem when dataset param is projected to base record HPCC-10407 Logical file does not open HPCC-10361 Prevent assignements that can SKIP from being lost HPCC-10462 Fix problem retrying add/remove ops in transactions HPCC-10411 Catch out of bounds AddSuperFile @ pos HPCC-10405 Change WU State column for better display HPCC-10465 Global merge bug if varrecs and late detection HPCC-10440 Ensure padded part copies have matching timestamps HPCC-10481 Default replicate dir causing problems HPCC-10406 Add sort by columns in queryset HPCC-10421 Fix "internal" build HPCC-10439 DOCS:VMWare Version HPCC-10429 Fix ecl-bundle selftest to check for the correct symbol HPCC-10364 Generate mergeAggregate() for hash aggregate if input is grouped. HPCC-10319 Fix attr problems if a subfile is empty super HPCC-10333 Embedded Python may encounter undefined symbols HPCC-10398 Fix persist_replicate mismatch HPCC-10384 Potential spillable row stream race condition crash HPCC-10387 Z.A.P does not include three parameters needed HPCC-10345 Disable Banner Setup for non-admin if authentication is set HPCC-10372 DeleteSuperFile possible crash HPCC-10374 Fix sorted loader issue effecting global sort HPCC-10301 Read enough data for mime header process when uploading files
Release Notes for Community Edition 4.2.0-2
All Release Notes for Community Edition 4.2.0-1 apply.
============================================================
Comprehensive list of changes from 4.0.2-1 Gold to 4.2.0-2
============================================================
HPCC-10423 Fix regression xpath('') shouldn't output xml tag
HPCC-10413 Reinstate non-sequential subfile orders
Release Notes for Community Edition 4.2.0-1
================================
Known Limitations for 4.2.0-1
================================
- HPCC-10319 If the first subfile of superfile is am empty superfile, common attributes are not set. This can cause, for example, incorrect flag for compression.
- HPCC-10209 The sort order UNICODE data are different for of SORT and INDEX.
- HPCC-10284 In the Tech Preview of ECL Watch, the Queries List and the published query details pages offer an interface to suspend any published query. However, suspending a Thor or hThor query is a capability not yet implemented .
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
============================================================
Comprehensive list of changes from 4.0.2-2 Gold to 4.2.0-GOLD
============================================================
Community Edition 4.2.0-1 Gold
HPCC-9039 Add IE 11 Support for GraphControl
HPCC-10383 IE8 Issue with TreeMap and set "selectedItems"
HPCC-10371 Reopening a WU Details page fails
HPCC-10325 ECL Watch does not show full list
HPCC-10315 Add unicode version of fn_hyphen_match
Community Edition 4.2.0-rc3 Release Candidate 3
HPCC-10225 Display graph timings in HH:MM:SS.mm format
HPCC-10261 Ensure that option -Xrs is always enabled in the JVM.
HPCC-10360 Fix Thor roxiemem spill priority order
HPCC-10287 Catch subfiles have correct @num sequence
HPCC-10359 Embedded R fails if there are ^M characters in the source
HPCC-10288 Add RemoveOwnedSubFiles (for 4.2)
HPCC-10272 Fix banner dialog prompt
HPCC-10307 R integration terminates process if R syntax invalid
HPCC-10321 Rename onWUReportBugInfo to onWUReportZapInfo
HPCC-10358 Rename WUGetBugInfo to WUGetZAPInfo, etc
HPCC-10304 Rename ws_workunit "onWUReportBug" to "onWUCreateZAPInfo"
HPCC-10359 Embedded R fails if there are ^M characters in the source
HPCC-10266 Disable banner usage from non-admin users
HPCC-10352 Pass PID in the web link for downloading eclagent log
HPCC-10347 ECL Watch "Open in New Window" fails
HPCC-10327 Ubuntu 13.10 dependency issue
HPCC-10323 ESP incorrectly checks for errors querying file perms
HPCC-10287 Add check for inadequencies of transaction impl.
HPCC-10309 Fix bug where EXISTS(a+b+c) evaluated as EXISTS(c)
HPCC-10288 Add RemoveOwnedSubFiles
HPCC-10287 Catch out of order supers when removing a subfile
HPCC-9912 Document LOCAL option on DATASET n TRANSFORM
** Community Edition 4.2.0-rc2 Release Candidate 2
HPCC-7899 Add Z.A.P button
HPCC-10290 ZAP report should distinguish compiler warnings and errors
HPCC-10273 Add logical files in query set page
HPCC-10292 ZIP from Zap has path info
HPCC-10279 esdl_srv_engine should return HTTP exceptions
HPCC-10224 Fix CSocket::name returning non terminated strings
HPCC-10270 SprayVariable has incorrect parameters
HPCC-10286 Add dependency for Ubuntu 13.10 (Saucy)
HPCC-10280 DOCS:Add ID Attribute
HPCC-10256 Add "Refresh Data" Button to Graph Page
HPCC-10283 Ensure GLOBAL(,OPT) is processed correctly inside a library
HPCC-10278 Create ZAP report feature not handling multiple logfiles
HPCC-9683 Fix performance and memory usage issue for huge dataset
HPCC-10276 Add jsonp support to WsEcl
HPCC-10237 Don't move CHOOSEN() over a grouped count project
HPCC-10265 Fix problems processing action dependencies
HPCC-10264 After publishing using a remote dali, roxie requires remote dali
HPCC-10275 "Compiled" Workunit not showing as completed
HPCC-10274 Add workunit xml file to ZAP Report zip file
HPCC-10129 DOCS:Std Lib Fix table formatting
HPCC-10240 Fix example following review feedback
HPCC-10262 Base Store cached data could "leak" between instances
HPCC-10240 Prevent a TABLE() aggregate being converted to a non aggregate
HPCC-10228 Roxie should lock subfiles, not just rely on superfile lock
HPCC-10029 Add Dictionary Example to ECL Playground
HPCC-9622 Disable failing hthor test when6b.ecl
HPCC-10253 WsWorkunits::onGet should return exceptions to the client
HPCC-10238 Remove ECLPLus interactive mode from docs
***** Community Edition 4.2.0-rc1 Release Candidate 1
HPCC-10251 Fix windows build break
HPCC-9415 Use epoll, add EPOLLRDHUP define for Centos5.x
HPCC-9918 CsvRecordSize class doesn't handle well the quoted and variable length datasets.
HPCC-9307 Allow roxie to have dependencies within a subgraph
HPCC-9415 Use epoll, fix critical section around init
HPCC-10227 Use key cache in indexread/count
HPCC-9244 Improved LOOKUP,MANY scheme
HPCC-10107 Csv auto discovery should work with utf8 files.
HPCC-10241 New ECL Watch + IE8
HPCC-9671 Add Published Query Pages
HPCC-9307 Clean up the code
HPCC-10204 Ensure that a contextClassLoader that uses the classpath is available to Java classes.
HPCC-10203 Add manifest resource support for wildcards and relative URLS
HPCC-10242 Fix preflight not working for roxie server and thor master
HPCC-10244 Fix ID tags to produce HTML version
HPCC-9906 Support DATASET(n, transform, LOCAL)
HPCC-10239 Windows Build break in WsDeploy
HPCC-9307 initial work and refactoring of action lists
HPCC-9965 Add a ,UNSTABLE flag to a JOIN
HPCC-10099 DOCS:JavaScript Embed
HPCC-9192 Doc:PackageMgmt page
HPCC-10176 Add Create Bug Report to ECL WU Details
HPCC-9882 Do not check the return from removeEntry()
HPCC-10174 Add Remote Dali Option
HPCC-10140 Edits based on code review
HPCC-10231 KeyedJoin hitting spurious limits
HPCC-9322 Allow active name to be used with ecl-unpublish
HPCC-9976 Add banner support to new ECL Watch
HPCC-10159 Document SMART option for JOIN
HPCC-9898 ConfigMgr - Fix thor topology cluster add / del
HPCC-7899 Add "Report bug" button in eclwatch WU page
HPCC-10140 Document Virtual Logicalfilename
HPCC-10226 Document change to EXPIRE semantics
HPCC-10124 ConfigMgr - Add new components and services from buildset
HPCC-9322 Allow active name to be used with ecl-unpublish
HPCC-9947 Improve the warning for an invalid use of NOTHOR
HPCC-9968 New EXPIRE semantics
HPCC-10004 DOCS:XREF Warning
HPCC-9992 Implement __PLATFORM__ to query the target platform
HPCC-9320 Preliminary minor refactoring for using global graph results
HPCC-10169 Integrate ClientTools on Windows 32bit with Jenkins
HPCC-10222 Perform proper field validation.
HPCC-9898 ConfigMgr - delete multiple roxie servers
HPCC-10130 Set accessedTime for all files
HPCC-10055 Add Error/Warning Log for Toaster Messages
HPCC-10022 Allow the max number of persist instances to be set
HPCC-9913 Fix forcing value to bool warning in ccdquery.cpp
HPCC-10195 Remove unused m_allowHttpNil flag from CSoapPrimitiveField
HPCC-9934 Add SprayFixed Input
HPCC-10032 Add schema generator support for xpath('')
HPCC-9970 Default persist files to expiring after 14 days
HPCC-9686 Add ability to fetch named results to ESPWorkunit
HPCC-9803 New ECL Watch does not support existing visualisations
HPCC-10021 ConfigMgr - Allow esp service to target a default cluster
HPCC-9812 Ability to spray from any source in new ECL Watch
HPCC-9966 Graph control disappears when switching HTML tabs
HPCC-10146 Job status when blocked
HPCC-9882 Check and return exception message from removeEntry()
HPCC-10188 Rename Properties to attributes for consistency
HPCC-10053 Display "busy" indicator on multi search
HPCC-7898 Link release notes
HPCC-10121 Match with the settings created by pull request #4952
HPCC-10121 Fix merge conflict
HPCC-9861 Fix ECL regeneration of functions with multiple calls.
HPCC-10196 Suggested improvement of for cpan mod installations
HPCC-10147 Add comments to examples to indicate the expected errors
HPCC-10194 Handle NULL results from Java functions
HPCC-10028 removeEntry() should pass the error message to the caller
HPCC-10177 Add code to restrict the number of persist instances
HPCC-10184 Potential memory leak in uncompress routine
HPCC-10185 Graph numeric properties sort as strings
HPCC-10136 Fix ECL in FUNCTIONMACRO_Example.ecl
HPCC-9941 Document FORWARD option on MODULE
HPCC-10147 Initial implementation of JOIN(..., GROUP(x,y))
HPCC-10177 Add code to restrict the number of persist instances
HPCC-10092 Configmgr - add attribute serverForArchivedECLWU to esp
HPCC-10130 Set accessedTime for all files
HPCC-10164 Don't substitute constants into ATMOST join conditions
HPCC-10028 removeEntry() should pass the error message to the caller
HPCC-9941 Document FORWARD on MODULE
HPCC-9415 Disable by default for now
HPCC-9415 New epoll implementation with common base class
HPCC-10183 ECL Record Layout metadata is not reported for XML files in hthor
HPCC-10181 Add Compile Time to WUQueryDetails response
HPCC-9722 DOCS:Non-Windows Client Tools
HPCC-9521 Refactor CDfsLogicalFileName to make it purely representational of
a logical file, avoid it resolving/looking up
HPCC-10175 Remove Roxie test page option from HPCC Platform
HPCC-10093 Read compressed file size from DFU attributes
HPCC-9547 packagemap-validate warning when library redefines query files
HPCC-10028 removeEntry() should pass the error message to the caller
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10113 Dedup RHS if keep and no atmost/abortlimit
HPCC-9870 Docs:JVM Settings
HPCC-10127 Configmgr - Location section missing in esp.xml
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10157 DOCS: Language Reference Links
HPCC-10015 Add WUID wildcard search for WUQuery
HPCC-10034 Move all JSON validation and pretty printing to client side
HPCC-9404 Test DEDUP, KEEP(RIGHT)
HPCC-10134 LogicalToPhysical file was not working
HPCC-9982 Jobs run on hthor should fail if they need to rebuild a thor persist
HPCC-10108 No way to disable quote processing and use the CSV quick partitioning
HPCC-10149 Fix regression test, and check for KEEP(1), LIMIT(n)
HPCC-8902 #workunit ('cluster', 'xxx') not supported by eclccserver
HPCC-10108 No way to disable quote processing and use the CSV quick partitioning
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10161 Add option in eclagent to force persist rebuilds, for debugging
HPCC-10160 EclAgent core if PERSIST names invalid thor cluster
HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor
HPCC-10149 More tests, and don't optimize KEEP(1),LIMIT(n)
HPCC-8245 Ensure smartjoin test order consistent
HPCC-8245 Be careful handling stop case
HPCC-10156 Add WsTopology method ListTargetClusters
HPCC-8245 Split row-owning vs non-owning into 2 implementations
HPCC-10149 Optimize JOIN(l,r,...,t(LEFT),ATMOST(1),LEFT OUTER)
HPCC-8245 Ensure flushedRowMarkers is clear at start
HPCC-8528 Modify the code after pull request comments
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10022 Ensure duplicate persists within a query are still caught
HPCC-10153 Add PublishedBy/IsLibrary to WUListQueries response
HPCC-10074 Automate Eclipse Help
HPC-8245 Avoid deadlock potential whilst flushing
HPCC-10061 Remove duplicated test case
HPCC-10006 Stop compound aggregation of CHOOSEN with start count
HPCC-10145 Spurious warnings when git.sh fetches from remote repo
HPCC-8528 Add #!/bin/bash in install scripts
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10106 Persist should ignore other persists when determining rebuild
HPCC-9847 ECLCC crash due to dynamic record type within a MODULE
HPCC-10143 Corrections to ECL documentation
HPCC-9916 Don't allow setting daliip or sourceCluster at subfile level
HPCC-9916 Allow source DALI and ProcessCluster overide in packagemap
HPCC-9723 Add PACKAGE_FILE_NAME_PREFIX
HPCC-8528 change permission
HPCC-10061 Move test case into runtime regression suite
HPCC-10022 Option to generate a persist for each unique ECL hash
HPCC-8245 Switch to TAKsmart
HPCC-8245 Smart Lookup Join
HPCC-10031 Don't create index count if index read has ONFAIL limit
HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor
HPCC-8528 Creat/remove symbolic links with ClientTools installend/Uninstall
HPCC-10126 htpasswd Authentication Modify Users Issue
HPCC-9723 change Package name to allow multiple clienttools installed
HPCC-10106 Persist should ignore other persists when determining rebuild
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10061 Don't remove subsorts if the input has no known sort order
HPCC-10131:Add support for optional 'jvmlibpath' property in environment.conf;
add additional error checking to JVM initialization.
HPCC-10012 Add support for centos builds with -with-plugins variant
HPCC-9956 Fix build break in windows introduced by previous commit.
HPCC-10111 Add -showpaths to eclcc verbose help text
HPCC-10111 In Windows, eclcc -showpaths has mixed folder separators
HPCC-9403 fix non-default user home directory related issues
HPCC-9773 Change group variable from $user to $group in chown.
HPCC-10096 Use correct queryset name to get Activated status
HPCC-10110 Docs:ConfigMgr Roxie
HPCC-10113 Lookup join incorrectly handling KEEP(1)
HPPC-10068 Various changes following review and new test case
HPCC-9956 Reduce log file prints for pre_connect ENETUNREACH errors
HPCC-10054 Enable "Enter" to complete search and forms
HPCC-10106 Rebuild Persists if input files change, ignore other persists
HPCC-10106 Ensure the #option is always in the workunit
HPCC-10095 Help Icon Issues
HPCC-10040 Increase maxRecordSize value to avoid "End of record not found..." exception
during XML spray
HPCC-10106 Rebuild Persists if input files change, ignore other persists
HPCC-10090 Docs:VM Steps
HPCC-9481 CSV record definition auto discovery
HPCC-10068 Implement syntax for JOIN(,SMART)
HPCC-9650 Sorting fails when same column is clicked several times
HPCC-10052 Add missing stop in previous commit.
HPCC-3315 Spot cluster 'realCluster' mismatch
HPCC-9842 Add Java Samples to ECL Playground
HPCC-10097 Regression test javaembed crashing intermittently
HPCC-10083 Some slave exceptions detected too late
HPCC-10078 Not return error when calling WUQueryDetails for hthor query
HPCC-9378 Remove DISTRIBUTE from the RHS of a global lookup join
HPCC-10080 Add Activated flag to WUListQueries response
HPCC-9984 Compile direct from a version control system
HPCC-9950 Fixed typo found in code review
HPCC-9950 Clarify ecl bundle parameter docs
HPCC-10045 Remove invalid error checking from debug builds.
HPCC-8624 Ensure activities that read a logical keep lock
HPCC-10052 Fix NWayInput/NWaySelect
HPCC-10046 Optimize aggregate on single row datasets
HPCC-9833 Fix exception leaking in ESP ECLWatch service code
HPCC-10059 Add options to git hook to control time between fetches, etc
HPCC-10072 Avoid roxiemem allocator cache deadlock
HPCC-10072 Avoid roxiemem allocator cache deadlock
HPCC-9984 Compile direct from a version control system
HPCC-9975 Evaluate(module) does not like enum
HPCC-10071 Allow eclcc regression suite cores to be configured
HPCC-10070 Update needed to eclcc regression test instructions in sourcedoc.xml
HPCC-10069 Typo correction to error messages 3101 and 3124
HPCC-10066 Add missing "Open in new window" buttons
HPCC-10067 Minor JavaScript Error/Warnings
HPCC-10064 Graph Syncing Issues
HPCC-10065 Unable to open LFDetailsWidget in a new window
HPCC-10063 Hide Timing Tree Map Help on Graph View
HPCC-9034 Add Package Maps GUI to EclWatch
HPCC-9249 Revised display message based on code review
HPCC-10049 Retrieve data for displaying cumulative Roxie graphs
HPCC-10044 Rename a method based on code review
HPCC-10044 Add IsLibrary, PublishBy, etc to WUQuerysetDetails/WUQueryDetails
HPCC-10060:Improve memory and thread handling of embedded Java code
HPCC-9935 Add version number to new request item
HPCC-10043 Add option to eclcc to restrict compilation to repository
HPCC-9387 Add legacy import support to ecl publish, deploy, and run
HPCC-9460 First Name and Last Name missing from My Account user area
HPCC-9974 Add self-test option to ecl-bundle
HPCC-9955 ECL Rec Layout metadata is not reported for CSV files in hthor
HPCC-10048 Fix uninitialised variable in XREFDirectoryBuilder::getDirectory
HPCC-9489 Add support to roxie for a checking memory allocator
HPCC-9489 Add support to roxie for a checking memory allocator
HPCC-9463 Use CInterfaceOf for a hashtable base class
HPCC-10039 Prevent error messages from being truncated
HPCC-9406 Some counts missing in roxie workunit graph progress
HPCC-9364 Fix assert(mergeOrder) on stepped index read in a child query
HPCC-9853 Fix clang warning/error on precedence of &&
HPCC-9853 Fix various warnings (a couple may have revealed minor bugs)
HPCC-9800 Remove unused checkPrimaries option in Roxie
HPCC-9946 Add support for JVM settings in environment.conf
HPCC-10001 If classpath not set use default
HPCC-10042 Edits to Configmgr Doc
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-9481 CSV record definition auto discovery
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-10038 failIfNoSourceFile parameter missing in DFUPlus help text.
HPCC-10037 Word swap due to incorrect grammar
HPCC-10035 Expose compressedSize at logical file level
HPCC-9616 Add __ECL_LEGACY_MODE__ to provide information to ecl
Simplify ensure, remove need for doCacheAdd flag Remove unused/unneeded remove() and clear()
HPCC-9827 Base roxiemem allocator cache on flags as well
HPCC-10003 Update status info to indicate what is compiling
HPCC-9855 Documentation for DATASET(n,TRANSFORM())
HPCC-10000 Ensure hash values are converted to integers
HPCC-10013 Correct usage syntax of listworkunits
HPCC-9977 Document "eclcc -Me" option and add to usage
HPCC-9481 CSV record definition auto discovery
HPCC-9286 Allow multiple optional atmost conditions.
HPCC-9999 Correctly export functions so hql.dll links on windows
HPCC-9835 avoid issues with transaction actions causing crash
HPCC-9961 Expose contents of @kind DFU attribute in WsDFU/DFUInfo
HPCC-9919 Fix core accessing uncompressed workunit resources
HPCC-8867 Fill in @kind file attribute for all files
HPCC-9553 Support typedefs as the base type for ENUM definitions
HPCC-9682 Rename a method based on review
HPCC-9682 Add WsWorkunits method to return paged QuerySet Queries
HPCC-9249 Return user/IP for paused queue to WsSMC/Activity response
HPCC-9935 Add SourceFormat to ESP FileSpray/SprayFixed request
HPCC-9503 Return action results when DFU WU restored
HPCC-9905 Remove unnecessary code from the master branch
HPCC-9701 Refactor meta calculation into separate properties
HPCC-9900 DFUPlus does not support escape option for CSV spray
HPCC-9779 Add an internal option to generate the ecl for a subgraph
HPCC-9589 Remove colocal/parent extract from some child activities
HPCC-9791 XML file spray logging improvement
HPCC-9810 Add test case for transfer to/from unicode
HPCC-9589 Introduce pseudo tables flags for xml/nlp parse
HPCC-9790 Use a hash table to quickly resolve expressions
HPCC-9791 XML file spray logging improvement
HPCC-9762 Optimize COUNT(ITERATE(ds)) to COUNT(ds)
HPCC-9743 Speed up #APPEND and #LOOP processing
HPCC-9759 Remove the globalFold option (default always on)
HPCC-9610 Improve implicit projection of child queries
HPCC-9707 Correct indentation/move inline functions to main file
HPCC-9707 Ensure scalar and set datasets are always hoisted
Update BUNDLES.rst
HPCC-9252 Fix issues found with huge allocators
HPCC-9645 Fix problems with adding newAtom to selects from child rows
HPCC-9667 Don't use buildTempExpr for getresults (can clone rows)
HPCC-9640 Optimize NORMALIZE(ds, 0) and NORMALIZE(ds, 1)
HPCC-9252 Reduce the locking window when allocating rows from a heap
HPCC-9252 Avoid freeing empty pages in a heap which contains none.
HPCC-9593 Added documentation pertaining to cmake structure
HPCC-9593 Added documentation pertaining to cmake structure
HPCC-9600 Use library classes for exists and count
HPCC-9602 Avoid temporary variables when returing simple expressions
HPCC-9627 Remove unused resourcing link type
HPCC-9597 Combine multiple ds[1]. into a single row
HPCC-9607 IPropertyTree exception on using STD.System.Workunit.
HPCC-9609 Tidy up dataLinkStart calls
HPCC-9598 Generate .row as a PROJECT instead of a 1 row NORMALIZE
HPCC-9252 Improve the locking contention in roxiemem
HPCC-9592 Generate a simpler graph for IF(cond, , ds)
HPCC-9557 DFUPLUS spray: Cannot specify no quote character
HPCC-9528 Regression Suite won't work with relative suiteDir path
HPCC-9543 Fix crash caused by fix for issue 9467
HPCC-9509 Don't allow SELFJOIN,ALL to be created
HPCC-9532 Fix code generator for reading dataset from another wuid
HPCC-9504 Add README.1st file into testing/regress directory to describe how to run Regression Suite
HPCC-8237 Add options to stress test callback usage in roxiemem
HPCC-8312 Rationalise the use of property and attribute
HPCC-9455 Add eclcc documentation in rst format
HPCC-9471 Change the parameter to queryAttribute to an enum
HPCC-8515 Running standalone with dalisrvers=... has issues.
HPCC-9428 Remove @ sign from Deleting File confirmation
HPCC-9465 Fix various issues picked up in the code review
HPCC-9442 Avoid ensureCapacity call on fixed size disk read
HPPC-9465 Use the preserved case for embedded language parameters
HPCC-9465 Preserve the case of parameters for external functions
HPCC-9446 Remove legacy @slaves from stock environment
HPCC-8869 Revise based on review comments
HPCC-9467 Thor needs to provide user credentials
HPCC-8869 Refactor Eclwatch activity code
HPCC-8869 Moves the existing onActivity code into three methods
HPCC-9238 Use a record of string to display fixed length datasets
HPCC-9430 Remove incorrect active datasets for unusual cases
HPCC-9438 Fix problem with unusual joins against null datasets.
HPCC-8728 lack of info. spraying large file(s) whilst partitioning
HPCC-9411 Information needed about unloadable roxie queries
HPCC-9266 DFU server logging excessive when spraying multiple files
HPCC-9411 Information needed about unloadable roxie queries
HPCC-9218 Further DFS refactoring solving some superfile issues
Remove CCsvMatcher.
Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method.
HPCC-8316 Clean up the code to remove lots of workflow loops
HPCC-9090 Add base 64 encode/decode functions to the ecllibrary
HPCC-9248 Option to expand hash distribute and match existing distribution
HPCC-9394 Remove unsafe (but unused) code in ccdfile.cpp
HPCC-9258 Make Roxie UDP ports configurable
HPCC-9239 Generate subsort optimizations
HPCC-9324 Error handler missing after malloc() call several places in eclrtl.cpp
HPCC-8477 DFU server is CPU bound for the first phase of CSV files
Added error handler implemetation to rtlMalloc() and rtlRealloc() functions.
HPCC-9224 WsEcl support for starting workunits asynchronously
HPCC-8248 Allow frunssh to use more threads by default
HPCC-7866 Use CInterfaceOf instead of double inheritance
HPCC-9132 Improve spotting lightweight denormalize
HPCC-8770 Show eclserver in Topology/TargetCluster page
HPCC-9165 Allow XREF to run without suspending coalescer
HPCC-9174 Allow functions that extend strings to be defined
HPCC-9175 Optimize unnecessary copies of unicode strings
HPCC-3207 Clarify closedown process
Release Notes for Community Edition 4.0.6-rc1 (Release Candidate 1)
All Known Limitations for Community Edition 4.0.4-1 still apply apply.
============================================================= Comprehensive list of changes from 4.0.4-1 to 4.0.6-rc1 ============================================================= HPCC-10481 - Default Replicate dir causing problems HPCC-10372 – Fixed DeleteSuperFile possible crash
Release Notes for Community Edition 4.0.4-1
================================
Known Limitations for 4.0.4-1
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages for Centos 5 does not support embedding JavaScript.
********************************************************************************************************************** Comprehensive list of changes from 4.0.2-x to 4.0.4-1 Gold ********************************************************************************************************************** HPCC-10287 Add check for inadequencies of transaction *** Community Edition 4.0.4-rc1 Release Candidate 1 HPCC-10288 Add RemoveOwnedSubFiles HPCC-10287 Catch out of order supers when removing a subfile HPCC-9912 edits from review HPCC-9912 Edits based on code review HPCC-9941 Document FORWARD option on MODULE HPCC-9941 Document FORWARD on MODULE HPCC-9912 Edits based upon review HPCC-9912 Document LOCAL option on DATASET n TRANSFORM HPCC-9722 DOCS:Non-Windows Client Tools HPCC-9870 Docs:JVM Settings HPCC-10127 Configmgr - Location section missing in esp.xml HPCC-9870 Docs:JVM Settings HPCC-10157 DOCS: Language Reference Links HPCC-10134 LogicalToPhysical file was not working HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor HPCC-10074 Automate Eclipse Help HPCC-10012 Add support for centos builds with -with-plugins variant HPCC-10110 Docs:ConfigMgr Roxie HPCC-10090 Docs:VM Steps HPCC-10090 Docs:VM Steps HPCC-10052 Add missing stop in previous commit. HPCC-9950 Fixed typo found in code review HPCC-9950 Clarify ecl bundle parameter docs HPCC-10045 Remove invalid error checking from debug builds. HPCC-10052 Fix NWayInput/NWaySelect HPCC-10046 Optimize aggregate on single row datasets HPCC-10072 Avoid roxiemem allocator cache deadlock HPCC-10048 Fix uninitialised variable in XREFDirectoryBuilder::getDirectory HPCC-9946 Add support for JVM settings in environment.conf HPCC-10001 If classpath not set use default HPCC-10042 Edits to Configmgr Doc HPCC-9855 Documentation for DATASET(n,TRANSFORM()) HPCC-10000 Ensure hash values are converted to integers HPCC-9977 Document "eclcc -Me" option and add to usage HPCC-9835 avoid issues with transaction actions causing crash HPCC-8867 Fill in @kind file attribute for all files
Release Notes for Community Edition 4.2.0-rc2
================================
Known Limitations for 4.2.0-rc2
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
============================================================
Comprehensive list of changes from 4.0.2-2 Gold to 4.2.0-rc2
============================================================
** Community Edition 4.2.0-rc2 Release Candidate 2
HPCC-7899 Add Z.A.P button
HPCC-10290 ZAP report should distinguish compiler warnings and errors
HPCC-10273 Add logical files in query set page
HPCC-10292 ZIP from Zap has path info
HPCC-10279 esdl_srv_engine should return HTTP exceptions
HPCC-10224 Fix CSocket::name returning non terminated strings
HPCC-10270 SprayVariable has incorrect parameters
HPCC-10286 Add dependency for Ubuntu 13.10 (Saucy)
HPCC-10280 DOCS:Add ID Attribute
HPCC-10256 Add "Refresh Data" Button to Graph Page
HPCC-10283 Ensure GLOBAL(,OPT) is processed correctly inside a library
HPCC-10278 Create ZAP report feature not handling multiple logfiles
HPCC-9683 Fix performance and memory usage issue for huge dataset
HPCC-10276 Add jsonp support to WsEcl
HPCC-10237 Don't move CHOOSEN() over a grouped count project
HPCC-10265 Fix problems processing action dependencies
HPCC-10264 After publishing using a remote dali, roxie requires remote dali
HPCC-10275 "Compiled" Workunit not showing as completed
HPCC-10274 Add workunit xml file to ZAP Report zip file
HPCC-10129 DOCS:Std Lib Fix table formatting
HPCC-10240 Fix example following review feedback
HPCC-10262 Base Store cached data could "leak" between instances
HPCC-10240 Prevent a TABLE() aggregate being converted to a non aggregate
HPCC-10228 Roxie should lock subfiles, not just rely on superfile lock
HPCC-10029 Add Dictionary Example to ECL Playground
HPCC-9622 Disable failing hthor test when6b.ecl
HPCC-10253 WsWorkunits::onGet should return exceptions to the client
HPCC-10238 Remove ECLPLus interactive mode from docs
***** Community Edition 4.2.0-rc1 Release Candidate 1
HPCC-10251 Fix windows build break
HPCC-9415 Use epoll, add EPOLLRDHUP define for Centos5.x
HPCC-9918 CsvRecordSize class doesn't handle well the quoted and variable length datasets.
HPCC-9307 Allow roxie to have dependencies within a subgraph
HPCC-9415 Use epoll, fix critical section around init
HPCC-10227 Use key cache in indexread/count
HPCC-9244 Improved LOOKUP,MANY scheme
HPCC-10107 Csv auto discovery should work with utf8 files.
HPCC-10241 New ECL Watch + IE8
HPCC-9671 Add Published Query Pages
HPCC-9307 Clean up the code
HPCC-10204 Ensure that a contextClassLoader that uses the classpath is available to Java classes.
HPCC-10203 Add manifest resource support for wildcards and relative URLS
HPCC-10242 Fix preflight not working for roxie server and thor master
HPCC-10244 Fix ID tags to produce HTML version
HPCC-9906 Support DATASET(n, transform, LOCAL)
HPCC-10239 Windows Build break in WsDeploy
HPCC-9307 initial work and refactoring of action lists
HPCC-9965 Add a ,UNSTABLE flag to a JOIN
HPCC-10099 DOCS:JavaScript Embed
HPCC-9192 Doc:PackageMgmt page
HPCC-10176 Add Create Bug Report to ECL WU Details
HPCC-9882 Do not check the return from removeEntry()
HPCC-10174 Add Remote Dali Option
HPCC-10140 Edits based on code review
HPCC-10231 KeyedJoin hitting spurious limits
HPCC-9322 Allow active name to be used with ecl-unpublish
HPCC-9976 Add banner support to new ECL Watch
HPCC-10159 Document SMART option for JOIN
HPCC-9898 ConfigMgr - Fix thor topology cluster add / del
HPCC-7899 Add "Report bug" button in eclwatch WU page
HPCC-10140 Document Virtual Logicalfilename
HPCC-10226 Document change to EXPIRE semantics
HPCC-10124 ConfigMgr - Add new components and services from buildset
HPCC-9322 Allow active name to be used with ecl-unpublish
HPCC-9947 Improve the warning for an invalid use of NOTHOR
HPCC-9968 New EXPIRE semantics
HPCC-10004 DOCS:XREF Warning
HPCC-9992 Implement __PLATFORM__ to query the target platform
HPCC-9320 Preliminary minor refactoring for using global graph results
HPCC-10169 Integrate ClientTools on Windows 32bit with Jenkins
HPCC-10222 Perform proper field validation.
HPCC-9898 ConfigMgr - delete multiple roxie servers
HPCC-10130 Set accessedTime for all files
HPCC-10055 Add Error/Warning Log for Toaster Messages
HPCC-10022 Allow the max number of persist instances to be set
HPCC-9913 Fix forcing value to bool warning in ccdquery.cpp
HPCC-10195 Remove unused m_allowHttpNil flag from CSoapPrimitiveField
HPCC-9934 Add SprayFixed Input
HPCC-10032 Add schema generator support for xpath('')
HPCC-9970 Default persist files to expiring after 14 days
HPCC-9686 Add ability to fetch named results to ESPWorkunit
HPCC-9803 New ECL Watch does not support existing visualisations
HPCC-10021 ConfigMgr - Allow esp service to target a default cluster
HPCC-9812 Ability to spray from any source in new ECL Watch
HPCC-9966 Graph control disappears when switching HTML tabs
HPCC-10146 Job status when blocked
HPCC-9882 Check and return exception message from removeEntry()
HPCC-10188 Rename Properties to attributes for consistency
HPCC-10053 Display "busy" indicator on multi search
HPCC-7898 Link release notes
HPCC-10121 Match with the settings created by pull request #4952
HPCC-10121 Fix merge conflict
HPCC-9861 Fix ECL regeneration of functions with multiple calls.
HPCC-10196 Suggested improvement of for cpan mod installations
HPCC-10147 Add comments to examples to indicate the expected errors
HPCC-10194 Handle NULL results from Java functions
HPCC-10028 removeEntry() should pass the error message to the caller
HPCC-10177 Add code to restrict the number of persist instances
HPCC-10184 Potential memory leak in uncompress routine
HPCC-10185 Graph numeric properties sort as strings
HPCC-10136 Fix ECL in FUNCTIONMACRO_Example.ecl
HPCC-9941 Document FORWARD option on MODULE
HPCC-10147 Initial implementation of JOIN(..., GROUP(x,y))
HPCC-10177 Add code to restrict the number of persist instances
HPCC-10092 Configmgr - add attribute serverForArchivedECLWU to esp
HPCC-10130 Set accessedTime for all files
HPCC-10164 Don't substitute constants into ATMOST join conditions
HPCC-10028 removeEntry() should pass the error message to the caller
HPCC-9941 Document FORWARD on MODULE
HPCC-9415 Disable by default for now
HPCC-9415 New epoll implementation with common base class
HPCC-10183 ECL Record Layout metadata is not reported for XML files in hthor
HPCC-10181 Add Compile Time to WUQueryDetails response
HPCC-9722 DOCS:Non-Windows Client Tools
HPCC-9521 Refactor CDfsLogicalFileName to make it purely representational of
a logical file, avoid it resolving/looking up
HPCC-10175 Remove Roxie test page option from HPCC Platform
HPCC-10093 Read compressed file size from DFU attributes
HPCC-9547 packagemap-validate warning when library redefines query files
HPCC-10028 removeEntry() should pass the error message to the caller
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10113 Dedup RHS if keep and no atmost/abortlimit
HPCC-9870 Docs:JVM Settings
HPCC-10127 Configmgr - Location section missing in esp.xml
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10157 DOCS: Language Reference Links
HPCC-10015 Add WUID wildcard search for WUQuery
HPCC-10034 Move all JSON validation and pretty printing to client side
HPCC-9404 Test DEDUP, KEEP(RIGHT)
HPCC-10134 LogicalToPhysical file was not working
HPCC-9982 Jobs run on hthor should fail if they need to rebuild a thor persist
HPCC-10108 No way to disable quote processing and use the CSV quick partitioning
HPCC-10149 Fix regression test, and check for KEEP(1), LIMIT(n)
HPCC-8902 #workunit ('cluster', 'xxx') not supported by eclccserver
HPCC-10108 No way to disable quote processing and use the CSV quick partitioning
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10161 Add option in eclagent to force persist rebuilds, for debugging
HPCC-10160 EclAgent core if PERSIST names invalid thor cluster
HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor
HPCC-10149 More tests, and don't optimize KEEP(1),LIMIT(n)
HPCC-8245 Ensure smartjoin test order consistent
HPCC-8245 Be careful handling stop case
HPCC-10156 Add WsTopology method ListTargetClusters
HPCC-8245 Split row-owning vs non-owning into 2 implementations
HPCC-10149 Optimize JOIN(l,r,...,t(LEFT),ATMOST(1),LEFT OUTER)
HPCC-8245 Ensure flushedRowMarkers is clear at start
HPCC-8528 Modify the code after pull request comments
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10022 Ensure duplicate persists within a query are still caught
HPCC-10153 Add PublishedBy/IsLibrary to WUListQueries response
HPCC-10074 Automate Eclipse Help
HPC-8245 Avoid deadlock potential whilst flushing
HPCC-10061 Remove duplicated test case
HPCC-10006 Stop compound aggregation of CHOOSEN with start count
HPCC-10145 Spurious warnings when git.sh fetches from remote repo
HPCC-8528 Add #!/bin/bash in install scripts
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10106 Persist should ignore other persists when determining rebuild
HPCC-9847 ECLCC crash due to dynamic record type within a MODULE
HPCC-10143 Corrections to ECL documentation
HPCC-9916 Don't allow setting daliip or sourceCluster at subfile level
HPCC-9916 Allow source DALI and ProcessCluster overide in packagemap
HPCC-9723 Add PACKAGE_FILE_NAME_PREFIX
HPCC-8528 change permission
HPCC-10061 Move test case into runtime regression suite
HPCC-10022 Option to generate a persist for each unique ECL hash
HPCC-8245 Switch to TAKsmart
HPCC-8245 Smart Lookup Join
HPCC-10031 Don't create index count if index read has ONFAIL limit
HPCC-10118 Backupnode creating unknown dir in hpcc-mirror, copy of thor
HPCC-8528 Creat/remove symbolic links with ClientTools installend/Uninstall
HPCC-10126 htpasswd Authentication Modify Users Issue
HPCC-9723 change Package name to allow multiple clienttools installed
HPCC-10106 Persist should ignore other persists when determining rebuild
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10077 Spray compressed does not set @compressedSize on file parts
HPCC-10061 Don't remove subsorts if the input has no known sort order
HPCC-10131:Add support for optional 'jvmlibpath' property in environment.conf;
add additional error checking to JVM initialization.
HPCC-10012 Add support for centos builds with -with-plugins variant
HPCC-9956 Fix build break in windows introduced by previous commit.
HPCC-10111 Add -showpaths to eclcc verbose help text
HPCC-10111 In Windows, eclcc -showpaths has mixed folder separators
HPCC-9403 fix non-default user home directory related issues
HPCC-9773 Change group variable from $user to $group in chown.
HPCC-10096 Use correct queryset name to get Activated status
HPCC-10110 Docs:ConfigMgr Roxie
HPCC-10113 Lookup join incorrectly handling KEEP(1)
HPPC-10068 Various changes following review and new test case
HPCC-9956 Reduce log file prints for pre_connect ENETUNREACH errors
HPCC-10054 Enable "Enter" to complete search and forms
HPCC-10106 Rebuild Persists if input files change, ignore other persists
HPCC-10106 Ensure the #option is always in the workunit
HPCC-10095 Help Icon Issues
HPCC-10040 Increase maxRecordSize value to avoid "End of record not found..." exception
during XML spray
HPCC-10106 Rebuild Persists if input files change, ignore other persists
HPCC-10090 Docs:VM Steps
HPCC-9481 CSV record definition auto discovery
HPCC-10068 Implement syntax for JOIN(,SMART)
HPCC-9650 Sorting fails when same column is clicked several times
HPCC-10052 Add missing stop in previous commit.
HPCC-3315 Spot cluster 'realCluster' mismatch
HPCC-9842 Add Java Samples to ECL Playground
HPCC-10097 Regression test javaembed crashing intermittently
HPCC-10083 Some slave exceptions detected too late
HPCC-10078 Not return error when calling WUQueryDetails for hthor query
HPCC-9378 Remove DISTRIBUTE from the RHS of a global lookup join
HPCC-10080 Add Activated flag to WUListQueries response
HPCC-9984 Compile direct from a version control system
HPCC-9950 Fixed typo found in code review
HPCC-9950 Clarify ecl bundle parameter docs
HPCC-10045 Remove invalid error checking from debug builds.
HPCC-8624 Ensure activities that read a logical keep lock
HPCC-10052 Fix NWayInput/NWaySelect
HPCC-10046 Optimize aggregate on single row datasets
HPCC-9833 Fix exception leaking in ESP ECLWatch service code
HPCC-10059 Add options to git hook to control time between fetches, etc
HPCC-10072 Avoid roxiemem allocator cache deadlock
HPCC-10072 Avoid roxiemem allocator cache deadlock
HPCC-9984 Compile direct from a version control system
HPCC-9975 Evaluate(module) does not like enum
HPCC-10071 Allow eclcc regression suite cores to be configured
HPCC-10070 Update needed to eclcc regression test instructions in sourcedoc.xml
HPCC-10069 Typo correction to error messages 3101 and 3124
HPCC-10066 Add missing "Open in new window" buttons
HPCC-10067 Minor JavaScript Error/Warnings
HPCC-10064 Graph Syncing Issues
HPCC-10065 Unable to open LFDetailsWidget in a new window
HPCC-10063 Hide Timing Tree Map Help on Graph View
HPCC-9034 Add Package Maps GUI to EclWatch
HPCC-9249 Revised display message based on code review
HPCC-10049 Retrieve data for displaying cumulative Roxie graphs
HPCC-10044 Rename a method based on code review
HPCC-10044 Add IsLibrary, PublishBy, etc to WUQuerysetDetails/WUQueryDetails
HPCC-10060:Improve memory and thread handling of embedded Java code
HPCC-9935 Add version number to new request item
HPCC-10043 Add option to eclcc to restrict compilation to repository
HPCC-9387 Add legacy import support to ecl publish, deploy, and run
HPCC-9460 First Name and Last Name missing from My Account user area
HPCC-9974 Add self-test option to ecl-bundle
HPCC-9955 ECL Rec Layout metadata is not reported for CSV files in hthor
HPCC-10048 Fix uninitialised variable in XREFDirectoryBuilder::getDirectory
HPCC-9489 Add support to roxie for a checking memory allocator
HPCC-9489 Add support to roxie for a checking memory allocator
HPCC-9463 Use CInterfaceOf for a hashtable base class
HPCC-10039 Prevent error messages from being truncated
HPCC-9406 Some counts missing in roxie workunit graph progress
HPCC-9364 Fix assert(mergeOrder) on stepped index read in a child query
HPCC-9853 Fix clang warning/error on precedence of &&
HPCC-9853 Fix various warnings (a couple may have revealed minor bugs)
HPCC-9800 Remove unused checkPrimaries option in Roxie
HPCC-9946 Add support for JVM settings in environment.conf
HPCC-10001 If classpath not set use default
HPCC-10042 Edits to Configmgr Doc
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-9481 CSV record definition auto discovery
HPCC-9984 Compile direct from a version control system
HPCC-9984 Compile direct from a version control system
HPCC-10038 failIfNoSourceFile parameter missing in DFUPlus help text.
HPCC-10037 Word swap due to incorrect grammar
HPCC-10035 Expose compressedSize at logical file level
HPCC-9616 Add __ECL_LEGACY_MODE__ to provide information to ecl
Simplify ensure, remove need for doCacheAdd flag Remove unused/unneeded remove() and clear()
HPCC-9827 Base roxiemem allocator cache on flags as well
HPCC-10003 Update status info to indicate what is compiling
HPCC-9855 Documentation for DATASET(n,TRANSFORM())
HPCC-10000 Ensure hash values are converted to integers
HPCC-10013 Correct usage syntax of listworkunits
HPCC-9977 Document "eclcc -Me" option and add to usage
HPCC-9481 CSV record definition auto discovery
HPCC-9286 Allow multiple optional atmost conditions.
HPCC-9999 Correctly export functions so hql.dll links on windows
HPCC-9835 avoid issues with transaction actions causing crash
HPCC-9961 Expose contents of @kind DFU attribute in WsDFU/DFUInfo
HPCC-9919 Fix core accessing uncompressed workunit resources
HPCC-8867 Fill in @kind file attribute for all files
HPCC-9553 Support typedefs as the base type for ENUM definitions
HPCC-9682 Rename a method based on review
HPCC-9682 Add WsWorkunits method to return paged QuerySet Queries
HPCC-9249 Return user/IP for paused queue to WsSMC/Activity response
HPCC-9935 Add SourceFormat to ESP FileSpray/SprayFixed request
HPCC-9503 Return action results when DFU WU restored
HPCC-9905 Remove unnecessary code from the master branch
HPCC-9701 Refactor meta calculation into separate properties
HPCC-9900 DFUPlus does not support escape option for CSV spray
HPCC-9779 Add an internal option to generate the ecl for a subgraph
HPCC-9589 Remove colocal/parent extract from some child activities
HPCC-9791 XML file spray logging improvement
HPCC-9810 Add test case for transfer to/from unicode
HPCC-9589 Introduce pseudo tables flags for xml/nlp parse
HPCC-9790 Use a hash table to quickly resolve expressions
HPCC-9791 XML file spray logging improvement
HPCC-9762 Optimize COUNT(ITERATE(ds)) to COUNT(ds)
HPCC-9743 Speed up #APPEND and #LOOP processing
HPCC-9759 Remove the globalFold option (default always on)
HPCC-9610 Improve implicit projection of child queries
HPCC-9707 Correct indentation/move inline functions to main file
HPCC-9707 Ensure scalar and set datasets are always hoisted
Update BUNDLES.rst
HPCC-9252 Fix issues found with huge allocators
HPCC-9645 Fix problems with adding newAtom to selects from child rows
HPCC-9667 Don't use buildTempExpr for getresults (can clone rows)
HPCC-9640 Optimize NORMALIZE(ds, 0) and NORMALIZE(ds, 1)
HPCC-9252 Reduce the locking window when allocating rows from a heap
HPCC-9252 Avoid freeing empty pages in a heap which contains none.
HPCC-9593 Added documentation pertaining to cmake structure
HPCC-9593 Added documentation pertaining to cmake structure
HPCC-9600 Use library classes for exists and count
HPCC-9602 Avoid temporary variables when returing simple expressions
HPCC-9627 Remove unused resourcing link type
HPCC-9597 Combine multiple ds[1]. into a single row
HPCC-9607 IPropertyTree exception on using STD.System.Workunit.
HPCC-9609 Tidy up dataLinkStart calls
HPCC-9598 Generate .row as a PROJECT instead of a 1 row NORMALIZE
HPCC-9252 Improve the locking contention in roxiemem
HPCC-9592 Generate a simpler graph for IF(cond, , ds)
HPCC-9557 DFUPLUS spray: Cannot specify no quote character
HPCC-9528 Regression Suite won't work with relative suiteDir path
HPCC-9543 Fix crash caused by fix for issue 9467
HPCC-9509 Don't allow SELFJOIN,ALL to be created
HPCC-9532 Fix code generator for reading dataset from another wuid
HPCC-9504 Add README.1st file into testing/regress directory to describe how to run Regression Suite
HPCC-8237 Add options to stress test callback usage in roxiemem
HPCC-8312 Rationalise the use of property and attribute
HPCC-9455 Add eclcc documentation in rst format
HPCC-9471 Change the parameter to queryAttribute to an enum
HPCC-8515 Running standalone with dalisrvers=... has issues.
HPCC-9428 Remove @ sign from Deleting File confirmation
HPCC-9465 Fix various issues picked up in the code review
HPCC-9442 Avoid ensureCapacity call on fixed size disk read
HPPC-9465 Use the preserved case for embedded language parameters
HPCC-9465 Preserve the case of parameters for external functions
HPCC-9446 Remove legacy @slaves from stock environment
HPCC-8869 Revise based on review comments
HPCC-9467 Thor needs to provide user credentials
HPCC-8869 Refactor Eclwatch activity code
HPCC-8869 Moves the existing onActivity code into three methods
HPCC-9238 Use a record of string to display fixed length datasets
HPCC-9430 Remove incorrect active datasets for unusual cases
HPCC-9438 Fix problem with unusual joins against null datasets.
HPCC-8728 lack of info. spraying large file(s) whilst partitioning
HPCC-9411 Information needed about unloadable roxie queries
HPCC-9266 DFU server logging excessive when spraying multiple files
HPCC-9411 Information needed about unloadable roxie queries
HPCC-9218 Further DFS refactoring solving some superfile issues
Remove CCsvMatcher.
Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method.
HPCC-8316 Clean up the code to remove lots of workflow loops
HPCC-9090 Add base 64 encode/decode functions to the ecllibrary
HPCC-9248 Option to expand hash distribute and match existing distribution
HPCC-9394 Remove unsafe (but unused) code in ccdfile.cpp
HPCC-9258 Make Roxie UDP ports configurable
HPCC-9239 Generate subsort optimizations
HPCC-9324 Error handler missing after malloc() call several places in eclrtl.cpp
HPCC-8477 DFU server is CPU bound for the first phase of CSV files
Added error handler implemetation to rtlMalloc() and rtlRealloc() functions.
HPCC-9224 WsEcl support for starting workunits asynchronously
HPCC-8248 Allow frunssh to use more threads by default
HPCC-7866 Use CInterfaceOf instead of double inheritance
HPCC-9132 Improve spotting lightweight denormalize
HPCC-8770 Show eclserver in Topology/TargetCluster page
HPCC-9165 Allow XREF to run without suspending coalescer
HPCC-9174 Allow functions that extend strings to be defined
HPCC-9175 Optimize unnecessary copies of unicode strings
HPCC-3207 Clarify closedown process
HPCC VM Image with Virtual Box
When importing the 32-bit or 64-bit HPCC VM Image into Virtual Box on a Windows machine, you must open up the network settings before you start the VM due to an issue with network adapters
After importing the Image, open the Settings for the Image. Navigate to Network settings and select the tab for Adapter 2.
Verify the following settings:
- Enable Network Adapter is checked
- Attached to: Host-only Adapter
- Name: VirtualBox Host-Only Ethernet Adapter
Make sure that the Name for Adapter 2 changes from 'vboxnet0' to 'VirtualBox Host-Only Ethernet Adapter'
Once confirmed, press the OK button and start the VM.
Release Notes for Community Edition 4.0.2-2 and 4.0.2-1
================================
Known Limitations for 4.0.2
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
- The RPM-based installation packages do not have the supporting plug-in for JavaScript support. This will be resolved in the next release. JavaScript support is present in the installation packages for other distros and in the VM.
============================================================
Comprehensive list of changes from 4.0.0-9 to 4.0.2-2 Gold
============================================================
Community Edition 4.0.2-2 Gold
HPCC-10010 Set uninitialized stopped flag
HPPC-10010 Fix race condition in multicore join helper
Community Edition 4.0.2-1
HPCC-9250 XPATH can no longer be ambiguous
Community Edition 4.0.2-rc3 Release Candidate 3
HPCC-9349 HTTPCALL still failing due to missing line in commit
HPCC-9940 Remove invalid consistency check code (only affected debug)
HPCC-9904 ensure detach checks if allowed to delete file
HPCC-9930 Updated list of dependencies for installing from source
HPCC-9938 Spelling & Grammar in Documentation
HPCC-9909 Typos in compiler error messages
Community Edition 4.0.2-rc2 Release Candidate 2
HPCC-9879 Fix cores with unicode find strength functions on null strings
HPCC-9902 Use the build version as the ecl version reported by eclcc
HPCC-9933 Bundle tool does not properly support multi-file bundles
HPCC-9867 CSV spray incorrectly splitting records with nested quotes
Remove CCsvMatcher.
Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method.
HPCC-8477 DFU server is CPU bound for the first phase of CSV files
HPCC-9893 Fix core caused by invalid inline dataset syntax
HPCC-9924 Avoid timeout causing HD resend
HPCC-9901 Generic Filter Widget
HPCC-9905 Fix problems with embeded functions returning datasets
HPCC-8844 Document LOCAL keyword
Community Edition 4.0.2-rc1 Release Candidate 1
HPCC-9337 --source-process option to specify where to copy data from
HPCC-9900 DFUPlus does not support escape option for CSV spray
HPCC-9915 Fix missing export declaration from new function
HPCC-9897 Bundles should have a method to indicate minimum platform version
HPCC-9841 Deleting files from cluster other than original fails
HPCC-9910 Undefined symbol with dictionary using INTEGER type
HPCC-9881 Add default context menu support
HPCC-9763 Use newly generated UNORDERED flag for join helper
HPCC-9746 Don't match expressions to constant transform values.
HPCC-9897 Bundles should have a method to indicate minimum platform version
HPCC-9869 Make packages easier to manage on multiple targets
HPCC-9869 check id parameter to getPckageMapById
IDE-305 Missing parameter in documentation for Std.Str.SplitWords()
HPCC-9837 EVALUATE topic in Lang Ref has "See Also" references that are not links
HPCC-9380 Document STD Library fileservices LogicalFileList param
HPCC-9891 Generate meta info even if syntax errors
HPCC-9883 OSX RPATH Fixing for Plugins
HPCC-9890 Dynamic loading assumes .so extension (so can fail on OSX)
HPCC-9874 Improve WsEcl JSON formatting for xml types used by ECL
HPCC-9864 Does not pull data from buddy nodes
HPCC-9884 Roxie does not copy files from remote if local orphan exists
HPCC-9841 Deleting files from cluster other than original fails
HPCC-9651 Move Timings TreeMap to new Graphs list
HPCC-9869 Add support for explicitly using packagemaps shared globally
HPCC-9869 Make packages easier to manage on multiple targets
HPCC-9860 Avoid holding session crit whilst destroying subs
HPCC-9858 Split out the embed catch tests
HPCC-9821 Allow raw HTML + JavaScript in result cells
HPCC-9840 Allow "Open in New Page" for each details page.
HPCC-9854 Enable prototyping in JSBin
HPCC-9857 Configmr - Crashes if referencing a missing HW node
Release Notes for Community Edition 4.0.2-rc2 (Release Candidate 2)
================================
Known Limitations for 4.0.2-rc2
================================
Note: The following issues do not affect deb-based systems.
- On rpm-based systems, if you have any version of HPCC Platform prior to 4.0.0-rc10 installed, you must first manually uninstall (using rpm -e) before attempting to upgrade.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
============================================================
Comprehensive list of changes from 4.0.0-9 to 4.0.2-rc2
============================================================
Community Edition 4.0.2-rc2 Release Candidate 2
HPCC-9879 Fix cores with unicode find strength functions on null strings
HPCC-9902 Use the build version as the ecl version reported by eclcc
HPCC-9933 Bundle tool does not properly support multi-file bundles
HPCC-9867 CSV spray incorrectly splitting records with nested quotes
Remove CCsvMatcher.
Move bool processFullBuffer from member of class to parameter list of getSplitRecordSize() method.
HPCC-8477 DFU server is CPU bound for the first phase of CSV files
HPCC-9893 Fix core caused by invalid inline dataset syntax
HPCC-9924 Avoid timeout causing HD resend
HPCC-9901 Generic Filter Widget
HPCC-9905 Fix problems with embeded functions returning datasets
HPCC-8844 Document LOCAL keyword
Community Edition 4.0.2-rc1 Release Candidate 1
HPCC-9337 --source-process option to specify where to copy data from
HPCC-9900 DFUPlus does not support escape option for CSV spray
HPCC-9915 Fix missing export declaration from new function
HPCC-9897 Bundles should have a method to indicate minimum platform version
HPCC-9841 Deleting files from cluster other than original fails
HPCC-9910 Undefined symbol with dictionary using INTEGER type
HPCC-9881 Add default context menu support
HPCC-9763 Use newly generated UNORDERED flag for join helper
HPCC-9746 Don't match expressions to constant transform values.
HPCC-9897 Bundles should have a method to indicate minimum platform version
HPCC-9869 Make packages easier to manage on multiple targets
HPCC-9869 check id parameter to getPckageMapById
IDE-305 Missing parameter in documentation for Std.Str.SplitWords()
HPCC-9837 EVALUATE topic in Lang Ref has "See Also" references that are not links
HPCC-9380 Document STD Library fileservices LogicalFileList param
HPCC-9891 Generate meta info even if syntax errors
HPCC-9883 OSX RPATH Fixing for Plugins
HPCC-9890 Dynamic loading assumes .so extension (so can fail on OSX)
HPCC-9874 Improve WsEcl JSON formatting for xml types used by ECL
HPCC-9864 Does not pull data from buddy nodes
HPCC-9884 Roxie does not copy files from remote if local orphan exists
HPCC-9841 Deleting files from cluster other than original fails
HPCC-9651 Move Timings TreeMap to new Graphs list
HPCC-9869 Add support for explicitly using packagemaps shared globally
HPCC-9869 Make packages easier to manage on multiple targets
HPCC-9860 Avoid holding session crit whilst destroying subs
HPCC-9858 Split out the embed catch tests
HPCC-9821 Allow raw HTML + JavaScript in result cells
HPCC-9840 Allow "Open in New Page" for each details page.
HPCC-9854 Enable prototyping in JSBin
HPCC-9857 Configmr - Crashes if referencing a missing HW node
Release Notes for Community Edition 4.0.0-9
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-8 to 4.0.0-9 ======================================== HPCC-9769 Java embed not working on Centos5
Release Notes for Community Edition 4.0.0-8
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-6 to 4.0.0-8 ======================================== HPCC-9839 Fix regression failing to check crcResources option HPCC-9802 Add exception release HPCC-9802 Delete logical file using removeEntry(), not detach() HPCC-9828 Resolve package watcher notification/reload deadlock
Release Notes for Community Edition 4.0.0-6
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-5 to 4.0.0-6 ======================================== HPCC-9771 Configmgr - crashes when deleting 'null' roxie server HPCC-9795 Roxie needs to figure out numChannels
Release Notes for Community Edition 4.0.0-5
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-4 to 4.0.0-5 ======================================== HPCC-9784 - Fix workunit output limit regression
Release Notes for Community Edition 4.0.0-4
All Known Limitations in 4.0.0-1 are still valid
======================================== Changes from 4.0.0-1 to 4.0.0-4 ======================================== HPCC-9745 Add getDaliServers() back into the ICodeContext
Release Notes for Community Edition 4.0.0-1
================================
Known Limitations for 4.0.0-1
================================
- If you are embedding source code for a case-sensitive language, such as R, you must pass your variables as all lowercase in your code. (even though ECL is case-insensitive.)
- If you are installing bundles from a compressed file (such as zip or .tgz) on a Mac, you must first extract the files.
- You cannot have multiple versions of Client Tools installed on a Linux machine.
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/4.0.0/clienttools/bin
- When running the VM image in VMware player, it may display an incorrect IP address for ECL Watch. If that does occur, login to the VMware shell using the default credentials (user:hpccdemo) and use the ifconfig command to see the actual IP address for the eth1 adapter. Enter that address (adding :8010 for the port) in your browser and ECL IDE.
Note: The following issues do not affect deb-based systems.
- For RPM based systems, you must first uninstall any previous versions before installing Community Edition 4.0.0.
- For RPM based systems, there are two different installation packages available. One package includes the optional plug-ins to support embedded code from other languages, such as JAVA, JavaScript, R, or Python.
- If you do not want support for other languages, choose the package for your distro that begins with
hpccsystems-platform_community-
- If you want support for other languages, choose the package for your distro that begins with:
hpccsystems-platform_community-with-plugins-
You must install the packages that have the plug-ins using the --nodeps option. Then you will have to install the dependencies for each language you wish to support. The dependencies to support each language are installed separately.
The optional plug-ins are:Python : pyembed JAVA : jniembed JavaScript : v8embed R : Rembed
- If you do not want support for other languages, choose the package for your distro that begins with
============================================================
Comprehensive list of changes from 3.10.x to 4.0.0-1
============================================================
HPCC-9050 Need to update the helper version number since incompatible
HPCC-9050 Allow ROLLUP condition to selectively use rolled up row for LEFT
HPCC-9063 Fix regression handling non dynamic filenames in roxie
HPCC-9045 WSFileIO is not accessible by non-admin users
HPCC-9061 Invalid "context" qualifier
HPCC-9056 Build break in thor (Windows)
HPCC-8597 Update Replace Master
HPCC-9058 Temporarily disable failing tests in thor
HPCC-8990 Regression suite failures with no active dali connection available
HPCC-9015 Restore previous ROLLUP semantics
HPCC-9047 Replace 'children' property with 'childNodes' in javascript
HPCC-8597 Update Replace Master
HPCC-9012 Minimum version of python changed to 2.6
HPCC-8953 Add roxie support for JSON/HTTP queries
HPCC-9014 Roxie Manual Correction
Add missing ENVIRONMENT_API
HPCC-9042 Correct Rembed using incorrect variable for found
HPCC-9041 Quotes around R_INCLUDE_DIRS causing issue with cmake<2.8.8
HPCC-9024 Fix FindR.cmake when related to Rembed plugin
HPCC-8954 Update Spray CSV
HPCC-8797 Configmgr - Guard against special characters in Comp Names
HPCC-9036 Remove "Legacy" pages
HPCC-9035 Support NAS flat configuration
HPCC-9015 Restore previous ROLLUP semantics
Ensure no overflow when calculating fpos
HPCC-9026 Pull distributor restart issues
HPCC-8981 ConfigMgr - Add NAS Translation to Hardware
HPCC-8954 Update Spray CSV
HPCC-8992 Various problems in key sampling used by merge
HPCC-9021 Non-locking mode for single-node / dev roxies
HPCC-9027 Roxie file handle errors
HPCC-9028 Roxie not handling OPT flag correctly on dynamically-resolved files
HPCC-9029 Roxie can core if write to file when no workunit
HPCC-8955 Document changes to "packagemap validate"
HPCC-8999 Move new Features in ECL Watch
HPCC-8954 Update Spray CSV
HPCC-8788 Require Python 2.7 to build pyembed
HPCC-9016 Centos 5 build error finding R libraries
HPCC-9000 Variable length record display issues
HPCC-8954 Update Spray CSV
HPCC-9010 Check query tree branch before using it
HPCC-9011 Check user object before checking its password expiration
HPCC-8887 Text running too close to table border in Graph window
HPCC-8539 Add configuration option to specify dali client MP port range
IDE-246 Add warning to getECLPluginDefinition
HPCC-9003 Check inside expression attributes for evaluation in thor.
HPCC-8991 STEPPED is supported by thor so remove the error
HPCC-8850 enhance package validation to check for files that aren't mapped
HPCC-8954 Update Spray CSV
HPCC-8792 Log disk space at thor startup
HPCC-8864 Add comment/code clearup
HPCC-7928 Ensure each branch of a SEQUENTIAL is independent
HPCC-8981 Configmgr - nicSpeed missing in Computer Types
HPCC-8797 Configmgr - Guard against special characters in Comp Names
HPCC-8761 Revise based on review
HPCC-8662 Configmgr - Add NAS translation to Hardware
HPCC-8981 Configmgr - nicSpeed missing in Computer Types
HPCC-8764 Ensure temps don't clash if sharing filing system
Correct return type
HPCC-8909 Avoid thor recycling if registration error detected
HPCC-8909 Throw error if Thor slaves and master have different build versions
HPCC-8977 Clean Warning in mime.cpp
HPCC-8761 Add HTTP 304 support to HTTP requests
HPCC-8053 Superfile lock contention causing superfile corruption
HPCC-8987 MoveExternalFile error misleading
HPCC-2695 More clang warnings
HPCC-8352 Remove out of date export declarations
HPCC-8809 LdapPassword needs new splash page after
HPCC-8888 Rename Spray CSV to Spray Variable in EclWatch display
HPCC-8984 WU With target of "compile" is not marked as completed
HPCC-7946 CATCH(expr,msg) won't compile
HPCC-8765 Plugin cmake macros to clean up optional plugins
HPCC-8849 QuerySet action commands should verify query exists
HPCC-8900 cli should allow wu compile state of compiled or completed
HPCC-8926 Fix ecl-queries still using queryset instead of target
HPCC-7946 CATCH(expr,msg) won't compile
Add an assert to ensure limit is <=32bit
HPCC-2998 Move helper to thorcommon and delete unused class
HPCC-8978 Issues with SOAPCALL in child queries.
HPCC-2998 Remove getRecordSize(NULL) from result reading
HPCC-219 Remove unused function (with incorrect hold parameter)
HPCC-8765 Plugin cmake macros to clean up optional plugins
HPCC-8976 Fix suspect code in CSocket::write_multiple
HPCC-8669 Extend NAS mapping options
HPCC-8973 Fix build break with huge page support
HPCC-8080 Correction of command line argument handling
HPCC-2998 Some calls to getRecordSize(NULL) remain
HPCC-8586 Remove code that tries to percolate maxlength when projecting
HPCC-2998 Some calls to getRecordSize(NULL) remain
HPCC-8877 Show WU state on Activity page
HPCC-8969 Enforce an absolute hard limit on dali results
HPCC-8665 Fix the types of link counted arguments to out of line functions
HPCC-8971 Optimize SEQUENTIAL of a single action.
HPCC-8865 Document Escape Character in SprayVariable ECL library function
HPCC-8843 Incorrect argument named in docs for Std.File.CreateSuperFile
HPCC-219 Not reporting errors due to locked files
HPCC-8964 Don't generate a JFindexfromactivity keyed join for thor
HPCC-8928 Optimize a few minor uses of NOT(expression)
HPCC-8966 Provide a context for GetGlobalUniqueIds
HPCC-8960 Uninitialized variable in dadfs (rename physical)
HPCC-8934 Minor changes following code review
HPCC-8957 Compressed files being published with incorrect crc
HPCC-8932 workunits are incompatible, so increase the version number
HPCC-8816 Show 'Delete Query' result and redirect to QuerySet
HPCC-8951 Incorrect extension for proxy plugins
HPCC-8932 Move getMinRecordSize() to IRecordSize
HPCC-8950 Control:activeQueries crashes a stand alone roxie server instance
HPCC-8951 Incorrect extension for proxy plugins
HPCC-8918 Payload syntax => should work the same for indexes
HPCC-8949 Ecl packagemap add needs to add each package one time
HPCC-8948 Allow 'slaveDaliClient' as job option
HPCC-8934 Add support for huge pages to roxiemem
HPCC-8937 Add a flag to skip existing superfile check
hpcc-8905 Fix minisort OOM and deadlock
HPCC-8925 XMLDECODE decodes & to nothing
HPCC-3155 RemotePull.xml
HPCC-8939 Fix problems with IN ('a','b')
hpcc-8905 Fix minisort OOM and deadlock
HPCC-8944 Add missing case entry for record calculation
HPCC-8828 Add new metrics to Roxie
hpcc-8930 Child graph could have missing progress data
HPCC-8352 Move DBZaction into eclrtl and more cleaning up
HPCC-8683 Problems with PLUGIN attribute on a service definition
HPCC-2678 Document NOFOLD
HPCC-8036 Java/Python language support in ECL
HPCC-8435 Clean up hierarchy of PTreeReader init and reset methods
HPCC-8352 Update comments to clarify the code
HPCC-8559 Remove legacy thor support
HPCC-8352 Allow divide by zero action to be configured
HPCC-8897 Pass cacheHint to use paged cache when querying workunits
HPCC-8184 Add calls to Roxie to bypass dafilesrv for network attached storage
HPCC-8927 Lazy open should default to smart mode
HPCC-8629 Document ESP HTPASSWD
HPCC-3155 Std.File.RemotePull compression docs
HPCC-8910 Rename EclWatch Copy URL menu to View URL
HPCC-8828 Add new metrics to Roxie
HPCC-8924 Prevent simple recursive computerTypes causing stack faults
HPCC-8186 Generate precompiled header at eclccserver startup time
HPCC-8923 Roxie not checking workunit version matches
HPCC-8922 Fix problems casting constant decimals to booleans
HPCC-8861 Refactor LogicalFiles
HPCC-8913 Remove a deprecated and unused IResultSet interface
HPCC-8562 Remove some redundant #options
HPCC-8418 Fix Schema for sets with xpaths 'name' and 'name/'
HPCC-8562 Remove TAKrawiterator - no longer generated
HPCC-8562 Fix error generating a SERIALIZE/DESERIALIZE activity
HPCC-8562 Always enable linked counted rows
HPCC-8562 Remove a couple more options
HPCC-8562 Refactor out a couple more options
HPCC-8562 Always support LCR and used LCR for temporaries
HPCC-8562 Remove support for legacy thor from the code generator
HPCC-8549 Document all the DICTIONARY syntax changes. more edits
HPCC-8418 Schema generation should ignore xpaths that are too long
HPCC-8901 Add priorityValue to the workunit information
HPCC-8898 #EXPORT not handling decimal types correctly
HPCC-8729 Improve workunit iterator efficiency
HPCC-8435 PTree Reader interface names should not reference XML
HPCC-8811 Revise based on review comments
HPCC-8435 Common up JSON and XML Pull Parser code
HPCC-8435 Implement JSON Pull Parser and PTree creation
HPCC-8549 Document all the DICTIONARY syntax changes. Edits
HPCC-8627 Add new ESP HTPASSWD style MD5 authentication
Cache and reuse postfilter
HPCC-8482 Remove unreachable code
HPCC-8862 Add support for csv escape characters to sprayVariable
HPCC-8585 Ensure Priority is cloned into the workunit
HPCC-8892 Error on key build, with excessively large key+payload
HPCC-8811 Return WUIDs in WsWorkunits/WUResubmit soap response
HPCC-8549 Document all the DICTIONARY syntax changes.
HPCC-8543 Document the new { default(value) } attribute on a field
HPCC-8882 Provide rudimentary documentation for eclrtl and thorhelper
HPCC-8895 DICTIONARY should keep first row with a given key
Add results of postfilter to cache.
HPCC-8896 Dict_keyed test failing regression suite in translation mode
HPCC-8882 Move commonext into thorhelper and thorutil
HPCC-8882 Switch use using the Roxie macros and remove a cloned class
HPCC-8882 Make eclrtl depend on roxiemem and remove row callback
HPCC-8882 Common up and clean up rowset releasing code.
HPCC-8482 Delay reporting errors in field mappings until actually used
HPCC-8891 ECLPlayground broken
HPCC-8810 Generate an RtlDictionaryTypeInfo for dictionary fields
HPCC-8556 Refactor const char * query functions from helpers
HPCC-8882 Remove unused dependencies from eclcc
HPCC-8882 Remove unnecessary XXX_API qualifiers
HPCC-8882 Add const to some addCluster() arguments
HPCC-8882 Add a dependency from thorhelper to dalibase
HPCC-8890 Avoid early abort losing original error
HPCC-8555 reinstate getOptInt from mismerge
HPCC-8886 Update dojo to 1.8.3
HPCC-8882 Clean up source following review
HPCC-8882 Merge roxiehelper into thorhelper
HPCC-8882 Remove unused dependency or roxiehelper on dalibase
HPCC-8882 Use the roxie class for an owned row in the stepping code
HPCC-8882 Move workflow.cpp from eclrtl.so to workunit.so
HPCC-8881 Move roxierow into thorhelper dll
HPCC-8878 Improve the error message if MAXLENGTH is too small
HPCC-8638 Update the regression test cases
HPCC-8638 Allow the internal CSV buffer to dynamically resize
HPCC-8870 Fix a minor possibility of corrupting memory in csv unquoting
HPCC-8806 Rename Delete Query to Deactivate on Queries Active tab
HPCC-8860 Ecl packagemap needs to return an error for invalid dali ip
HPCC-8760 Revise one more time
HPCC-8863 Fix cores generating independent dictionaries.
HPCC-8583 Make ESPWorkunit a singleton to support MVC paradigm
HPCC-2839 Separate Package Validation warnings from erors
HPCC-2839 Command line tool to validate package content
HPCC-8555 Rationalise ICodeContext and remove legacy functions
HPCC-8554 Combine derived helpers that are split into multiple interfaces
HPCC-8840 Internal error on STORED dictionary
HPCC-8836 Core on stored dataset with child dictionary
HPCC-8589 Add tests for dictionary in key payload in keyed join
HPCC-8839 Include sizes in key-row size error message
HPCC-8873 Fix archive instructions
HPCC-8819 Allow LOCAL to prefix a definition (like SHARED/EXPORT)
HPCC-8661 Add support for DICTIONARYs in the payload of a key
HPCC-8745 Implement inline dictionaries as compile time constants
HPCC-8834 Package base resolutions should not depend on declaration order
HPCC-8760 Revise based on review
HPCC-8826 Build errors on java plugin in EE build
HPCC-8743 Implement dictionary support in Thor
HPCC-8492 INDEPENDENT on dataset with child dictionary gives internal error
HPCC-8824 Remove compile warning reported from gcc
HPCC-8821 Don't optimize 1 character compare on ebcdic strings
HPCC-8789 Pausenow could fail to abort and lose spills
HPCC-8760 Upgrade ESP to upload multiple files per http request
HPCC-8486 Optimize DICTIONARY(null-dataset)
HPCC-8564 Added override settings for nproc to limits.conf
HPCC-8490 Can't convert dictionary to dataset in output spec
HPCC-8794 Handle ESP Exceptions
HPCC-8726 Fix regression errors on KEYED(key-field in )
HPCC-8790 Reversed sequence and maturity in stageVer var
HPCC-8783 Refactor and split ccdserver.cpp
HPCC-8735 Avoid seperate call to fetch total # workunits
HPCC-8814 OUTPUT(dictionary) was not working
HPCC-8815 Remove deserializer from getDictionaryResult
HPCC-8813 The test aggsqx3.ecl key is out of date
HPCC-8727 ONCE dictionaries should not be serialized to the slaves
HPCC-8744 Optimize dictionary lookups of single fixed length fields
HPCC-8807 Implement typedefs for dictionary and datasets
HPCC-8808 Fix issues with truncation of lookup values
HPCC-8808 Fix issues with truncation of lookup values
HPCC-8802 Implement RECORDOF(dictionary)
Modify (void ** &)rows to *(void ***)(&rows)
HPCC-8787 Refresh Page with a Invalid Hash String
HPCC-8748 Start treating constant rows as link counted
HPCC-8795 WU Query Page Add Context Menu
HPCC-8608 Remove FilesBaseDN reference
HPCC-8785 Distinguish between local execute and local data acts
HPCC-8786 Graph "Advanced/Show SVG" broken
HPCC-8465 Implement THISNODE(dictionary) and serialize to slaves
HPCC-8498 In roxiemem, check that pointer being linked/released is in the heap
HPCC-8781 Improved ONCE handling for roxie/hthor
HPCC-8608 Remove FilesBaseDN reference
HPCC-8727 ONCE dictionaries should not be serialized to the slaves
HPCC-8775 Remove duplicate definition of prototypeAtom
HPCC-8774 Always defined type_t as an enum
HPCC-8773 Add a control:closedown command to Roxie
HPCC-8772 Fix core when serializing a row that didn't need it
HPCC-8656 Double nested datasets only show first "outer" row
HPCC-8749 Support common directory for loading java classes
HPCC-8718 Update comments to document the problem and new thinking
HPCC-8738 Delete the original embedding examples
HPCC-8739 Minor improvements to IR output for help with debugging
HPCC-8732 Core on second embedded javascript query in Roxie
HPCC-825 Change Resubmit and Restart buttons to be less confusing
HPCC-8720 Add support for SET OF simpletype to embed plugins
HPCC-8550 Spurious warnings using #option ('compileOptions')
HPCC-8720 Add support for SET OF simpletype to embed plugins
HPCC-8551 Move tests to regression suite
HPCC-8720 Add support for SET OF simpletype to embed plugins
HPCC-8723 Configmr - htpasswdFile is not set
HPCC-8720 Add support for SET OF simpletype to embed plugins
HPCC-8713 Re-instate xmlsize functionality
HPCC-8030 R/Java/JavaScript/Python language support in ECL
HPCC-8551 Fix additional issues with serialization
HPCC-8542 Ensure skew min/max present
HPPC-8551 Refactor the serialization functions
HPCC-8019 Use resizeRow to scale row tables
HPCC-8630 Configmr - Add htpasswd Option to ESP Authentication
HPCC-8567 Issues when graph control is missing
HPCC-8544 Remove deprecated DATASET syntax from regression test examples
HPCC-8289 Use allocator caching
HPCC-8626 Add new option GenerateFullFieldUsage
HPCC-8635 Logical File displays wrong contents
HPCC-8607 Add ssl support to the ecl command line tools
HPCC-8288 Cache allocators
HPCC-8567 Issues when graph control is missing.
HPCC-8621 Reinstate typedef for hash64_t when compiling on windows
HPCC-8604 Add JavaScript Layout
HPCC-8582 Add Back/Forward Support
HPCC-8197 Configmgr - Rename 'Swap Master' to 'Replace Master'
HPCC-8569 Confimgr - Adding hardware to a blank environment fails
HPCC-8518 Optimize JOIN(transform(LEFT),LEFT OUTER,LOOKUP) to PROJECT
HPCC-8544 Remove deprecated syntax DATASET
HPCC-8335 Fix more issues with DEFAULT on field
HPCC-8335 Fix example and internal error checking when cast no_null
HPCC-8335 Option on a field to control the default value
HPCC-8535 Fix cast of a string constant to very large string type
HPCC-8532 Fix meta annotations and type/scope generation in the IR
HPCC-8361 Provide a function to convert a type to IR text
HPCC-1845 Fix graph loading time Change timeout on graph control to 15 seconds
after review of 30 seconds is a configurable option and not default timeout.
HPCC-8507 Improve some xml read errors
HPCC-8497 Remove warning about unused parameter
HPCC-8361 Improvements to IR generator
HPCC-8489 Update the example to match a fix in the inline syntax
HPCC-8500 Rename variable from encryptkey to decrypt key
HPCC-8410 Fix link error compiling with visual studio
HPCC-8493 Add option to suppress roxie single-node optimizations
HPCC-8361 Fix linux compile errors
HPCC-8297 Provide a callback mechanism when resizing a row
HPCC-8361 Add support for selftest
HPCC-8489 Can't initialize child dictionary from inline spec
HPCC-8361 Initial implementation of new IR processor
HPCC-8429 Implement DATASET(dictionary)
HPCC-8426 Support DICTIONARYs created in child queries
HPCC-8410 Move daregress to CPPUNIT
HPCC-8483 Add build options to simplify coverage analysis
HPCC-8364 Move doRemove methods to files
HPCC-8457 Add hthor support for reading/writing dictionary to workunit
HPCC-7984 ECL Watch 4
HPCC-8453 Add dictionary tests to regression suite
HPCC-8457 Add hthor support for reading/writing dictionary to workunit
HPCC-8329 Dictionary support
HPCC-1845 Fix graph loading time
HPCC-8411 Improve conditonal assignments of datasets
HPCC-8196 Configmgr - Roxie 'replace' functionality not working
HPCC-8390 Renaming to MsgHeader, using struct copy
HPCC-8390 Change strategy to use inner struct
HPCC-8384 Silence most unused parameter warnings
HPCC-8390 Don't rely on offsetof
HPCC-8392 Silence silly empty body warning
HPCC-8387 Fix NULL-to-bool conversion
HPCC-8386 Fix extraneous or missing parenthesis
HPCC-8383 Add using to access declaration
HPCC-8301 DFS refactory: removal and auto-commit
HPCC-7991 Avoid uninitialized valgrind warning
HPCC-8158 Set maxCompileThreads >1 by default
HPCC-8059 Memory leaks
HPCC-7983 Avoid circular link leak for null inputs
HPCC-8310 Verify KeyedJoin,local matches index
HPCC-8278 Cache memory allocators
HPCC-3309 Ensure child graphs are executed sequentially
HPCC-8303 Allow resizeRow to indicate how much data should be copied.
HPCC-2351 Ensure APPLY actions are in separate subgraphs
HPCC-2351 Use new sequential flag for roxie graphs
HPCC-2351 Add a new sequential flag for a graph
HPCC-8279 Merge removeEntry and removePhysical
HPCC-7929 Configmr - Tooltips too long and multiples
HPCC-8228 Use countX instead of lenX for a link counted dataset parameter
HPCC-8021 Confimgr - Adding multiple ACL Access rules fails
HPCC-8050 RemoveEntry/Physical in transactions
HPCC-8181 Added more info on ecl packagemap validate from code review
HPCC-8044 Redesign WU Details Page
HPCC-8181 Add ecl packagemap validate to docs
HPCC-8066 Allow LINKCOUNTED as a better keyword for _LINKCOUNTED_
HPCC-8044 Redesign WU Details Page
HPCC-8215 Regenerate HEADING correctly instead of as HEADER
HPCC-8172 Fix build break from previous commit
HPCC-8172 CMake warning about missing file
HPCC-2966 Configmgr - Should warn if duplicate IPs assigned
HPCC-7850 Configmgr - Roxie componenet needs to have LDAP tab
HPCC-8048 Add Remove Super File to transactions
HPCC-8049 Add Rename Physical to transactions
HPCC-8072 Common up widget "stub" files
HPCC-8126 ECLPlayground Link is Broken
HPCC-8111 Revert unneeded change to esp/files/CMakelists.txt
HPCC-8077 Workunit Timings Changes
HPCC-8072 Common up widget "stub" files
HPCC-7930 Rename ecl-package to ecl-packagemap
HPCC-7867 Add timings "TreeMap" to graph web page.
HPCC-7848 Add activity and edge indexes to the graph web page
Language Reference and Standard Library Reference updates
GH-2562 Change license to Apache
GH-3235 Add new ECL Source view to ECL Watch
GH-2562 Change license to Apache
GH-3253 ECL Playground Initial Selection Blank
GH-3240 Add result view for Source Files
GH-3237 Add WU Timers TreeMap View
GH-3237 Added missing dojox files.
GH-3158 New Graph Web Page
GH-3149 DOJO 1.8
Remove setActive, add cache lookups to transaction
HPCC-9071 Language version increased to 4.0.0
HPCC-9075 Clean up unused Roxie configuration settings
HPCC-9070 False positive from dict15c test on thor
HPCC-9068 Embedded scripting plugins need to syntax check without dll
HPCC-9069 Spurious minor regression suite differences
HPCC-8022 Configmgr - Cannot make one ACL list base of another
Remove unused temporary variable
HPCC-8799 WsEcl support for JSON via HTTP-GET and FORM-ENCODED-POST
HPCC-9117 Stopping of dafilesrv generates odd message
HPCC-9088 Python errors prevent start of ESP in 4.0.0rc2
HPCC-9124 Avoid issues with out of date precompiled headers
HPCC-9113 Running workunit not refreshing tabs
HPCC-9079 Enable "Close" on tabs
HPCC-9056 Build break in thor (Windows)
HPCC-9094 Ensure space is allocated for the length of a child dataset
HPCC-7999 Invalid syntax reported by OpenLDAP
HPCC-9100 Ignore foreign info when resolving file in package
HPCC-9115 Fedora389 LDAP returns NULL errstring
HPCC-9085 Improve method names and remove unneeded IMPLEMENT_IINTERFACE
HPCC-9085 Fix Roxie JSON handling of array item names
HPCC-9105 Add missing const which was causing a compile error.
HPCC-9104 Add -checkVersion option to eclcc to control ecl version checking
EPE-22 Redirect Eclipse plugin to use new ECL Watch
HPCC-9092 Win32 + OSX Package Name Wrong
HPCC-9099 Fix a few leaks in exception handling code
HPCC-9098 Fix release of an exception that could be rethrown
HPCC-9096 Include "ecl packagemap validate" section into Roxie Ref
HPCC-9084 Add comment clarifying transfer of ownership
HPCC-9089 Improve Roxie basic JSON formatting
HPCC-9084 Delimit JSON across multiple Roxie ouputs
HPCC-9122 Add 'delimited' as s synonym for 'csv' in the dfuplus formats
HPCC-9159 Add missing plugin proxies
HPCC-9152 Add validateStore option to daliadmin
HPCC-9160 Plugins that don't export pluginDefinition block get unloaded
HPCC-9154 Remove logging of daliUser usage
HPCC-9063 Fix regression handling non dynamic filenames in roxie
HPCC-9108 Solve problem not commoning up selectors
HPCC-8617 Update ConfigMgr docs
HPCC-9148 Eclccserver does not support controlling permissions
HPCC-9148 Eclccserver does not support controlling permissions
HPCC-9146 Archiving failing to archive generated dlls
HPCC-9076 Attempt to read temp file that has not yet been registered
HPCC-9072 Fix issue with null act and multiple outputs
HPCC-9140 Remove ERROR with no parameters.
HPCC-9101 Allow daliadmin import to have a qualifier on the tail
HPCC-9139 Segfault in eclagent using BLOB fields
HPCC-9112 Large sets of files sprayed using wildcard may be truncated
HPCC-9078 The default system will not start on a 32-bit VM with 10 GB memory
HPCC-9137 Add note re:Fedora repository
HPCC-9135 multi-part boundary line check should include extra '-'
HPCC-9135 crlf before mime boundary line should not in file content
HPCC-9083 Document ECLWatch Tech Preview
HPCC-9051 Add the RoxieControlAccess tag to authenticated features
HPCC-9120 Fix global rollup early stop deadlock
HPCC-9013 enter bad pwd for expired user still prompts for pwd change
HPCC-9127 Fix global merge regression
HPCC-9106 Incorrect determination of password expiration prompt
HPCC-9114 XMLParse gives spurious errors on CDATA sections that end ]]]>
HPCC-8076 Document new escape option on CSV files
HPCC-9062 Limit remote location list by cluster
HPCC-9205 SprayVariable file fix
HPCC-9177 Configmgr - Allow dashes in the name field
HPCC-9202 DFS transaction remove/add regression
HPCC-9200 Install improvements
HPCC-9190 Roxie should not reconnect to dali if restarts while lockDali
HPCC-9186 Roxie cores writing dataset to workunit
HPCC-9033 Track number of ATMOST triggers in Roxie
HPCC-9198 Hyperlink + Open Tab fails on FireFox
HPCC-9194 Document NOXPATH attribute
HPCC-9187 Missing check for ecl-queries-copy --overwrite option
HPCC-9177 Configmgr - Allow eclccserver option to contain dashes
HPCC-9182 CSafeSocket write should handle buffer size of 0
HPCC-9182 Make common routine for adding to FlushingStringBuffer queue
HPCC-8914 Implemennt NOXPATH flag on OUTPUT
HPCC-8954 Change to Spray Delim.
HPCC-9121 Add Wuid filter by field to filter by Fixes HPCC-9121
HPCC-9169 Rename SHUFFLE (a temporary name) to subsort
HPCC-8067 LINKCOUNTED is not documented
HPCC-9184 Roxie queue name not found in /Status/Servers list after re-attach
HPCC-9189 Disable udpResendEnabled logic
HPCC-9182 Prevent adding empty FlushingStringBuffer block to queue
HPCC-9184 Roxie queue name not found in /Status/Servers list after re-attach
HPCC-9109 Add hyperlink to enable single click open
HPCC-9149 Add details about Eclcc Options
HPCC-9183 change the 'cluster stopped' to 'cluster not attached'
HPCC-7896 Roxie CRoxiePackageSetManager holds lock for too long
HPCC-9126 DFU Workunits Refactor
HPCC-9172 Fix mismatching records from datasets in MAP/CASE
HPCC-9178 Remove several references to UNKNOWN_USER
HPCC-9136 Modified based on review
HPCC-9046 Browse ECLWorkunits: sorting should be case-insensitive
HPCC-9185 Always return a maxlength > minLength
HPCC-9145 Fix some memory leaks
HPCC-9136 Remove Roxie Queries options from ECLWatch UI
HPCC-9022 Allow testsocket to read query from stdin
HPCC-8959 No publish "success" feedback
HPCC-9163 Get cloned remote file descriptor once per CResolvedFile
HPCC-9125 Add a check to ensure eclcc and gcc use the same include version
HPCC-9022 Allow testsocket to read query from stdin
HPCC-9173 Ubuntu 13.04 Build Fails
HPCC-9054 Make sure documentation of indexes includes discussion of the BLOB attribute.
HPCC-9147 Change error to warning on mismatch major version
HPCC-8956 Add documentation for #option ('divideByZero')
HPCC-9064 Document the changes to the ROLLUP semantics
HPCC-8888 Rename Spray CSV to Spray Delimited in EclWatch display
HPCC-9153 UNIMPLEMENTED on OSX
HPCC-9125 Add a check to ensure eclcc and gcc use the same include version
HPCC-8929 Add Copy URL Instructions
HPCC-9237 Fix misplaced XML end tag in LR module
HPCC-9226 Fix build break on Centos
HPCC-9221 Deleting package from roxie will cause query to hang
HPCC-9236 WU Lists calling the server for each row
HPCC-9235 Avoid restart distributor delays
HPCC-9166 Add ECLWatch WU Filters doc
HPCC-9097 Added plugins flag to file name on rpm based systems
HPCC-9226 CmdProcess lockup on failure, and does not use path
HPCC-9197 Leave generated xml tag open until attributes have been added
HPCC-9217 Remove legacy implementations of editdistance functions
HPCC-9214 Include remoteSubFiles when replicating CResolvedFile on slave
HPCC-9208 Correctly catch errors returned by pssh and prevent core
HPCC-9076 Rollback fix
HPCC-9211 Improve LRM parameter text formatting for readability
HPCC-9197 Escape content when converting WsECL form to XML
HPCC-7879 Interface example not self contained, add comment
HPCC-9164 Add Delimited format to DFUPlus docs
HPCC-9209 Add missing cast so max timing isn't truncated
HPCC-8127 LIMIT ignores a filter on the right recset if specified in the join condition
HPCC-9193 Clarify Page 30 Inst&RunHPCC
HPCC-8880 TOXML not documented in ECL Language Reference
HPCC-7875 Enhance OUTPUT documentation to hint that 'format' does a project
HPCC-2284 Reduce size of the continuation info for Roxie indexes
HPCC-9273 Add --pmid parameter to ecl cli docs
HPCC-9262 Change parameter name that allows users set the pacakgeMap id
HPCC-9282 Ensure the correct name for an expression is extracted
HPCC-9280 Detail Pages missing information at startup
HPCC-9279 REGRESSION - ESP cored when trying to view a file
HPCC-9277 Excessive tracing in lookupFileName
HPCC-9262 Allow user to optionally set the pacakgeMap id
HPCC-9251 Incorrect check of dali UNKNOWN USER
HPCC-9256 Email module in std library missing import
HPCC-9246 SOAPCALL may lose records in 4.0.0-rc6
HPCC-9245 Packagemap needs to support mixed case package ids
HPCC-9097 Correct issue with package naming for windows and mac
HPCC-9010 Check query tree branch before using it
HPCC-9240 Workunit monitoring is "lumpy" and too aggressive
HPCC-9255 WsEcl should use IWorkUnit::setXmlParams to set stored values
HPCC-9276 Make DFUDetails Page more consistent visually.
Revert HPCC-9335 Track end of file from inputs used in stepped join
HPCC-9334 Graph view shows odd characters
Rename soap references to generic Wsc referenes
HPCC-9349 Add HTTPCALL implementation in Thor
HPCC-9381 Roxie file resolution tracing
HPCC-9339 Ecl packagemap validate results need to be clearer
HPCC-9351 Regression suite distribute,skew test
HPCC-9363 Ecl publish to foreign ip can't resolve superkeys
HPCC-9366 diskaggregate leaking threads
HPCC-9332 Recursively add input files for other non-persist workflow items
HPCC-9335 Smart stepping join continues to request rows after end of file
HPCC-9335 Add some GRAPH based stepping tests
HPCC-9335 Fix potential core if the input doesn't support stepping
HPCC-9360 Add subgraph with properties grid to graph page
HPCC-9361 Graph Page Sync Issue
HPCC-9335 Improvements to single stepping nested merge joins
HPCC-9305 Auto open DFU Workunits on file action
HPCC-9340 Ecl packagemap delete needs a message when successful
HPCC-9350 Fix DISTRIBUTE,SKEW assert
HPCC-9305 Auto open DFU Workunits on file action
HPCC-9343 ecl roxie reload --help incorrect
HPCC-9267 LZBrowseWidget
HPCC-9055 Ability to close "Details" tab once opened
HPCC-9301 Dojo 1.9 + Chrome + GraphControl Disappearing
HPCC-9299 Upgrade to dojo 1.9.0
HPCC-9210 Create generic ESPRequest.Store
HPCC-9204 Migrate to dgrid
HPCC-9204 Switch from dojox/grid to dgrid
HPCC-9335 Track end of file from inputs used in stepped join
HPCC-9333 Fix possible loss of records in sort
HPCC-9331 Missing activity logging if local graph
HPCC-9265 Lightweight selfjoin hint(parallel_match) issue
HPCC-9263 Correct the output of "ecl packagemap"
HPCC-9329 Add text search test cases into CE regression suite
HPCC-9328 Fix misue of a queryProp, should be getPropBool
HPCC-9225 Allow WsEcl caller to specify jobname
HPCC-9326 onStartCalled not set if nullact causing assert
HPCC-9300 HashJoin serialization race condition
HPCC-9264 Avoid possible deadlocks if error gathering lookup RHS
HPCC-9437 Add option for high resolution timing in log files
HPCC-9350 Fix DISTRIBUTE,SKEW assert
HPCC-9431 Allow constant folder to resolve functions in eclrtl
HPCC-9443 Race condition can cause roxie to core when updating packages
HPCC-8847 Visibility and module inheritance
HPCC-9432 Use 'cat' not 'echo' Std,System.Util.CmdProcess in the example
HPCC-9441 Fix case issues in Client Tool docs (eclplus & dfuplus)
HPCC-9410 Add superfile information to control:getQueryXrefInfo
HPCC-8842 Delete spurious semicolon after an if condition
HPCC-9408 Document changes to the way MODULE inheritances works
HPCC-9435 Report a better error if eclcc fails to open stdin
HPCC-9426 Unprojected disk read with virtuals allocated too little memory
HPCC-8379 Show suspended roxie query on EclWatch
HPCC-9383 Better support common fuzzy package matching pre-publish
HPCC-3130 changing perms on eclwatch takes 5 minutes to take affect
HPCC-9418 Refactor Certify docs
HPCC-9117 Stopping of dafilesrv generates odd message
HPCC-9215 DALI should not check LDAP for non managed scopes
HPCC-9382 Add EBCDIC support to HexView
HPCC-9241 Returns results after action button is clicked on WUs page
HPCC-9385 Fix thread pool runningCount()
HPCC-9417 Fix XPATH being ignored for nested records
HPCC-9223 Improve error message when there are no active packages
HPCC-9414 Add XML/JSON responses to FileSpray/UploadFile
HPCC-9320 Add WUID web links to Browse Queries page
HPCC-9338 Add --no-files option to ecl-publish
HPCC-9391 Refactor DataHandling docs
HPCC-9347 Relocate Spray forms
HPCC-9356 Add depth and distance fields to Graph Page
HPCC-9409 Protect access to delayed inputs with a critical section
HPCC-9412 Input fields in dijit.Toolbar lock up the web page
HPCC-9355 Allow pasting of XGMML
HPCC-9006 Soapplus xml comparison issue
HPCC-9007 Soapplus comparison not comparing root node
HPCC-9306 Don't allow restarted workunits to take the wrong branch
HPCC-9399 Add stepped dedup to hthor and clean up roxie code
HPCC-9399 Support smart stepping through a dedup activity
HPCC-8938 Exception can cause sort partition deadlock
HPCC-8842 Fix problems with module inheritance
HPCC-9269 Dynamic file resolution does not use package files
HPCC-9393 ATMOST stats inaccurate
HPCC-9392 Roxie inactive file handle closer is broken
HPCC-9344 Ecl queries list socket creation needs longer timeout
HPCC-9303 Use thread pool for DFS requests
HPCC-9384 The testsearch2.ecl query in regression suite needs key updating
HPCC-9568 Configmgr - remove extra roxie info
HPCC-9571 Configmgr - Farm tab on roxie not working
HPCC-9611 Can't run more than one thor job that uses Java
HPCC-8804 New ECL Watch homepage (Tech Preview)
HPCC-9570 SOAPCALL returning "Request too large for buffer fragment"
HPCC-9594 Rembed fails in thor
HPCC-9612 Roxie is ignoring slaveThreads setting
HPCC-9587 Ubuntu 12.04 32bit eclcc cores on constant folding
HPCC-9341 Add ecl-publish support for suspend and delete previous
HPCC-9606 Update images in ECL Watch Tech Prev doc
HPCC-9605 Remove spurious 20s sleep at slave start
HPCC-9596 Core in dali if environment contains nodes without @computer set
HPCC-9582 New feature: evaluate(module, attribute)
HPCC-9579 Standalone Roxie coring
HPCC-9560 ensure spilling occurs if rehash fails
HPCC-9535 Rationalize Roxie topology info
HPCC-9551 Roxie cannot set thread priorities to positive values
HPCC-9567 Ignore (unreliable) numDataCopies value in overloaded mode
HPCC-9559 ecl-packagemap-query-files command to show query file mappings
HPCC-9563 XML_CATALOG not being set correctly
HPCC-9555 Fix possible crash when hashdedup spills
HPCC-9419 Remove an extra check
HPCC-9523 Fix potential hashdedup deadlock
HPCC-9558 Spot and handle deleted WU
HPCC-9419 Revise based on review comments
HPCC-9535 Rationalize Roxie topology info
HPCC-332 Cmake version dependency
HPCC-2345 Debug fails to build package
HPCC-9546 ecl-roxie-unused-files command
HPCC-9419 Set ClusterPartDiskMapSpec in File Copy
HPCC-9419 Pass data2 through ClusterPartDiskMapSpec for overloaded
HPCC-9550 Control:getQueryXrefInfo not showing super keys
HPCC-8854 Performance Improvements
HPCC-9549 Library cannot be resolved unless uses same package as query
HPCC-9544 ecl-packagemap-add should report unresolved files
HPCC-9515 Add support to move rows from one heaplet to another.
HPCC-9539 Expose SuperFile info from WsWorkunits::WUQueryDetails
HPCC-9451 Docs:Clear Permission Cache button in ECL Watch
HPCC-9420 Pass offset setting to remote copy
HPCC-9420 Rename three variables
HPCC-9445 Fix leak reporting for packed allocators
HPCC-9535 Rationalize Roxie topology info
HPCC-9468 Main Graph Depth
HPCC-9491 Move CFileChangeWriteLock,avoid refs to Owned
HPCC-9487 ESP should set IE=edge for certain ECLIDE HTTP responses
HPCC-9420 Pass Roxie directory settings to file copy function
HPCC-9487 ESP should set IE=edge for certain ECLIDE HTTP responses
HPCC-9520 Update VM Resource page Docs
HPCC-9525 Segmentation fault when remote copy
HPCC-9514 Merge contents of sourcedoc.xml and remove it.
HPCC-9473 TOPN activity crashes if LIMIT depends on context
HPCC-9508 Add eclipse code layout settings file to project
HPCC-9411 Information needed about unloadable roxie queries
HPCC-9518 Issues with reporting on suspended queries
HPCC-9486 Configmgr - Handle new level attribute
HPCC-9511 Remove references to roxieconfig from configmgr tooltips
HPCC-9516 Backslash in doc needs special handling for HTM/CHM docs output
HPCC-9505 Add roxiemem activity mem tracing on OOM
HPCC-9496 PackageMap Validate not checking RefFileInPackage flag
HPCC-9514 Add initial documentation about roxiemem
HPCC-8803 Directories hpcc-data2 and hpcc-data3 don't get used
HPCC-9506 Improved memory statistics reporting
HPCC-9491 Ensure lock checked in multiple cluster case
HPCC-9484 Ubuntu 13.04 support
HPCC-4476 Fix KEYED substring matching against a field from the index
HPCC-9494 Clean up unused roxiemanager code
HPCC-9488 Better handling of changes to config files
HPCC-9490 Protect against finalizing row with too much data written
HPCC-9482 Add compile time check for returning variable length rows
HPCC-9482 Fix code for calls to external c++ functions returning rows.
HPCC-9389 Add testsocket control:querypackageinfo support
HPCC-8803 Directories hpcc-data2 and hpcc-data3 don't get used
HPCC-9453 keyed join, onfail causing record loss
HPCC-8803 Directories hpcc-data2 and hpcc-data3 don't get used
HPCC-9483 Valgrind complains about remotefile's hashtable of endpoints
HPCC-9480 A GROUP ROLLUP was incorrectly marked as having grouped output.
HPCC-9397 Roxie remote file resolution issues
HPCC-8446 Added ability to run single query in regress
HPCC-9478 Nested global loop crash
HPCC-9397 Roxie remote file resolution issues
HPCC-9448 Add soapplus to Client Tools build
HPCC-9449 Add Landing Zone Page to ECLWatch Docs
HPCC-9444 Location of files for the Programmers Guide was incorrect
HPCC-9447 If libRembed is present, eclcc malfunctions on some systems
HPCC-9629 New language features to support bundles
HPCC-9569 ConfigMgr - remove extra roxie info
HPCC-9687 Ambiguous xpath error from EclWatch displaying Roxie queries
HPCC-9688 Version 4.0 rc14 configmgr cannot display old roxie configurations
HPCC-9569 ConfigMgr - remove extra roxie info
HPCC-9619 Add missing key files
HPCC-9664 dfu copy of files generating odd names
HPCC-9620 Document ecl roxie --unused-files
HPCC-9674 Edit duplicate sentence in Packages Chapter
HPCC-9625 New options in ecl publish: no-files,suspend-prev,delete-prev
HPCC-9639 Roxie may segfault on startup if previous 4.0 build used
HPCC-9665 Uninitialized variable in dadfs.cpp
HPCC-9646 Compile warning in thorsoapcall.cpp
HPCC-9641 Use DEFAULT() attributes for omitted values in inline tables.
HPCC-9660 Fix optimization of a DENORMALIZE with an empty rhs
HPCC-9502 Option when spraying wildcards to fail if no matches
HPCC-9545 ecl-packagemap-validate option to check subfiles exist in dfs
HPCC-8053 Timeouts can cause superfile update inconsistencies
HPCC-9631 KeyedJoin may miss cached IKeyIndex's
HPCC-9621 IE8 + XP ECL Watch Issues
HPCC-9638 Filter "Clear" does not reset some drop down controls
HPCC-9636 OUTPUT(module) not outputting DICTIONARY attributes
HPCC-9628 Eclcc hangs at end if libarchive dynamically unloaded
HPCC-9572 Fix hash dedup row leak after spill event
HPCC-9729 IE Does not work with new ECL Watch
HPCC-9724 Default bundle directory should be per user
HPCC-9713 Bad installation message when installing on Ubuntu 13.04
HPCC-9704 Add libarchive support to WIN32
HPCC-9052 Document Direct Access to Roxie using either SOAP or JSON
HPCC-9584 Document evaluate(module, attributeId) feature
HPCC-9678 Document ecl bundle commands
HPCC-9710 R embedding gives spurious stack errors in Roxie
HPCC-9642 Update ECL Watch Tech Preview docs
HPCC-9709 Core in ecl-publish install if package not already installed
HPCC-9708 Hook plugin libarchiveFile cores under windows
HPCC-9699 Java embed is not working on Ubuntu 13.04
HPCC-9603 Add information into Language Guide under IN
HPCC-9700 Warning "Explicit file /opt/HPCCSystems/share/Bundles" not found
HPCC-9540 Standard Library Ref - CountWordsused instead of WordCount
HPCC-9500 ECL Sample in ECL Language Reference does not compile
HPCC-9698 Can't run more than one thor job that uses R
HPCC-9643 Update VM Docs to include Virtual Box support
Release Notes for Community Edition 3.10.8-9
All Known Limitations in 3.10.8-2 are still valid
======================================== Changes from 3.10.8-8 to 3.10.8-9 ======================================== HPCC-9350 - Fix DISTRIBUTE,SKEW assert
Release Notes for Community Edition 3.10.8-8
All Known Limitations in 3.10.8-2 are still valid
======================================== Changes from 3.10.8-6 to 3.10.8-8 ======================================== HPCC-9417 Fix XPATH being ignored for nested records HPCC-9409 Protect access to delayed inputs with a critical section
Release Notes for Community Edition 3.10.8-6
This version contains a few changes from 3.10.8-4. All Known Limitations in 3.10.8-3 are still valid
======================================== Changes from 3.10.8-4 to 3.10.8-6 ======================================== e9fe20d Community Edition 3.10.8-6 Gold bc125c8 HPCC-9392 Roxie inactive file handle closer is broken 2599f26 Community Edition 3.10.8-5 Gold 5986b84 HPCC-9363 Ecl publish to foreign ip can't resolve superkeys 6ebf76c HPCC-9366 diskaggregate leaking threads
Release Notes for Community Edition 3.10.8-4
This version contains one change from 3.10.8-3. All Known Limitations in 3.10.8-3 are still valid
======================================== Changes from 3.10.8-3 to 3.10.8-4 ======================================== HPCC-9333 - Fix possible loss of records in sort
Release Notes for Community Edition 3.10.8-3
This version contains one change from 3.10.8-2. All Known Limitations in 3.10.8-2 are still valid
======================================== Changes from 3.10.8-2 to 3.10.8-3 ======================================== HPCC-9300 - HashJoin serialization race condition
Release Notes for Community Edition 3.10.8-2
================================
Known Limitations for 3.10.8-2
================================
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.2/clienttools/bin
If you install the full platform, this step is not needed to use the client tools. - Under certain circumstances, the ECL IDE can display an error message when submitting ECL code from a read-only file. The error message says that it cannnot save the file because Access is denied. This message can be safely ignored. (IDE-263)
============================================================
Comprehensive list of changes from 3.10.6-1 to 3.10.8-2
============================================================
HPCC-9120 Fix global rollup early stop deadlock
HPCC-9127 Fix global merge regression
HPCC-9114 XMLParse gives spurious errors on CDATA sections that end ]]]>
HPCC-9056 Build break in thor (Windows)
HPCC-9094 Ensure space is allocated for the length of a child dataset
HPCC-9100 Ignore foreign info when resolving file in package
HPCC-9105 Add missing const which was causing a compile error.
HPCC-9098 Fix release of an exception that could be rethrown
HPCC-9096 Include "ecl packagemap validate" section into Roxie Ref
HPCC-9045 WSFileIO is not accessible by non-admin users
HPCC-9014 Roxie Manual Correction
HPCC-9015 Restore previous ROLLUP semantics
Ensure no overflow when calculating fpos
HPCC-9026 Pull distributor restart issues
HPCC-8992 Various problems in key sampling used by merge
HPCC-9021 Non-locking mode for single-node / dev roxies
HPCC-9027 Roxie file handle errors
HPCC-9028 Roxie not handling OPT flag correctly on dynamically-resolved files
HPCC-9029 Roxie can core if write to file when no workunit
HPCC-8955 Document changes to "packagemap validate"
HPCC-9000 Variable length record display issues
HPCC-9003 Check inside expression attributes for evaluation in thor.
HPCC-8850 enhance package validation to check for files that aren't mapped
HPCC-8981 Configmgr - nicSpeed missing in Computer Types
HPCC-8053 Superfile lock contention causing superfile corruption
HPCC-8987 MoveExternalFile error misleading
HPCC-8849 QuerySet action commands should verify query exists
HPCC-8900 cli should allow wu compile state of compiled or completed
HPCC-8926 Fix ecl-queries still using queryset instead of target
Add an assert to ensure limit is <=32bit
HPCC-8080 Correction of command line argument handling
HPCC-8877 Show WU state on Activity page
HPCC-8969 Enforce an absolute hard limit on dali results
HPCC-8865 Document Escape Character in SprayVariable ECL library function
HPCC-8843 Incorrect argument named in docs for Std.File.CreateSuperFile
HPCC-8964 Don't generate a JFindexfromactivity keyed join for thor
HPCC-8957 Compressed files being published with incorrect crc
HPCC-8816 Show 'Delete Query' result and redirect to QuerySet
HPCC-8951 Incorrect extension for proxy plugins
HPCC-8949 Ecl packagemap add needs to add each package one time
HPCC-8948 Allow 'slaveDaliClient' as job option
HPCC-8937 Add a flag to skip existing superfile check
HPCC-8939 Fix problems with IN ('a','b')
HPCC-8905 Fix minisort OOM and deadlock
HPCC-8944 Add missing case entry for record calculation
HPCC-8930 Child graph could have missing progress data
HPCC-8897 Pass cacheHint to use paged cache when querying workunits
HPCC-8927 Lazy open should default to smart mode
HPCC-8910 Rename EclWatch Copy URL menu to View URL
HPCC-8924 Prevent simple recursive computerTypes causing stack faults
HPCC-8923 Roxie not checking workunit version matches
HPCC-8922 Fix problems casting constant decimals to booleans
HPCC-8418 Fix Schema for sets with xpaths 'name' and 'name/'
HPCC-8418 Schema generation should ignore xpaths that are too long
HPCC-8811 Revise based on review comments
HPCC-8862 Add support for csv escape characters to sprayVariable
HPCC-8585 Ensure Priority is cloned into the workunit
HPCC-8892 Error on key build, with excessively large key+payload
HPCC-8811 Return WUIDs in WsWorkunits/WUResubmit soap response
HPCC-8890 Avoid early abort losing original error
HPCC-8870 Fix a minor possibility of corrupting memory in csv unquoting
HPCC-8806 Rename Delete Query to Deactivate on Queries Active tab
HPCC-8860 Ecl packagemap needs to return an error for invalid dali ip
HPCC-2839 Separate Package Validation warnings from erors
HPCC-2839 Command line tool to validate package content
HPCC-8839 Include sizes in key-row size error message
HPCC-8873 Fix archive instructions
Fix build error
HPCC-8819 Allow LOCAL to prefix a definition (like SHARED/EXPORT)
HPCC-8834 Package base resolutions should not depend on declaration order
HPCC-8821 Don't optimize 1 character compare on ebcdic strings
HPCC-8564 Added override settings for nproc to limits.conf
HPCC-8181 Added more info on ecl packagemap validate from code review
HPCC-8181 Add ecl packagemap validate to docs
HPCC-9159 Add missing plugin proxies
HPCC-9152 Add validateStore option to daliadmin
HPCC-9063 Fix regression handling non dynamic filenames in roxie
HPCC-9146 Archiving failing to archive generated dlls
HPCC-9072 Fix issue with null act and multiple outputs
HPCC-9139 Segfault in eclagent using BLOB fields
HPCC-9112 Large sets of files sprayed using wildcard may be truncated
HPCC-9205 SprayVariable file fix
HPCC-9202 DFS transaction remove/add regression
HPCC-9190 Roxie should not reconnect to dali if restarts while lockDali
HPCC-9189 Disable udpResendEnabled logic
HPCC-9163 Get cloned remote file descriptor once per CResolvedFile
HPCC-9173 Ubuntu 13.04 Build Fails
HPCC-9235 Avoid restart distributor delays
HPCC-9226 CmdProcess lockup on failure, and does not use path
HPCC-9197 Leave generated xml tag open until attributes have been added
HPCC-9214 Include remoteSubFiles when replicating CResolvedFile on slave
HPCC-9208 Correctly catch errors returned by pssh and prevent core
HPCC-9197 Escape content when converting WsECL form to XML
HPCC-9137 Add note re:Fedora repository
HPCC-9051 Add the RoxieControlAccess tag to authenticated features
HPCC-9264 Avoid possible deadlocks if error gathering lookup RHS
Release Notes for Community Edition 3.10.6-1
============================================================
Change from 3.10.4-1 to 3.10.6-1
============================================================
- HPCC-9015 Restore previous ROLLUP semantics
Release Notes for Community Edition 3.10.4-1
================================
Known Limitations for 3.10.4-1
================================
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.2/clienttools/bin
If you install the full platform, this step is not needed to use the client tools.
============================================================
Comprehensive list of changes from 3.10.2-1 to 3.10.4-1
============================================================
HPCC-8908 Std distributor not reset in child query, lost recs
HPCC-8911 Deadlock adding duplicate subfile to super
HPCC-8907 Fix potential core/internal error constant folding CASE
HPCC-8889 getEnv cores on roxie when no packages are defined
HPCC-8866 Allow PackageId match to query name without version
HPCC-8855 Expose some options to #option
HPCC-8875 Enable core files for eclccserver
HPCC-8817 Add code to handle AgentQueue for Thor
HPCC-8817 Fix hthor running WU not shown on Activity page
HPCC-8857 Add an example
HPCC-8856 Fix problems with inactive selectors
HPCC-8857 Don't create aliases for CSV attributes(!)
HPCC-8668 Roxie takes a significantly long time loading data
HPCC-8777 Allow ecl packagemap delete and activate to work properly
HPCC-8834 Package base resolutions should not depend on declaration order
HPCC-8612 Add Date and Copyright Info
HPCC-8767 ESP users should be able to reset expired passwords
HPCC-8823 Fix of Scheduler Doc
switch order of receiver/sender stop in cancel
Remove unecessary and dangerous call to stop() in destructor
HPCC-8812 Fix broken web link for Change password
HPCC-8676 Add publishedBy and suspendedBy attributes to Query Entry
HPCC-8805 Fix query selection problem on BrowseQueries page
Remove unnecessary extra stop broadcast
HPCC-8608 Remove FilesBaseDN reference
HPCC-8625 Roxie was not handling multiple QuerySet case correctly
HPCC-8717 Revised based on the last comment
HPCC-8800 Potential lookupjoin deadlock
HPCC-8717 Avoid multiple calls to SDS connect() for JobQueue in EclWatch
HPCC-8715 Compress graphs and handle graphs/results more efficiently.
HPCC-8721 Delete workunit temporaries
HPCC-8762 Ecl packagemap list/info needs to support authentication
HPCC-8763 Remove dkc option from dfuplus usage text
HPCC-8755 Fix Auto Refresh on ECL WU Details page
HPCC-8756 Remove DKC action from DFUPlus docs
HPCC-8753 Reset persist calculation when re-executing a workflow item
HPCC-8758 Stall in LOOKUP JOIN within LOOP
HPCC-8733 cmake STREQUAL should be protected from empty strings
HPCC-8737 Roxie loses queries if it starts before dali is ready
HPCC-8666 Submit workunit should reschedule even if workflow not reset
HPCC-8177 Enhance Queries/Browse function
HPCC-8648 Add ecl-queries-list support for showing only inactive queries
HPCC-8632 Reduce multiple SDS connect() calls for environment info
HPCC-8697 Build errors on EE on Ubuntu 12.10
HPCC-8688 Generate rows with constant sets as compile time constants
HPCC-8678 Add ecl cli support for adding comments published queries
HPCC-1960 Standalone diskwrite makes bad filename
HPCC-8679 Add ecl cli support for specifying a repository snapshot
HPCC-8682 Fix deadlock with BUILDINDEX in LOOP
HPCC-8677 Remove calls to setPasswordsFromSDS from ESP/EclWatch
HPCC-8673 Fix memory leaks when running Get Roxie Metrics
HPCC-8643 Fix memory leaks in ESP EclWatch services
HPCC-8671 Variable name misspelling causes error in eclwatch
HPCC-8633 Add mutex to control data access for preflight result
HPCC-8445 Add Certify doc
HPCC-8645 Configmgr - Add attribute in XML view fails in IE
HPCC-8637 Make thorslave dali connection optional.
HPCC-8594 Fix splitter activity timings + missing indexread timing
HPCC-8537 Skip title line when parsing space usages in preflight
HPCC-8600 Add ecl command line support for query priority
HPCC-8461 Configmgr - Fix filesBasedn of Dali and ESP to match LDAP
HPCC-8253 Need to return active status when doing ecl package list
HPCC-8137 Add Programmers Guide to Set.
Release Notes for Community Edition 3.10.2-1
================================
Known Limitations for 3.10.2-1
================================
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.2/clienttools/bin
If you install the full platform, this step is not needed to use the client tools. - If you have installed the Client Tools and IDE on your Windows workstation, you do not need to install the Graph Control separately. However, you must restart your browser to use the newly installed Graph Viewer.
============================================================ Comprehensive list of changes from 3.10.0-1 to 3.10.2-1 ============================================================ HPCC-8570 Created common function for kill HPCC-8526 RtlDatasetBuilder wasn't updating self when it was reallocated HPCC-8610 Ensure all Eclagent logfiles get recorded in workunit HPCC-8599 Roxie may core when removing a file from file cache HPCC-8563 Ensure groups/clusters are consistently lowercased. HPCC-8552 Speed up MP broadcast on congested network HPCC-8570 Moved location of rm of pid file in killed HPCC-8570 Remove Sentinel check to stop process HPCC-8598 Added support for Ubuntu 12.10 Quantal HPCC-8599 Roxie may core when removing a file from file cache HPCC-8581 Display long strings at the last column(s) of Results table HPCC-8601 Debug values being passed as stored values in deployArchive HPCC-8567 ECLPlayground Sample Drop Down Error HPCC-8595 Avoid stall if hashdist is spilling and runs out of disk HPCC-8596 Problems dealing with CSV headers in mixed width supers HPCC-8547 Interleaved mixed width subfiles exposing mapSubPart bug HPCC-8254 Ensure child datasets are freed up by compound read activities HPCC-2951 Docs: HTTPCALL added to Language Reference HPCC-7950 Fix minor compile error introduced by previous change HPCC-7950 Use common HpccPackage classes in roxie HPCC-8226 Dali cannot resolve backup location HPCC-8546 Configmgr doesn't work in IE 8 HPCC-8485 result_lib.xslt not escaping some xml strings HPCC-8577 Unecessarily slow thor start/stop times HPCC-8495 openWorkUnit() should return NULL for a NULL or empty wuid HPCC-8545 Open Workunit not work for archived WU in ECLWatch HPCC-8566 Fix XML Schema generation skips top level attributes HPCC-8541 Add examples illustrating calling Python and Java from ECL HPCC-8514 Fix ESDL parameter defaults not being set properly HPCC-8459 Fix incorrect ESP log when file not deleted HPCC-8531 Use the keep going attribute for eclcc regression suite HPCC-8506 Implement SecureSocket::readtms to support HTTPS SOAPCALL HPCC-8516 Fix problem with ROWS(RIGHT) in keyed denormalize HPCC-8521 Fix file cloning while copying queries not resolving indexes HPCC-8660 Fixed redirection HPCC-8655 Fix ESP crash when running WUGetDependancyTrees HPCC-8660 Adding tracing to hpcc_common HPCC-8653 Add tracing to show time hpcc-init is taking HPCC-8413 Stepped join don't split results of previous graph iterations HPCC-8413 Fix problems with STEPPED JOIN accessing non existant results HPCC-8576 Minor change to tooltip for globalMemorySize HPCC-8605 Ensure log files are recorded to the workunit HPCC-8692 Fix OSX build issues HPCC-8664 Addition tracing for MP MultiPacket error
Release Notes for Community Edition 3.10.0-1
================================
Known Limitations for 3.10.0-1
================================
Notice: If you installed the ECL IDE from the download available before 2 p.m. EST January 10, 2013, then you should uninstall it, download the latest installer, and reinstall. The newer installer fixes the online help section of the IDE.
- If you have installed a release candidate version of the ECL IDE and Client Tools and would like to upgrade to the final release version, the upgrade can fail because Windows will detect that the HPCC Client Tools is already installed. The workaround is to uninstall first.
- If you install the Client Tools package for Linux, you must manually set the path using this command:
export PATH=$PATH:/opt/HPCCSystems/3.10.0/clienttools/bin
If you install the full platform, this step is not needed to use the client tools.
============================================================
Comprehensive list of changes from 3.8.6 to 3.10.0-1
============================================================
HPCC-8512 Ensure all set results are tagged as root - not just the first
HPCC-8442 Using libXSLT to process esp_service.xsl fails
HPCC-8494 Fix incompatibility in the message format for ftslave
HPCC-8449 Relax an internal consistency check causing an assert
HPCC-8464 Add a #option('removeXpathFromOutput') to remove xpaths
HPCC-8450 WsEcl navigation not checking getQueryRegistry return
HPCC-8393 Client Tools Installs to wrong folder on Linux
HPCC-8441 Ensure link counted datasets are cleared when serializing keys
HPCC-8448 Fix potential core on an invalid keyed join
HPCC-8437 Don't generate DISTRIBUTE activities inside child graphs
HPCC-8433 Regression in hashdedup, possible div 0
HPCC-8432 Clienttools package name fixed on Windows
HPCC-8432 Clienttools package name fixed on Linux
HPCC-8101 Access to workunit is denied
HPCC-8420 Ensure that slaves being killed belong to correct thor
HPCC-8414 Fix schema and display of child datasets using xpath('n')
HPCC-8367 Modify Preflight script for backward compatibility
HPCC-8412 XREF memory configuration regression
HPCC-8395 Avoid MP issue, caused by new lookupjoin
HPCC-8393 Client Tools Installs to wrong folder on Linux.
HPCC-8358 ESP Soap arrays of structures not xml decoding input strings
HPCC-8389 HashDist grouped input regression
HPCC-8360 Global lookup join regression
HPCC-8252 Macro comments for expected results don't match results
HPCC-8246 Denormalize has incorrect comments in code.
HPCC-8306 Merge stopping early on groups inputs.
HPCC-8298 Ensure only the dfsgroup request is captured
HPCC-8304 Regression causing spilling hthor sort to lose records
HPCC-8299 Fix error modfying a shared rowset
HPCC-8300 Allow stringlib.hpp to be included by other plugins
HPCC-8026 Fix View Log file in Last N Hours option
HPCC-8291 All definitions of EclDefinition in plugins must be static
HPCC-8292 Recover from errors starting esp when reading plugin symbols
HPCC-8287 Avoid rsync prompt in thor slave script
HPCC-8286 Make sure the IXmlToRowTransformer is cached as a member
HPCC-8264 Ensure that row allocators are cached for xmltorowtranslators
HPCC-8282 Fix a couple of issues compiling with visual studio
HPCC-8274 Fix compile issue introduced by HPCC-3681
HPCC-3310 Add rsync to cmake dependencies
HPCC-3310 Avoid multiple ssh calls to same node, starting thor
HPCC-8185 Protect against corrupt or truncated end of dali delta
HPCC-8199 Packagemap list and info needs to return loaded information
HPCC-8274 Improve bad MP packet tracing
HPCC-8268 Fix internal error triggered by MIN(ds, value, KEYED)
HPCC-8189 JobQueue updating dali too frequently
HPCC-8255 Csv headings deadlock
HPCC-8250 Activities derived from disk read asserting on multiway files
HPCC-8151 Group dedup all, was stripping end of group markers.
HPCC-8236 Avoid spilling callback deadlock
HPCC-8229 Fix occasional crash generating code to cast a string to data
HPCC-8235 Ensure end-of-groups stripped for sorted join input
HPCC-8052 nested ChildDatasets + ECL Playground generated results
HPCC-8234 Avoid deadlock on balanced splitter
HPCC-8224 Fast compression issues
HPCC-8220 Configmgr - Pluging path is not populated
HPCC-8225 Fix global ENTH deadlock issue
HPCC-8052 nested ChildDatasets + ECL Playground generated results
HPCC-8094 Group Hash Dedup support
HPCC-3097 Rationalize row reader/writer helpers
HPCC-8212 Implement grouped hash dedup for hthor and roxie
HPCC-8034 Add example of grouped hash dedup to the regression suite
HPCC-7980 Translate remote file dafilesrv access to local
HPCC-7944 Add setting, to allow master memory to be specified
HPCC-8221 ESP wasn't correctly loading plugin definitions
HPCC-8052 nested ChildDatasets + ECL Playground generated results
HPCC-8216 Csvread,opt heading crash
HPCC-8213 Disable sub-file checking on internal build
HPCC-2558 Fix problems deleting workunit .so/.cpp files
HPCC-8120 Firstn deadlock
HPCC-8129 Fix bug generating an optimized hash function on a child dataset
HPCC-3192 change fileServices spray functions to pass on maxConnections
HPCC-8202 Fix potential crash on exit in scheduleadmin
HPCC-7970 Fix some confusion with units when setting timing info
HPCC-8156 column width calculations inacurate
HPCC-8159 Add option to generate precompiled header for eclcc-generated code
HPCC-8052 nested ChildDatasets not showing up in ECL Playground generated results
HPCC-7970 Include eclcc timing information in workunits
HPCC-8052 nested ChildDatasets not showing up in ECL Playground generated results
HPCC-8193 Roxie file resolution issues
HPCC-8180 Roxie issues reloading changed files
HPCC-8159 Add option to generate precompiled header for eclcc-generated code
HPCC-8194 CRoxiePackageSetManager does not initialize stateHash
HPCC-8188 Correct spelling in usage section for ecl roxie
HPCC-3095 Format result columns from XML Schema
HPCC-8159 Prepare for use of precompiled headers in eclcc-generated code
HPCC-8176 Regression in library resolve code
HPCC-8174 Global loop regression
HPCC-8102 Rename eclccserver maxCompileThreads option
HPCC-8132 Global loop again race condition
HPCC-8103 Fix missing hyperlinks for results in WU Details page
HPCC-8130 Fixed IFS issue related to spaces in path in profile
HPCC-8130 Loading of profile regression on start of platform
HPCC-7975 Add std.system.thorlib.platform
HPCC-8129 Fix bug generating an optimized hash function on a child dataset
HPCC-8174 Global loop regression
HPCC-8102 Rename eclccserver maxCompileThreads option
HPCC-8132 Global loop again race condition
HPCC-8103 Fix missing hyperlinks for results in WU Details page
HPCC-7975 Add std.system.thorlib.platform
HPCC-8129 Fix bug generating an optimized hash function on a child dataset
HPCC-8002 Fix a couple of issues pick up by msvc
HPCC-8114 Make missing return an error
HPCC-8118 Build error under clang
HPCC-8114 Check gcc c++ version before using -Werror=
HPCC-8064 Roxie passing NULL for IUserDescriptor
HPCC-8114 Make missing return an error
HPCC-8113 Crash in thor when sorting very large arrays
HPCC-7943 Indicate replicate optional
HPCC-8002 Fix windows compile break
HPCC-8032 Fix compile error from previous submit
HPCC-8032 Fix regression in non-grouped input hash aggregate
HPCC-3306 Stop code generator swapping a DISTRIBUTE and a COUNT PROJECT
HPCC-7956 HPCC-7956 Implement grouped version of hash aggregate
HPCC-8026 Fix linux compile error passing StringBuffer to ... argument
HPCC-8087 Add DFU server name into DFU WU xml and diaplay in EclWatch
HPCC-7943 Indicate replicate optional
HPCC-8013 Ecl Packagemap add needs to add logical file info to dali
HPCC-8095 Remove many refs to UNKNOWN_USER
HPCC-8013 Ecl Packagemap add needs to add logical file info to dali
HPCC-8086 Complete Monitorinterval setting
HPCC-8026 Update View Log based on
HPCC-8081 Fix compilation errors from HPCC-8014
HPCC-8079 Compile errors related to IUserDescriptor refactoring
HPCC-8078 System won't compile under Clang
HPCC-8032 Roxie and hthor support for grouped hash aggregate
HPCC-2253 Implement Syntax for grouped hash aggregate
HPCC-3139 Make ecl cli bash_completion command specific
HPCC-2964 Configmgr - Allow swapping of Thor Master
HPCC-8013 Ecl Packagemap add needs to add logical file info to dali
HPCC-7944 Add setting, to allow master memory to be specified
HPCC-7973 New choose activity, thor implementation
HPCC-7860 ECL Plugin for Eclipse docs lists graph control as prerequisite
HPCC-7979 Ensure persistent settings reset at end of job
HPCC-8062 Fix Typo in doc
Refactor hashdist(send) to use thread pool of senders
Add option to allow receiver to spill disk
HPCC-8002 Tidy/remove legacy HDD meta scheme
HPCC-3092 Add ESCAPE option to CSV dataset
HPCC-1744 Added sub uninstall to match the sub install
HPCC-8014 Require IUserDescriptor in all HPCC calls
HPCC-2964 Configmgr - Allow swapping of Thor Master
HPCC-8017 Expand huge allocations into adjacent free blocks on resizeRow
HPCC-3213 Clear workunit variables before submitting in WURun
HPCC-7930 Rename ecl-package to ecl-packagemap
HPCC-7930 Rename ecl-package to ecl-packagemap
HPCC-8051 Fix warnings caused by implicit cast in jdebug.hpp
HPCC-8045 Refactoring daregress
HPCC-3154 Improve XmlSchema availability options through WsWorkunits
HPCC-8038 Add out-of-order check to subfiles
HPCC-7990 Compilation error using DICTIONARY with spanMultipleCpp
HPCC-0559 Set time out value for deleting logical file
HPCC-8003 Std.System.Util.CmdProcess() fails with undefined symbol fsCmdProcess2
HPCC-1835 Configmgr - Enable deletion of components with same names
HPCC-7873 Remove call to reset a workunit which was in the wrong place
HPCC-2950 Added SOAPACTION option to SOAPCALL docs
HPCC-8025 The complete-uninstall script should not remove unrelated packages
HPCC-7937 Throw an error on ambiguous prop tree get
HPCC-7982 Memory leaks in thor keyed join activity
HPCC-7998 Fix WsEcl handling of view resource of type xml
HPCC-7998 Fix WsEcl handling of repository based Result views
HPCC-7986 Lookup join core and all join regression
HPCC-3017 Configmgr - Context menu display issue on multiselect
HPCC-1835 Confimgr - Enable deletion of components with same names
HPCC-2802 Add instructions to use Unity Launcher icon
HPCC-7825 Additional edits to Roxie file copy section
HPCC-8015 Typo in roxie help message
HPCC-7825 Document roxie file copy settings
HPCC-8016 Ensure global sort order recalculated when grouped order lost
HPCC-8011 xmlsize crash fix
HPCC-2942 Configmgr - Add custom attributes
HPCC-2942 Configmgr - Add custom attributes
HPCC-8004 Wrong user descriptor when accessing Distributed Superfile
HPCC-7997 Fix retrieveWebServicesInfo support for QueryMainDefinition
HPCC-7948 Display CsvEscape option in logical file page
HPCC-7964 Configmgr - When updating ldap filesBasedn, propagate change
HPCC-7995 Various minor valgrind-reported issues
HPCC-7992 Add support for beyond compare 3 comparison to regress suite
HPCC-7989 Add missing dependency on XML::Simple
HPCC-7977 Fix incorrect filenames in documentation directory
HPCC-2390 Update ROLLUP documentation for clarity on matching rules
HPCC-7965 Modify based on code review.
HPCC-7974 Fix ecl-package commands using incorrect return type
HPCC-7978 ecl commands should set QueryMain explicitly
HPCC-7962 Fix problems with ecl --main option
HPCC-7981 Memory leak in memoryUsageReporter
HPCC-7965 Set correct content type for xml/xslt to avoid log failure
HPCC-7941 Update ConfigMgr Images and Docs
HPCC-7852 Share the same IWUClusterInfo with reloadCluster()
HPCC-7852 Display an error when a query is published and suspended
HPCC-7948 Add CsvEscape option to EclWatch UI/dfuwu/ftbase
HPCC-7969 False positives from distmerge.ecl in regression suite
HPCC-7972 False positives in roxie regression suite on when6c.ecl
HPCC-7953 Roxiemem unit tests fail if all run together
HPCC-7966 Spurious errors reported by remote.ecl in regression test
HPCC-7971 Fix typo in fromxml.xml regression suite key
HPCC-0954 Added documentation for CATCH function
HPCC-7941 Update ConfigMgr Images and Docs
HPCC-2884 he NOSORT option of JOIN not complete
HPCC-2346 two log directories for dafilesrv created on startup
HPCC-7963 Configmgr - Missing && breaking build
HPCC-7955 Configmgr - Disassociating ldap from esp causes seg fault
HPCC-7961 Fix problems with eclcc handling of -main
HPCC-7954 Configmgr - improper popup when changing ESP service bindings
HPCC-7955 Configmgr - Disassociating ldap from esp causes seg fault
HPCC-3327 Row arrays limited to 500 million rows
Add some loop in child query tests
HPCC-2885 not all LIMIT options are documented on JOIN
HPCC-7917 Add CLI support for a --help option
HPCC-7941 Update ConfigMgr Images and Docs
HPCC-7931 Edits from code review
HPCC-7941 Update ConfigMgr Images and Docs
HPCC-3034 Make publishing and copying of queries aware of packages
HPCC-7939 Confusing code in checkLogicalName
HPCC-2960 Configmgr - Navigator multiselect can cause display issues
HPCC-2960 Configmgr - Navigator multiselect can cause display issues
HPCC-7940 ECLWatch Users screen should be sortable on PWD Expiry columns
HPCC-2882 Comparison operator silent about sets
HPCC-7931 In ecl CLI, package action renamed to packagemap
HPCC-2804 Do not inline distributed dataset
HPCC-2804 Test negative rows
HPCC-2197 Ecl package command line parameters need to be more consistent
HPCC-2804 Continue to hoist no_dataset_from_row to reduce impact
HPCC-2804 Inline dataset_from_transform
HPCC-7935 Use temp_files for regression temp dir
HPCC-0633 Add support for loopagain support
HPCC-7934 Disable udpResendEnabled by default
HPCC-7808 Fix a few issues with DISTRIBUTE(,SKEW)
HPCC-7821 Fix ReferencedFileList handling of SuperFile within SuperFile
HPCC-2883 Description of HASH option for JOIN
HPCC-2679 Document WHEN's "failure"
HPCC-2825 document SOAPCALL TIMELIMIT option
HPCC-2832 SOAPCALL timeout now a double
HPCC-7923 Update ConfigMgr Images and Docs
HPCC-2939 Configmgr - IE context menu in navigator causes tree view jump
HPCC-2197 Ecl package command line parameters need to be more consistent
HPCC-7882 Update docs to reflect changes to ecl CLI
HPCC-7856 Include macros with parameters-with-defaults in dependencies
HPCC-7920 Core in dafilesrv if sent a VER command in authenticated mode
HPCC-2058 Add a ,UNORDERED option to an index read
HPCC-7888 Reinstate lost dllsToSlaves=false changes
HPCC-7919 Report errors that prevented loading a Roxie query
HPCC-2309 Configmgr - Entering LDAP ou info is error-prone
HPCC-7918 Configmgr - Save As from context menu locks up browser
HPCC-7916 Add ecl roxie commands
HPCC-3153 Filter WU names before showing on Browse Workunits page
HPCC-3365 Add params for per-query memory and time limits from CLI
HPCC-7913 Regression in control:reload caused by HPCC-7897 fix
HPCC-7910 Fix building unittests under windows
HPCC-7892 Roxie should default to predictable order
HPCC-7909 Compile failure on OSX
HPCC-7890 Default to outputting multiple c++ files
HPCC-7897 Use ReadWriteLock to reduce impact of lock on query lookup table
HPCC-2880 Report files currently in use by cluster
HPCC-7861 Fix field xpath('') causing invalid XML
HPCC-7828 Replacement Images for ECLWatch
HPCC-7872 add 3 Std.Str funcs: ExcludeFirstWord ExcludeLastWord ExcludeNthWord
HPCC-2197 Ecl package command line parameters need to be more consistent
HPCC-7888 Ensure query dlls in separate dir
HPCC-7891 colprefix inx with 0 rows hitting assert
HPCC-7828 Replacement Images for ECLWatch
HPCC-7887 rowarray.ensure(0) debug assert
HPCC-7886 Issue warnings and retry on thread start timeout
HPCC-7868 PackageSet needs a unique id
HPCC-7877 Fix ECL CLI errors referring to Cluster rather than Target
HPCC-3263 Flag libraries when published to QuerySets
HPCC-7828 Replacement Images for ECLWatch
HPCC-3326 Thor Lookup Join improvements
HPCC-7880 Additional thor memory tracing
HPCC-0674 Add new word remove functions to Std.Str
HPCC-3198 Remove 'Run ECL' link from EclWatch
HPCC-7870 Convert 'Slave Number' input to integer before comparison
HPCC-7869 Roxie cores in regression suite
HPCC-0716 Include superfile into addSuper transactions
HPCC-3266 Add Clustername to Std.System.Thorlib
HPCC-2958 Configmr - buildset for dropzone is mixed
HPCC-7820 Add LDAP scope for the per-user temp file location
HPCC-7851 Use StringArray sort()
HPCC-7864 Standalone mode broken in Roxie in 3.10
HPCC-2941 Configmgr - XML view should be labelled XML View
HPCC-7862 Initialize and Terminate JLIB in Treeview executable
HPCC-7851 Sort published job alphabetically in WsECL
HPCC-7859 Fix unity installer
Remove setActive, add cache lookups to transaction
HPCC-3162 Fix windows StringArray export and template instantiation
HPCC-3134 Configmgr - Need finer granularity when copying Hardware
HPCC-3312 Support setting per-query memory and time limits from CLI
HPCC-3314 Configmgr - Need finer granularity when copying Hardware
HPCC-3198 Remove 'Run ECL' link in EclWatch
HPCC-7836 Changes to docs to remove or replace IE-7
HPCC-3206 Display Delete access denied when no access to a scope
HPCC-3078 Add preflight option to display usage of mounted disks
HPCC-3187 Remove JDBC Driver from HPCC-Platform source line
HPCC-7823 Add element to extend reuse of file
HPCC-7823 Added informalexample tag to ECLR modules
HPCC-3162 Hide DelimToStringArray
HPCC-7831 filterprojects fail in child queries
HPCC-3039 Add how to use INI file & Env Variable details to ecl CLI chapter
HPCC-3324 ESP can crash if multiple queries received together
HPCC-3292 Don't update workunit jobname when publishing from CLI
HPCC-3297 Show usage when ecl queries copy is called with no parameter
HPCC-2704 Use const methods in IReferencedFile interface
HPCC-3116 Deschedule WU even if the WU is not found
HPCC-3286 Provide new helper function to estimate row memory consumption
HPCC-3210 Ensure temp files are under user scope
HPCC-7816 Update CONTRIBUTORS file to reference Jira issues
HPCC-7815 Remove redundant/wrong default dir
HPCC-7810 Add chapter about Packages to Roxie Manual
HPCC-3278 Fix File Spray rate displayed in DFU Workunit Details page
HPCC-1874 Modify code to avoid using dynamic array allocation
HPCC-7807 Change commit-msg tests to Jira
HPCC-1874 Configmgr - Enable deletion of attributes
HPCC-3136 Configmgr
- Improper notification of config file change
- After generating a configuration using the wizard.
Selecting advanced view will no longer refresh configuration.
HPCC-2394 Don't ignore xpath within ECL IFBLOCK when outputing XML
HPCC-2938 Fix Configmgr - Component tree collapses
HPCC-2636 Refactor Preflight code to avoid multiple SSH calls to same node
HPCC-3281 getPlatform() should not cache
HPCC-2122 Add ability to pause DFU queue
HPCC-2704 Setup and copy files to roxie when copying/publishing queries
HPCC-3294 Implementation of CHOOSE(expr, ds, ds, ds)
HPCC-3274 Add proxies for EE-only plugins to CE builds
HPCC-3199 Added new actions and options to Client Tools manuals.
HPCC-3281 Fix for exception thrown in helper
HPCC-3199 Add --no-activate option to ecl publish and change default
HPCC-3216 Add more info to int/string in IR
HPCC-2255 Improve WsECL error messages when roxie communication fails
HPCC-3157 Update query publishing and ws_ecl to use target as queryset name
HPCC-3157 Roxie using target cluster names to load QuerySets
HPCC-2705 Add cli support for ecl roxie reload
HPCC-3255 added -- to target and server parameters in sample code
HPCC-3255 removed one more @ from sample code
HPCC-3255 remove @ from sample code
HPCC-3255 Change examples to use ecl run instead of eclplus
HPCC-3221 Fix typo when regressing an unadopted change
HPCC-2562 Change license to Apache
HPCC-2169 Add wildcard support to ecl unpublish for queryids
HPCC-3246 Fix Configmgr - IE specific display issues
- IE specific issues prevent proper rendering of webpage
- Fix use of commas in javascript
- Fix javascript comparison
HPCC-3209 Remove some un-needed code and simplify
HPCC-3137 Fix Configmgr
- XML View doesn't handle quotes(")
- Use XSLT to escape single quotes so javascript properly handles
string
HPCC-2562 Change license to Apache
HPCC-3221 Various memory optimizations for eclcc
HPCC-3218 Remove timing info from eclcc tests
HPCC-3209 Add Block input form to WsECl
HPCC-3232 ESP to cache password expiry policy
HPCC-2827 Configmgr - Provide msg when validation finds no issue
- A pop message will indicate when validation completes with no issues
HPCC-0658 Add user option to eclplus
HPCC-3223 Fix Submit button problem on preflight result page
HPCC-3200 Return StringBuffer reference from appendJSONValue
HPCC-2879 Add spray test
HPCC-3203 Script error on ECLWatch from within ECL IDE
HPCC-2706 Add cli support for comparing state across roxie nodes
HPCC-2333 Modify code based on review
HPCC-3005 Fix ECLAgent::getPlatform() problem
HPCC-3196 Fix internal error submitting functional definition
HPCC-3182 32bit Windows build failure
HPCC-2734 platform command line usage changes based on comments
HPCC-3183 Improve git commit message hook
HPCC-3176 Wformat-security warning on ws_dfuService
HPCC-3172 Avoid spurious error on empty inline wildcard superfiles
HPCC-2806 Add ecl-roxie cli supporting attaching/detaching roxie from dali
HPCC-2734 Rationalize cluster name command line usage
HPCC-2333 Outdated Optional packages still display in EclWatch
HPCC-3120 Bad error when viewing WU result on WU Details page
Standardize title format for all modules in Standard Library Reference
HPCC-3133 Fix dict2 key, skip Thor for now
HPCC-2768 Some code in unicodelib plugin is not in proper namespace
HPCC-3066 Roxie not releasing files fully after running workunit.
Added default chkconfig parameters
Add dictionary support to ECL
HPCC-3098 Misleading git tag displayed on internal builds
Fix ESP allowing JSON and XML responses to be redirected
Improve JSON exception handling and numeric string handling for WsECL
HPCC-3081 Thor slave not shown when group name not set
wsecl escaping of json strings
HPCC-2788 rogue error following disk full
HPCC-3070 superfile deleted when removing its subfiles
Changes based on feedback and improved error message
Error message alerts only when there is an issue
More verbose error message
Minor spacing change based on feedback.
Minor optimization based on feedback.
Incorporate changes based on feedback
- Common up and refactor code for Hardware and Software copy
- Refactor iterator syntax
- Remove unused variable
- Remove extraneous code
HPCC-3009 LOCAL on a keyed join causes Roxie to misbehave
HPCC-2956 Roxie support for HTTPCALL activity
Fix build break on strict compilers
HPCC-2675 Implementation of spilling hash dedup
HPCC-2629 Configmr - Save As Button
HPCC-3027 Roxie logs capured in .stderr file
Initial work on trasnformer to common up some selectors
Remove redundant code
Fix whitespace issue
Minor fixes to selector sequence for implicit project
Remove selSeq from no_dataset_from_transform
Further clean up the rows handling to use a single stack
Fix problem with selSeq being redefined
Even closer to worFix problem with implicit project using merging transform
Improve the code to spot differences between expressions
Use an expr attr instead of an attr so it gets transformed
Fix problems where LEFT substituion was incorrectly short circuited
Clean up conditional code
Resolve rebasing merge conflicts
Work towards efficiently disambiguating left
Fix eclcmd build issue
remove outer Response and Results tags from EclDirectEx result xml
HPCC-3029 Changes based on code review. - Don't attempt to create incomplete expression. - Handle null or empty fragment.
HPCC-2629 Configmgr
- save as button
- Add a 'Save Environment As' button to toolbar.
- 'Save Environment As' can only be used in read-only mode
- 'Save Environment As' loads the saved environment file
Fix double output of SOAP struct array root tag
HPCC-3029 Don't always treat expression fragments as table.field.
Either prefix or postfix can be literal strings, or numeric field.
eclcc memory - more savings
Move usedTables to a separate base class
Optimize some representations of no_select
eclcc memory savings - move type field
Change a few more common classes to use CInterfaceOf
Reducing eclcc memory consumption
Improve consistency of help text
Unified ClientTools Packaging for OSX, Linux and Windows.
Changed default install location for ClientTools (???/HPCCSystems/3.8.0/clienttools)
Added third party dlls to windows + OSX install.
Removed invalid dependencies from DFU Plus
Removed OSSDIR from child projects and appended it to CMAKE_INSTALL_PREFIX as needed.
Required folders now calculated relative to eclcc.
Include examples.
Replace const char** with PointerArrayOf
Add COMPRESSED(FIRST) and COMPRESSED(ROW) tests
Improve ws_workunits cluster parameter validation
Consistently use queryname to generate root tags in WsEcl
Add pure specifiers to some internal functions.
HPCC-2849 Move Total Thor Time to end of Timings
HPCC-2955 Spaces not trimmed from workunit id
Add --no-reload option to ecl-publish and ecl-queries-copy
HPCC-2989, more null ptr
HPCC-2998 Remove some getRecordSize(NULL) calls
Additional small regression in recent esp serialization refactoring
HPCC-2974 Remove extra ? in View Data File
HPCC-2161 Package add queryset shortcut parameter should be -qs
HPCC-2979 Return type warning is universal
HPCC-2161 Only one package can be active per queryset / packagemap
Allow roxiemem heap flags to be passed
HPCC-2940 Confimgr
- XML View doesn't properly handle '\'
- Modify XSLT javscript generation to escape '\' characters
HPCC-1836 Configmgr
- Navgtr window jump in IE onclick
- When clicking on an item in the tree in the navigator window the scroll position will no longer reset to the top
- When clicking on an item in the context menu in the navigator window the scroll position will no longer reset to the top
HPCC-2836 - buildindex var row,col_prefix fix
HPCC-2900 fix white space issues.
ESP code generation parameter order for BaseEspStruct::toStr
Fix based on review. Properly handle duplicately named components.
Not more than 10 files per log line
Daliadmin fix checksuperfile usage
Minor for-loop restructure based on feedback.
Fix for out of bounds array index based on feedback
Proper handling of multiple config files matching staged configuration.
- All will be highlighted.
Fix and enhancement for configmgr pull request #2601 and for issue HPCC-2386 - Add highlight to indicate staged envrionment in table triggered from open environment button
- Fix IE specific display
- Removed ForEach loop since only 1 iteration is needed - Cleaned up
StringBuffer assignment
- Add check for NULL pointer and will throw an exception if encountered
Fix for pull request #2593 -
Fix for center context menu not accepting clicks
HPCC-2649 Configmgr - duplicate component
- Add 'Duplicate Componenet/Service' to context menu
- Duplicate components and assign unique name
HPCC-2287 CSV options not visible in DFU workunit
Some more examples of nested conditional execution
Clean up the code and start use more specific flags
Update the way some throw flags are set
Simplify the context flag for tracking skips
HPCC-1887 Configmgr on component rename focus is lost
- When renaming components, the screen refreshes but focus will be on the newly renamed component
HPCC-1629 Spray file default target file name
HPCC-2859 Remove h2h from HPCC-Platform/plugins/
HPCC-2888 add superfile operations to esp log
Move repetitive JSON comma delimiting code into a shared function
ForEach first redundant
Simplify loadSubFiles
Remove fixmissing flag
Expect rounding of the last digit
Rename TempDecimal to Decimal
Use ASSERT(check(cond, fmt, args))
Split BCD tests, init with zero
New option to generate a detailed log file
HPCC-2807 Added version scheme used for platform/clienttools to docs.
Use the same module initialisation under windows.
Add template classes for implementing the linkcounts.
Add an option to rerun a query to eclcc regression script
HPCC-2828 - Clean up code using DelayedSizeMarker
Improvements to the eclcc regression script
Commit of fix of auto-conflict resolved file.
added some XML fixes rebased into 3.10.x ResolvedConflicts:
More normalization of the use of drop list, and some include fixes
phase I of drop list normalization
HPCC-2600 First phase SQL Join support (code review changes)
HPCC-2800,Disable URIPARSER by default
Split off candidate-3.10 branch
Customer request to modify SOAPCALL timeout granularity
Add a size()
HPCC-2815 DelayedSizeMarker mb size patch
HPCC-2390 rollup matching transform result, not left
Add ifdef wrapper for CppUnit
Fix Clang errors
Comment typos
Conditional URI test execution
Re-Enable unittests
HPCC-2721 configmgr
- ldap systemUser drops prepended backslash
Add additional backslash ('\\') for javascript to properly display backslash
Allow multiple include dirs
HPCC-2600 First phase SQL Join support
Support single join (inner or outer)
Join clause turns off index file use
EclEngine utilizes maps for quick lookup of corresponding table->index
and source dataset name
ECL code is more centralized, support for multiple files enabled.
HPCCPrepStatement - now contains cache for multiple index files.
HPCCResultSet - contains structure with all available columns (from all tables in query)
- index turned off for join queries (temporary)
All expression fragments now contain parent table, and field name.
HPCC-2795 noreturn specific to newer compilers
Remove unnecessary extern C
Implement URI backbone
Fix minor issues reported by eclipse
Silence Clang error on private assignment operator
HPCC-2390 ROLLUP - more test cases
HPCC-2390 ROLLUP should compare previous input row
Fix internal assert on (obscure) side-effects in workflow
HPCC-2576 Output debug settings (-f values) to archive
HPCC-2763 Fix valgrind error running compiler test suite
HPCC-2764 Core dumps possible if mix debug/release .so's
Fix crash on linux generating a field usage report
Allow RIGHT ONLY joins against indexes
HPCC-2748 Minor memory leak
Provide a function for estimating allocated row capacity
Add ESP support for JSON formatted responses
Introduce extra hash dedup helper functions
Release more example regression tests
Release some example regression test files
Treat a query containing a single row as output(row)
Missing file from pull commit #0def97c73ad3d104e5eb0b153f9429b8a86e1c0d
Fix scoping issues with #GETDATATYPE
Fix handling of impure conditions and case/map
Address some of the issues from the code review
More minor optimations to child query code
Add Ubuntu Unity Launcher icon
Clone record count information onto the graph results
Reimplement the way child queries are commoned up.
Noreturn in start-stop-daemon
Fix clang -Wreturn-type
Fix clang -Wsizeof-pointer-memaccess
Fix clang -Wdeprecated
Default inline is GCC only
Split use/decl, else, more comments
Add ExpressionDumper basic logic
Fix some issues detected by Valgrind
Fix a few example files to avoid newly introduced error
Old Thor shouldn't have TBDs
Mark when* TBD in thor
Skip library2a in hthor
Add new test case to verify catch behaviour with splitters
Moved chunksize to a define.
Adding missing reserve of space for memorybuffer.
changed loop to no longer worry about a file under the chunkSize as it is handled in read.
Corrections based on code review of richardkchapman and jakesmith.
Add OSX build section to README
HPCC-2660 CATCH,SKIP in Roxie not aborting upstream activities
HPCC-2660 CATCH,SKIP in Roxie not aborting upstream activities
HPCC-2656 thorlib.nodes() always returns 1 on Roxie
More output to library2a.ecl
HPCC-2624 remote.ecl mismatch test in Roxie regression suite
HPCC-2654 Skip library tests in hthor regression suite
HPCC-2515 Improve behaviour of getWuid() in Roxie
Pass ecl command line -foptions to eclcc and to deploy workunit
HPCC-2640 pipe8.ecl test filing in Roxie
Move ESPstruct "NamedValue" to a common ecm file
Moved chunksize to a define.
Index need to be big_endian unsigned
Remove hard-coded locale settings in init scripts
Add missingt call (which currently has no effect)
Fix a minor issue with the selectors for ROLLUP(GROUP)
HPCC-2607 - avoid issues with UTF8 locale
Adding missing reserve of space for memorybuffer.
changed loop to no longer worry about a file under the chunkSize as it is handled in read.
Add ecl completion
Corrections based on code review of richardkchapman and jakesmith.
HPCC-2612 Spurious regression suite error from teststd.ecl
Better file completion
Draft bash completion ECL tools
HPCC-2610
HPCC-2596 added chunking of file read.
HPCC-2596 added chunking of file read.
Changed options to -f<option>=<value> and -X<name>=<value>.
HPCC-2393 Error on keyed child index
Disable intindex until we fix it
HPCC-2387 configmgr
- Give indication of staged configuration
- In the wizard summary and advaned view highlight matching
configuration file matching staged configuration file
- Add tooltip to explain highlighting
HPCC-2596 added support for creation of md5sum from file.
Add options to 'ecl run' for setting debug and stored variables
HPCC-2596 added support for creation of md5sum from file.
Fix dllsToSlaves option
Fix potential use of NULL pointer in printf %s
HPCC-2202 Incorrect output from xml output(row)
Compress query init and trace timing
HPCC-2549 Add pwd expiry column to ECLWatch users screen
Skip applyaction while HPCC-2351 is not fixed
Stop GRAPH(expr) always hoisting (debug operator)
Only create expression if actually used
Short circuit constant replacer
Optimization: Add member function to avoid cloning
Mark regress query with IFACTION TBD
Avoid cloning expression when can just link instead
Optimize handling of no_self on rhs of an assign
diskread optimization
Optimize (and fix) appending a row to a dataset
Add usage message to Roxie
Make catch3 Roxie-only test
Skipping unimplemented Thor tests as TBD
Minor refactor of child query spotting code
Clean up code and remove unused function
Remove code that is no longer required
GH#2328 edited ECLPlus docs to use standalone ecl only, instead of .file
Add comment on how to debug symbols
Adding output to avoid premature optimisation on LEFT case
Allow dynamic counts
Allow dataset to have its arguments optimised
Optimise NORMALIZE to DATASET
Add create superfile inside transactions
Fix assert when ebcdic string used in filename
Fix regression in eclcc accessing a uninitialised member
Minor changes following on from code review
Clear warnings in regression
Add include path to regressions
Add compiler+options to log
New option -freportFieldUsage to track fields used
Final fixes and minor optimization
Minor clean up of the enumerated type
Extend implicit row projection to nested rows
Better error handling, using external diff
recommit of Version.xml.in
Release extra tests for nested selects
Added support for striped tables in docs
Modified the Version source files
commit of Re-revised Version.xml
Fix typo in dali regression suite
Added some code for CHM production to Version docs
Pagination fix for Installing_and_RunningTheHPCCPlatform.xml
Release Notes for 3.8.6
=============================================
Known Limitations for Community Edition 3.8.6
=============================================
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.
Centos/Red Hat/SuSesudo rpm -e
Ubuntu/Debiansudo dpkg -r
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv start
This only has to be done once. - On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821) - Querying a corrupt superfile could produce inconsistent results instead of an error message. However, the source of the superfile corruption has been fixed in 3.8.4 (HPCC-7908)
=============================================
Comprehensive List of changes from 3.8.4 to 3.8.6
=============================================
HPCC-8027 skew percentages not visible in graph
HPCC-8018 - Dynamic array causes Windows build failure
HPCC-7884 Detect superfile error on reload subs
HPCC-8001 Modify example to ensure group aggregate not generated
HPCC-8001 Stop generating grouped hash aggregate activities
HPCC-7996 Introduce memory manager spill threshold option
HPCC-7942 Fix problem with LIMIT(0) on an JOIN(,ALL)
HPCC-7880 Additional thor memory tracing
HPCC-7861 Fix field xpath('') causing invalid XML
HPCC-7888 Ensure query dlls in separate dir
HPCC-7904 Allow xref max memory to be configured
HPCC-7884 Detect superfile error on reload subs
HPCC-3328 Increase dafilesrv file handle hard limit
HPCC-8110 GETENV should fall back to calling OS getenv()
HPCC-8112 Added support for environment profile to hpcc_setenv
HPCC-8130 Fixed IFS issue related to spaces in path in profile
HPCC-8130 Loading of profile regression on start of platform
=========================================
Release Notes for 3.8.4-1
=============================================
Known Limitations for Community Edition 3.8.4-1
=============================================
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.
Centos/Red Hat/SuSesudo rpm -e
Ubuntu/Debiansudo dpkg -r
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv start
This only has to be done once. - On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821) - Querying a corrupt superfile could produce inconsistent results instead of an error message. However, the source of the superfile corruption has been fixed in 3.8.4 (HPCC-7908)
=============================================
Comprehensive list of changes in 3.8.4-1
=============================================
gh-3151 Fix Thor's setIORetryCount setting
gh-3115 Core in eclagent testing Std.File.MonitorFile
gh-3138 fix missing error deleting subfile
gh-2940 Confimgr - XML View doesn't properly handle '\'
gh-3094 Fix Configmgr - Writing modified optional attributes was reverting their value
gh-2731 not disable 'retain superfile structure'
gh-3076 Add Slave Number column on Cluster pages
gh-2995 Chrome Drop Down displays behind Graph Control
gh-3106 CONTRIBUTORS file updated to reflect requirement for issue ref.
gh-3101 Give warning when DICTIONARY used as an identifier
gh-3007 Configmgr-should check for dafilsrv + ftslave when adding thor slave
gh-3023 Fix error calling MakeAbsoluteSD
gh-3024 Allow set permissions for repository root
gh-2933 - Ensure pid files are removed on reboot
gh-3055 FIX minor typo in error messages
gh-3050 Correction to docs -- add uninstall instructions for Ubuntu.
gh-2860 https connection to EclWatch failed
gh-2949 Fix password expiration issue with openLdap
gh-2886 Made edits to DFUPlus doc: add transferbuffersize=nnn, format=recfmv, format=recfmvb
gh-2834 variable length indexwrite fix
gh-2829 OSX Load Plugins Issue Dynamic loading of libraries was failing in eclcc on OSX
gh-2786 LDAPConfig to filter out DC entries for DNS
gh-2715 FileActors example not extracting episode numbers
gh-2478 wrong order of machines in preflight page
Change multimap to BoolHash and set the BoolHash using Network Address, process name, process type and process number
Which define unique preflight request for system component.
gh-3321 Fix memory leak for large blocks in memory manager
gh-3313 Memory fragmentation issues
gh-3280 Update license to match latest version
gh-3280 Fix problems projecting nested records
gh-3248 Fixes font issues in the Eclipse, CHM and PDF documentation outputs
gh-3242 xalan libraries resolved to wrong folder
========================================================================================
HPCC-7843 Temporarily dump stack trace dereferencing NULL user
HPCC-7838 stack dump changes break in string function
HPCC-7834 Temporarily dump stack trace if default dali user
HPCC-3298 Fix problems accessing SHARED symbols
HPCC-7813 Add sub-del test in daregress
HPCC-7817 Memory leak in Std.Uni.GetNthWord
HPCC-3286 Update to use new getExepctedFootprint()
HPCC-3336 Update to reflect review comments
HPCC-7812 DFS loadDefaultBases race condition
HPCC-3286 Minisort could spill and lose records
HPCC-3299 Fix missing export from Std.System.Util
HPCC-7811 Fix DFS filename rename issue
=========================================
Release Notes for 3.8.2.2
=============================================
Comprehensive list of changes in 3.8.2-2
=============================================
GH-3321 Fix memory leak for large blocks in memory manager GH-3313 Fix Memory fragmentation issues
=========================================
Release Notes for 3.8.2
Known Limitations for 3.8.2
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.
Centos/Red Hat/SuSesudo rpm -e <package_filename>
Ubuntu/Debiansudo dpkg -r <package_filename>
- To uninstall the HPCC optional packages from your system, issue the appropriate command below. If necessary, do so on each node that it is installed on.
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv start
This only has to be done once.
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
- The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821)
=============================================
Comprehensive List of changes from 3.8.0 to 3.8.2
=============================================
gh-3161 Pass user descriptor when checking logical files gh-3163 Dali iterateFiles/ldap optimizations gh-3083 logical rename, not renaming physicals correctly gh-2418 LDAP Dali dont use NULL user descriptor gh-3088 Fix possible memory manager deadlock gh-3073 Fix schemas not matching results when using xpaths gh-3075 Add result_lib.xslt support for displaying attributes gh-3054 Fix incorrect 'Cluster Stopped' display for hThor and Roxie gh-3063 Fix possible crash in esp gh-3040 promoteSuperFile fix gh-3047 Consistently use queryname to generate root tags in WsEcl gh-2821 ECL Playground IE8 Issue: gh-2991 hThor file published group name gh-2821 ECL Playground: IE7 + IE8 Loading Issue. gh-2834 variable length indexwrite fix gh-2990 rowarray removeRows crash gh-2779 Remove default daliadmin file logging gh-2784 Config Manager populate ldapserver basedn gh-2760 Invalid links to download resources. gh-2747 FIx empty page from Users link for non-admin gh-3188 Fix ws_ecl resource leak after calling resolveQueryAlias
=========================================
Release Notes for 3.8.0
Known Limitations for 3.8.0
- If you have optional packages installed from previous versions, you should remove them before upgrading in order to avoid confusion.
- If you have an existing multinode system or customized system, make sure the port for ECLDirect and ECLWatch are the same (default is 8010). This is necessary for ECL Direct/Run and ECL Playground to display on the ECL Watch page.
- Resizing the result field of the ECL Playground (in Firefox and IE) will cause the Graph to appear and refresh constantly.#2405
- In Chrome, the ECL Playground Sample drop list displays behind the graph screen.
- When running ecl in ECL Run/Direct now, the workunit details will be returned immediately instead of the actual result itself. If you want the results, navigate there from the section in the details.
- If you are upgrading, the new install may fail to stop Thor. To avoid this issue, we recommend stopping your system components before installing the upgrade.
- Dafilesrv should be running before you start other components. Occasionally, in large systems, the hpcc-init start script tries to start a component before dafilesrv is ready. To avoid this issue, start dafilesrv before any other components after installing. You can use the following command:
sudo -u hpcc /opt/HPCCSystems/sbin/hpcc-run.sh -a hpcc-init -c dafilserv start
This only has to be done once.
- On a system with LDAP Security enabled, if you are logged in as a user without Administrative rights, attempting to access User/Permissions pages in ECL Watch should show an exception: Access denied, administrators only. In this release, a blank page is returned.
- If you are upgrading from a previous 3.8 rc version on any system that uses rpm for installation (Centos, OpenSuse), you may see a message such as:
package hpccsystems-platform-community-3.8.06rc.x86_64 (which is newer than hpccsystems-platform-community-3.8.01.x86_64) is already installed
The workaround would be to run rpm -e on the previously installed package and then rpm –Uvh the new package. On Debian systems where you would be using dpkg you will get a warning: downgrading, but the installation completes. - The ECL Playground may not load in Internet Explorer in versions earlier than IE9. (gh#2821)
- There is an issue that causes the maximum length of a variable length key/payload indexwrite to be 4k. When building an index with a key/payload row that exceeds 4K, an assert in ctfile.cpp will result. (gh-2834)
===============================
Comprehensive List of changes in 3.8.0
===============================
#2336 Spill loop
#2352 Page Loaded Results
#2057 Configmgr reload config if environment file changes
Modify memory cleanup to use Owned object.
Add delete to clean up memory allocated as result of call to CFile::monitorDirectory
Replace mutexs with critical sections
Replace locks/unlocks with local synchronization objects
Use single thread for configfile monitoring.
#2349 Archive-dependency #2216
Deleting external temp file dependencies inside CQ
#2353 Centos6 Dependencies
#2274 Added el6 dependency list.
Mark link with _dependsOn if different nesting level
#2340 Spot invalid files in progress file
Added missing dojox files.
#2332 Graph progress
#2338 Row count 64
#2216 Add dependency on libarchive
#2323 Child query varfilename
#2348 ecljdbc aggreate fn work
Adds eclfunction classes to keep track of ECL function properties
Clean up several sections of code (removes unneeded comments,etc.)
Sends cluster param
#2208 Sink timings were not handled properly
#2341 ESP addlogicalfile
#2316 Add logical file to new supefile in ECL Watch
Fixed Url reference for DFUWorkunits in the ECL Watch Activity Page
#2319 loop sync optimization
#1083 use 64bit row count on 32/64 systems
#2335 pkg filecopy nodaliip
#2334 Fix references to EE
Use a spill result for a dataset hoisted from a loop
#2325 Ecl package copyFiles needs to properly read dali ip param
#2293 Modify Enterpise Edition Only message to a friendlier Coming Soon message
Minor changes, reflecting comments
Minmize graph progress
Refactor watchdog and implement MP version
Updated Doc Changes for 3.8
Changes to remove references to optional packages for 3.8
#2241 Page Loaded Results
#2321 pkg error reporting
#2318 treemaker
#2301 Provide the input meta for a graph loop result output
#2315 child query varfilename handling
Catch another possible progress serialization crash
2196 Ecl package needs to return error messages to user
Adding Initial Genesis User Guide docs to 3.8x branch
Removal and rename of HDFS_Stream. Commit to 3.8.x
Loop subgraph init optimzation
loading an empty xml stream, created wrong root node type
Generate .ldaprc file using configgen
#2312 prev grouprollover fix not quite right
#2308 Roxie selftest regression causing core
Global group regression
#2291 Move dbgassertex to jlib so it can be used elsewhere
#2285 graph progress crash
#2257 Allow graph results to have spill priority
#2272 Add progress of loop (counter)
#2282 Fix issue with childif and graph progress
#2286 Added CMakeLists.txt files for HDFS_to_HPCC_Connector doc
Removed unused "context". Mixin is more efficient than delegate.
Remove misleading CThorExpandingRowArray constructor
Remove blocking progress crit
#2220 pkg delete crash
#2238 loopresult issue
#2230 ecljdbc jar build
ECLPlayground: Page loaded results.
#2277 HDFSConnector Guide Revisions
#2275 emptyloop
#2278 Typo corrections and minor updates to ECL LRM
Prevent FROMXML being forced to execute inside a graph
#2279 Fix join nosort primary regression
#2239 selfjoin child stall
#2280 Fix global merge on 1node regression
#2276 Created guide for HDFS connector
Fix loop empty error, if any slaves sill processing
#2258 pkg copyfile crash
#2229 Restructured path variables to avoid long relative path per code review
Global patch of loop subgraphs
Fix issues with distributed results in child queries
#2270 Fix compilation error in x86_64
#2267 Failed libxslt transforms causing core in libxml
#2229 ECLJDBC driver inherits platform's cmake version variables and values.
Using sizeof(record, max) to determine records' max length, which is used
to determine termination threshold in case of data format error.
The H2H feature now logs to the standard hpccsystems log location.
HPCC environment.conf variables are used to determine appropriate location.
#2260 Fix hashjoin regression caused by 2195
#2247 ecl package copyFiles crashes if no user / password specified
#2240 Dali audit logfile
#2227 ldapNeverExpires
#2249 replace streaming labels
#2248 pkg copyfile daliip
#2244 ecl package command line needs to process daliip parameter
#2242 Removed all "stream" references
#2181 ecl package delete can cause esp to core
#2231 Wrong Dali audit logfile name constructed
Fix selfjoin global child query stall
#2235 leaks
ECLPlayground: Formatting changes only.
Fix some global group issues and leaks
New ESP accounts should have expiring passwords
#2200 ldap Names
#2178 ECL Playground
#2223 Fixed a few memory leaks
#2195 Up Thor version number
Switch Thor to RoxieMM and use new swapping paradigm
Move roxierow to roxiemem
#2214 superattr-blank
#2209 roxiePipe
#2206 nullnew
#2213 superfile desc's ignoring blank attrs
#2205 Use logfile creator for roxiePipe logfile
#2184 actinitrace
#2210 Fix a complie warning in ws_dfu
#2212 Fix problem incorrectly removing COUNTER from PROJECT
Keep 'SmcAccess' and better display of permissions page
Fix problems with new returning null on linux
Improved error reporting when LDAP object name exists
#2065 Replace 'SMC' in ECLWatch/ConfigMgr UI
Releasing crit too early
#2193 Fix regression if memory leak option is enabled
#2194 Remove 'break' from if stmt
#2191 precise-workaround-2187
#2188 precise-workaround-2187
#2189 Report "ESP Password Expired" to user
#2173 pkg_activate
ECL Playground: Load from existing WU.
#2180 child flags
#2187 hpcc-init fails to stop thor on Ubuntu 12.04
#2159 FEATURE - support for reading directly from zip and other archives
#2185 SelfJoin object leak, cause error if spilled
Restructure child dataset flags so they are more useful
#2183 pkg_delete_nofileneeded
Protect against potential act. init race
#2182 Pkg file delete should not require a local copy of the pkg file
#2179 Fix internal error on complex nested field selection
#2166 Add the ability to properly activate / deactive package sets
#2167 dfs-daregress
#2165 Dataset count range starts at 1
#2171 Fix problem using unsigned numbers in #line
Revert superfile regression, hint what to do to fix later
#2163 FEATURE - hook-based git file reading
#2154 FEATURE - hook-based git file reading
#2132 ECLPlayground
#2386 Fix various problems with the checking allocator
#2385 archive-dependency-2216
#2378 ECLPlayground: Fixed issue when hosted within an iFrame. #2366
#2384 Incorrect libarchive dependency in lucid/maverick
#2362 Ensure clearAggregate() fields are assigned in order
#2374 archive-dir-2383
#2379 The name EclLimit can be misconstrued therefore the property more accurately
describes its function
#2363 zip files in local directory cause eclcc to assert
#2367 Housekeeping, remove redundant code/files
#2373 Unlock access to File monitor singleton
#2364 Fix compile problem with CWsDeployFileInfo
#2361 #2281-cherry-pick
Final fixes and minor optimization
Minor clean up of the enumerated type
Extend implicit row projection to nested rows
#2493 Use the correct loop bound for checking alignment
#2482 derivedmodule
Update based on review comments
Ensure the allocations from the roxie heap are aligned
#2486 Restructure SQL parser
#2477 callbackrecurse
#2465 gh2460
#2480 Can't access archived workunits
#2466 Add sum() support
Add sum() function description
Add sum() and sum() group by support
#2483 Remove Relogin function from ESP
#2419 rowtable-opt
#2484 Correct libarchive dependency on Squeeze
Fix the tracing message so it is clearer
#2437 validate cluster
#2470 Correct libarchive dependency on Squeeze
#2451 row project bug
#2449 Issue_2415
#2472 xml exception
#2463 Fix configmgr crash when passing an invalid sourcefile in query string
#2461 #2435 floating context menu
#2464 Add missing options to DFUPlus docs
Fix error overriding a transform in a module
#2479 Fix crash comparing varunicode constants
Fix stack fault if memory callback allocates memory
#2458 centos6deps
Fix HTML returned for exceptions when xml response requested
Improve ws_workunit and EclDirect cluster name validation and default behavior
#2411 Distiguish between clusters and querysets, and validate
#2445 fixed naming issue in el6 dep file.
#2460 dropzones not selectable for file upload
#2435 configmgr - Close context menu on top doc click
#2455 ECL Playground doc to fix image refs
#2453 ECLPlayground: Warnings not displaying.
Fixes problem where rows could lose fields
#2518 Ensure reuse of a file inherits all nescessary flags
#2423 issue2219_2
#2448 packagingDir
#2505 thorlog
#2476 resolve some thor log issues
#2491 issue1945
#2457 playground link
#2514 issue2495
#2502 Thor duplicate port check
#2506 bindcrash
#2501 packedrecord
#2511 ldap Make Dali filesBasedn required
#2512 Updated docs and images to reflect ECLwatch changes
ESP not logging failed permissions check
#2503 Truncated Archive when download
#2499 Implicit table alias support (regression fix) Acknowledge table alias sans "AS" keyword.
Protect against a crash with invalid ECL
#2498 SP columnfix
Ensure stop_slaves is build into package
#2471 problems with multithor init scripts
Fix problem with inline dataset and packed records
#2489 fix getprocs and getproccolumns
#2494 Create placeholder class for development
The placeholder "HPCCVersionTracker.java" class is overwritten by CMAKE process with appropriate
HPCC Version
#2448 Added plugins and corrected improper warnings on install. *
#2522 Support NetworkAddress_Port as input and add a popup help
For legacy workunit, allows a user to enter ip of slave.
#2585 Issue defining topology with same name and prefix in any order.
#2583 Get thor slave log on node getting wrong log
getLogs not returning logs in legacy
#2552 configmgr javascript exception
#2577 multistop-issue
need to sort before uniqing
#2570 multislave stop issues
#2575 More Housekeeping document changes regarding the document build issue gh-2548
EclWatch: Issues displaying incomplete results.
#2573 Start slave-multispeedup
#2565 Slow startup when slavesPerNode > 1
#2535 n-waymerge fix
#2569 Rollback misreleased mergededup.ecl (from #2563)
#2571 Fix problem stopping local slaves
#2567 Add getWuidVersion method
#2548 Housekeeping changes regarding the Document Build
#2533 n-way merge fail
#2476 Add methods for adding/retreiving logs to workunit
#2508 superfile support
#2559 Fix broken hpcc_setenv, due to Mac changes
#2554 eclcc Fix a couple of memory leaks
Fix unhandled javascript exception. Check to ensure variable has been assigned before using it.
#2537 mac build error
#2528 dyn lib support
#2542 test Ct_package
#2541 added ecllibrary to all packages built.
#2517 Create_test_pkg
#2526 multithreaded_doc_build
#2531 LDAP server prompts foir DaFileSrv & FTSlave
Fix build error on OSX in archive reader
#2524 configmgr issues in IE
#2459 Added target properties for includer files and images.
Change paramter type to const char* based on review feedback.
#2490 Add config to exclude ldapServer from comps_on_all_nodes configuration setting
#2527 Added support for mac to hpcc_setenv
#2459 Clean up of docMacros.cmake to correct -j build failures.
#2508 Superfile support Fix DFUFile.getSubfilescount() issue. DFUFile.containsSubfiles() now uses getSubfile
#2523 Add IE specific javascript to clear context menu.
#2508 Add superfile support Create dfufile container class (HPCCLogicalFiles) *
#2500 Create test package for jdbc driver
#2648 from Mac Packaging
#2643 standalone regression #2642
#2642 Standalone hthor programs fail to start
#2593 Improve context menu UI
#2634 Regression suite failing on library tests
#2588 Single Document Builder Factory
#2620 Improve Get Slave Log for Workunit
#2588 Reuse thread safe DocumentBuilderFactory object.
#2618 file page support
Add pagesize property, defaults to 100
Don't fetch all files every time a single file's metadata is needed. \
Cache individual file's metadata \
Improve search
#2617 Replace getDebugValue() with getLogs()
#2540 changes based on code review.
#2476 Cluster name cannot be hard coded
#2616 start_slave-fix
Soft link to thorslave causing problems
#2586 parse optional modifiers
#2603 JComp incorrectly quotes source file name
#2595 Fix ESP cores when WU ID not found
#1633 modified Installing_and_RunningTheHPCCPlatform.xml *
#2709 Roxie dali connection
#2701 MAC Packaging
#2650 Connect timeout
#2696 Cache the Collator between calls to unicode editdistance
Better handling of invalid unicode status
#2697 Split of Client Tools User's Guide into two variations.
#2682 subs-remove-issue
Ensure Dali subscription removed on exception
#2692 Documentation pagination fixes
#2666 Improve context_menu_ui
#2676 MAC Client Tools
eclcc default folders on OSX eclcc is unable to locate plugins and ECL Library
when installed as part of Client Tools on OSX
#2689 connect to dali timeout
#2667 Roxie dali connection
#2681 Ensure SDS client connection removed
#2673 unicode wild match
#2667 Roxie dali connection
registerClientProcess escalating delay to connect
Optimize prefix join on unicode fields
#2593 Fix for center context menu not accepting clicks
#2619 update wsecldirect default port
Adds configurable connection timeoutval *
#2728 ECLPlayground Override default target.
#2738 EclPlayground docs add target drop list
#2733 Ensure stdout is flushed for stand alone roxie
#2714 dfs del
#2726 Roxie standalone program delay
#2712,Fixing unconditional deletion of super, avoid lock on add/del subfiles in DFU
#2722 update to options of ECLCC in Client Tools manual
#2702 roxie query cleanup
#2717 Mac Package name wrong + rpath issue.
#2719 Fix invalid assert assertex(required < choosenLimit)
#2711 Ability to verify same queries are on all roxie nodes
Remove potential double // in dllserver records
=========================================
Release Notes for 3.6.2
Known Limitations in 3.6.2
- Relogin from ECLWatch is currently not supported in Firefox.
- Due to changes in the authentication methods on ubuntu 10.10 and above, ulimit allowances from pam are not enabled by default. To allow the hpcc user to set limits correctly, this pam module must be enabled.
It can be enabled on a default ubuntu install with the following steps:- Sudo vi /etc/pam.d/common-session
- Append the following line to the file.
session required pam_limits.so
- Thor queries may fail with port errors in local configurations.
For configurations where the EclAgent process is configured to run on the same nodes as slaves and there are multiple slaves per box (slavesPerNode >1) you may, if unlucky, hit a port in use error when running queries. You can avoid this issue by ensuring EclAgent doesn't run on the same node as slaves or by changing the thor slave base port, to a number that will keep it well away from any other component ports (for example, 20000).
- The code generator incorrectly tracks the sort order and distribution of a LOOP or GRAPH as matching the input dataset, rather than the intersection of the input dataset and the loop/graph body. This could potentially cause incorrect optimizations to be done on the output of a LOOP.
- If LDAP is turned on in Dali for File Scope security, you get an error when trying to view a data file using the View Data File feature in ECL Watch.
---------------------------------------------------
Comprehensive list of changes in 3.6.2
---------------------------------------------------
GH#2187 provides a workaround to a regression in Ubuntu’s killall command that prevented Thor from stopping correctly under Ubuntu 12.04
GH#1985 ChooseN issues in child queries
GH#1942 Added temporary ulimit settings for dafilesrv.
GH#1991 Use correct architecture dependent hadoop lib path based on Hadoop uris
GH#1980 Support checking against tags for multiple editions
GH#1978 Fix Build break httptransport
GH#1972 Add useradd/groupadd to esp files
GH#1911 ESP should not log password
GH#1957 Ensure manifest object is valid before using
GH#1930 sendEmail rejecting some valid server addresses
GH#1933 fix useradd groupadd_html
GH#1938 Fix useradd.html and groupadd.html
Add useradd.html and groupadd.html to CE
GH#1871 ldapsecurity link failure when USE_OPENLDAP=0
GH#1806 Thor and Dali created via Advanced view will not have optional attributes.
GH#1916 Fix expansion of SELF.x used on the rhs of an assign
GH#1902 Add test case to regression suite to cover lookupjoin leak
GH#1910 Add support for Include statements in manifest files
GH#1855 soap calls to wsecl not checking credentials
GH#1900 Roxie memory leaks not always properly cleaned up
GH#1719 Roxie regression suite assumes local server
GH#1865 Roxie can core when query deployed
GH#1822 Fix xref attach/remove files
GH#1834 Remove validation before starting ConfigMgr
GH#1646 Roxie groups only updated on new env.
GH#1873 Fix ecl command line should default to not limiting results
GH#1891 Implement LOG(MIN) and LOG(expr) for SOAPCALL
GH#1890 Fold filenames to ensure they are consistent
GH#1885 Remove more traces of (now unnecessary) hack in prefix join
GH#1889 Disk aggregate and index aggregate could corrupt memory
GH#1880 Fix resource permissions display on FireFox
GH#1876 op78Lookup join stop race deadlock
GH#1868 Grouped HashAggregate deserialization error
GH#1875 Prefix join core - previous fix not correct
Fix problem with constant folding inline tables
GH#1913 ldapsecurity link failure when USE_OPENLDAP=0
GH#1914 Thor and Dali created via Advanced view will not have optional attributes.
GH#1937 hiddenselector
GH#1904 Roxie regression-suite
GH#1906 Roxie databuffer-leak
GH#1857 Fix 'Page Not Found' error when change password
GH#1831 Recent change broke Dali start if clean
GH#1646 Detect new environment cluster group changes
GH#1851 Fix some build errors on Mac OSX from recent changes
GH#1786 Added creation of PDF docs to CMake.
GH#1686 missing WsWorkunit support for WUActionExecuteExisting
GH#1728 Add ecl queries support for showing suspended given cluster
GH#1595 Remove unused configuration option syncCluster
GH#1646 Detect new environment cluster group changes
GH#1825 LDAP / esp addition in community OSS code
GH#1779 ecl command line does not support setting result limits
GH#1774 Fix soap to WsEcl for calling roxie queries broken
GH#1663 Display component name for thorslaves
GH#1775 Splitter, child recs issue
GH#2001 docs-Update Permissions section and added image
GH#1956 eclwatch link to component configuration file fails
GH#1983 Group delete fix
GH#1993 Ecl Watch Crash when searching WUs by Ecl text
GH#1867 Roxie reload core
GH#1805 Child query reading XML dataset failure
GH#1579 Add sections for ecl package commands
GH#1769 Added stagever to the release version in the RPM.
GH#1731 Set Thor slaves attribute to number of slaves times slaves per node
GH#1718 Changed from awk with delim _ to bash expansions to allow for component names with _ in them
GH#1695 remove prependeing roxie cluster to logical files
GH#1683 assertex(diff >= 0) failing in global smart steppingAdd soapcall logging tests to regression suite
GH#1596 configmgr - popup for password verify doesn't have focusAllow dataset as well as LEFT inside the LOG() expr
Added some comments to clarify getRHS
GH#1869 Multislave setups were ignoring nodeGroup
Roxie core in self-join with prefix match optimization GH#1850 branching-strategy
GH#1786 Move package code to community release
GH#1830 Select cluster order on Activity page
GH#1826 syncCluster
Keep environment persist to disk if external
Fix checkEclVersionCompatible checks subminor against wrong value
GH#1784 Guard against no spares on manual swap
GH#1804 PackageCommandsinECL
GH#1375 Add a comment to clarify the code
GH#1375 Access graph results directly if available
GH#1843 execute_existing
GH#1807 ecl_queries_cluster
GH#1839 version_compatible
GH#1756 Remove ThorCluster prop @slaves
GH#1787 wsecl_roxiexml
GH#1789 limit2
GH#1772 add_stagever
GH#1763 Fix ecl command line not showing server side compilation errors
GH#1741 Add getCount(xpath) utility method to IPT
GH#1736 Increase the ecl language version to 3.6.0
GH#1725 Remove default memory setting values from thor.xsd
GH#1716 Change memory size defaults + allow configurable
GH#1700 When generating form for STORED SETS use textarea
GH#1412 fix some more swapnode related problems
GH#1592 Constant fold assert(condition or true)
GH#1573 slave PID file is compenentname_slave_slavenum
GH#1573 Remove Thor slaves and spares from configgen output
GH#1580 Add -listdropzones option to configgen
GH#1607 Fix problem with COUNTER not tracked inside []
GH#1562 Fix preflight display for thor under Target Cluster
GH#1577 Compound filter group diskread could lose records
GH1555 thorloopresult
GH#1566 Fix potential aggregate child query issue
GH#1547 Ensures slaves file exists - backupnode/stop thor
GH#1697 no prepend clustername
GH#1689 roxie-gss-assert
GH#1642 Fix Preflight not work for Multinode thor slaves
GH#1660 show compiling
GH#1658 pw verify focus
Fix activity page not showing contents of eclccserver queue
GH#1637 Results with nested records not deserialized
GH#1621 assertfold
GH#1522 copy_queries
GH#1918 Fix dali backupComputer issue
GH#2019 Thor status link broken due to missing xslt`
GH#2011 Datastream should be build and packaged independent from the platform
GH#2010 Join overflow partition crash`
GH#2004 Remove debug code from index.xslt
GH#1995 Encrypt attributes of view type password
GH#2103 Prevent crash if cache destroyed before files. Roxie caching local files too long GH #2101 Roxie assert error on partially suspended queries
GH#2100 Roxie file cache was not checking timestamps
GH#2099 Roxie generated filenames for index parts were incorrect
GH#2072 filesbasedn not being set in esp.xml
GH#2080 Thor tmpfile threading
GH#2024 Thor could core in CGraphTempHandler::registerFile
GH#1154 Changed formatting used for version tag in config time generated files.
GH#2043 Added section about backing up data including use of backupnode to Data Handling manual added user security section info to installing and running doc added ldap config info to installing and running doc
GH#2024 Move thor base ports, to avoid clash
GH#2027 Meta informaiton for a loop/graph was wrong
GH#1918 Fix dali backupComputer issue
GH#2135 Enable the Roxie package file processing ESP service
=========================================
Release Notes for 3.6.0
Known Limitations in 3.6.0
- If a Thor cluster is re-configured in an environment and deployed to the cluster, the HPCC cluster will not use the new Thor topology if it mismatches the previous layout. Instead it will issue warning(s) within the Dali logs. Similarly, if the new environment, with mismatched Thor cluster layouts are pushed to Dali using the 'updtdalienv' cmd tool, it will issue warnings if there are mismatches. This is primarily to prevent any swapnode that have occurred in the interim from being lost.
In order to force an update to reflect the new deployed environment, it is necessary to use:
updtdalienv-f
The '-f' will force the Thor cluster layouts in the environment to take precedence over the existing environments in Dali.
Alternatively, to force an update of an individual ThorCluster (if there are many), the 'swapnode' cmd line can be use,. For Example:
swapnode reset
- If you have any 6.6.0.x version of the ECL IDE installed, it might require you to first uninstall that version before installing this version of the ECL IDE.
- If you have an existing configuration in your ECL IDE and upgrade the server it is pointing to, you must change the compiler entry to use the ver_3_6 folder.
For example: C:\Program Files (x86)\HPCC Systems\HPCC\bin\ver_3_6\eclcc.exe
- If you want to point a configuration in the ECL IDE server running 3.4.2 or older, make sure the compiler setting in preferences is using the ver_3_0 folder.
For example: C:\Program Files (x86)\HPCC Systems\HPCC\bin\ver_3_0\eclcc.exe
Note: The ver_3_0 or ver_3_6 corresponds to the language version not the release version. This can be found using the command: eclcc --version
- If you attempt to open an XML file in Configuration Manager and the file does not have hpcc ownership, the Configuration Manager could crash.
----------------------------------------------
Comprehensive list of changes in 3.6.0
----------------------------------------------
gh-1503 Remove typo
gh-1492 Change the way Thor fetches its group
gh-1426 preserve -Wl, for gcc and add options after object
gh-1491 roxie-queries-gh1460
gh-1460 Roxie should indicate suspended in control:queries
gh-1468 viewunicode Fix bug in viewing unicode indexes
gh-1478 hashagg-localfix
gh-1476 Fix regression in hashagg,local
gh-1185 Backupnode log redirection
gh-1430 SOAP Namespace missing trailing '/'
gh-1458 dfuserver Add isReplicated() method
update CMakeLists.txt to create link to exectuable on path
gh-622 set defaultCopies and ensureReplicate
gh-1431 Keep object file for eclcc -c
gh-1428 ws_wu_release_IWUQuery
gh-1443 linkoption
gh-1346 ecl command to list queries
gh-1441 Rename ConfigMgr esp instance name to create the logfiles in the appropriate directory
Fix deadlock in WsWorkunits
gh-1435 backupnode
gh-1426 Implement -Wl, and related changes
gh-1440 subproject_install
gh-1251 added abbility to run subproject install scripts.
gh-1438 squeeze_support
gh-1436 Added check for Debian 6.x and dependency list for squeze.
gh-1185 start_backupnode not working
gh-1424 Fix possible deadlock regression in splitter
gh-1419 Remove deprecated sdsfix
Protect against mismatched master and slave builds
gh-1410 macrosubmit Fix problem submitting macros as queries
gh-1402 Fix problem with missing toplevelkey indicator
gh-1406 Report problems with invalid use of ROW(dataset)
gh-1399 Fix regression from splitter-progress-fix
gh-1358 Roxie memory leaks
gh-1385 splitter-progress-fix
gh-1337 control:lockDali command was not working
gh-341 Remove ability to add plugins via ConfigMgr
gh-1343 Add checkbox "No separator" to Spray csv input
gh-1283 EclWatch Config button not display esp.xml
gh-1373 csvcomp-sizebug
=========================================
Release Notes for 3.4.2
Known Limitations in 3.4.2
- gh-622 Replication of logical files can occasionally fail
- gh-1123 A race condition can cause Thor slaves to fail on first start
----------------------------------------------
Comprehensive list of changes in 3.4.2
----------------------------------------------
1335 deadlock fix - Fix deadlock stopping merge distribute
1161 Rollback flawed memory frag. Protection
1325 Fix crash in eclcc on invalid use of RIGHT
1302 Hashdistribute not handling grouped input
1296 Turn off parallel subgraph handling
1287 Fix issue handling ipv4 addresses with .0
1289 Prevent superfile from being added to itself
1282 gh-1277 Fixed problems of Event Scheduler and deschedule
1218 Add support for support nodes in ConfigMgr Wizard.
1281 Improve error message in ftslave for wrong IP
1196 Allow user to override settings for software components
1186 WsEcl not escaping some XML before calling XSLT
1099 Fix compile issue for old gcc
1099 Detect process affinity and limit threads
1159 Fix graph executor, needs to block if running
1233 Check Cluster Info
1198 Check return from getTargetClusterInfo to prevent core in workunit.dll
1232 Ecl WU Details crashed when cluster not found
1239 Fix regression in roxiemem when resizing rowsets
1184 Add support for support nodes in envgen.
1161 Linux build issues
1226 Superfile resolution from packages may cor
1161 detect low allocator memory
1215 prepare race buildfix
1204 Fix potential seh in eclminus
1207 Set initial size for allocator to min not max
remove redundant if (fixedSize) check
Set initial size for allocator to min not max
Set initial size for allocator to min not max
1159 Fix graph prepare threading issue
1102 Fix problems with AGGREGATE,MERGE transform
1079 Allow descending sort orders for MERGE,SORTED
1111 Potential keyed join deadlock
1112 Compute aggregrate merge on slave 1 (not master)
1105 Spill reference count issue
1104 Hash Aggregrate failing in child query
1042 Thor delay traversing dependencies
282 Update to correct eclserver log name
1029 Roxie debugger stopped working
1022 Fix problems with merged scope becoming inconsistent
1016 Check that git tags match build tag
Add option to use git describe to generate BUILD_TAG
Use _spawnvp instead of _execvp on windows for ecl command line
981 oneiric
1009 Remove deprecated roxieconfig and references to it
1006 Remove eclServer attribute in eclWatch
998 Fix link errors when creating standalone executable
982 Add dependency file for oneiric build
928 Moved all remaining ${SERV} to /etc/init.d/ and
removed sysvconfig as a dep for Debian Lenny.
928 Moved internal calls to dafilesrv init to /etc/init.d
957 IfNull regression
912 Always call getInterfaceIp to find the host IP
439 hpcc user should be a system account
936 Added psmisc to Lenny dependency list.
932 Fix bug casting utf8 constants to longer lengths
923 Fix problems with unknown modules if import unused
907 Page Not Found error when ShowQuery for a file
910 Fix problem with import all on legacy queries
459 improving recovery on bad input
877 Fix problem compiling files not in the include path
820 Exception when click XLS on Thor Usage
864 Update process names so EclWatch can display correct process status
848 Wizard should not generate eclagent for Roxie Cluster Topology
859 Fix issue with status page and shared thors
851 Thor graph execute race condition
843 Thor Usage Graph show NaN%
844 Preflight checking for wrong Roxie process name
817 Fix Graph not found error.
815 Show correct icon for publish dialog.
747 Remove inappropriate const
Add appendQuoted fix
Fix issues where a thor is in >1 target cluster
Fix some issues in activity/usage page
492 Added script to generate a clean deb file.
835 Bad path set to installed rpath for binaries.
836 Fix invalid pointer access in generated code
834 Add time information when running a single test
831 g++ script needs to be executable
830 ECL Command line enhancements
392 WsEcl display of exceptions from query
818 RemoveGroupAdd
186 Remove extra file: groupadd.html
821 Preflight calls old code for EE
824 Add string conversion functions to date module
807 Removing ESP User
153 preflight command should not specify EspUser
=========================================
Release Notes for 3.4
This release, version 3.4.0, has many new features, a number of bug fixes, and some new tools. In addition, two additional operating systems are now supported.
---------------------------
Significant Features
---------------------------
- Support for additional Linux distros -- Ubuntu 11.10 (Oneiric Ocelot) and Debian 5 (lenny)
- Better EE compatibility.
- Roxie queue support.
- New ecl command line tool. This is installed with your ECL IDE. Instructions can be found in the Client Tools manual.
- Thor bug fixes. (see list below)
- std.date - date support in the standard library. See the date.ecl file in the ecllibrary folder installed with the ECL IDE
- Custom output visualization capabilities. See the Visualizing ECL Results PDF for instructions. The PDF file contains a link to download examples.
Known Limitations in 3.4
- Internet Explorer 9 may ask you to login more than once.
- When upgrading from 3.2 to 3.4, it is important to ensure that the eclagent is not attached to the roxie section in the Topology.
------------------------------------
Comprehensive list of changes
------------------------------------
936 Added psmisc to Debian lenny dependency list.
932 Fix casting utf8 constants to longer lengths
923 Fix problems with unknown modules if import unused
907 Page Not Found error when ShowQuery for a file
910 Fix problem with import all on legacy queries
459 improving recovery on bad input
877 Fix problem compiling files not in the include path
820 Exception when click XLS on Thor Usage
220 Update process names so EclWatch can display correct process status
848 Wizard should not generate eclagent for Roxie Cluster Topology
859 Fix issue with status page and shared thors
851 Thor graph execute rate condition
843 Thor Usage Graph show NaN%
844 Preflight checking for wrong Roxie process name
817 Graph not found error.
747 Remove inappropriate const
Add back appendQuoted fix
492 Fix issues where a thor is in >1 target cluster
835 Bad path set to installed rpath for binaries.
836 Fix invalid pointer access in generated code
492 Added script to generate a clean deb file.
Fix some issues in activity/usage page
834 Add time information when running a single test
831 g++ script needs to be executable
830 ECL Command line enhancements
815 Show correct icon for publish dialog.
826 wsecl_display_exceptions
392 WsEcl display of exceptions from query
818 RemoveGroupAdd
824 libdate2 Add string conversion functions to date module
821 Preflight calls old LN code for EE
186 Remove extra file:groupadd.html
807 RemovingESPUser
153 LN preflight command should not specify EspUser
492 Moved to relative pathing for install.
809 Added sysvconfig to Lenny dep list.
781 ref. correct targets/queues on activity page
808 wsecl_query_state
WsEcl to support showing Aliases or Queries and will respect supspended query state.
172 Enable addition of EclServer to Topology
803 User-Agent not set if no LDAP enabled
781 ref. correct targets/queues on activity page
799 main
800 g++ installed to wrong place
705 Slow compiles of generated stubs
795 Unused ESP client wrapper libs
795 Remove extra file: useradd.html
794 wucreate_owner
725 workunit owner not being set
457 Improve WU Publish success\fail error reporting.
159 Load eclServer if component type is eclServerType
499 Changed error message when host cannot be Pinged.
205 Updated maintainer line to have correct format.
239 Updated install output asking user to run keygen with sudo.
779 Moved redirection of stdout to start_slave instead of in the frunssh call.
763 lcrflag
783 Fix broken backupnode
777 remove Replicate option for hthor spray
771 nwayselectbug
774 slowsashastop
775 a helper method to get HThor group names
683 Reduce length verify timeout
108 Remove EE specific components from cgencomplist files
772 NWaySelect late initialization causing crash
108 Move buildsetEE.xml.in to EE source line
Adds support for -main to remote compiling
764 install-ecl
762 ecl command not on path
745 superfile
Switches over to using Legacy to differentiate thor
Add back compatibility check to super files
760 pipeflat
759 legacyoption
761 Release example files for previous issues
Remove legacy LCR option
704 Allow FLAT (and THOR) on PIPE
205 Added chmod command to generate_bash macro.
755 Add missing optimization for set of dataset[const]
752 init_eclserver
754 thorqueuelogging
717 Incorrect queuename in tracing + status
Remove unwanted file init_eclserver
750 fix typo, add expect, libldap deps
443 Lost the permissions settiongs on the default ssh key
443 Correcting typo's and two missing xslt files.
742 dfuprogress Improve ftslave logging (for very large transfers)
741 regresssuite Update test to match new data comparison rules.
711 ws_workunts causing esp cores
443 More regressions from cmake refactoring
443 Typo in one of the refactored files
715 libdate
Use directory wildcards for cases where we want to deploy subtrees
728 bug84019
730 ecl_credentials
731 jobname
Some WUUpdate values not being set
ecl command line user credential support
ECL command line support for external commands
84019 When using wizard, assign esp to the the first ip
722 hthor file resolution issues
205 Refactoring of CMake install system
Should indicate a 'diabled in this version' feature
714 roxie-package-value Package file format inconsistencies
713 issue610
712 from Switch special eclcc debug flags to use - not colon
Fix set of string problems and move code to plugin
707 ee-rpms
More issues when building as subproject
706 ee-rpms
Incorrect paths for generated files when included as a subproject
703 New ECL Command Line tool
701 Fix a regression compiling a non archive from stdin
700 Package file resolution issues
699 roxie-package2 Package id resolution should be case insensitive
698 Optimize DEDUP(ds, LEFT.x = RIGHT.x) in thor
697 roxie-dali
Deleted a char by accident
652 Roxie dali caching
678 loopissues
691 Include options from dfu superfile copy to contents
690 Fix problems with AGGREGATE on complex datasets
694 FIX Roxie not getting queryset name properly from Dali packagemap definition
695 Spill file fails creation
692 Fix if condition for New and New Range to act on "Computer" type only.
689 Add support for Ubuntu 11.10 (oneiric)
581 Enable Roxie queues in ConfigMgr and Wizard
687 Build error using gcc 4.6
684 Fix problem creating an archive from an archive
685 thorlib.group() gives internal error in eclagent
642 ensure correct file is compiled
Loop/Graph issues
675 Thor LOOP could deadlock on exception
677 Protect LOOP maxIterations from going negative
676 GRAPH/LOOP counter invalid via helper call
672 aggregate
671 More info certification process
Fix access to context information from SUM/MAX
Add explanation to external, foreign, multi, query
670 colocal
669 Prevent compiler log files from clashing with eclcc
Fix locality of activities within nested thor loops
666 Roxie locks up when trying to overwrite a file
Fix problems with merged scope becoming inconsistent
Remove eclServer attribute in eclWatch
Fix link errors when creating standalone executable
Use _spawnvp instead of _execvp on windows for ecl command line
Add dependency file for oneiric build
928 Moved all remaining ${SERV} to /etc/init.d/ and removed sysvconfig as a dep for lenny.
928 Moved internal calls to dafilesrv init to /etc/init.d
IfNull regression
439 hpcc user should be a system account
936 Added psmisc to lenny dependency list.
=========================================
Known Limitations in 3.2.2.1
- #651 It is possible that Thor will not start the first time on a clean system. If you stop and start again, this will not occur.
- #219 Not reporting errors due to locked files
- #205 Ubuntu 11 desktop reports 'low quality package' if you use the software manager to install the packages.
- #663 In ECL Watch, the Buildset column is not displayed on the Systems Server page.
Release Notes - Changes from 3.2.0.2 to 3.2.2.1
- #331 Updated naming convention to Debian policy.
- #558 Full keyed join failure
- #563 Local result buffers too small
- #544 Pause and Pause Now button not shown
- #255 Fix count spill issue
- #509 Prototype for out of line functions
- #516 Import clashes with filename
- #524 WHEN fails if used in child graph
- #363 Invalid assignment for parentContextSz
- #267 Stand alone temp files in wrong location #500 Add GNU AFFERO GENERAL PUBLIC LICENSE text
- #494 Piperead was prevented from running in child graph
- #489 Fix race condition in smart buffering
- #488 Disk smart lookahead not dealing with large records
- #366 Leading '.' in filename should not cause ESP to crash
- #476 Fixes SEH with very large data values
- #423 Allow ConfigMgr to open read-only files without crashing
- #452 Cannot do multiple selection with shift button
- #449 Potential for splitter deadlock or crash
- #415 Problems for adding files to existing superfile
- #432 Restores support for some legacy file extensions
- #87 Added creation of Full Name with useradd and usermod.
- #88 Changed sudoers prefix to HPCC from OSS.
- #419 Full keyedjoins could lose pending matched groups
- #401 More fix for truncating large file when uploading file
- #402 Lost exceptions from master activities
- #377 Reports the correct line number at eof
- #357 Roxie not using the CSV separator info from Dali
- #398 Avoid truncating large file when uploading file #270 Add -g option to g++ compile step on debug build
- #345 Check user input in Local Path using dropzone path
- #631 Fixed Ordered Hash Aggregate in 64-bit (Memcpy copied size32_t instead of pointer)
=========================================
Known Limitations in Community Edition 3.2.0.2
* If you modify a DFU workunit in ECL Watch, the spray will not work.
It will prompt for a file location even though it’s already there.
A new Spray task will work fine..
* Issue # 219 Not reporting errors due to locked files
* Issue #205 Ubuntu 11 desktop reports 'low quality package' if you use
the software manager to install the packages.
* In ECL Watch, the Buildset column is cut off
* In ECL Watch, the Upload/download feature truncates files if you attempt to
upload a second file before the first one completes,
***************************************
Known Limitations in VM Edition 3.2.0.2
* If you modify a DFU workunit in ECL Watch, the spray will not work.
It will prompt for a file location even though it’s already there.
A new Spray task will work fine..
* Issue # 219 Not reporting errors due to locked files
* In ECL Watch, the Buildset column is cut off
* In ECL Watch, the Upload/download feature truncates files if you attempt to
upload a second file before the first one completes,
***************************************
Release Notes 3.2.0.2
* Implement Context Sensitive Help for ECL Language and Standard libraries in the ECL IDE
* Fix g++ compiler warnings in Roxie subdirectory;
Fix some warnings from g++
Return a string buffer, and notify user on error condition
Rename getCurrentDirectory() to appendCurrentDirectory() to make the semantics clear
Build warnings
* Sequence was not included in the package file names in release mode
* Version numbers displayed from environment.xml are usually out of date
* New push/run scripts added.
This is a rollup of all commits for the branch script_updates.
Removing old script files.
Added new scritps for pushing files and running commands.
Setting perms on /etc/HPCCSystems to be owned by hpcc.
Adding in script files to install.
Updating install to make sure perms are right and fixing copyright utf8 logo.
* Fixed issue presented by link dereferencing if /etc/HPCCSystems is a symlink.
* Changing if syntax that has issues on shell and older versions of bash.
* Removed force of changing permissions as it is not needed and breaks sub dirs in the directory.
Removed invalid lines from the buildCmd function
* DALI - improve --help handling
* JLIB - fix thread unsafeness in dumping namecount table (not enabled by default anyway)
* VerifyUser method is needed by ECL IDE
* Problem with UNICODE inputs for DOXIE
* Excessive logging from doWUQueryForArchivedWUs
* Make Pause/PauseNow buttons conditionally appear for ThorLCR
* Make xmllib compile on newer versions of xerces
Old function marked as deprecated in xerces documentation.
* Eclagent log showing 2 WU's
Filter out extra log lines using both sequence number and WUID
* Restructure some of the regression batch files
* New workunits not being picked after lock out
The submitWorkUnit() will not work without releasing the lock.
* All slaves subscribing to all channels (check localSlave)
* JLIB - avoid some ptree leaks if exceptions, e.g. parsing xpaths
* Adding a simple cluster install script that uses expect to
* THOR - fix multislave+ssh setup (remove rogue parameter from
frunssh call)
* codegen: Fix problem not tracking dependencies of a variable filename
* exclude partitions
* Report an error on non-local use of COMBINE in thor
* Add missing files from the compiler regression suite
* exclude partitions
* Add function to set the position inside ECLWatch menu tree
Code functions commoned up
* Move the code for Browsing Resource from ws_roxiequeryservice to ws_smc
* ESP should be able to redefine an existing menu link
Also clean several lines using setProp().
* Report an error on non-local use of COMBINE in thor
* Add missing files from the compiler regression suite
* Run spawned program locally on windows (temporary fix)
* Preserve file part TLK
* Remove legacy code from the grammar
* Remove some experimental features from the ecl grammar which are no
longer supported. It also rounds out the implementation of inline
function definitions (which are primarily used by the FUNCTIONMACRO
command). For detailed documentation see the bug report.
It corrects the encoding of a couple of example files, adds a couple
of test cases, and fixes a problem with the make file when no warnings
are generated.
* Resolve definitions with no scope in an archive
When searching for a definition "x" in the root of an archive the code
should have been looking for an Attribute tag inside a Module tag (with
a blank name). Instead it was incorrectly searching for a global
Attribute tag (not inside any tag).
This meant that the text for queries that came from definitions in the
root of the source tree didn't get displayed in esp.
I think the format changed in the past and this function wasn't updated to reflect the correct structure.
* Updating Deps system used for building packages.
Updating CMake to load os specific dependencies from an external file.
Added suse11.4 dep files along with update to disable make package if dep file does not exist.
Added a template deps file that is used if the os does not have a deps file.
Fixing spacing.
Moved to using a --noarch flag to getpackagerevisionarch.sh in order to have one dep file per distribution.
Updating template file to remove usage of _
* Changed method of output redirect in remote install.
remote-install-engine.sh used an incorrect output redirection that
at times would cause an error display on run that was of no bearing
to the action.
Moved output redirect from 2>&1 1>/dev/null to 1>/dev/null 2>&1
* Fix a mistake for the 'sort' attribute of menu folder tree
There is a mistake in previous changes . Before those
changes, the 'sort' attribute of a menu folder tree was set only when
requested. One of my changes forced the 'sort' attribute to be true,
which is incorrect. Now, the old code is switched back.
* Fix autoCopyBackup=false issue
If autoCopyBackup is disabled, Thor does not pick up replicate
(unless it's local e.g. via mount)
* Updating password setting procedure for hpcc user.
* Added a passwd command to the add_user funciton in hpcc_common.
passwd -d ${USER}
Fixing indent issue.
* Fixed arg parsing for hpcc-run.sh
Corrected an issue with the arg parsing loop to allow for only
one argument to be passed to the command along with verifying
that the argument is one of the allowed commands.
* Changed dependency list to not include -dev
Updated ubuntu dependency lists to no longer use:
libboost-regex-dev
libicu-dev
libldap2-dev
* method to allow clients to change Dali throttle limits
Default is 10 concurrent requests, and throttling by 1000ms.
Which means that if there are >10 active requests from a client to Dali, it
will delay up to max 1s (if one becomes free it will delay less)
Some clients may want to raise this level if expected to have more
concurrent activities. Esp is an example, where under some configurations,
blocking if >10 actives sessions may be undesirable.
* Replace the call to listSubFiles for performance
The existing code calls listSubFiles to get data about subfiles.
The listSubFiles does an extra lookup which slows down the system.
The new code will reuse the existing IDistributeFile instance to
get names of subfiles.
* Improve dataset too large error message
Add result name or sequence number to message
* Changed configmgr to run as hpcc
Updated the call to start-stop-daemon to have configmgr
run as hpcc instead of root allowing all files created
under /etc/HPCCSystems/source to be owned by hpcc.
* Fixed issue where IFS was being set and not reverted.
The bash internal file separator was not being unset/reset correctly.
This caused issues with hpcc-run.sh when using a regex replace to
remove the dali ipaddress from the list of cluster ip addresses.
* Replace the call to listSubFiles for performance
* Fixed issue where IFS was being set and not reverted.
* Updated hpcc-run to allow for correct run order.
Previously hpcc-run was starting and stopping all component in
order based on the ip's in the environment.xml as returned by
configgen and parsed by sort | uniq.
added code to locate which node has Dali along with
remove the ip from the list of ip's and then run the commands
in the correct order.
Start - dali node > other nodes
Stop - other nodes > dali node
also added code to change how restart works. Previously
restart would run on each node in ascending order. I have
changed this to run a for loop setting cmd to stop and then
start when a restart command is given.
* Fixing tabs.
* Fixed issue where commands were only working on reboot.
Updated setting of IP for dali operations.
* Set and show Compiled state for WUActionCompile WU
* Existing code sets and displays a Completed state for a workunit even
if a user wants to just do compile using Compile buttons in ECL IDE.
The user may not be able to distinguish between the WU's they have
submitted and those they have only compiled.
eclccserver code sets the Compiled state if the action
is WUActionCompile. ECLWatch dispays the state in WU Details page. To
avoid people thinking it is 'stuck' in compiled state, I add an Action
field on the top of the state field. The Action is read from WU xml.
For this situation, the Action shows Compile.
* Fix eclagent hang on locked index file
IndexWriteActivity incorrectly calls resolveLFN, which locks the file,
then calls expandLogicalFilename before attempting to delete. This fix
removes the incorrect call and replaces with expandLogicalFilename,
allowing the file to be deleted.
* build break in dasds.cpp
* Compiler warnings from modern g++
Fix a number of compiler warnings related to use of ... with format
strings that don't (or might not) match the supplied parameters.
Most were most likely harmless but a couple looked like they would
cause unintended results.
g++ does not like use of printf etc with a variable for the format
string parameter (because it will behave unpredicatably if the
string passed to it contains a %). I don't like using appendf with a
single constant string parameter (because it's inefficient).
* Get rid of the SVN $HeadURL keyword expansions
Remove all $HeadURL entries in the code.
Use BUILD_TAG in place of any $HeadURL: output to logs.
Update include paths and include build-info.h as needed.
Clean up some unnecessary blank lines.
* Ordered IPT impl.+cleanup createPTree*
Add an optional ordered IPropertyTree implementation.
Rationalize the various createPTree* methods.
* Added which_pidof function and usage.
Added which_pidof function to hpcc_common along with its usage where
ever pidof was called.
Updated which_service to follow the same format as which_pidof using
the command on the users path before using a direct path.
* added call to basename in the expect call to install.
added basename usage to remove directory information from the function that
generates the expect call to install the package via remote-install-engine.sh.
* Fix message misspellings in eclagent
Fix misspelled words and incorrect method names in log messages and
exception strings.
* Improve dataset too large error message
* set perms correctly on configmgr directories
Directories were being created with ownership of root. This was causing
configmgr to fail to start as configmgr is running as the user hpcc.
Added chown for config file and source directory.
* Fix issue with dfu jobs left running
If an exception occured within runWU within dfu server, it would leave the
dfu workunit tracked as running (within /Status/Server in Dali).
Consequently queuedJobs as used by EclWatch would still think the jobs were
running and list them as such on the Activity page
* Speed up regex and add algorithm option
Reenables some old code in 64bit that was previously disabled because
it used too much stack in 32bit. It also allows a HINT to be specified
on a PARSE to allow the stack or heap implementation to be selected.
Add HINT(ALGORITHM('stack')) to select the recursive stack based version
Add HINT(ALGORITHM('heap')) to select the heap based version.
* Clean up example files, remove spaces
Remove trailing spaces from examples that shouldn't have been there.
* Clean up the public regression suite
Removes some internal paths from the regression suite batch file, makes
the comparison program configurable, and moves all settings to one file
* Check for invalid strings
Check for null and empty strings before attempting a
string comparision.
Tested and found that Roxie starts normally and empty
RoxieServerProcess nodes are not being generated.
Roxie rename fails due to null string comparision
* set perms correctly on configmgr directories
* Get rid of the SVN $HeadURL keyword expansions
Remove the declaration of the CBuildVersion class from the header file.
The previous fix for this issue inadvertently left this behind. Any
code that still referenced it would have given link errors.
Fix missing include in sourcedoc.xml
Delete the reference to the (deleted) directory roxie/roxieconfig
Fix missing include in sourcedoc.xml
* Improve ecl/regress documentation
Update sourcedoc.xml so it uses the docbook format for lists and examples.
* Corrected permissions on config directory for HPCC.
Permissions for a group member to access a folder owned by another user
that has group rights must be 775 in order to write new files to the
directory.
The default permissions set when creating a directory are 755
which allows group members to read and execute items in the directory, but
not create new files.
* Fix eclagent hang on locked index file
Taking the fix since I'm sure it improves the situation.
We should do the work on cleaning up the filename processing sooner rather than later.
* Fix loopback problems with ftslave
Changes the consistency check from isHost to isLocal to allow an
ftslave instance to be started on a loopback ip as well as the
real network ip
* Force install-cluster.sh to deploy new keys.
When the newkey option was given to install-cluster.sh it was failing to install
the newkey to the head node because of the default keys allowing valid ssh.
Checking that a newkey is wanted and then forcing the keys to install on all
nodes was required.
* Environment.conf added to remote install payload and install.
environment.conf should be deployed to all nodes in a cluster when install-cluster.sh
is run because of the nature of the file having a chance to have changes needed
for a users cluster.
* Fix linux compile problem
template confusion, call to kill needed qualifier to own template
* Enable index activities in stand alone
Enable stand alone index activities to access index files by generating
a well formed local filename, and by enabling dautils to return a file
descriptor.
* Enable index activities in stand alone
* Correct some spelling mistakes and typos
Ran sources through spell checker and corrected various spelling mistakes
and typos. Not exhaustive, didn't look at all dirs.
* Remove spurious space in middle of code
* install-cluster.sh fails if run from home directory
If run from the home directory of the admin user that you name,
install-cluster.sh would copy the tgz file it created over itself, install it,
then delete it. It will then fail to install on the other nodes.
Change the location where the tgz file is created to /tmp/ to avoid this
Also delete the tgz file when done.
* Fix csvSeparator typo
A sprayed CSV file that published a @csvSeparator attribute was not being
picked up by Thor due to a typo
* Fix badly formatted pipewrite exception
An exception generated by pipewrite if the process returned an error code,
had a rogue extra parameter, which was likely to cause it to crash in printf
formatting
* minor tidy of inconsistent exceptions
* Fix badly formatted pipewrite exception
* Use g++ -Wformat option to detect errors
Adds __attribute__(format) on some printf-like functions to allow g++ to
detect format errors. Fixes a number of format errors that were detected
as a result.
There are other functions outside jlib that should get similar
treatment
Additional fixes based on feedback from review. Also removed the
-Werror for now as there are some retrun value chacks yet to be resolved.
* Visual Studio 2010 build issues
Avoid issues in VS2010 where a custom build step uses a batch file.
The bison and flex build commands we use may be implemented as batch
files that set up environment variables to enable bison to locate any
files it needs before passing parameters on to the executable. In such
cases the custom build steps generated for VS2010 by CMake need to use
CALL to call the nested batch file otherwise only the first custom build
step of any project will be executed.
Also, some errors in the dependencies for generated files caused VS2010
to attempt to rebuild the same file several times in parallel. This
could lead to internal errors in hidl or unnecessary rebuilds. These
are fixed in this patch.
* Improve dataset too large error message
* Add dataset sequence/name to error message to help analyze
* More fixes to -Wformat errors
Introduce more checkes on vararg type functions in thor
Clearup all 'warning: format not a string literal and no format arguments'
Adds __attribute((format)) where appropriate to Roxie functions to allow
g++ to detect incorrect usage of printf-style parameters.
* Preserve file part TLK
The change made in commit 23ba18b will cause dfuserver to core when
spraying from a non-distributed file, as the distributedSource
will be NULL. This patch adds a test for that case.
* Set YUI loader base to local path
Set YUI loader base to local path to avoid loading files from
the default base of http://yui.yahooapis.com.
Also, load "MIN" version of files rather than the "raw" version.
Clean up svn references in cmake files
Unneeded references to svn removed from the hpcc project.
* Check for NULL object
Issue occurs when trying to build a new environment via the Wizard. The
code causing the problem was added as part of the "envgen" tool that
lets users generate an environment via the command line.
The envgen tool lets the user specify override directories via a
command line option. Since the same code is used to generate the
environment both via the Wizard and the envgen tool and the override
directories object is NULL in the case of the Wizard, ConfigMgr crashes
when trying to generate an environment via the Wizard. Hence, added fix
to check for NULL object before accessing the override directories.
* Add more debugging/postmortem information to ESP log
Existing ESP log contains a log line to trace ESP processing time
for each HTTP request. The code is modified to add more information
into the log line if there is an exception or the request takes a
long time to process. The information includes user (if available),
IP, and HTTP/SOAP request.
* Thor script error, causing restart fail
A missing space in a bash expression causing run_thor
to fail when thormaster exited. As a result Thor would not
auto restart
* Unable to start thor on multinode system
Some late fixes from 3.0.4 were lost from 3.1
These fixes are not perfect because the IFS is being modified
and not restored - other code is relying on this fact.
However while we argue about the correct fix we should get 3.1 in
sync with 3.0.4
* Unrecognized interface resolved as 0.0.0.0
If the interface named in environment.conf does not exist, the code
was supposed to fall into using hostname when resolving the '.' net
address. However due to a flaw in the logic it will actually use
0.0.0.0, and various components will fail to start as a result.
This patch splits the 'test' and 'retrieve' functionality into
separate functions to make them easier to follow, and adds the ability
to use a wildcard in the interface specification. When searching for
an interface ip, loopback interfaces are always searched AFTER
non-loopback ones.
With this fix in place, the most appropriate value for interface= in
environment.conf is *
* Add more printf style format checking
* Fix copyrights in *.ecl
Copyrights should use (c) rather than unicode.
Fix copyrights on some CMakeLists.txt files
Some CMakeLists.txt files had been checked in with an
abbreviated copyright message.
* Added support for building on Debian Lenny
Adds the required dependency list to build a package on Debian Lenny.
Fixes the distrocheck to handle Debian Lenny (and others) better, and be
more consistent with the distro checking code in getpackagerevisionarch.sh
* Update the broken stylesheet for SOAP Test page
Three fixes: (1) pass http request headers using hidden field when
the 'showhttp' flag is set to false; (2) not use the response header
if the 'showhttp' = false; (3) clear the user/password code since
the authentication will be passed by web browser when needed.
* IDFUWorkUnit::submit() to standalone functions.
Move IDFUWorkUnit::submit() to a standalone function named
"submitDFUWorknit()".
Modeled after the submitWorkunit() function for ECL workunits it will
release the IDFUWorkunit interface before putting the workunit on a queue.
This should help prevent race conditions related to having locked
workunits on a queue.
* Update the broken stylesheet for SOAP Test page
* Add checkboxes to the Select Computers Dialog
Add checkboxes to make selection of computers via the
"Select Computers" dialog box in ConfigMgr more user friendly.
User can still double click a single row to mimic row selection
and pressing the ok button. To check the select box for a bunch
of rows, user can select some rows and use context menu to select
or unselect those rows. Also, rename "Add Computers" to
"Add Hardware" and rename the table varibles to be consistent
with their usage.
* Remove duplicate message definitions
Remove some code which had been moved from hqlcerrors to hqlerrors
* Clean code for WsSMC, WSTopology, ws_machine
(1) remove code lines which have been commented out; (2) remove
most of debug lines; (3) modify debug log lines which should only
be used at high log levels; (4) modify debug log lines which should
have 'WARNING' in the front of the log lines.
* Set Thor/@localThor correctly
Set Thor/@localThor to true if all thor slaves are on the same
node as the thor master, otherwise set it to false. Check the nodes
based on the ip address of the nodes rather than name of the node
to handle manual editing.
* complete-uninstall.sh is redhat only
The utility script sbin/complete-uninstall.sh had a few issues:
- assumed a rpm-based system
- incorrect copyright message
- assumed (non-standard) location of hpcc home directory
- was not shipped
Change the script to handle uninstalls of .deb files too, and use
option on userdel to handle home directory removal more cleanly.
Add the file back to the install set.
* Some files have bad copyright messages
Many files in the initfiles directory had temporary copyright messages
appropriate only until the code was released. Some files intended as
the defaults for user-edited configuration files should not have any
copyright.
This patch replaces them with the proper copyright blocks.
* Stack buffer overrun in holeIntFormat
Example: Add example of row transfer to eclcc tests
Fix a number of problems in holeIntFormat
- a width parameter > 500 would overwrite stack
- maxlen parameter not being used
- using a variable format string so could not be checked
- space filling code would have no effect
* Renumber errors that have been moved, and cleanup
Renumber some errors that have been moved from hqlcerrors to hqlerrors
so they use the range for that dll, and clean up a couple of other
instances.
* More issues detected by format check option
Fix some more issues detected by the format check option, this
time ones that were inside #ifdef _DEBUG and so missed last time
around.
Example: Add example of row transfer to eclcc tests
* Strip symbols from executables in packages
Add the option CPACK_STRIP_FILES to our CMake script so that symbols
are stripped from the rpm/deb packages. This reduced the size of the
deb package from 66Mb to 23Mb. Leave the symbols in if not building
a Release package.
* Complete-uninstall.sh is redhat only
* Remove duplicate message definitions
Roxie not processing continuation data properly
When reading from disk rather than in-memory (preload), data from
flat or CSV files from fileparts other than the first may appear
truncated if there is more data to be returned from slaves than can
be returned in a single chunk.
There was some confusion about what BufferedDirectReader::tell()
should return - it was returning a file position in the entire
underlying file, where the corresponding 'seek' to continue reading
was assuming the position was relative to those parts of the file
managed by this node.
With this patch, tell() refers to the position in the stream rather
than in the complete logical file, which is consistent with how the
code in ccdactivities expects it to behave.
Roxie not processing continuation data properly
* Added the creation of sentinel files to dali and sasha.
daserver and saserver were not creating senteniels for automatic restart. Instead,
the sentinel files were being created in the init_dali and init_sasha scripts.
Cleaned up extra spaces in init_dali script.
Move createSentinelTarget to using getenv for SENTINEL in order to create the sentinel IFile object. This allows
the component init_ scripts to export SENTINEL and control the name of their sentinel file.
Added removeSentinelFile function to be able to handle removal of sentinel files that exist.
Added usage of createSentinelTarget to the following components.
- agentexec
- dafilesrv
- daserver
- dfuserver
- eclccserver
- eclscheduler
- esp
- roxie
- saserver
- thormaster
Added removeSentinelFile usage to:
- agentexec
- dafilesrv
- daserver
- dfuserver
- eclccserver
- eclscheduler
- esp
- roxie
- saserver
- thormaster
Updated init_roxie to no longer pass the sentinel file on the command line.
Removed unneeded log line when creating sentinel file.
Added missing removal of sentinel file at the start of esp.
Updated createSentinelFile to have better logging along with exception catching/throw when file cannot be create/written.
Updated all component init scripts to look for comp.sentinel instead of comp_sentinel.txt.
Updated init system to look for files with "*sentinel" in their name for the sentinel file.
Updated missed _sentinel.txt lines in init_esp, init_roxie, init_sasha, and stop_thor.
Remove old and unneeded init files.
Cleaned up old style start/stop scripts to use new sentinel scheme and evironment variable.
Added handling of NULL sentinelFile to removeSentinelFile and writeSentinelFile.
Rebased to cleanup commit messages, and fixed a couple of issues:
- formatting in jfile.cpp
- referencing %roxiedir too early in stopccd.bat
- exceptions leaked in removeExceptionFile/writeExceptionFile
- typos in ccdmain and eclccscheduler meant would not compile
* Remove test code uploaded by mistake
* Added bash vars and environment.conf usage to complete-uninstall.
Moved complete-uninstall.sh to complete-uninstall.sh.in and add it to config
time processor list.
Moved all directory and user removal to using environment vars from environment.conf.
Corrected type in function name set_environmentvars.
* Clean up sentinel creation
All currently used init scripts will now delete the sentinel file at
startup to avoid loops if the program fails to load entirely. Also
fix missing copyright on init scripts, and ensure that programs
create sentinel files at appropriate points (i.e. once all possible
startup errors have been checked and the process is in its ready state.
Have not cleaned up issues in the legacy startup scripts - I propose
to move them out of the repo shortly.
* Added the creation of sentinel files to dali and sasha.
Still needs some work, but should be much better with these changes than before.
* Remove dynamic format strings from eclcc
Change some code that triggered the gcc printf format warnings so
they now use constant strings.
* Report missing attribute on no line, not line 1
* Minor change to eclcc regress batch file
Use the base name instead of the full pathname as the filter for the
regression comparison.
* Remove legacy startup scripts from repository
Create 3.2 release candidate branch
Removed references to init_start/stop_thor that should no longer be in install file.
init_start/stop_thor where still referenced in thor.install and should not have been as they
have been removed from the source tree.
* Fix EclWatch File Download on multi-node system
The problem only happens on multi-node system (ECLWatch and dropzone
are not in the same machine). When a user wants to download a file
using ECLWatch Upload/download File menu, the file download should be
done by clicking the file on the Upload/download page. The old code
does not work because network IP is not used as a part of the input
of createIFile(). The fix creates a RemoteFilename object using both
IP and file path/name. Then, the RemoteFilename object is used as the
input of createIFile(). Now, the fie download works.
* Default 64bit regex to use stack implementation.
* Fix problems with count on temporary file
Counts on temporary files have problems because the filename is
implicitly mangled with the wuid. This wasn't being taken into
account.
Add code to output some more flags from the code generator, and code
in hthor to use those flags.
Note, this is likely to still require a similar fix in thor.
* Updated init system to always use our installed start-stop-daemon.
Cleaned up the start-stop-daemon to remove logic that would prevent it from building on os'es that already have
start-stop-daemon installed.
Refactor start-stop-daemon further
Merge branch 'issue171' into candidate-3.2.x
Remove files that are no longer used
* Fix copyrights
Fix all copyrights in initfiles directory that were using the short form with
missing language and incorrect symbol. Remove some dead files encountered
along the way.
Fix copyright notices on all sourcedoc.xml files to be consistent
Clean up remaining short-form copyright messages
Copyright changes merged into 3.2 branch
* Thor sentinel file was not being created
Recent changes to sentinel file creation missed one file (because of
over-convoluted chain of files involved in thor startup, but that's
another bug). As a result thor would not automatically restart on
closedown.
Use the proper environment variable name so that thor will create the
sentinel file.
* START-STOP-DAEMON environment variable needs renaming
* bash does not like - in an environment variable name.
Rename to use underscores in place of -. Also the code in hpcc-common to
set the variable was using the wrong path.
* jptree serialization format change means reads from old dali
fails. The change made to jptree to introduce the ordered tree
flag causes serialization issues when talking to a dali that saved data
using the previous flag values.
This change restores the binary flag to its previous value, and uses a
previously unused value for the new ordered flag. Dali information saved by
systems between the previous change and now may be invalidated, but this
should only affect developer-built private systems as the change has
never been released in any official build.
jptree serialization format change means reads from old dali fails
* Ensure imported modules added to archive
Previously a module entry was only added to the archive if a
definition from it was used in the query. This change ensures it
a blank entry will be created.
* Code assumes read() will read full requested amount
Various code in jlib was assuming that read() and pread() would never
return less than the requested amount except at end-of-file. The Posix
standard states that they may do so if a signal is received during the
read operation after some data has been retrieved. Testing on Lustre
suggests that this ican sometimes happen. We previously had code in to
handle cases where calls to pread() were interrupted before data had
been read, but they would not help all cases.
The calls to ::read / ::pread were not as well isolated as they should
have been (and there were also calls to _read to confuse the issue).
Refactor the code to common up calls to ::read as much as possible, and
add logic to retry interrupted reads.
read full requested amount.
* Regress change variable change from int to unsigned
A previous change from int to unsigned meant that an array index x-2
became a very high number when it underflowed.
* Added missing directory creation and chown to configmgr script.
Configmgr would fail to start if /var/{run,lock}/HPCCSystems did not exist,
or was not owned by hpcc.
* Added error check for package install failure to remote install.
Added expect to package requirement for all distributions.
* Fixes row invariant filters on csv files
Fixes a bug with csv read in hthor, where the canMatchAny() was not
being tested before reading the disk file. This meant row invariant
filters were ignored.
* Fix regression reading multi byte utf8
Fixes a bug reading utf8 files, where the size of the field was being
passed to a function instead of the number of utf8 characters.
Probably a regression post 702.
* Return WUID inside DFU WU responses
WUID was returned inside DFU WU responses since it is needed for
SOAP requests. But, the code lines for returning WUID in DFU WU
responses were removed by mistake when we worked on Isuue #172.
This fix adds the code lines back.
* Added User check to the remote install engine used in install cluster.
New checkUser function using the id command allows for the checking of the user creation.
Added stderr redirection of id command to /dev/null
Update build version ready for 3.2.2 closedown
* Check user input in Local Path using dropzone path
When a file is sprayed, the Local Path field is pre-populated using
a dropzone directory. A user has to input a file under that directory
or select a file using the Choose File button. The existing code
verifies the file selection by comparing the Local Path field with
pre-populated value of the dropzone directory. If they are the same,
an error message will be shown. But, when the spray request comes from
a modified DFU WU, the Local Path field is pre-populated using the
full path of the file input by the user. The existing code does not
handle that. This fix changes the code to remember the value of the
dropzone directory and compare the Local Path field with the value of
dropzone directory.
* Add -g option to g++ compile step on debug build
eclcc generated executables for Linux are not getting debug symbols
included, even though the debug command line option is set. Fix the
problem by adding -g to linux compile step
* Code assumes read() will read full requested amount
* typo in code to ensure full reading could core
A typo in the code for ensureing that read/pread read the full amount even
when interrupted by signals could result in a heap corruption, as the byte
before the buffer might get overwritten.
Code was checking a 64-bit unsigned -1 value against a 32-bit one, and thus
comparing 0xffffffffffffffff versus 0x00000000ffffffff and not getting a match
In fact neither type was right - the return value is ssize_t (which is signed)
* Roxie not using the CSV separator info from dali
Roxie was not picking up the SEPARATOR, QUOTE and TERMINATOR
settings from dali when reading a CSV file.
Add a queryProperties method to the IResolvedFile interface,
and use it to track the properties from an IDistributedFile.
While the full IDistributedFile info is not serialized to slaves
in the delayed resolution cases, the properties need to be.
* Reports the correct line number at eof
Previously an implicit \n was added to the end of the source file,
which meant that any error at the end of the file reported the error
on the next (non-existant line number). It also fixes a potential
problem where the position was not initialised for an EOF token.
Release Notes - Changes from 3.0.3 to 3.0.4
- Resolved an issue that would prevent proper ssh key installation
- Resolved an issue where Thor won't start if hostname was not set.
- Resolved the false warning the install-cluster.sh script (too many arguments)
- Resolved an issue in the init system that could prevent Thor slaves nodes from starting
- Added chmod 775 for the config directory to allow group writes to the directory.
- The install-cluster.sh script now uses basename to install
- Resolved issue in the hpcc-run.sh script where it could not communicate with some nodes.
- Resolved and issue where startup could fail id Dali was not on the lowest IP
NOTE: The ECL IDE ver. 3.0.2 is still valid for this version of the platform.
Known Limitations (for Community Edition version 3.0.4)
If you compile ECL code using the command line compiler, you may experience a slowdown if the source code has a long directory path to the compiler. This will be addressed in a future release.
=========================================
Release Notes - Changes from 3.0.2 to 3.0.3
- Now supports Ubuntu ver 11.04.
- A new script, install-cluster.sh, is now available to make installation on larger clusters easier.
- Fixed an issue that could cause a multi-node Roxie not to start under some conditions.
NOTE: The ECL IDE ver. 3.0.2 is still valid for this version of the platform.
Known Limitations (for Community Edition version 3.0.3)
Under certain circumstances, the install-cluster.sh script can issue this false warning:
/tmp/remote_install/remote-install-engine.sh: line 104: [: too many arguments
This message can be safely ignored.
=========================================
Release Notes - Changes from 3.0.1 to 3.0.2
- In WsECL, constructed namespaces for workunit results now ensure spaces are removed to ensure valid URNs.
- Roxie and WsECL now construct namespaces for unnamed outputs in a consistent manner.
- In ECL Watch, Search Roxie Queries would fail if a Workunit (WU) was missing.
- A Roxie Query with a missing WU could cause WsECL to core.
- The Browse Resources page now works correctly in ECL Watch.
Known Limitations
- If you create a Roxie cluster in Config Manager's Advanced View, you must edit the Environment XML file before trying to start the cluster. If you use the wizard, you will not encounter this issue.
Config Manager's Advanced View creates a superfluous section in the environment XML file that prevents a Roxie Cluster from starting. After using Advanced View, open the XML file in a text editor and delete the superfluous section. The section to delete is an extra RoxieServerProcess with a blank netaddress as shown below:<RoxieServerProcess aclName="" computer="" dataDirectory="/var/lib/HPCCSystems/hpcc-data/roxie" listenQueue="200" netAddress="" numThreads="30" port="9876" requestArrayThreads="5"/> - On Ubuntu, the dafilesrv component does not stop upon uninstallation of the hpccsystems-platform. The user will have to manually kill the process.