Skip to main content

HPCC Systems blog contributors are engineers, data scientists, and fellow community members who want to share knowledge, tips, and other helpful information happening in the HPCC Systems community. Check this blog regularly for insights into how HPCC Systems technology can put big data analytics to work for your own needs.

Gavin Halliday on 02/09/2021
Previous blogs in this series have looked as persisting data, configuring storage and importing data into a Cloud Native HPCC Systems environment. In this blog, Gavin Halliday provides a tutorial style guide to exporting data from an HPCC Systems bare metal environment to an HPCC Systems Cloud Native environment.
Gavin Halliday on 10/08/2020
This blog contributes to our series focusing on using our new HPCC Systems Cloud native platform. It follows on from two previous blogs by Gavin Halliday on data storage and persisting data in our cloud native platform. In this blog, Gavin provides more information about Storage Planes and how to use them.
Gavin Halliday on 09/28/2020
This blog contributes to our series focusing on using our new HPCC Systems Cloud native platform. Gavin's previous blog on this topic, talked about how to persist your data in an HPCC Systems cloud native environment. This blog continues on the same topic, focusing on the most recent changes that have been or will be implemented to allow you to configure storage on a cloud native HPCC Systems cluster.
Gavin Halliday on 06/10/2020
This is the third blog in our series focusing on using our new HPCC Systems Cloud native platform. The previous two blogs track our Path to the Cloud and provide details of how to setup a default system using a Helm chart and Microsoft Azure using Kubernetes. Our Cloud development project is ongoing, so keep checking the blogs in this series for updates. This blog covers how to persist your data in an HPCC Systems cloud native environment.
Gavin Halliday on 02/09/2017

ECL has two commonly known keywords for grouping together actions – PARALLEL and SEQUENTIAL.  Surely it is fairly obvious which one to use?  Use PARALLEL if you do not mind in which order operations are executed and use SEQUENTIAL if you do.  Unfortunately many people do not realise that SEQUENTIAL can be very bad for your query’s health.

Gavin Halliday on 11/06/2015

The next stage in adding a new activity to the system is to define the interface between the generated code and the engines. The important file for this stage is rtl/include/eclhelper.hpp, which contains the interfaces between the engines and the generated code. These interfaces define the information required by the engines to customize each of the different activities.

Gavin Halliday on 09/21/2015

The first stage in implementing QUANTILE will be to add it to the parser. This can sometimes highlight issues with the syntax and cause revisions to the design. In this case there were two technical issues integrating the syntax into the grammar. (If you are not interested in shift/reduce conflicts you may want to skip a few paragraphs and jump to the walkthrough of the changes.)

Gavin Halliday on 06/29/2015

When adding new features to the system, or changing the code generator, the first step is often to write some ECL test cases. They have proved very useful for several reasons:

Gavin Halliday on 05/11/2015

This series of blog posts started life as a series of walk-throughs and brainstorming sessions at a team offsite. This series will look at adding a new activity to the system. The idea is to give an walk through of the work involved, to highlight the different areas that need changing, and hopefully encourage others to add their own activities.

Gavin Halliday on 03/10/2015

As your body of ECL code grows it gets harder to track the dependencies between the different ECL definitions (or source files). Providing more information about the dependencies between those definitions makes it easier to understand the structure of the ECL code, and also gives you a better understanding of what queries would be affected by changing a particular definition. (i.e., If I change this, what am I going to break?)