Skip to main content

HPCC Systems blog contributors are engineers, data scientists, and fellow community members who want to share knowledge, tips, and other helpful information happening in the HPCC Systems community. Check this blog regularly for insights into how HPCC Systems technology can put big data analytics to work for your own needs.

Cassandra Walker on 05/06/2020
Enterprise Control Language (ECL) Workunit Services standard library functions can be used to capture details about workunits running on Thor including processing time, errors, current state, and more. Capturing these details allows for monitoring, trending, error analysis, degradation, and other data points that can help improve the efficiency of Thor environments.  In this blog, we will look at how to use this information to monitor the system with visualizations in Power BI.
Richard Chapman on 04/21/2020
This is the first in a series of blogs about the new development work in progress to provide a Cloud native version of our platform. Our latest release series, HPCC Systems 7.8.x, includes the first wave of changes. In this blog, Richard Chapman talks about our journey to the Cloud and demonstrates how to setup a simple test cluster using a default helm chart.
Jake Smith on 04/21/2020
In this blog, Jake Smith walks through the steps required to setup a default HPCC Systems cluster on Microsoft Azure using HPCC Systems. This is the second in a series of blogs designed to support and encourage our community users to test and provide feedback about using our new Cloud native HPCC Systems platform.
Cassandra Walker on 04/14/2020
Massive computation workflows utilize High Performance Computing Cluster (HPCC) Systems environments that require significant resources, but these resources are only needed during processing. A commercial cloud service is a great resource to facilitate a short term need for computing capacity, without a long term commitment. It allows the user to access computing services, such as servers, storage, networking, and software over the internet (“the cloud”). In this blog, we discuss how HPCC Systems was deployed on the Microsoft Azure cloud computing platform to test custom data.
HPCC Systems on 03/19/2020
​​​​​​​Sarah Fabius has worked for more than five years at LexisNexis Risk Solutions, where she is a systems engineer and an HPCC Systems ambassador. She has a passion for technology and enjoys finding unique ways to promote diversity and inclusion within the HPCC Systems community. Throughout the year, you can find Sarah leading ECL Code Camps and conferences for women in technology, including the annual She is Tomorrow’s Technologist, a LexisNexis Risk Solutions conference for female students interested in technology. We sat down with Sarah to discuss her experience at LexisNexis Risk Solutions, some of her favorite moments working in the community and advice she would give to young technologists looking to get into the industry.
Lorraine Chapman on 03/11/2020
The HPCC Systems core developers gathered together to discuss future plans for the HPCC Systems platform. These offsite meetings happen twice a year, bringing together a team of developers that usually work remotely from each other in Europe and the USA. While the team meets regularly by conference call, these offsite meetings are the perfect opportunity to brainstorm uninterrupted in person. Lots of ground is covered during this offsite meeting week. Read on to find out more about the future plans for the HPCC Systems platform. 
Cassandra Walker on 03/09/2020
In today’s world, Data Analytics is an important part of sports. Sports organizations on every level use data analytics to predict and improve player performance, a team’s quality of play, prevent injury, increase revenue, and more. Christopher Connelly, a Sport Scientist at North Carolina State University (NCSU), spoke at Community Day 2019 and HPCC Systems Tech Talk 29 about the university’s Athlete 360 program. 
Shamser Ahmed on 02/18/2020
How can we make a long-running ECL job complete sooner? Are the assumptions made regarding the datasets correct? What is the ideal size of the cluster that for this job? Post-execution workunit analysis is an important process to answer these questions and gather the information necessary to optimize workunits. Shamser Ahmed introduces the Workunit Analysis Tool, designed for ECL developers to analyse workunit performance which is available from HPCC Systems 7.6.x.  
Lorraine Chapman on 01/29/2020
Our annual Community Day Summit is an exciting event, rich in content, providing a wide range of learning and networking opportunities. Community Day is packed with presentations and breakout sessions while the day before, there is the opportunity to attend an ECL workshop and students from across our academic community present their work at our technical poster contest. Come and share our reflections on this event and watch the presentations for the first time or review them at your leisure!
Cassandra Walker on 01/17/2020
James McMullan, Sr. Software Engineer at LexisNexis Risk Solutions, gave an overview of the Spark-HPCC Plugin & Connector in a breakout session at the 2019 HPCC Systems Community Day. This presentation also included an introduction to Apache Zeppelin, a demonstration of a random forest model created in Spark, and a discussion about the future of the Spark-HPCC Ecosystem.