Skip to main content

HPCC Systems blog contributors are engineers, data scientists, and fellow community members who want to share knowledge, tips, and other helpful information happening in the HPCC Systems community. Check this blog regularly for insights into how HPCC Systems technology can put big data analytics to work for your own needs.

Cassandra Walker on 04/14/2020
Massive computation workflows utilize High Performance Computing Cluster (HPCC) Systems environments that require significant resources, but these resources are only needed during processing. A commercial cloud service is a great resource to facilitate a short term need for computing capacity, without a long term commitment. It allows the user to access computing services, such as servers, storage, networking, and software over the internet (“the cloud”). In this blog, we discuss how HPCC Systems was deployed on the Microsoft Azure cloud computing platform to test custom data.
HPCC Systems on 03/19/2020
​​​​​​​Sarah Fabius has worked for more than five years at LexisNexis Risk Solutions, where she is a systems engineer and an HPCC Systems ambassador. She has a passion for technology and enjoys finding unique ways to promote diversity and inclusion within the HPCC Systems community. Throughout the year, you can find Sarah leading ECL Code Camps and conferences for women in technology, including the annual She is Tomorrow’s Technologist, a LexisNexis Risk Solutions conference for female students interested in technology. We sat down with Sarah to discuss her experience at LexisNexis Risk Solutions, some of her favorite moments working in the community and advice she would give to young technologists looking to get into the industry.
Lorraine Chapman on 03/11/2020
The HPCC Systems core developers gathered together to discuss future plans for the HPCC Systems platform. These offsite meetings happen twice a year, bringing together a team of developers that usually work remotely from each other in Europe and the USA. While the team meets regularly by conference call, these offsite meetings are the perfect opportunity to brainstorm uninterrupted in person. Lots of ground is covered during this offsite meeting week. Read on to find out more about the future plans for the HPCC Systems platform. 
Cassandra Walker on 03/09/2020
In today’s world, Data Analytics is an important part of sports. Sports organizations on every level use data analytics to predict and improve player performance, a team’s quality of play, prevent injury, increase revenue, and more. Christopher Connelly, a Sport Scientist at North Carolina State University (NCSU), spoke at Community Day 2019 and HPCC Systems Tech Talk 29 about the university’s Athlete 360 program. 
Shamser Ahmed on 02/18/2020
How can we make a long-running ECL job complete sooner? Are the assumptions made regarding the datasets correct? What is the ideal size of the cluster that for this job? Post-execution workunit analysis is an important process to answer these questions and gather the information necessary to optimize workunits. Shamser Ahmed introduces the Workunit Analysis Tool, designed for ECL developers to analyse workunit performance which is available from HPCC Systems 7.6.x.  
Lorraine Chapman on 01/29/2020
Our annual Community Day Summit is an exciting event, rich in content, providing a wide range of learning and networking opportunities. Community Day is packed with presentations and breakout sessions while the day before, there is the opportunity to attend an ECL workshop and students from across our academic community present their work at our technical poster contest. Come and share our reflections on this event and watch the presentations for the first time or review them at your leisure!
Cassandra Walker on 01/17/2020
James McMullan, Sr. Software Engineer at LexisNexis Risk Solutions, gave an overview of the Spark-HPCC Plugin & Connector in a breakout session at the 2019 HPCC Systems Community Day. This presentation also included an introduction to Apache Zeppelin, a demonstration of a random forest model created in Spark, and a discussion about the future of the Spark-HPCC Ecosystem.
Jessica Lorti on 01/13/2020
In this month’s “5 Questions” interview series, Flavio Villanustre talks with Anthony Fishbeck. Anthony is a senior architect for LexisNexis Risk Solutions and the creator of the Enterprise Services Platform (ESP), a highly adaptive and extensible component that serves as the front end of HPCC Systems.
Roger Dev on 01/07/2020
The GNN (Generalized Neural Network) bundle provides an ECL interface to Keras and Tensorflow. Using GNN, an ECL developer can construct, train, and utilize arbitrarily complex Neural Networks such as Classical, Convolutional, and Recurrent networks. These networks can be utilized to analyze complex data such as images, video, and time-series.
Lorraine Chapman on 12/16/2019
This competition provides students working on HPCC Systems related projects with an opportunity to showcase their achievements. 13 students presented on projects ranging from platform related features and machine learning library contributions to interesting use cases and research results. Read on to meet the students and judges, see the posters and learn which were the winning entries.