HPCC Systems Blog

HPCC Systems blog contributors are engineers and data scientists who for years have enabled LexisNexis customers to use big data to fulfill critical missions, gain competitive advantage, or unearth new discoveries. Check this blog regularly for insights into how HPCC Systems technology can put big data to work for your own organization.

by Richard Chapman
on 03/02/2017

When reading a disk file in ECL, the layout of the file is specified in the ECL code. This allows the code to be compiled to access the data very efficiently, but can cause issues if the file on disk is actually using a different layout. In particular, it can present a challenge to the version control process, if you have ECL queries that are being changed to add functionality, but which need to be applied without modification to datafiles whose layout is changing on a different timeline.

We have had a partial solution to this dilemma available in Roxie for index files for a while, with the ability to apply runtime translation from the fields in the physical index file to the fields specified in the index. However it suffered from significant potential overhead and was not available for flat files or on Thor. Until now...

by Arjuna Chala
on 02/28/2017

It is not surprising that health insurance providers are looking at smart watches (and the inherent smart data) as a promising technology that would act as an enabler to encourage their customers to lead a healthy lifestyle. For a provider, healthier customers will mean a reduction in the overall cost for healthcare and increasing the profitability of the service providers. Aetna, for example, recently started to offer their customers discounts to Apple watches. In essence laying the foundation to monitor and deliver the data to provide proactive healthcare. This is analogous to an Internet company laying the fiber optic to a consumers house, in essence laying the ground work for future business with the customer.  

by Lorraine Chapman
on 02/22/2017

Continuing the series of blogs about the successes of our student interns, this blog focuses on the work of Vivek Nair. Vivek first joined the HPCC Systems team as part of the LexisNexis Corporate Intern Program in 2015, helping to optimise the Random Forest Algorithm in the HPCC Systems Machine Learning Library (ECL-ML). In 2016, he rejoined the team this time as part of the HPCC Systems intern program, with Arjuna Chala as his mentor. He was tasked with working on a proof of concept to produce a regression suite for the HPCC Systems Machine Learning Library and developing a number of machine learning plugins for the Data Science Portal (DSP).

by Jessica Lorti
on 02/17/2017

On February 16, 2017, HPCC Systems hosted the latest edition of The Download: Tech Talks by the HPCC Systems Community.  These technically-focused talks are for the community, by the community.  The Download: Tech Talks is intended to provide continuing education through high quality content and meaningful development insight throughout the year.

by Jessica Lorti
on 02/10/2017

Michael Targett, Senior Director for Data at FlightGlobal (www.flightglobal.com) joins us on The Download Podcast.  Michael shares how FlightGlobal utilizes the industry’s most comprehensive fleet data to derive insights that create efficiencies and cost savings.