Skip to main content

Just because HPCC Systems comes with its own proprietary programming language (ECL), does not mean this is the only language you can use to query your data. You can embed a number of different languages within your ECL code. Not only this, you can process data on a HPCC Systems cluster from a variety of different sources using the various plugins and connectors we provide specifically to help you bridge the gap.

Embedded Languages
HPCC Systems already supports the embedding of Java, Javascript, R, C++, Cassandra, Python, SQL and SqLite in your ECL code. There is a separate blog you can read about the use of the EMBED feature which provides all the details you need to know for each of these languages. You can also read what Richard Chapman (VP, Research and Development and HPCC Systems platform lead architect) has to say about embedding C++ efficiently. Check out the sources and readmes for each of these embeddable languages in Github.

We also supply plugins for Redis and Memcached, where values can be set and retrieved by key simply by making calls to functions in the plugin. We support the Redis publish/subscribe option and more details about the usage of this plugin can be found in the Redis readme. There is also a readme for Memcached providing details about this plugin and how to get started using it.

We are continuing to extend our reach in this area and have recently added Kafka and Couchbase to the list of available plugins in the HPCC Systems 6.x.x series.

Add ons and connectors
Here is a list of add ons and connectors we provide to help you process data from other sources on HPCC Systems:

  • WsSQL – Provides an SQL interface to HPCC Systems.
  • ECL Data Integration Plugins for Pentaho – Make big data development as easy as drag and drop
  • R Integration – Quickly integrate to the HPCC Systems platform by writing ECL queries using R. Find out which features are currently available.
  • JDBC driver – Connect to HPCC Systems via your favorite JDBC client and access your data without writing a single line of ECL.
  • ODBC driver – Read write and update HPCC Systems queries through ODBC.

So although HPCC Systems is an end to end solution, it doesn’t have to be used that way if it doesn’t suit you. If you want to continue using your favorite language or datastore but need to use the processing power of a high performance computing cluster, go for it! The HPCC Systems platform is all about usability and interoperability. The embedded language capability and variety of connectors that it supports are a reflection of this.

We’re chipping away at a list of other sources we’d like to support. But if we don’t provide the embedded language, plugin or connector you need, why not contribute the code to provide it yourself? Take a look at the sources to see how others have added theirs and there is even a template for the supporting documentation.

More information...

  1. Download the latest version of HPCC SystemsECL IDE and the supporting documentation.
  2. Find out more about ECL (Enterprise Control Language) and take an online training course.
  3. Find out more about how HPCC Systems works, watch some video tutorials and case studies.
  4. Listen to some of our users talk on Community Day at the 2016 HPCC Systems Engineering Summit, about how they have used HPCC Systems to deliver results, fast.
  5. Find out how to contribute to our open source project.