Fri Aug 17, 2018 3:16 am
Login Register Lost Password? Contact Us


HPCC as Database

Post questions or comments on how best to manage your big data problem

Tue Jul 19, 2011 6:09 pm Change Time Zone

Can we use HPCC as a Big data storage device and let lucene/solr search engine to index the data and make it searchable?

Is there any attempt made earlier like this?
Durai
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 24
Joined: Thu Jun 23, 2011 2:50 pm

Tue Jul 19, 2011 8:36 pm Change Time Zone

We did have someone do that a long time ago; I believe he was successful - at least as a proof of concept.

We have not pursued the idea any further ourselves; ECL has native text indexing and searching capabilities - so we tend to use those for performance and simplicity and to allow us to integrate our text and non-text products.

David

Incidentally we do have a 'boolean search' module (which is built upon our text indexing capability) - that offers sophisticated text searching out of the box.
dabayliss
Community Advisory Board Member
Community Advisory Board Member
 
Posts: 109
Joined: Fri Apr 29, 2011 1:35 pm


Return to Managing Big Data

Who is online

Users browsing this forum: No registered users and 1 guest

cron