CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site
This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Developer Discussion »
  • Google Summer of Code »
  • Interactive Search Project
Pages: [1]

Author Topic: Interactive Search Project  (Read 446 times)

sarangi94

  • I’m new here
  • *
  • Posts: 2
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Drupal
  • MySQL version: 5
  • PHP version: 5
Interactive Search Project
March 13, 2016, 03:44:50 pm
Hi,
I am Sourav Sarangi(3rd year undergrad student) at IIIT Hyderabad. I have worked with lucene/solr before and I am proposing to integrate it into the solution.
 I am proposing to flatten out rdbms data into lucene document onto which faceted search can be performed on the index efficiently and then from the ids of the results we can extract full results from the database by running a query which will be faster than implementing so many inner joins on the rdbms
For multiple databases we can maintain individual indexes.
Also for various access ids we can filter out the results while database querying.

Andrew Perry

  • I post occasionally
  • **
  • Posts: 98
  • Karma: 1
  • Building empowering tools that comply with rules
    • Community Builders Australia
  • CiviCRM version: 3.x, 4.x
  • CMS version: Joomla 1.0.x, 1.5.x -> Drupal 6.x, 7.x, WordPress
  • MySQL version: 5.1, 5.5, 5.6
  • PHP version: 5.2, 5.3, 5.4
Re: Interactive Search Project
March 13, 2016, 05:27:15 pm
What about using Elasticsearch given it has features built on top of Lucene?
Community Builders Australia Pty Ltd
www.communitybuilders.com.au

sarangi94

  • I’m new here
  • *
  • Posts: 2
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Drupal
  • MySQL version: 5
  • PHP version: 5
Re: Interactive Search Project
March 19, 2016, 09:02:54 am
Yes it is interesting but really it depends on the use case of the project and how large data bases normally CiViCRM has. Are we looking at distributed data over here, cause only then it makes sense.

mathieu

  • Administrator
  • Ask me questions
  • *****
  • Posts: 620
  • Karma: 36
    • Work
  • CiviCRM version: 4.7
  • CMS version: Drupal
  • MySQL version: MariaDB 10
  • PHP version: 7
Re: Interactive Search Project
March 19, 2016, 03:05:17 pm
To summarize our discussion on IRC:

- CiviCRM installations can vary from mostly 10-50k contacts/contributions, to over 500k-1M for some organisations.
- Most organisations typically have only 1 CiviCRM database, some organisations use "multi-site" (1 CiviCRM instance with different "domains", and multiple front-facing sites), others use isolated CiviCRM instances for their chapters and aggregate afterwards (more rare, and these orgs usually have the means to setup their own reports).

The "advanced search" has #1 a UI issue (lots of options, takes a long time before we see a result), but presumably #2 we have to think about better technical solutions to provide faster search results (ex: Lucene).
CiviCamp Montréal, 29 septembre 2017 | Co-founder / consultant / turn-key CiviCRM hosting for Quebec/Canada @ SymbioTIC.coop
Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Developer Discussion »
  • Google Summer of Code »
  • Interactive Search Project

This forum was archived on 2017-11-26.