Project

General

Profile

Actions

Feature #6033

closed

Add configuration to disable 'pathquery'

Added by ben leinfelder over 10 years ago. Updated over 9 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
Start date:
07/09/2013
Due date:
% Done:

0%

Estimated time:
Bugzilla-Id:

Description

As we move toward SOLR-based query support, pathquery will play less of a role in Metacat. We should be able to disable it altogether for installations that do not wish to incur the processing overhead.


Related issues

Related to Metacat - Task #5930: Add a configuration property to turn on/off the indexing processes (SOLR indexing)ClosedJing Tao04/30/2013

Actions
Actions #1

Updated by ben leinfelder over 10 years ago

  • Assignee set to Jing Tao
Actions #2

Updated by ben leinfelder over 10 years ago

  • Target version changed from 2.x.y to 2.1.1
Actions #3

Updated by ben leinfelder over 10 years ago

  • Target version changed from 2.1.1 to 2.2.0
Actions #4

Updated by Jing Tao over 10 years ago

  • Status changed from New to Resolved

In the metacat.properties file, there is a property:

dbquery.enabledEngines=pathquery;solr

If the "pathquery" is removed, the actions of metacat - query, squery and spatial_query will be disabled. The dataquery will still work because it doesn't use the pathquery.

The IndexQueque will be disabled as well (no threads will be generated to build index). So the metacat will not build index in the xml_index and xml_path_index tables any more.

The action "buildindex" in metacat will be disabled too.

The methods in Dataone for the pathquery engine will be disabled too.

If the pathquery is added back, the missing index will be rebuilt after restart the tomcat and the above the methods will be restored.

Actions #5

Updated by ben leinfelder over 9 years ago

  • Status changed from Resolved to In Progress
  • Target version changed from 2.2.0 to 2.5.0
Actions #6

Updated by Jing Tao over 9 years ago

It seems we missed a spot:
metacat 20140822-00:40:14: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/singleDateTime/calendarDate' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@d921d13 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The age is 5492 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 5 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 9 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: MetaCatServlet.checkIndexPaths - already indexed. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:14: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/rangeOfDates/beginDate/time' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@1f397822 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The age is 5608 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 2 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 0 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: MetaCatServlet.checkIndexPaths - already indexed. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:16: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/rangeOfDates/endDate/time' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@60cea70d [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The age is 7052 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 5 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 312 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - already indexed. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/singleDateTime/time' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@d921d13 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The age is 8480 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 8 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 135 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - not indexed yet. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - Inserting following path in xml_path_index: coverage/temporalCoverage/singleDateTime/time [edu.ucsb.nceas.metacat.MetaCatServlet]

Actions #7

Updated by Jing Tao over 9 years ago

  • Status changed from In Progress to Closed

I missed the spot in checkIndexPaths in the MetacatServlet class. So the check was added in that method. Codes was committed to both 2.4 branch and trunk.

Actions #8

Updated by Jing Tao over 9 years ago

  • Target version changed from 2.5.0 to 2.4.2
Actions

Also available in: Atom PDF