Project

General

Profile

Feature #6033

Add configuration to disable 'pathquery'

Added by ben leinfelder over 6 years ago. Updated about 5 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
Start date:
07/09/2013
Due date:
% Done:

0%

Estimated time:
Bugzilla-Id:

Description

As we move toward SOLR-based query support, pathquery will play less of a role in Metacat. We should be able to disable it altogether for installations that do not wish to incur the processing overhead.


Related issues

Related to Metacat - Task #5930: Add a configuration property to turn on/off the indexing processes (SOLR indexing)Closed04/30/2013

History

#1 Updated by ben leinfelder over 6 years ago

  • Assignee set to Jing Tao

#2 Updated by ben leinfelder over 6 years ago

  • Target version changed from 2.x.y to 2.1.1

#3 Updated by ben leinfelder over 6 years ago

  • Target version changed from 2.1.1 to 2.2.0

#4 Updated by Jing Tao over 6 years ago

  • Status changed from New to Resolved

In the metacat.properties file, there is a property:

dbquery.enabledEngines=pathquery;solr

If the "pathquery" is removed, the actions of metacat - query, squery and spatial_query will be disabled. The dataquery will still work because it doesn't use the pathquery.

The IndexQueque will be disabled as well (no threads will be generated to build index). So the metacat will not build index in the xml_index and xml_path_index tables any more.

The action "buildindex" in metacat will be disabled too.

The methods in Dataone for the pathquery engine will be disabled too.

If the pathquery is added back, the missing index will be rebuilt after restart the tomcat and the above the methods will be restored.

#5 Updated by ben leinfelder over 5 years ago

  • Target version changed from 2.2.0 to 2.5.0
  • Status changed from Resolved to In Progress

#6 Updated by Jing Tao over 5 years ago

It seems we missed a spot:
metacat 20140822-00:40:14: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/singleDateTime/calendarDate' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@d921d13 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The age is 5492 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 5 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 9 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: MetaCatServlet.checkIndexPaths - already indexed. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:14: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/rangeOfDates/beginDate/time' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@1f397822 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The age is 5608 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 2 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:14: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 0 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: MetaCatServlet.checkIndexPaths - already indexed. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:16: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/rangeOfDates/endDate/time' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@60cea70d [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The age is 7052 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 5 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:16: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 312 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - already indexed. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - Checking if 'coverage/temporalCoverage/singleDateTime/time' is indexed.... [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The connection is checked out: org.postgresql.jdbc3.Jdbc3Connection@d921d13 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The method for checking is: MetaCatServlet.checkIndexPaths [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The age is 8480 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The usage is 8 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: DBConnectionPool.getDBConnection - The connection time is: 135 [edu.ucsb.nceas.metacat.database.DBConnectionPool]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - not indexed yet. [edu.ucsb.nceas.metacat.MetaCatServlet]

metacat 20140822-00:40:17: [DEBUG]: MetaCatServlet.checkIndexPaths - Inserting following path in xml_path_index: coverage/temporalCoverage/singleDateTime/time [edu.ucsb.nceas.metacat.MetaCatServlet]

#7 Updated by Jing Tao over 5 years ago

  • Status changed from In Progress to Closed

I missed the spot in checkIndexPaths in the MetacatServlet class. So the check was added in that method. Codes was committed to both 2.4 branch and trunk.

#8 Updated by Jing Tao about 5 years ago

  • Target version changed from 2.5.0 to 2.4.2

Also available in: Atom PDF