https://projects.ecoinformatics.org/ecoinfo/https://projects.ecoinformatics.org/ecoinfo/ecoinfo/favicon.ico?14691340362005-11-02T21:01:07ZEcoinformatics RedmineKepler - Bug #1909: generalize cache manager to provide support for very large data fileshttps://projects.ecoinformatics.org/ecoinfo/issues/1909?journal_id=65852005-11-02T21:01:07ZMatt Jonesjones@nceas.ucsb.edu
<ul></ul><p>This needs to be added as general support in the cache manager. Data files can<br />frequently be tens to hundreds of megabytes or more. The cache manager should<br />have support for accessing these objects in a memory-friendly manner.</p> Kepler - Bug #1909: generalize cache manager to provide support for very large data fileshttps://projects.ecoinformatics.org/ecoinfo/issues/1909?journal_id=65862005-11-03T17:40:32ZDan Higginshiggins@nceas.ucsb.edu
<ul></ul><p>Java GIS actors have capability for handling very large files (i.e. no need for<br />very large grids to be in RAM, although disk-based treatment is slow). These<br />large files are NOT saved in the cache, however. They are handled and stored as<br />ordinary files.</p> Kepler - Bug #1909: generalize cache manager to provide support for very large data fileshttps://projects.ecoinformatics.org/ecoinfo/issues/1909?journal_id=65872005-11-16T17:49:38ZChad Berkleyberkley@nceas.ucsb.edu
<ul></ul><p>This should be implemented in the extension of CacheObject that deals with data<br />files.</p> Kepler - Bug #1909: generalize cache manager to provide support for very large data fileshttps://projects.ecoinformatics.org/ecoinfo/issues/1909?journal_id=65882006-02-03T20:26:00ZKevin Rulandkruland@ku.edu
<ul></ul><p>The two types of cache objects which provide access to the raw file:<br />RawDataCacheObject and DataCacheFileObject, both will give direct access to the<br />File object. This object should be used along with java.nio to provide random<br />buffered access to files. The actual manipuation of the buffers will be highly<br />dependent on the data in the files and cannot be abstracted to the cache layer.</p> Kepler - Bug #1909: generalize cache manager to provide support for very large data fileshttps://projects.ecoinformatics.org/ecoinfo/issues/1909?journal_id=65892013-03-27T21:18:34ZRedmine Admin
<ul></ul><p>Original Bugzilla ID was 1909</p>