add full support for EML2 comple textFormat in EML ingestor
need to be able to read data files that are described by the complex textFormat
fields in EML2. right now the ingestor only uses the simpleDelimited fields for
parsing. See dataTable/physical/dataFormat/textFormat/complex.
#4 Updated by Jing Tao about 15 years ago
Create two classes - TextWidthFixedDataFormat and TextDelimitedDataFormat to
store the data format information. And in EML2Parser, to add code to get complex
format information and store them into above objects. And create
TextComplexFormatDataReader to read the complex data file to rowVectors. In
DBTableGenerator class, we add a new constructor to handle data file inputstream
rather than data vector array. Also in EMl2DataSource actor, to add code to
handle complex format data file.
Now kepler can handle complex data format and output it as all fields or part
fields(by sql query command).
Complex data format can be handled in both eml200 and eml201.