#1498 adding missing extracted metadata fields
#1395 WorkflowRuntimeParameters static fields cleanup, moving parameters to dedicated modules to prevent excessing icm-iis-common module modifications
fixing test after cermine upgrade
making integration tests run on dedicated test cluster istead of embedded mini-oozie container
removing obsolete avrobased workflow
reverting example-1.pdf file removal which seems to be required by CermineMetadataExtractionTest
fixing cermine integration test, changing PDF contents
#1329 adding affiliations field in ExtractedDocumentMetadata PMC schema. Metadata extraction code refactoring by extracting code responsible for building Affiliation avro records to AffiliationBuilder class and sharing it with pmc ingestion. Implementing affiliations ingestion functionality in PmcXmlHandler covered with unit tests. Adding affiliations field support in ingest pmc metadata transformer.
#1240 raising mapred.task.timeout to 3600000 (1h) just in case any extremely complex PDF document appear. All time consuming documents will be registered in failure sink.
#1257 dropping schema generation related hacks in all map-reduce modules, switching to literal schema parameters
#1248 persisting content url in supplementaryData to make it easier to find content causing failure
#1248 bugfix renaming inputEntityId to inputObjectId after schema changes
#1248 introducing failures sink datastore support in metadata extraction module
#1240 extending mapred.task.timeout for metadata extraction to 30 minutes
Removing usage of working_dir from Java workflow node.
#1068 updating expected test output
#1133 dropping useless workfing_dir creation for java nodes
expected results updated
#953 extending maximum heap size from 2048 to 4096 after Dominika introduced iText dependency upgrade to 5.5.3 in cermine. This combination should minimize the possibility of failures caused by fatal OOMErr.
#913 renaming DocumentContentUrl#contentSize to DocumentContentUrl#contentSizeKB changing field type from int to long, importing content size from ObjectStoreFile#fileSizeKB, updating dnet-objectstore-rmi dependency from 1.0.0 to 2.0.1-SNAPSHOT
#913 reading content size from newly introduced DocumentContentUrl#contentSize field not from URLConnection where size is not available when Transfer-Encoding=chunked, setting to 0 when size is not available
#913 introducing support for max file size parameter, currently checked against Content-Lenght header
affiliation's address and country code passed from Cermine to Avro
fixing converter code after recent Affiliation.avdl refactoring and adding countryCode field, renaming contry to countryName
fixing test code after recent Affiliation.avdl refactoring and adding countryCode field, renaming contry to countryName
expected output corrected
expected output updated
expected record updated
convertBibEntry() made public
expected test corrected
setting excluded_ids to undefined value