Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  java 37980 almost 9 years Marek Horst #1395 WorkflowRuntimeParameters static fields c...
  resources 36394 about 9 years Marek Horst #1240 raising mapred.task.timeout to 3600000 (1...

Latest revisions

# Date Author Comment
37980 26/06/2015 07:46 PM Marek Horst

#1395 WorkflowRuntimeParameters static fields cleanup, moving parameters to dedicated modules to prevent excessing icm-iis-common module modifications

37343 20/05/2015 06:49 PM Marek Horst

#1329 adding affiliations field in ExtractedDocumentMetadata PMC schema. Metadata extraction code refactoring by extracting code responsible for building Affiliation avro records to AffiliationBuilder class and sharing it with pmc ingestion. Implementing affiliations ingestion functionality in PmcXmlHandler covered with unit tests. Adding affiliations field support in ingest pmc metadata transformer.

36394 15/04/2015 05:17 PM Marek Horst

#1240 raising mapred.task.timeout to 3600000 (1h) just in case any extremely complex PDF document appear. All time consuming documents will be registered in failure sink.

36289 09/04/2015 07:10 PM Marek Horst

#1257 dropping schema generation related hacks in all map-reduce modules, switching to literal schema parameters

35986 03/04/2015 01:30 PM Marek Horst

#1248 persisting content url in supplementaryData to make it easier to find content causing failure

35937 02/04/2015 04:15 PM Marek Horst

#1248 bugfix renaming inputEntityId to inputObjectId after schema changes

35936 02/04/2015 04:01 PM Marek Horst

#1248 introducing failures sink datastore support in metadata extraction module

35832 30/03/2015 07:17 PM Marek Horst

#1240 extending mapred.task.timeout for metadata extraction to 30 minutes

35701 27/03/2015 06:18 AM Mateusz Kobos

Removing usage of working_dir from Java workflow node.

33369 12/12/2014 04:08 PM Marek Horst

#953 extending maximum heap size from 2048 to 4096 after Dominika introduced iText dependency upgrade to 5.5.3 in cermine. This combination should minimize the possibility of failures caused by fatal OOMErr.

View revisions

Also available in: Atom