Project

General

Profile

Statistics
| Revision:

dnet40/modules/icm-iis-metadataextraction/trunk @ 37665

Name Size Revision Age Author Comment
  core 36337 over 9 years Marek Horst #1257 raising oozie.action.max.output.data to 8192
  src 37665 over 9 years Marek Horst reverting example-1.pdf file removal which seem...
README.markdown 662 Bytes almost 12 years marek.horst
deploy.info 811 Bytes 32243 about 10 years Marek Horst introducing embedded integration test entry
pom.xml 7.44 KB 37348 over 9 years Marek Horst #1330 icm-iis-metadataextraction and icm-iis-in...
  • svn:ignore: .* bin target build

Latest revisions

# Date Author Comment
37665 08/06/2015 04:42 PM Marek Horst

reverting example-1.pdf file removal which seems to be required by CermineMetadataExtractionTest
37660 08/06/2015 03:41 PM Marek Horst

fixing cermine integration test, changing PDF contents
37659 08/06/2015 03:40 PM Marek Horst

fixing cermine integration test, changing PDF contents
37348 20/05/2015 07:00 PM Marek Horst

#1330 icm-iis-metadataextraction and icm-iis-ingest-pmc modules cermine dependency upgraded to recently released 1.6 version
37343 20/05/2015 06:49 PM Marek Horst

#1329 adding affiliations field in ExtractedDocumentMetadata PMC schema. Metadata extraction code refactoring by extracting code responsible for building Affiliation avro records to AffiliationBuilder class and sharing it with pmc ingestion. Implementing affiliations ingestion functionality in PmcXmlHandler covered with unit tests. Adding affiliations field support in ingest pmc metadata transformer.
36394 15/04/2015 05:17 PM Marek Horst

#1240 raising mapred.task.timeout to 3600000 (1h) just in case any extremely complex PDF document appear. All time consuming documents will be registered in failure sink.
36366 14/04/2015 12:54 PM Marek Horst

#1277 upgrading cermine dependency to most recent 1.5 release
36337 13/04/2015 01:33 PM Marek Horst

#1257 raising oozie.action.max.output.data to 8192
36289 09/04/2015 07:10 PM Marek Horst

#1257 dropping schema generation related hacks in all map-reduce modules, switching to literal schema parameters
35986 03/04/2015 01:30 PM Marek Horst

#1248 persisting content url in supplementaryData to make it easier to find content causing failure

View revisions

Also available in: Atom