Project

General

Profile

Statistics
| Revision:

# Date Author Comment
39163 10/09/2015 06:13 PM Marek Horst

merging trunk changes with IIS-CDH-5.3.0 branch

37881 19/06/2015 04:10 PM Marek Horst

merging trunk changes with IIS-CDH-5.3.0 branch

37117 11/05/2015 02:58 PM Marek Horst

merging trunk changes with IIS-CDH-5.3.0 branch

35402 17/03/2015 03:01 PM Marek Horst

#1197 introducing job.properties changes aligning paths to rumcajs cluster HDFS structure

35259 11/03/2015 04:53 PM Marek Horst

creating IIS-CDH-5.3.0 branch

34945 02/03/2015 01:18 PM Marek Horst

updating job.properties

34693 20/02/2015 07:16 PM Marek Horst

#1133 dropping useless workfing_dir creation for java nodes

33133 02/12/2014 02:54 PM Marek Horst

replacing non standard dash character to '-'

33131 02/12/2014 12:48 PM Marek Horst

replacing non standard dash character to '-'

33130 02/12/2014 10:42 AM Marek Horst

fixing test run on jenkins: seting encoding explicitly to utf8

33125 01/12/2014 09:06 PM Marek Horst

#1017 fixing expected citations

33123 01/12/2014 07:40 PM Marek Horst

#1017 fixing PMC and DOI identifiers retrieval from avro map: addressing by Utf8 objects not by String

33104 28/11/2014 06:13 PM Marek Horst

#1017 accepting ExtractedDocumentMetadata instead of DocumentText at PMC citation ingestion input. Aliging integration test and importer workflow.

32942 21/11/2014 05:50 PM Marek Horst

#1017 introducing new PMC metadata ingestion currently extracing references, journal and pages fields.
Replacing DOM/XPath based citations ingestion with much faster SAX version. Changing pmidtooaid transformer utilizing ExtractedDocumentMetadata instead of parsing XML file. Enabling PMC metadata ingestion in common/import.

32324 07/11/2014 02:57 PM Marek Horst

#955 fixing reference raw text generation for pretty printed NLM documents

31234 08/10/2014 07:45 PM Marek Horst

#840 renaming DeduplicationMapping to more generic IdentifierMapping

31225 08/10/2014 06:19 PM Marek Horst

#840 moving IdentifierMapping from importer to common package

31218 08/10/2014 06:12 PM Marek Horst

#840 renaming DeduplicationMapping to more generic IdentifierMapping

31117 06/10/2014 01:20 PM Marek Horst

#757 adding reducing phase for filtering out pmids by article type, mapping phase groups PmidMapping objects by pmid and at reducer phase duplicates will be filtered out

31116 06/10/2014 01:18 PM Marek Horst

#757 introducing article type extraction along with unit test. Article type will be required for filtering out pmc duplicates and leaving only proper types

31031 02/10/2014 01:44 PM Marek Horst

fixing sourceDocumentId which is now extracted from input DocumentText record conveying NLM

31023 02/10/2014 01:08 PM Marek Horst

#757 fixing pmc citation matching test by providing proper input

31022 02/10/2014 01:08 PM Marek Horst

#757 fixing pmc citation matching test by providing proper input

30987 01/10/2014 06:38 PM Marek Horst

#757 fixing pmid and doi matching, fixing sourceDocumentId and destinationDocumentId generation

30986 01/10/2014 06:37 PM Marek Horst

#757 fixing pmid and doi matching, fixing sourceDocumentId and destinationDocumentId generation

30804 22/09/2014 08:25 AM Michal Oniszczuk

Commented out test in a stub of a solution to the task #576: Ingestion of metadata from EuropePMC.

30802 20/09/2014 02:19 PM Michal Oniszczuk

Stub of a solution to the task #576: Ingestion of metadata from EuropePMC.

30801 20/09/2014 02:18 PM Michal Oniszczuk

Refactored code to use the XPathEvaluator.fromString method.

30145 12/09/2014 03:16 PM Marek Horst

updating default job properties

29631 28/07/2014 09:45 PM Marek Horst

renaming workflow to ingest_pmc_plaintext

29097 14/07/2014 03:58 PM Marek Horst

replacing "result" string with Type.result.name()

28990 10/07/2014 04:15 PM Marek Horst

updating job.properties

28973 09/07/2014 05:55 PM mateusz.fedoryszak

dir names in parameters should not contain nameNode

28931 07/07/2014 05:52 PM mateusz.fedoryszak

rename a field