fixed a return value
fixed sqoop java action
updated sql dao with full url; changed sqoop driver
extended mapping from protocolbuffer objects, implemented ExactMatch and overrideMatch configuration param
#637 introducing methods building organization identifiers based on organization name, organization entities and result to organization relations. Currently those methods are not hooked up with exporter main method.
utilizing renamed invertBidirectionalRelationAndBuild() method
Implemented, create index action
changed api
Pretty printing JSON representation of Avro records in case of error in TestingConsumer
introducing buildOaf(OafEntity oafEntity, DataInfo dataInfo) method for building inferenced entities
removed modular lightui from container
extending progress log interval from 10 000 to 100 000
fixed xpath using attributes
added a delete statement
changed a value
vocabulary dnet:datasourceCompatibilityLevel
shortening transformer_export_documentto* action names to be less than 50 characters
replacing "result" string with Type.result.name()
renamed driver compatibility to openaire_basic
adding uoa-espas-dataprovider-service
#354 hooking up primary/main workflow with documenttodataset and documenttoproject transformers skipping export of already existing relations in HBase
updating default job.properties
removing deprecated PersonWithInferencedData avro schema
#354 removing obsolete transformers/export/person transformer along with tests
removing json export test which became obsolete
removing deprecated DocumentWithInferencedData and DataSetReferenceWithInferencedData avro schemas
#354 removing obsolete transformers/export/inferenced_document_without_imported_data transformer along with tests
#354 removing obsolete transformers/export/identifier/referenceddatasets transformer along with tests
remove duplicated puma rule
set of modified transformationrules from skalny for the new beta
#354 removing obsolete transformers/export/identifier/documents transformer along with tests
#354 removing obsolete transformers/export/document transformer along with tests
temporary version
FP7ProjectID parameter also adds 'and (relfundinglevel0_id exact 'FP7')' filter
adding openSearch descriptor
cleaning
new module
introducing FsShellPermissions utility class, utilizing proprly working chmod in metadataextraction cache
added extended config
branch for updating the mapping to protos, extend the configuration
set datasourceprefix to "webcrawl_wq___"
updated rule for csv import
t
m
added serialization, tests
instantiate one SAXReader for each call
fixed format-layout-interpretation concatenation,doesn't fail when the fieldExtractor returns a null result
added json serialization, builds the matching key one time only
updated profile to new OAI schema
using format-layout-interpretation to define the OAI store collection name
The expected name of collection is format-layout-interpretation
do not upsert sets here in the mapper: we shall delegate to a separate workflow to be run after the OAI feeding is completed.
early implementation of jar upload script
Always new records to test how faster we go
fixed a problem with lower case
renaming root element from list to citations
retry on exceptions
javadoc annotations
Refactoring
#486 fixing integration test: introducing missing document_text_wos input port for primary/processing
#486 introducing last piece missing: text collapser in front of referenceextraction_researchinitiatives joining text contents coming from already existing document_text input port and newly introduced document_text_wos input port providing WoS contents
refactor of xsl template and split function instead of recursive calls
Refactored class that extracts fields from records. When we can't find an expected index from the configuration to check its repeatability, the field is indexed as repeatable and a counter is updated.
pass the configuration string indented.
redefining the behaviour of the "skipRecord" rule by adding attribute "syntaxcheck" in the record header, #323
fixed application context
Updated SolrIndexDocument now it returns an instance of SolrInputDocument
idScheme and idNamespace defined as part of the OAI configuration profile
changed signature of the method in indexCollectionnow the method lookup throws an IndexServiceException
Implemented SolrIndexCollection
added IDSCHEME and IDNAMESPACE elements to the OAI configuration profile
#486 bugfix: reordering existence filter with id relacer: we need to update identifiers first, then update existence filter
No hadoop-parent: classes needed in mapreduce-jobs have been copied to avoid the jar to inherit "heavy dependencies" to spring and dnet IS.
proto to pace mapping parses the whole entity