Activity
From 27/07/2014 to 25/08/2014
25/08/2014
- 06:15 PM Revision 29856 (dnet40): updated index feed job to make use of the new shared solr lib
- 06:09 PM Revision 29855 (dnet40): updating performance test
- 06:06 PM Revision 29854 (dnet40): moving ACM importer to icm-iis-mainworkflows due to extending dependances with cermine, introducing performance tests
- 06:06 PM Revision 29853 (dnet40): moving ACM importer to icm-iis-mainworkflows due to extending dependances with cermine, introducing performance tests
- 05:33 PM Revision 29852 (dnet40): removed deploy info
- 05:33 PM Revision 29851 (dnet40): added deploy info
- 05:31 PM Revision 29850 (dnet40): branch to test the new index feeding libs
- 05:29 PM Revision 29849 (dnet40): moved StreamingInputDocumentFactory to dnet-index-solr-common
- 04:53 PM Revision 29848 (dnet40): show the current size when current > total
- 04:46 PM Revision 29847 (dnet40): moved dependency to solr from dnet-index-client to dnet-index-solr-client
- 04:45 PM Revision 29846 (dnet40): removed dependency to solr
- 04:22 PM Revision 29845 (dnet40): Show of inaccurate size in progressJobNode
- 04:13 PM Revision 29844 (dnet40): added ignore property
- 04:11 PM Revision 29843 (dnet40): added standard maven folder
- 04:07 PM Revision 29842 (dnet40): added pom
- 03:57 PM Revision 29841 (dnet40): added trunk
- 03:57 PM Revision 29840 (dnet40): create module dnet-index-solr-common
- 02:14 PM Revision 29839 (dnet40): convertBibEntry() made public
- 12:56 PM Revision 29837 (dnet40): New examples in the docsim demonstrator, matching the new database content
- 12:55 PM Revision 29836 (dnet40): updating default job properties
22/08/2014
- 05:38 PM Revision 29835 (dnet40): removing common import input parameters which are not required in this context
- 05:34 PM Revision 29834 (dnet40): removing 'import' directory creation and removal which was obsolete
- 05:27 PM Revision 29833 (dnet40): checking whether trust level is empty before comparing to predefined threshold
- 04:57 PM Revision 29831 (dnet40): removed unused properties about OAI
- 04:56 PM Revision 29830 (dnet40): idScheme and idNamespace are not a property anymore, but they are dynamically read from the OAI configuration profile
- 03:01 PM Revision 29829 (dnet40): Better to use the info level for the interceptor, so we can see that someone is keeping on harvesting. The possible resumption token is instead printed in debug mode by DNetOAICore
- 02:53 PM Revision 29828 (dnet40): OAI interceptor now logs in debug if everything's ok
- 02:34 PM Revision 29827 (dnet40): introducing trust_level_threshold support in statistics workflow
- 02:27 PM Revision 29826 (dnet40): introducing trust_level_threshold support in common import workflow
- 02:24 PM Revision 29825 (dnet40): introducing trust level threshold support when importing information space data
- 02:15 PM Revision 29824 (dnet40): introducing IMPORT_TRUST_LEVEL_THRESHOLD parameter
- 01:27 PM Revision 29823 (dnet40): throwing exception when mdstoreid or mdstore service location set to $UNDEFINED$ value
- 01:21 PM Revision 29822 (dnet40): throwing exception when actionsetid set to $UNDEFINED$ value
- 01:13 PM Revision 29821 (dnet40): providing default value for action_set_id_entity_dataset set to $UNDEFINED$. This change is required when exporting in statistics export mode where no entities are exported and such parameter should not be required.
- 12:57 PM Revision 29820 (dnet40): AbstractContentInitializer log to fatal
- 12:56 PM Revision 29819 (dnet40): introducing dedicated statistics mainworkflow encapsulating importing, processing and exporting phases. This workflow was introduced explicitly for statistics purposes because we want to operate over InformationSpace imported data in contrary to primary workflow where some of the statistics input was inferred and it wasn't clear whether it will become part of InformationSpace.
- 11:33 AM Revision 29818 (dnet40): extending description
- 11:30 AM Revision 29817 (dnet40): allowing overriding inference_provenance_blacklist default 'iis' value which will be required in mainworkflows/statistcs where inferenced document to project relations should be taken into account
21/08/2014
- 06:48 PM Revision 29816 (dnet40): setting default $undefined$ value for 'input_aux_dataset_existing_id'
- 06:33 PM Revision 29815 (dnet40): setting default undefined values for 'mdstore_service_location' and 'dataset_mdstore_ids_csv'
- 06:13 PM Revision 29814 (dnet40): Cleaned logs
- 05:26 PM Revision 29813 (dnet40): Updated default list of compound indices.
- 05:15 PM Revision 29812 (dnet40): logs pretty print dates as the IS container does
- 05:01 PM Revision 29811 (dnet40): Allow "<>" in queries in OAI configuration using EscapeXML before saving to the configuration profile.
- 02:03 PM Revision 29809 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
- 02:03 PM Revision 29808 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
- 02:03 PM Revision 29807 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
- 12:56 PM Revision 29806 (dnet40): introducing CONFIDENCE_TO_TRUST_LEVEL_FACTOR field holding 0.9 multiplier used for IIS confidence level [0;1] translation to trust level [0;0.9]
20/08/2014
- 05:58 PM Revision 29801 (dnet40): supporting $UNDEFINED$ value in IMPORT_INFERENCE_PROVENANCE_BLACKLIST
19/08/2014
- 12:14 PM Revision 29799 (dnet40): adding junit dependency for unit tests
- 12:13 PM Revision 29798 (dnet40): introducing citations xstream deserialization tests
- 12:13 PM Revision 29797 (dnet40): introducing hashCode and equals method
- 12:00 PM Revision 29796 (dnet40): introducing CitationsXmlConverter unit test
18/08/2014
- 05:08 PM Revision 29795 (dnet40): updating main method introduced for testing purposes
- 05:07 PM Revision 29794 (dnet40): updating main method introduced for testing purposes
- 05:05 PM Revision 29793 (dnet40): #433 introducing ComparableCitationEntry and TypedId model in citations, exported as sorted set XML representation
05/08/2014
- 04:44 PM Revision 29790 (dnet40): moved test to correct package
- 03:02 PM Revision 29789 (dnet40): Added description for start node
- 02:54 PM Revision 29788 (dnet40): Adding parenthesis in mongo queries, otherwise they are not interpretred as expected.
04/08/2014
- 12:59 PM Revision 29783 (dnet40): Updated pubdate
- 12:58 PM Revision 29782 (dnet40): Overview cleanup
- 12:50 PM Revision 29781 (dnet40): added links to the latest available schema and documentation
- 12:45 PM Revision 29780 (dnet40): documentation generated for services.openaire.eu
01/08/2014
- 07:05 PM Revision 29779 (dnet40): fixed outgoing arc
- 07:01 PM Revision 29778 (dnet40): added compound index on funder and oaftype for OAI
- 06:57 PM Revision 29777 (dnet40): including organizations in oaf query for OAI configuration.
- 06:55 PM Revision 29776 (dnet40): Updated OAI configuration profile.
- 06:23 PM Revision 29775 (dnet40): Fixed json parameters for OAI M/R job node
- 05:28 PM Revision 29774 (dnet40): Added node to set the new current OAI db
- 05:28 PM Revision 29773 (dnet40): SimpleJobNode that updates the current OAI db via xUpdate
- 04:51 PM Revision 29772 (dnet40): Do not ensure index when creating an oaistore
- 04:32 PM Revision 29771 (dnet40): Added forgotten handler.don call
- 04:29 PM Revision 29770 (dnet40): Fixed parameters
- 04:08 PM Revision 29769 (dnet40): new bean for lupa collector plugin
- 04:07 PM Revision 29768 (dnet40)
- 04:07 PM Revision 29767 (dnet40): -PLUS profile updated
- -OAI profile updated to new schema
- 03:18 PM Revision 29766 (dnet40)
- 10:07 AM Revision 29765 (dnet40)
- 09:25 AM Revision 29764 (dnet40): labels
- 09:20 AM Revision 29763 (dnet40)
31/07/2014
- 10:56 PM Revision 29762 (dnet40)
- 10:54 PM Revision 29761 (dnet40)
- 10:52 PM Revision 29760 (dnet40)
- 09:58 PM Revision 29759 (dnet40)
- 09:38 PM Revision 29758 (dnet40)
- 07:58 PM Revision 29754 (dnet40)
- 07:17 PM Revision 29753 (dnet40): fixed parameters for setFormat node
- 06:42 PM Revision 29752 (dnet40): SetFormatInfoJobNode takes three optional parameters that specify the name of the env properties where format, layout, and intepretation will be put.This is useful to the dm.provision wf, where the OAI nodes need the triple "oaf-index-openaire" instead of "DMF|TMF-index-openaire".
- 06:28 PM Revision 29751 (dnet40): Fixed target node
- 06:15 PM Revision 29750 (dnet40): Using new version of OAI publisher.
- 06:14 PM Revision 29749 (dnet40): Updated test.
- 06:08 PM Revision 29748 (dnet40): Updated workflows for OAI feed/post feed.
- 06:07 PM Revision 29747 (dnet40): The oai database currently in use is discovered dynamically from the OAIConfiguration profile.
- The xquery to use to retrieve the db name from the configuration is in the property services.oai.publisher.db.xquery....
- 06:01 PM Revision 29746 (dnet40): OAIPublisherCOnfiguration profile now requires CURRENTDB element after IDNAMESPACE
- 04:58 PM Revision 29743 (dnet40)
- 04:54 PM Revision 29742 (dnet40): more logging
- 04:44 PM Revision 29741 (dnet40)
- 04:44 PM Revision 29740 (dnet40)
- 04:25 PM Revision 29739 (dnet40)
- 03:39 PM Revision 29736 (dnet40): Removed module dnet-oai-hdfs-workflows. It is now deprecated and not to be used anymore.
- 02:44 PM Revision 29735 (dnet40)
- 02:28 PM Revision 29734 (dnet40): fixed blacklist type
- 12:49 PM Revision 29733 (dnet40): added toString
- 12:48 PM Revision 29732 (dnet40): more logging. fixed entity type check
- 12:28 PM Revision 29731 (dnet40): #9059 reverting #717 change: shortening app_path for primary workflow due to the fix applied by Paweł on WF_JOBS MODIFY mysql table: canging varchar(255) to mediumtext.
- 12:25 PM Revision 29730 (dnet40): updating job.properties
- 11:51 AM Revision 29729 (dnet40)
- 11:50 AM Revision 29728 (dnet40)
- 11:49 AM Revision 29727 (dnet40)
- 09:03 AM Revision 29726 (dnet40)
30/07/2014
- 11:11 PM Revision 29725 (dnet40)
- 11:10 PM Revision 29724 (dnet40)
- 10:27 PM Revision 29723 (dnet40)
- 10:24 PM Revision 29722 (dnet40)
- 10:24 PM Revision 29721 (dnet40)
- 09:40 PM Revision 29720 (dnet40)
- 09:40 PM Revision 29719 (dnet40)
- 09:21 PM Revision 29718 (dnet40)
- 09:20 PM Revision 29717 (dnet40)
- 09:20 PM Revision 29716 (dnet40)
- 09:18 PM Revision 29715 (dnet40)
- 09:12 PM Revision 29714 (dnet40)
- 08:47 PM Revision 29713 (dnet40)
- 08:37 PM Revision 29712 (dnet40): dnet-mapreduce-jobs dependency moved to trunk snapshot 0.0.4
- 04:41 PM Revision 29709 (dnet40): Jochen updates
- 04:40 PM Revision 29708 (dnet40): Testing with dnet mapreduce 2.0.0 snapshot
- 04:15 PM Revision 29707 (dnet40): more logging
- 04:09 PM Revision 29706 (dnet40): -created a generic WF for non-epidoc content
- -removed mediawiki WF and used the aforementioned one
-changed typology accordingly in lupa and mediawiki DS profiles... - 03:57 PM Revision 29704 (dnet40): updated jobtracker2 endpoint
- 03:38 PM Revision 29702 (dnet40): defined limit to the maximum number of counters
- 03:05 PM Revision 29699 (dnet40)
- 03:02 PM Revision 29698 (dnet40): update OAI schema
- 03:01 PM Revision 29697 (dnet40): fixed bug on index ui
- 12:31 PM Revision 29695 (dnet40)
- 12:16 PM Revision 29694 (dnet40): Update index job node, added parameter backend Id for the new index
- 12:15 PM Revision 29693 (dnet40): update lightui-eagle profile
- 12:15 PM Revision 29692 (dnet40): added Lupa profile
- 12:04 PM Revision 29691 (dnet40): fixed wrong merge
- 11:42 AM Revision 29690 (dnet40): Pretty printing of JSON dump
- 11:42 AM Revision 29689 (dnet40): changed interface removed lookup and browsing from index service interface
- 11:25 AM Revision 29688 (dnet40): changed implementation using module dnet-index-client
- 11:18 AM Revision 29687 (dnet40): changed implementation using module dnet-index-client
- 11:17 AM Revision 29686 (dnet40): Implemented index client
- 11:16 AM Revision 29685 (dnet40): Fixed a problem with UTF-8 and Ajax POST calls
29/07/2014
- 11:13 PM Revision 29684 (dnet40)
- 11:13 PM Revision 29683 (dnet40)
- 10:48 PM Revision 29682 (dnet40)
- 10:43 PM Revision 29681 (dnet40)
- 10:42 PM Revision 29680 (dnet40)
- 10:36 PM Revision 29679 (dnet40)
- 10:35 PM Revision 29678 (dnet40)
- 10:33 PM Revision 29677 (dnet40)
- 10:31 PM Revision 29676 (dnet40)
- 10:30 PM Revision 29675 (dnet40)
- 09:30 PM Revision 29674 (dnet40)
- 09:00 PM Revision 29673 (dnet40)
- 08:58 PM Revision 29672 (dnet40)
- 08:40 PM Revision 29671 (dnet40)
- 08:40 PM Revision 29670 (dnet40)
- 08:37 PM Revision 29669 (dnet40)
- 07:27 PM Revision 29668 (dnet40)
- 07:24 PM Revision 29667 (dnet40)
- 05:52 PM Revision 29666 (dnet40)
- 05:52 PM Revision 29665 (dnet40)
- 05:39 PM Revision 29664 (dnet40)
- 05:22 PM Revision 29663 (dnet40): Edit profiles
- 05:01 PM Revision 29662 (dnet40): profile deletion
- 04:15 PM Revision 29661 (dnet40): ui refinements
- 04:01 PM Revision 29660 (dnet40): fixed the bug of NullPointerExeption while mode parameter is not provided for prepareRepoRegistration.action
- 04:00 PM Revision 29659 (dnet40): ui refinements
- 03:47 PM Revision 29658 (dnet40): preparation for IS_validation
- 03:24 PM Revision 29657 (dnet40): defined limit to the maximum number of counters
- 03:20 PM Revision 29656 (dnet40): preparation for IS_backups
- 02:57 PM Revision 29655 (dnet40): added a new log index
- 02:55 PM Revision 29654 (dnet40)
- 02:53 PM Revision 29653 (dnet40)
- 02:46 PM Revision 29652 (dnet40): removed norm-space() for descriptions
- 02:41 PM Revision 29651 (dnet40)
- 02:34 PM Revision 29650 (dnet40)
- 02:28 PM Revision 29649 (dnet40)
- 12:48 PM Revision 29648 (dnet40): introducing missing record_collapser property in job.properties
- 11:54 AM Revision 29647 (dnet40): memory-related properties set
- 11:53 AM Revision 29646 (dnet40): expected test corrected
- 10:43 AM Revision 29645 (dnet40): updating expected record content
- 10:04 AM Revision 29642 (dnet40): reordered browsing fields
- 01:07 AM Revision 29641 (dnet40)
- 01:03 AM Revision 29640 (dnet40)
- 12:58 AM Revision 29639 (dnet40)
- 12:58 AM Revision 29638 (dnet40)
- 12:57 AM Revision 29637 (dnet40)
28/07/2014
- 11:52 PM Revision 29636 (dnet40)
- 11:52 PM Revision 29635 (dnet40)
- 11:45 PM Revision 29634 (dnet40)
- 11:44 PM Revision 29633 (dnet40)
- 10:40 PM Revision 29632 (dnet40): fixing placeholder name
- 09:45 PM Revision 29631 (dnet40): renaming workflow to ingest_pmc_plaintext
- 06:28 PM Revision 29630 (dnet40): fixed wrong cardinality
- 06:27 PM Revision 29629 (dnet40)
- 05:55 PM Revision 29628 (dnet40): Bulk importer for profiles and schemas
- 05:04 PM Revision 29627 (dnet40): forcing properties about "metadata editor" to the first one encountered (according to D3.1)
- 05:01 PM Revision 29626 (dnet40): #717 shortening app_path for primary workflow
- 05:01 PM Revision 29625 (dnet40): forcing properties about "metadata editor" to the first one encountered (according to D3.1)
- 04:50 PM Revision 29624 (dnet40): correction in "decoration" cardinality
- 04:41 PM Revision 29623 (dnet40): early definition of overall provision workflow
- 04:39 PM Revision 29622 (dnet40): removed indentation
- 04:08 PM Revision 29621 (dnet40): updating job.properties
- 03:21 PM Revision 29619 (dnet40): -moved cleaning xsl
- -introduced lower-case fx for some xpath
- 03:17 PM Revision 29617 (dnet40): removed "hamster references"
- 03:14 PM Revision 29616 (dnet40): fixing output port names: removing default values for citation_pmc and dataset, setting proper output_citation_pmc in both preprocessing and primary workflows
- 03:12 PM Revision 29615 (dnet40): removed "hamster references"
- 03:10 PM Revision 29614 (dnet40)
- 03:04 PM Revision 29613 (dnet40)
- 02:56 PM Revision 29612 (dnet40): updating job.properties
- 02:56 PM Revision 29611 (dnet40): #717 shortening app_path for preprocessing workflow and subworkflows
- 02:55 PM Revision 29610 (dnet40): Register profile
- 02:49 PM Revision 29609 (dnet40): Blackboard inspector
- 02:47 PM Revision 29608 (dnet40): added new WF parameter
- 01:08 PM Revision 29607 (dnet40): some updates in xslt
- 12:53 PM Revision 29606 (dnet40): fixed the content-type of an ajax call
- 12:24 PM Revision 29605 (dnet40): collection aware OAI store job nodes
- 11:57 AM Revision 29604 (dnet40)
- 11:56 AM Revision 29603 (dnet40): removed unused spring-aop dependencies
- 11:49 AM Revision 29602 (dnet40): removed unused aspectj dependencies
- 11:40 AM Revision 29601 (dnet40): added datacite resource types to dnet:publication_resource ; added rights terms used by zenodo and datacite to dnet:access_modes
- 10:19 AM Revision 29594 (dnet40): condition to show refresh button
- 10:11 AM Revision 29593 (dnet40): Workflow duration
Also available in: Atom