Skip to content

Upload of two new vocabularies using the E84 function to allow IODE staff to update vocabulary/ontologies by uploading RDF** #279

Description

@paulineobps

In the E84 Contract Final Report for their contract Dec 2021 https://drive.google.com/file/d/12ngVQqXSpkmwkuCDIzcPKCaHNyB_it8Y/view?usp=share_link, the below extract was included that covered providing the ability to update vocabularies/upload new vocabularies.

Item 3: Establish automatic vocabulary/ontology update cron jobs OR (preferred) implement function to allow IODE staff to update vocabulary/ontologies by uploading RDF
Element 84 has migrated the internal graph database from Virtuoso to Neptune. A vocabulary/ontology ingest pipeline has been successfully implemented that enables IODE OBPS staff to add or update vocabularies/ontologies while only having to interact with AWS S3. IODE OBPS staff are only required to upload the vocabulary/ontology and small metadata file to S3 where the automated process will then asynchronously bulk load the vocabulary/ontology into Neptune. Once the vocabulary/ontology has been bulk loaded, the pipeline automatically triggers an update to the terms index where the new terms are added to the Elasticsearch index. The pipeline then triggers a bulk ingest which results in documents being re-tagged

We have user requests to upload WoRMs and the ASFA subset of the multilingual AGROVOC. With the above can we now upload these two new vocabularies please

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions