Copyright © 2011-2012 W3C® (MIT, ERCIM, Keio), All Rights Reserved. W3C liability, trademark and document use rules apply.
PROV-DM, the PROV data model, is a data model for provenance that describes the entities, people and activities involved in producing a piece of data or thing. PROV-DM is structured in six components, dealing with: (1) entities and activities, and the time at which they were created, used, or ended; (2) agents bearing responsibility for entities that were generated and actities that happened; (3) derivations between entities; (4) properties to link entities that refer to a same thing; (5) collections of entities, whose provenance can itself be tracked; (6) a simple annotation mechanism.
To provide examples of the PROV data model, the PROV notation (PROV-N) is introduced: aimed at human consumption, PROV-N allows serializations of PROV-DM instances to be created in a compact manner. PROV-N facilitates the mapping of the PROV data model to concrete syntax, and is used as the basis for a formal semantics of PROV-DM. The purpose of this document is to define the PROV-N notation.
This section describes the status of this document at the time of its publication. Other documents may supersede this document. A list of current W3C publications and the latest revision of this technical report can be found in the W3C technical reports index at http://www.w3.org/TR/.
This is the fourth public release of the PROV-DM document. Following feedback, the Working Group has decided to reorganize this document substantially, separating the data model, from its contraints, and the notation used to illustrate it. The PROV-DM release is synchronized with the release of the PROV-O, PROV-PRIMER, PROV-N, PROV-DM-CONSTRAINTS documents. We are now making clear what the entry path to the PROV family of specifications is.
This document was published by the Provenance Working Group as an Editor's Draft. If you wish to make comments regarding this document, please send them to public-prov-wg@w3.org (subscribe, archives). All feedback is welcome.
Publication as an Editor's Draft does not imply endorsement by the W3C Membership. This is a draft document and may be updated, replaced or obsoleted by other documents at any time. It is inappropriate to cite this document as other than work in progress.
This document was produced by a group operating under the 5 February 2004 W3C Patent Policy. W3C maintains a public list of any patent disclosures made in connection with the deliverables of the group; that page also includes instructions for disclosing a patent. An individual who has actual knowledge of a patent which the individual believes contains Essential Claim(s) must disclose the information in accordance with section 6 of the W3C Patent Policy.
Provenance is defined as a record that describes the people, institutions, entities, and activities, involved in producing, influencing, or delivering a piece of data or a thing in the world. Two companion specifications respectively define PROV-DM, a data model for provenance, allowing provenance descriptions to be expressed [PROV-DM] and a set of constraints that provenance descriptions are expected to satisfy [PROV-DM-CONSTRAINTS].
In this context, PROV-N is introduced as a notation to write instances of the PROV data model primarily aimed at human consumption. PROV-N allows serializations of PROV-DM instances to be written in a technology independent manner. So far, PROV-N has been used in the following ways:
PROV-N was designed to be as close as possible to PROV-DM without the syntactic bias and modelling constraints that concrete technologies bring with them, e.g., XML's choice between attribute and element, RDF's reliance on triples, or JSON's usage of dictionaries.
The purpose of this document is solely to define the syntax of PROV-N. For each construct of PROV-DM, a corresponding PROV-N expression is introduced, by way of a production in the PROV-N grammar presented in this document.
Section 2 provides the design rationale for the PROV Notation.
Section 3 defines the notation for the Extended Backus-Naur Form (EBNF) grammar used in this specification.
Section 4 presents the grammar of all expressions of the language, presented one by one, and grouped according to PROV-DM components.
Section 5 defines the grammar of containers, a house-keeping construct of PROV-N capable of packaging up PROV-N expressions and namespace declarations.
Section 6 defines the grammar of accounts.
Section 7 defines media type for the PROV-N notation.
The PROV namespace is http://www.w3.org/ns/prov#.
All the elements, relations, reserved names and attributes introduced in this specification belong to the PROV namespace.
The key words "must", "must not", "required", "shall", "shall not", "should", "should not", "recommended", "may", and "optional" in this document are to be interpreted as described in [RFC2119].
A key goal of PROV-DM is the specification of a machine-processable data model for provenance so that application having obtained the provenance of the resource they manipulate can reason about such provenance. As such, representations of PROV-DM are available in RDF and XML.
However, communicating provenance between humans is also important when teaching, illustrating, formalizing, and discussing provenance-related issues. To this end, PROV-N is a notation that is designed to write instances of the PROV-DM data model in a compact textual form, without the syntactic baggage and constraints coming with a markup language such as XML or a description framework such as RDF.
wasDerivedFrom(e2, e1, a, g2, u1)
PROV-N optional arguments need not be specified (as long as this does not lead to ambiguity).
The activity, generation, and usage are specified in the first derivation, whereas they are not in the second.
wasDerivedFrom(e2, e1, a, g2, u1) wasDerivedFrom(e2, e1)
Activity a1 does not have start and end times specified, whereas a2 does
activity(a1) activity(a2, 2011-11-16T16:00:00, 2011-11-16T16:00:01)
For cases where it is desirable to indicate which arguments have not been specified, PROV-N uses the syntactic marker - for unspecified arguments.
The activity, generation, and usage are specified in the first derivation, whereas they are not in the second, but have been explicitly marked as such.
wasDerivedFrom(e2, e1, a, g2, u1) wasDerivedFrom(e2, e1, a, -, -) wasDerivedFrom(e2, e1, -, -, -)
Activity a1 does not have start and end times specified, but they are been marked syntactically.
activity(a1, -, -)
When an expression has an identifier, the identifier always occur in first position. For expressions with optional identifier, it may be replaced by the syntactic marker -.
Derivation has an optional identifier. In the first derivation, the identifier is not expressed. It is explicit in the second, and marked by a - in the third.
wasDerivedFrom(e2, e1) wasDerivedFrom(d, e2, e1) wasDerivedFrom(-, e2, e1)
Most expressions have an optional set of attribute-value pairs, which occur in last position, and delimited by square brackets.
activity(ex:a10) activity(ex:a10, []) activity(ex:a10, [ex:param1="a", ex:param2="b"])
wasDerivedFrom(e2, e1)
This specification includes a grammar for PROV-N expressed using the Extended Backus-Naur Form (EBNF) notation.
Each production rule (or production, for short) in the grammar defines one non-terminal symbol, in the form:
E ::= expression
Within the expression on the right-hand side of a rule, the following expressions are used to match strings of one or more characters:A PROV-N document consists of a sequence of expressions, wrapped up in an expression container with some namespace declarations. This section focuses on the definition of expressions.
Instances of the PROV-DM data model are expressed as PROV-N expressions, which have a text conformant with the toplevel production expression of the grammar.
expression | ::= |
entityExpression
| activityExpression
| generationExpression
| usageExpression
| startExpression | endExpression | communicationExpression | startByActivityExpression | agentExpression | attributionExpression | associationExpression | responsibilityExpression | derivationExpression | revisionExpression | quotationExpression | hadOriginalSourceExpression | traceabilityExpression | alternateExpression | specializationExpression | noteExpression | annotationExpression |
In the rest of the section, productions are presented for each expression, followed by small examples illustrating the syntax of expressions compliant with the presented productions.
An entity's text matches the entityExpression production.
entity(tr:WD-prov-dm-20111215) entity(tr:WD-prov-dm-20111215, [ prov:type="document" ]) entity(tr:WD-prov-dm-20111215, [ prov:type="document", ex:version=2 ])
An activity's text matches the activityExpression production.
activity(ex:a10) activity(ex:a10, -, -) activity(ex:a10, -, -, [prov:type="edit"]) activity(ex:a10, -, 2011-11-16T16:00:00) activity(ex:a10, 2011-11-16T16:00:00, -) activity(ex:a10, 2011-11-16T16:00:00, -, [prov:type="createFile"]) activity(ex:a10, 2011-11-16T16:00:00, 2011-11-16T16:00:01, [prov:type="createFile"]) activity(ex:a10, [prov:type="edit"])
A generation's text matches the generationExpression production.
wasGeneratedBy(tr:WD-prov-dm-20111215, ex:edit1, -) wasGeneratedBy(tr:WD-prov-dm-20111215, ex:edit1, 2011-11-16T16:00:00) wasGeneratedBy(e2, a1, -, [ex:fct="save"]) wasGeneratedBy(e2, -, -, [ex:fct="save"]) wasGeneratedBy(ex:g1, tr:WD-prov-dm-20111215, ex:edit1, -) wasGeneratedBy(ex:g1, tr:WD-prov-dm-20111215, ex:edit1, 2011-11-16T16:00:00) wasGeneratedBy(-, tr:WD-prov-dm-20111215, ex:edit1, -)
Even though the production generationExpression allows for expressions wasGeneratedBy(e2, -, -) and wasGeneratedBy(-, e2, -, -), these expressions are not valid in PROV-N, since at least one of activity, time, or attributes must be present.
A usage's text matches the usageExpression production.
used(ex:act2, ar3:0111, -) used(ex:act2, ar3:0111, 2011-11-16T16:00:00) used(a1,e1, -, [ex:fct="load"]) used(ex:u1, ex:act2, ar3:0111, -) used(-, ex:act2, ar3:0111, -)
An activity start's text matches the startExpression production of the grammar
wasStartedBy(ex:act2, ar3:0111, -) wasStartedBy(ex:act2, ar3:0111, 2011-11-16T16:00:00) wasStartedBy(ex:act2, -, 2011-11-16T16:00:00) wasStartedBy(ex:act2, -, -) wasStartedBy(ex:act2, -, -, [ex:param="a"]) wasStartedBy(s, ex:act2, ar3:0111, 2011-11-16T16:00:00) wasStartedBy(-, ex:act2, ar3:0111, 2011-11-16T16:00:00)
Even though the production startExpression allows for expressions wasStartedBy(e2, -, -) and wasStartedBy(-, e2, -, -), these expressions are not valid in PROV-N, since at least one of trigger, time, or attributes must be present.
An activity end's text matches the endExpression production of the grammar.
wasEndedBy(ex:act2, ex:trigger, -) wasEndedBy(ex:act2, ex:trigger, 2011-11-16T16:00:00) wasEndedBy(ex:act2, -, 2011-11-16T16:00:00) wasEndedBy(ex:act2, -, 2011-11-16T16:00:00, [ex:param="a"]) wasEndedBy(e,ex:act2, -, -) wasEndedBy(e, ex:act2, ex:trigger, 2011-11-16T16:00:00) wasEndedBy(-, ex:act2, ex:trigger, 2011-11-16T16:00:00)
Even though the production endExpression allows for expressions wasEndedBy(e2, -, -) and wasEndedBy(-, e2, -, -), these expressions are not valid in PROV-N, since at least one of trigger, time, and attributes must be present.
wasInformedBy(ex:a1, ex:a2) wasInformedBy(ex:a1, ex:a2, [ex:param1="a", ex:param2="b"]) wasInformedBy(i, ex:a1, ex:a2) wasInformedBy(i, ex:a1, ex:a2, [ex:param1="a", ex:param2="b"]) wasInformedBy(-, ex:a1, ex:a2) wasInformedBy(-, ex:a1, ex:a2, [ex:param1="a", ex:param2="b"])
wasStartedByActivity(ex:a1, ex:a2) wasStartedByActivity(ex:a1, ex:a2, [ex:param1="a", ex:param2="b"]) wasStartedByActivity(s,ex:a1, ex:a2) wasStartedByActivity(s,ex:a1, ex:a2, [ex:param1="a", ex:param2="b"]) wasStartedByActivity(-,ex:a1, ex:a2) wasStartedByActivity(-,ex:a1, ex:a2, [ex:param1="a", ex:param2="b"])
An agent's text matches the agentExpression production.
agent(ag4) agent(ag4, [ prov:type="prov:Person" %% xsd:QName, ex:name="David" ])
wasAttributedTo(e, ag) wasAttributedTo(e, ag, [ex:license="cc:attributionURL" %% "xsd:QName"]) wasAttributedTo(id, e, ag, [ex:license="cc:attributionURL" %% "xsd:QName"]) wasAttributedTo(-, e, ag, [ex:license="cc:attributionURL" %% "xsd:QName"])
An association's text matches the activityAssociationExpression productions of the grammar defined in this specification document.
wasAssociatedWith(ex:a1, -, ex:e1) wasAssociatedWith(ex:a1, ex:ag1, -) wasAssociatedWith(ex:a1, ex:ag1, ex:e1) wasAssociatedWith(ex:a1, ex:ag1, ex:e1, [ex:param1="a", ex:param2="b"]) wasAssociatedWith(a, ex:a1, -, ex:e1) wasAssociatedWith(-, ex:a1, -, ex:e1) wasAssociatedWith(-, ex:a1, ex:ag1, -)
Even though the production associationExpression allows for expressions wasAssociatedWith(a, -, -) and wasAssociatiedWith(-, a, -, -), these expressions are not valid in PROV-N, since at least one of agent or plan must be present.
actedOnBehalfOf(ag1, ag2, -) actedOnBehalfOf(ag1, ag2, a) actedOnBehalfOf(ag1, ag2, -, [prov:type="delegation"]) actedOnBehalfOf(ag2, ag3, a, [prov:type="contract"]) actedOnBehalfOf(r, ag2, ag3, a, [prov:type="contract"]) actedOnBehalfOf(-, ag1, ag2, -)
A derivation expression's text matches the derivationExpression production.
wasDerivedFrom(e2, e1) wasDerivedFrom(e2, e1, a, g2, u1) wasDerivedFrom(e2, e1, -, g2, u1) wasDerivedFrom(e2, e1, a, -, u1) wasDerivedFrom(e2, e1, a, g2, -) wasDerivedFrom(e2, e1, a, -, -) wasDerivedFrom(e2, e1, -, -, u1) wasDerivedFrom(e2, e1, -, -, -) wasDerivedFrom(d, e2, e1, a, g2, u1) wasDerivedFrom(-, e2, e1, a, g2, u1)
wasRevisionOf(tr:WD-prov-dm-20111215, tr:WD-prov-dm-20111018, -) wasRevisionOf(tr:WD-prov-dm-20111215, tr:WD-prov-dm-20111018, w3:Consortium) wasRevisionOf(id,tr:WD-prov-dm-20111215, tr:WD-prov-dm-20111018, w3:Consortium) wasRevisionOf(tr:WD-prov-dm-20111215, tr:WD-prov-dm-20111018, -) wasRevisionOf(id,tr:WD-prov-dm-20111215, tr:WD-prov-dm-20111018, -) wasRevisionOf(-,tr:WD-prov-dm-20111215, tr:WD-prov-dm-20111018, -)
A quotation expression's text matches the quotationExpression production of the grammar.
wasQuotedFrom(ex:blockQuote,ex:blog) wasQuotedFrom(ex:blockQuote,ex:blog,ex:Luc,ex:Paul) wasQuotedFrom(ex:blockQuote,ex:blog,-,ex:Paul) wasQuotedFrom(ex:blockQuote,ex:blog,ex:Luc,ex:Paul,[]) wasQuotedFrom(ex:blockQuote,ex:blog, -, -) wasQuotedFrom(id,ex:blockQuote,ex:blog,ex:Luc,ex:Paul) wasQuotedFrom(-,ex:blockQuote,ex:blog,ex:Luc,-)
An original source record's text matches the originalSourceExpression production of the grammar.
hadOriginalSource(ex:e1, ex:e2) hadOriginalSource(ex:e1, ex:e2,[ex:param="a"]) hadOriginalSource(-,ex:e1, ex:e2,[ex:param="a"]) hadOriginalSource(-,ex:e1, ex:e2)
A traceability expression's text matches the traceabilityExpression production of the grammar.
tracedTo(e2,e1) tracedTo(e2,e1,[ex:param="a"]) tracedTo(id,e2,e1,[ex:param="a"]) tracedTo(-,e2,e1)
An alternate relation's text matches the alternateExpression production.
alternateOf(tr:WD-prov-dm-20111215,ex:alternate-20111215)
A specialization relation's text matches the specializationExpression production.
specializationOf(tr:WD-prov-dm-20111215,tr:prov-dm)
A Derivation-by-Insertion relation's text matches the derivationByInsertionFromExpression production.
derivedByInsertionFrom(c1, c, {("k1", v1), ("k2", v2)}) derivedByInsertionFrom(c1, c, {("k1", v1)}) derivedByInsertionFrom(c1, c, {("k1", v1), ("k2", v2)}, [])
A Derivation-by-Removal relation's text matches the derivationByRemovalFromExpression production.
derivedByRemovalFrom(c3, c1, {"k1", "k3"}) derivedByRemovalFrom(c3, c1, {"k1"}) derivedByRemovalFrom(c3, c1, {"k1", "k3"}, [])
A Membership relation's text matches the membershipExpression production.
memberOf(c3, {("k4", v4), ("k5", v5)}) memberOf(c3, {("k4", v4)}) memberOf(c3, {("k4", v4), ("k5", v5)},[])
A note's text matches the noteExpression production.
note(ann1,[ex:color="blue", ex:screenX=20, ex:screenY=30])
A note's text matches the noteExpression production.
hasAnnotation(tr:WD-prov-dm-20111215,ex2:n1)
In PROV-N, the following prefixes are reserved:
A PROV-N document must not redeclare prefixes prov and xsd.
The following example declares three namespaces, one default, and two with explicit prefixes ex1 and ex2.
container default <http://example.org/0/> prefix ex1 <http://example.org/1/> prefix ex2 <http://example.org/2/> ... end
A qualified name is a name subject to namespace interpretation. It consists of a namespace, denoted by an optional prefix, and a local name. PROV-DM stipulates that a qualified name can be mapped into an IRI by concatenating the IRI associated with the prefix and the local part.
A qualified name's prefix is optional. If a prefix occurs in a qualified name, it refers to a namespace declared in a namespace declaration. In the absence of prefix, the qualified name refers to the default namespace.
A PROV qualified name has a more permissive syntax then XML's QName [XML-NAMES] since it allows any syntax for its local part provided that the concatenation with the namespace results in a valid IRI [IRI].
Examples of articles on the BBC Web site seen as entities.
container prefix bbc <http://www.bbc.co.uk/> prefix bbcNews <http://www.bbc.co.uk/news/> entity(bbc:) // bbc site itself entity(bbc:news/) // bbc news entity(bbc:news/world-asia-17507976) // a given news article entity(bbcNews:) // an alternative way of referring to the bbc news site end
Examples of entities with declared and default namespace.
container default <http://example.org/2/> prefix ex <http://example.org/1/> entity(ex:a) // corresponds to IRI http://example.org/1/a entity(ex:a/) // corresponds to IRI http://example.org/1/a/ entity(ex:a/b) // corresponds to IRI http://example.org/1/a/b entity(b) // corresponds to IRI http://example.org/2/b entity(ex:1234) // corresponds to IRI http://example.org/2/1234 entity(4567) // corresponds to IRI http://example.org/2/4567 end
Note:The productions for qualifiedName and prefix are conflicting. In the context of a namespaceDeclaration, a parser should give precedence to the production for prefix.
An attribute's text matches the attribute production.
The reserved attributes in the PROV namespace are the following.
A Literal's text matches the Literal production.
The non terminals stringLiteral and intLiteral are syntactic sugar for quoted strings with datatype xsd:string and xsd:int, respectively.
In particular, a Literal may be an IRI-typed string (with datatype xsd:anyURI); such IRI has no specific interpretation in the context of PROV.
Note:The productions for qualifiedName and intLiteral are conflicting. In the context of a Literal, a parser should give precedence to the production for intLiteral.
prov:type="ex:Programmer" %% xsd:QNameto indicate that ex:Programmer should be interpreted as qualified name (QName). Instead, we could have a notation such as
prov:type='ex:Programmer'
The reserved type values in the PROV namespace are the following.
The entity ag is a person (type: prov:Person), whereas the entity pl is a plan (type: prov:Plan).
agent(ag,[prov:type="prov:Person" %% xsd:QName]) entity(pl,[prov:type="prov:Plan" %% xsd:QName])
Time instants are defined according to xsd:dateTime [XMLSCHEMA-2].
The third argument in the following usage expression is a time instance, namely 4pm on 2011-11-16.
used(ex:act2, ar3:0111, 2011-11-16T16:00:00)
An expression container is a house-keeping construct of PROV-N capable of packaging up PROV-N expressions and namespace declarations. An expression container forms a self-contained package of provenance descriptions for the purpose of exchanging them. An expression container may be used to package up PROV-N expressions in response to a request for the provenance of something ([PROV-AQ]).
Given its status of house keeping construct for the purpose of exchanging provenance expressions, an expression container is not defined as a PROV-N expression (production expression).
An expression container, written container decls exprs endContainer in PROV-N, contains:
An expression container's text matches the expressionContainer production.
The following container contains expressions related to the provenance of entity e2.
container prefix ex <http://example.org/> entity(e2, [ prov:type="File", ex:path="/shared/crime.txt", ex:creator="Alice", ex:content="There was a lot of crime in London last month."]) activity(a1, 2011-11-16T16:05:00, -,[prov:type="edit"]) wasGeneratedBy(e2, a1, -, [ex:fct="save"]) wasAssociatedWith(a1, ag2, -, [prov:role="author"]) agent(ag2, [ prov:type="prov:Person" %% xsd:QName, ex:name="Bob" ]) endContainer
This container could for instance be returned as the result of a query to a provenance store for the provenance of entity e2 [PROV-AQ].
PROV-DM has introduced a notion of account by which a set of provenance descriptions can be bundled up and named. PROV-DM assumes the existence of mechanisms to implement accounts, but such mechanisms remain outside its scope. It is suggested that specific serializations may offer solutions to name bundles of descriptions.
Given that the primary motivation for PROV-N is to provide a notation aimed at human consumption, it is therefore appropriate to introduce a notation for accounts, which would include an account name and a bundle of expressions.
An account, written account(id, exprs) in PROV-N, contains:
In PROV-N, an account's text matches the accountExpression production of the grammar.
It is also useful to package up one or more account expressions in an expression container, for interchange purpose. Hence, expressionContainer is revised as follows.
The following container
container prefix ex <http://example.org/> account(ex:acc1,...) account(ex:acc2,...) endContainer
illustrates how two accounts with identifiers ex:acc1 and ex:acc2 can be returned in a PROV-N serialization of the provenance of something.
The following container
container prefix ex <http://example.org/> ... account(ex:acc1, entity(tr:WD-prov-dm-20111018, [ prov:type="pr:RecsWD" %% xsd:QName ]) entity(tr:WD-prov-dm-20111215, [ prov:type="pr:RecsWD" %% xsd:QName ]) ... wasAssociatedWith(ex:pub2, w3:Consortium, pr:rec-advance)) account(ex:acc2, entity(ex:acc1, [prov:type="prov:AccountEntity" %% xsd:QName ]) wasAttributedTo(ex1:acc1, w3:Consortium)) endContainer
illustrates a first account, with identifier ex:acc1, containing expressions describing the provenance of the technical report tr:WD-prov-dm-20111215, and a second account ex:acc2, describing the provenance of the first. In account ex:acc2, ex:acc1 is the identifier of an entity of type prov:AccountEntity.
The media type of PROV-N is text/prov-n. The content encoding of PROV-N content is UTF-8.
See http://www.w3.org/2002/06/registering-mediatype for Register an Internet Media Type for a W3C Spec.
WG membership to be listed here.