Updated test case process document (from Luc's feedback)
authorTrung Dong Huynh <tdh@ecs.soton.ac.uk>
Fri, 23 Nov 2012 10:20:44 +0000
changeset 4937 a1c32174d82e
parent 4936 beac6b568c21
child 4939 1d28e48de55b
Updated test case process document (from Luc's feedback)
testcases/process.html
--- a/testcases/process.html	Thu Nov 22 21:30:39 2012 +0000
+++ b/testcases/process.html	Fri Nov 23 10:20:44 2012 +0000
@@ -171,13 +171,15 @@
 
 <h3>Test cases</h3>
 
-<p>The test cases will be made available  online at: &lt;URI&gt;<br />
-  Every test case has an identifier, e.g. <strong>association2-FAIL-c52</strong>.
+<p>The test cases for PROV-CONSTRAINTS (see <a href="#table-test-cases">Table 2</a>) can be downloaded from <a
+href="http://dvcs.w3.org/hg/prov/raw-file/default/testcases/constraints/">http://dvcs.w3.org/hg/prov/raw-file/default/testcases/constraints/</a></p>
+<p>
+  Each test case has an identifier, e.g. <strong>association2-FAIL-c50</strong>.
   In order to facilitate the testing process, the identifier
   also indicates whether the test case should be successfully validated (i.e. <b>PASS</b>)
   or not (i.e. <b>FAIL</b>). In addition, in case of the latter, we also include the
   numberings of the constraints that we expect to cause the test case to fail validation,
-  e.g. <b>c52</b>. 
+  e.g. <a href="http://dvcs.w3.org/hg/prov/raw-file/default/model/prov-constraints.html#typing"><b>c50</b></a>. 
 </p>
 
 <p>The provenance document for each test case will be provided in the following representations:</p>
@@ -190,28 +192,28 @@
     <td><strong>Documentation</strong></td>
   </tr>
   <tr>
+    <td><p><strong>PROV-N</strong></p></td>
+    <td><p>.provn</p></td>
+    <td><p><a href="http://www.w3.org/TR/prov-n/">[[PROV-N]]</a></p></td>
+  </tr>
+  <tr>
+    <td><p><strong>RDF (PROV-O)</strong></p></td>
+    <td><p>.ttl</p></td>
+    <td><p><a href="http://www.w3.org/TR/prov-o/">[[PROV-O]]</a></p></td>
+  </tr>
+  <tr>
     <td><p><strong>PROV-XML</strong></p></td>
     <td><p>.provx</p></td>
     <td><p><a href="http://dvcs.w3.org/hg/prov/raw-file/default/xml/prov-xml.html">http://dvcs.w3.org/hg/prov/raw-file/default/xml/prov-xml.html</a></p></td>
   </tr>
-  <tr>
-    <td><p><strong>PROV-RDF</strong></p></td>
-    <td><p>.ttl</p></td>
-    <td><p><a href="http://www.w3.org/TR/prov-o/">http://www.w3.org/TR/prov-o/</a></p></td>
-  </tr>
-  <tr>
-    <td><p><strong>PROV-N</strong></p></td>
-    <td><p>.provn</p></td>
-    <td><p><a href="http://www.w3.org/TR/prov-n/">http://www.w3.org/TR/prov-n/</a></p></td>
-  </tr>
 </table>
 
 
 
-<p>For example, the available files for the test case <strong>association2-FAIL-c52</strong>
-are: <strong>association2-FAIL-c52.xml</strong>, <strong>association2-FAIL-c52.ttl</strong>,
-and <strong>association2-FAIL-c52.provn</strong>. They can all be found at <a
-href="http://dvcs.w3.org/hg/prov/raw-file/default/testcases/constraints/">http://dvcs.w3.org/hg/prov/raw-file/default/testcases/constraints/</a>.</p>
+<p>For example, the available files for the test case <strong>association2-FAIL-c50</strong>
+are: <strong>association2-FAIL-c50.provx</strong>, <strong>association2-FAIL-c50.ttl</strong>,
+and <strong>association2-FAIL-c50.provn</strong>. All three representations for each test
+cases can be found at the URL provided above.</p>
 
 </section>
 
@@ -227,7 +229,7 @@
 NOT be included in either of the files.</p>
 
 <p>For example, if a validator can <strong>only</strong> process the three test cases
-<b>derivation1-PASS</b>, <b>derivation2-FAIL-ordering</b>, <b>and derivation3-PASS</b>, we
+<b>derivation1-PASS</b>, <b>derivation2-FAIL-ordering</b>, and <b>derivation3-PASS</b>, we
 expect the result
 files's contents to be similar to the below.</p>
 <pre class="example">
@@ -265,7 +267,7 @@
 
 <p class="note">Dong: We need to check whether all the constraints are sufficiently covered and curate from the WG or generate ourselves the test cases for constraints that haven’t been covered by these.</p>
 
-<table border="1" cellspacing="0" cellpadding="5">
+<table border="1" cellspacing="0" cellpadding="5" id="table-test-cases">
 
   <caption>Table 2. PROV-CONSTRAINTS test cases</caption>
   <tr>
@@ -286,7 +288,7 @@
   </tr>
   <tr>
     <td><b>derivation2-FAIL-ordering</b></td>
-    <td>&nbsp;</td>
+    <td>ordering</td>
     <td>Fail</td>
     <td>
       <a href="http://dvcs.w3.org/hg/prov/raw-file/default/testcases/constraints/derivation2-FAIL-ordering.provn" title="derivation2-FAIL-ordering.provn">PROV-N</a>
@@ -296,7 +298,7 @@
   </tr>
   <tr>
     <td><b>derivation3-PASS</b></td>
-    <td>ordering</td>
+    <td>&nbsp;</td>
     <td>Pass</td>
     <td>
       <a href="http://dvcs.w3.org/hg/prov/raw-file/default/testcases/constraints/derivation3-PASS.provn" title="derivation3-PASS.provn">PROV-N</a>
@@ -371,10 +373,13 @@
 successful if its validation result is the same as the expected result in Table 2.</p>
 
 <p>The test case results will also need to be collated against the constraints they cover
-to indicate which constraints have/have not been successfully tested.</p>
+to indicate which constraints have/have not been successfully tested. This information will
+be added to the
+<a href="http://dvcs.w3.org/hg/prov/raw-file/default/reports/prov-implementations.html">implementation
+report</a> for the validator for which those test cases result are submitted.</p>
 
 <p>The collated result will be made available to the implementer soon after they submit
-their result</p>
+their result.</p>
 
 </section>