Skip to content

Commit f4ea95c

Browse files
authored
docs: Updated evidence & artifact linking on validation reports (#1343)
* WIP * Edit: Map and assess evidence * WIP: Assess compliance * save * Assess compliance: Link evidence to reports * Rename: Provide compliance assessments > Assign compliance assessments * Edit: Link artifacts to reports * save * save * oops, edited the notebooks not in the source, reverting * Shuffling Validator 4 training around * autogenerate single-source setup * edit * save * Refine validation report * save * save * Edit: Running data quality tests * Edit: Map and assess evidence > Map evidence to guidelines * Edit: Map and assess evidence > Assess evidence for compliance * save * save * save * Edit: Add and manage artifacts * proofread * more proofreading * proofreading Validator Fundamentals * proofread * ... * Pulling in updated notebooks * tweak * edits * edit * oops * Fixing typo * Finetune
1 parent 5cf1b61 commit f4ea95c

32 files changed

Lines changed: 1102 additions & 811 deletions

site/faq/faq-testing.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ Check out our introductory series — [**{{< var vm.product >}} for validation**
115115

116116
[^12]: [Manage record stakeholder types](/guide/configuration/manage-record-stakeholder-types.qmd)
117117

118-
[^13]: [Assess compliance](/guide/validation/assess-compliance.qmd#link-validator-evidence)
118+
[^13]: [Assess compliance](/guide/validation/assess-compliance.qmd#map-evidence)
119119

120120
[^14]: [Can we configure, customize, or add our own tests?](#can-we-configure-customize-or-add-our-own-tests)
121121

site/get-started/validator/quickstart-validator.qmd

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,7 @@ After you successfully run the notebook, return to the {{< var validmind.platfor
118118

119119
- Your validation report is broken down into sections, defined by your report templates.[^3]
120120
- The report includes risk assessment summaries at the overall and per-section level, overviews of your compliance assessments provided within your validation report.[^4]
121-
- Each sub-section allows you to attach test results as evidence,[^5] as well as log artifacts based on your evaluation of datasets or records.[^6]
121+
- Each sub-section (or guideline) allows you to attach test results as evidence,[^5] as well as log artifacts based on your evaluation of datasets or records.[^6]
122122

123123
:::: {.flex .flex-wrap .justify-around}
124124

@@ -138,13 +138,13 @@ After you successfully run the notebook, return to the {{< var validmind.platfor
138138

139139
#### Add evidence to your report
140140

141-
Expand any section of the validation report to attach your test results and drafts of test result summaries generated by the {{< var validmind.developer >}} as evidence by clicking on **{{< fa link >}} Link Evidence to Report**.
141+
Expand any section of the validation report to attach your test results and drafts of test result summaries generated by the {{< var validmind.developer >}} as evidence by clicking **Evidence** on any guideline to expand the evidence panel.
142142

143143
For example:
144144

145-
1. Locate the 2.2.1. Data Quality section and click on **Class Imbalance Assessment**.
145+
1. Within your validation report, click on **Class Imbalance Assessment**.
146146

147-
2. Under the Class Imbalance Assessment sub-section, locate Validator Evidence then click **{{< fa link >}} Link Evidence to Report**.
147+
2. Under the Class Imbalance Assessment guideline click **{{< fa link >}} Link Evidence**, then select **Validator Evidence** as the [evidence type]{.smallcaps}.
148148

149149
3. Select the Class Imbalance test results we logged: **ValidMind Data Validation Class Imbalance**
150150

@@ -173,9 +173,9 @@ Now that you've grasped the basics of using {{< var vm.product >}} for validatio
173173

174174
[^3]: [Working with document templates](/guide/templates/working-with-document-templates.qmd)
175175

176-
[^4]: [Assess compliance](/guide/validation/assess-compliance.qmd#provide-compliance-assessments)
176+
[^4]: [Assess compliance](/guide/validation/assess-compliance.qmd#assign-compliance-assessments)
177177

178-
[^5]: [Assess compliance](/guide/validation/assess-compliance.qmd#link-validator-evidence)
178+
[^5]: [Assess compliance](/guide/validation/assess-compliance.qmd#map-evidence)
179179

180180
[^6]: [Add and manage artifacts](/guide/validation/add-manage-artifacts.qmd#add-artifacts-on-validation-reports)
181181

22.6 KB
Loading

site/guide/documentation/work-with-content-blocks.qmd

Lines changed: 34 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -45,9 +45,10 @@ The content editing toolbar is a rich text editor that enables you to:
4545
- Format your text, including adding hyperlinks and code blocks
4646
- Reference related record and artifact field values with variables[^2]
4747
- Insert LaTex formulas[^3]
48+
- Reference other sections of the document[^4]
4849
- Attach images via upload or URL
4950

50-
You can also use the toolbar to suggest changes, save named versions of content, and leave comments.[^4]
51+
You can also use the toolbar to suggest changes, save named versions of content, and leave comments.[^5]
5152

5253
::: {.callout title="Stuck on where to start?"}
5354
Use {{< var vm.product >}} to assist you with generating content via AI!^[[Generate content drafts with AI](#generate-content)]
@@ -58,9 +59,9 @@ Use {{< var vm.product >}} to assist you with generating content via AI!^[[Gener
5859
## Prerequisites
5960

6061
- [x] {{< var link.login >}}
61-
- [x] There are records registered in the inventory.[^5]
62-
- [x] Documents exist and are completed or are in progress for your record.[^6]
63-
- [x] You are a [{{< fa code >}} Developer]{.bubble} or [{{< fa circle-check >}} Validator]{.bubble}, or assigned another role with sufficient permissions to perform the tasks in this guide.[^7]
62+
- [x] There are records registered in the inventory.[^6]
63+
- [x] Documents exist and are completed or are in progress for your record.[^7]
64+
- [x] You are a [{{< fa code >}} Developer]{.bubble} or [{{< fa circle-check >}} Validator]{.bubble}, or assigned another role with sufficient permissions to perform the tasks in this guide.[^8]
6465

6566
:::
6667

@@ -79,26 +80,26 @@ Use {{< var vm.product >}} to assist you with generating content via AI!^[[Gener
7980

8081
#### [from library]{.smallcaps}
8182
Text Block
82-
: Inserts a text block from a template in your block library:[^8]
83+
: Inserts a text block from a template in your block library:[^9]
8384
a. Select the reusable blocks you want to add.
8485
b. Click **Insert # Text Block(s) to Document**.
8586

86-
Test-Driven[^9]
87+
Test-Driven[^10]
8788
: Adds a new section with logged test results.
8889

89-
Metric Over Time[^10]
90+
Metric Over Time[^11]
9091
: Adds a new section with logged metric over time results.
9192

9293
:::
9394

94-
7. After adding the block to your document, click on the text to make changes or add comments.[^11]
95+
7. After adding the block to your document, click on the text to make changes or add comments.[^12]
9596

9697
### Reference field values
9798

9899
While editing a simple text block within documents, you can reference values in the form of variables from:
99100

100101
::: {.callout}
101-
- To reference field values in the form of variables, your organization must not have tracked changes enabled by default.[^12]
102+
- To reference field values in the form of variables, your organization must not have tracked changes enabled by default.[^13]
102103
- Note that while you are able to select fields with empty values within available record or artifact type fields, no value will be displayed in the content block until the field is populated.
103104

104105
:::
@@ -118,8 +119,8 @@ While editing a simple text block within documents, you can insert math equation
118119
While editing a simple text block within documents, you can have {{< var vm.product >}} assist you with generating content drafts.
119120

120121
::: {.callout title="How can generate content drafts with AI?"}
121-
- To use the generate content drafts with AI feature, your organization must not have tracked changes enabled by default.[^13]
122-
- Generating content drafts works best after you've logged tests with the {{< var validmind.developer >}},[^14] as existing test descriptions and results provide more context for the {{< var vm.product >}} AI Content Builder to draw upon.
122+
- To use the generate content drafts with AI feature, your organization must not have tracked changes enabled by default.[^14]
123+
- Generating content drafts works best after you've logged tests with the {{< var validmind.developer >}},[^15] as existing test descriptions and results provide more context for the {{< var vm.product >}} AI Content Builder to draw upon.
123124

124125
:::
125126

@@ -128,7 +129,7 @@ To generate content drafts:
128129

129130
{{< include content_blocks/_generate-with-ai.qmd >}}
130131

131-
When generating content drafts with AI, accepted versions and edits are retained in your {{< fa wifi >}} Activity[^15] just like other updates to your documents.
132+
When generating content drafts with AI, accepted versions and edits are retained in your {{< fa wifi >}} Activity[^16] just like other updates to your documents.
132133

133134
<br>
134135

@@ -176,7 +177,7 @@ While editing a simple text block within documents, you can directly reference o
176177

177178
:::
178179

179-
Hyperlinks will also take you to the referenced section in PDF document exports.[^16]
180+
Hyperlinks will also take you to the referenced section in PDF document exports.[^17]
180181

181182
## Remove content blocks
182183

@@ -186,11 +187,11 @@ Test-driven or metric over time blocks can be re-added later on but **text block
186187

187188
1. In the left sidebar, click **{{< fa cubes >}} Inventory**.
188189

189-
2. Select a record or find your record by applying a filter or searching for it.[^17]
190+
2. Select a record or find your record by applying a filter or searching for it.[^18]
190191

191-
3. In the left sidebar that appears for your record, click **{{< fa file >}} Documents** and select the **Latest** tab.[^18]
192+
3. In the left sidebar that appears for your record, click **{{< fa file >}} Documents** and select the **Latest** tab.[^19]
192193

193-
4. Click on the document file you want to remove a block from.[^19]
194+
4. Click on the document file you want to remove a block from.[^20]
194195

195196
5. Click on a section header to expand that section and remove content.
196197

@@ -209,34 +210,36 @@ Test-driven or metric over time blocks can be re-added later on but **text block
209210

210211
[^3]: [Insert mathematical formulas](#insert-mathematical-formulas)
211212

212-
[^4]: [Collaborate with others](collaborate-with-others.qmd)
213+
[^4]: [Reference document sections](#reference-document-sections)
213214

214-
[^5]: [Register records in the inventory](/guide/inventory/register-records-in-inventory.qmd)
215+
[^5]: [Collaborate with others](collaborate-with-others.qmd)
215216

216-
[^6]: [Working with documents](/guide/templates/working-with-documents.qmd)
217+
[^6]: [Register records in the inventory](/guide/inventory/register-records-in-inventory.qmd)
217218

218-
[^7]: [Manage permissions](/guide/configuration/manage-permissions.qmd)
219+
[^7]: [Working with documents](/guide/templates/working-with-documents.qmd)
219220

220-
[^8]: [Manage text block library](/guide/templates/manage-text-block-library.qmd)
221+
[^8]: [Manage permissions](/guide/configuration/manage-permissions.qmd)
221222

222-
[^9]: [Work with test results](/guide/documentation/work-with-test-results.qmd)
223+
[^9]: [Manage text block library](/guide/templates/manage-text-block-library.qmd)
223224

224-
[^10]: [Work with metrics over time](/guide/monitoring/work-with-metrics-over-time.qmd)
225+
[^10]: [Work with test results](/guide/documentation/work-with-test-results.qmd)
225226

226-
[^11]: [Collaborate with others](/guide/documentation/collaborate-with-others.qmd)
227+
[^11]: [Work with metrics over time](/guide/monitoring/work-with-metrics-over-time.qmd)
227228

228-
[^12]: [Managing your organization](/guide/configuration/managing-your-organization.qmd#manage-document-defaults)
229+
[^12]: [Collaborate with others](/guide/documentation/collaborate-with-others.qmd)
229230

230231
[^13]: [Managing your organization](/guide/configuration/managing-your-organization.qmd#manage-document-defaults)
231232

232-
[^14]: [Run tests and test suites](/developer/how-to/testing-overview.qmd)
233+
[^14]: [Managing your organization](/guide/configuration/managing-your-organization.qmd#manage-document-defaults)
233234

234-
[^15]: [View model activity](/guide/inventory/view-record-activity.qmd)
235+
[^15]: [Run tests and test suites](/developer/how-to/testing-overview.qmd)
235236

236-
[^16]: [Export documents](/guide/reporting/export-documents.qmd)
237+
[^16]: [View model activity](/guide/inventory/view-record-activity.qmd)
237238

238-
[^17]: [Working with the model inventory](/guide/inventory/working-with-the-inventory.qmd#search-filter-and-sort-models)
239+
[^17]: [Export documents](/guide/reporting/export-documents.qmd)
239240

240-
[^18]: [Work with document versions](/guide/documentation/work-with-document-versions.qmd)
241+
[^18]: [Working with the model inventory](/guide/inventory/working-with-the-inventory.qmd#search-filter-and-sort-models)
241242

242-
[^19]: [Working with documents](/guide/templates/working-with-documents.qmd)
243+
[^19]: [Work with document versions](/guide/documentation/work-with-document-versions.qmd)
244+
245+
[^20]: [Working with documents](/guide/templates/working-with-documents.qmd)

site/guide/validation/_add-artifacts-on-documentation.qmd

Lines changed: 6 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -23,32 +23,26 @@ SPDX-License-Identifier: AGPL-3.0 AND ValidMind Commercial -->
2323

2424
1. On the modal that opens, provide information for your artifact.
2525

26-
1. When you are done, click **Save** to submit the artifact.
26+
1. When you are done, click **Add {Artifact Type}** where `{Artifact Type}` is the artifact type you want to add to submit the artifact.
2727

2828
Once created, you can then add supporting documentation to your artifact.^[[Manage attachments on artifacts](/guide/validation/add-manage-artifacts.qmd#manage-attachments)]
2929

3030
::::
3131

3232
:::: {.content-hidden unless-format="revealjs"}
33-
1. In the left sidebar, click **{{< fa cubes >}} Inventory**.
34-
35-
1. Select a record or [find your record by applying a filter or searching for it](/guide/inventory/working-with-the-inventory.qmd#search-filter-and-sort-records){target="_blank"}.
36-
37-
1. In the left sidebar that appears for your record, click **Development** under {{< fa file >}} Documents.
33+
a. In the left sidebar that appears for your record, click **Development** under {{< fa file >}} Documents.
3834

39-
<!-- Either log an artifact on this overview page, or via a specific documentation section. Both methods will allow you to associate an artifact with a documentation section. -->
40-
41-
1. On your record's documentation page, click **{{< fa plus >}} Add Artifact**.
35+
b. On your record's documentation page, click **{{< fa plus >}} Add Artifact**.
4236

43-
1. Select the [artifact type](/guide/validation/manage-artifact-types.qmd){target="_blank"} you want to add:
37+
c. Select the [artifact type](/guide/validation/manage-artifact-types.qmd){target="_blank"} you want to add:
4438

4539
- Validation Issue
4640
- Policy Exception
4741
- Limitation
4842

49-
1. On the modal that opens, provide information for your artifact.
43+
d. On the modal that opens, provide information for your artifact.
5044

51-
1. When you are done, click **Save** to submit the artifact.
45+
e. When you are done, click **Add {Artifact Type}** where `{Artifact Type}` is the artifact type you want to add to submit the artifact.
5246

5347
Once created, you can then [add supporting documentation to your artifact](/guide/validation/add-manage-artifacts.qmd#manage-attachments){target="_blank"}.
5448

0 commit comments

Comments
 (0)