-
Notifications
You must be signed in to change notification settings - Fork 28
Analysis templates suggested updates #357
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
11531af
0180b2b
30e402c
2edb12a
bc2b86d
be4fbff
c754d47
dc567e2
ae6acf8
32219eb
3253ec1
0d1e328
3dcf00a
b45666e
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -45,3 +45,4 @@ words: | |
| - Uchechukwu | ||
| - webdev | ||
| - Welsch | ||
| - llms | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -15,24 +15,25 @@ referred to in the criteria. | |
|
|
||
| How your technical information is organized, laid out, and presented. This | ||
| includes structure (pages/subpages/sections/subsections), information types | ||
| (conceptual/instructional/reference), and matching documentation content to user | ||
| (conceptual/instructional/reference), and content that matches user | ||
| expectations. | ||
|
|
||
| We evaluate on the following: | ||
|
|
||
| - Is there high level conceptual content? | ||
| - Is every product feature documented? | ||
| - Does the documentation define all user roles (personas) for the product? | ||
| - Are there instructions (tasks, tutorials) documented for features? | ||
| - Do instructions (tasks, tutorials) cover the intended purposes of all | ||
| user-facing features? | ||
| - Are there instructions for all major use cases for each user role? | ||
| - Are tasks organized by user role and use case? | ||
| - Does instructional content demonstrate atomicity — are individual tasks | ||
| clearly named according to their goals? | ||
| - Are tasks written as numbered step-by-step instructions? | ||
| - Do task descriptions in headings and the TOC describe the task with a verb | ||
| phrase? | ||
| - Is the documentation free of any key features which are documented but missing | ||
| task documentation? | ||
| - Are there any features that are documented (for example, described | ||
| conceptually) but are missing task documentation? | ||
| - Is the “happy path” — the most common use case — documented? | ||
| - If the documentation does not suffice, is there a clear escalation path for | ||
| users needing more help? | ||
|
|
@@ -60,7 +61,8 @@ We evaluate on the following: | |
| - Are different types of installation documented (development, test, production) | ||
| if necessary? | ||
| - If needed, are multiple OSes documented? | ||
| - Do users know where to go after reading the getting started guide? | ||
| - Is there guidance for what to read next after reading the getting started | ||
| guide? | ||
| - Is your new user content clearly signposted on your site’s homepage or at the | ||
| top of your information architecture? | ||
| - Is there easily copy-pastable sample code or other example content? | ||
|
|
@@ -126,6 +128,23 @@ We evaluate on the following: | |
| [Inclusive Naming Initiative](https://inclusivenaming.org) website? | ||
| - Does the project use language like "simple", "easy", etc.? | ||
|
|
||
| ### AI Optimization and Discoverability | ||
|
|
||
| Tools and techniques are emerging that enable AI agents to use documentation as | ||
| input. For example, many repositories now include "AI-friendly" Markdown files | ||
| that enable LLMs to ingest content. We encourage projects to optimize for | ||
| AI-based documentation use. | ||
|
|
||
| We evaluate on the following: | ||
|
|
||
| - Is there an llms.txt file in the root of the website or documentation | ||
| repository? | ||
|
|
||
| The leading proposal for an AI-enabling file for websites is at | ||
| [llms-txt](https://llmstxt.org/ llms.txt). | ||
|
|
||
| Task can be accomplished manually or by tools. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. What task? What tools? Is this a continuation of the AI tools criteria? If so, it should be a bullet item and explain why it's a criterion.
Collaborator
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. not needed - removed |
||
|
|
||
| ## Contributor documentation | ||
|
|
||
| ### Communication methods documented | ||
|
|
@@ -150,10 +169,14 @@ Example: | |
|
|
||
| We evaluate on the following: | ||
|
|
||
| - Are docs issues well-triaged? | ||
| - Are docs issues triaged with respect to effort level and required expertise? | ||
| - Is there a clearly marked way for new contributors to make code or | ||
| documentation contributions (i.e. a “good first issue” label)? | ||
| - Are issues well-documented (i.e., more than just a title)? | ||
| - Are issues documented with: | ||
| - What is missing, incorrect, or improperly presented? | ||
| - What impact the issue has on documentation users? | ||
| - A suggested remedy? | ||
| - An estimate of the effort required to address the issue? | ||
| - Are issues maintained for staleness? | ||
|
|
||
| Example: | ||
|
|
@@ -172,7 +195,7 @@ We evaluate on the following: | |
| - Do you have a community repository or section on your website? | ||
| - Is there a document specifically welcoming new contributors and documenting a | ||
| first contribution process? | ||
| - Can new users find where to get help? | ||
| - Are there prominently displayed resources for new users to find help? | ||
|
|
||
| Example: | ||
|
|
||
|
|
@@ -184,7 +207,7 @@ One of the CNCF’s core project values is open governance. | |
|
|
||
| We evaluate on the following: | ||
|
|
||
| - Is project governance clearly documented? | ||
| - Does the project governance align with CNCF guidelines and values? | ||
|
|
||
| Example: | ||
|
|
||
|
|
@@ -239,8 +262,8 @@ requirements for sandbox projects._ | |
| Incubating status. | ||
| - Is there rudimentary **project documentation**, or a placeholder or | ||
| substitute? | ||
| - It is acceptable at this maturity level to link out to documentation that | ||
| hasn't yet been integrated into the website. | ||
| - It is acceptable at this maturity level to link to documentation that hasn't | ||
| yet been integrated into the website. | ||
| - _Example_: website with a single homepage, without any documentation or, as | ||
| was mentioned above, linking out to an external (preexisting) source for | ||
| docs. | ||
|
|
@@ -266,15 +289,15 @@ requirements for sandbox projects._ | |
| #### Graduated | ||
|
|
||
| - Are follow-through actions from the [Docs assessment][] complete? | ||
| - Does **project documentation** fully addresses the needs of key stakeholders? | ||
| - Does **project documentation** fully addresses the needs of stakeholders? | ||
|
|
||
| #### Archived | ||
|
|
||
| - Is the website repo in an [archived state][]? | ||
| - Is the archived status of the project obvious to those visiting the website, | ||
| such as through the use of a prominent banner? | ||
| - If a successor project exists, are there links to its website and/or migration | ||
| documentation. | ||
| documentation? | ||
|
|
||
| [archived state]: | ||
| https://docs.github.com/en/repositories/archiving-a-github-repository/archiving-repositories | ||
|
|
@@ -295,12 +318,8 @@ We evaluate on the following: | |
|
|
||
| - Is the website usable from mobile? | ||
| - Are doc pages readable? | ||
| - Are all or most website features accessible from mobile -- such as the | ||
| top-nav, site search, and in-page table of contents? | ||
| - Might a [mobile-first][] design make sense for your project? | ||
| - Are color contrasts significant enough for color-impaired readers? | ||
| - Are most website features usable using a keyboard only? | ||
| - Does text-to-speech offer listeners a good experience? | ||
|
|
||
| [mobile-first]: | ||
| https://developer.mozilla.org/en-US/docs/Web/Progressive_web_apps/Responsive/Mobile_first | ||
|
|
@@ -310,8 +329,8 @@ Plan for suitable [accessibility][] measures for your website. | |
| We evaluate on the following: | ||
|
|
||
| - Are color contrasts significant enough for color-impaired readers? | ||
| - Are most website features usable using a keyboard only? | ||
| - Does text-to-speech offer listeners a good experience? | ||
| - Are all vital website features usable using a keyboard only? | ||
| - Does text-to-speech offer listeners a usable experience? | ||
|
|
||
| It is up to each project to set their own guidelines. | ||
|
|
||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -23,6 +23,9 @@ TO USE THIS TEMPLATE, search and replace the named IDs: | |
| - `_PROJECT-DOC-REPO_`: repository where the project technical documentation is | ||
| stored; this might be its own repo or a directory in the project main repo | ||
|
|
||
| Replace link placeholders in brackets, such as [_PROJECT_][project-website], | ||
| with a Markdown-style link. | ||
|
|
||
|
Collaborator
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I added this. Remove if you think its not needed. |
||
| For the analysis procedure, see [Analysis how-to](../howto.md). | ||
|
|
||
| > Note: delete this "About this template" section after you have customized this | ||
|
|
@@ -86,11 +89,14 @@ This document is divided into three sections that represent three major areas of | |
| concern: | ||
|
|
||
| - **Project documentation:** concerns documentation for users of the _PROJECT_ | ||
| software, aimed at people who intend to use the project software | ||
| software, aimed at people who intend to use the project software. | ||
| - **Contributor documentation:** concerns documentation for new and existing | ||
| contributors to the _PROJECT_ OSS project | ||
| contributors to the _PROJECT_ OSS project. | ||
| - **Website:** concerns the mechanics of publishing the documentation, and | ||
| includes branding, website structure, and maintainability | ||
| includes branding, website structure, and maintainability. | ||
|
|
||
| A fourth area of concern, AI optimization and discovery, might be included in | ||
| this analysis. If so, it is discussed in a separate document, `ai-guidance.md`. | ||
|
|
||
| Each section begins with summary ratings based on a rubric with appropriate | ||
| [criteria] for the section, then proceeds to: | ||
|
|
@@ -100,6 +106,12 @@ Each section begins with summary ratings based on a rubric with appropriate | |
| - **Recommendations**: suggested changes that would improve the effectiveness of | ||
| the documentation. | ||
|
|
||
| > Author's note: We recommend writing implementation notes only for large | ||
| > projects. An implementation plan can bridge the gap between the high-level | ||
| > recommendations in this document and individual issues entered in the doc | ||
| > repo. Remove the sentences about the implementation doc if you didn't write | ||
| > one. | ||
|
|
||
| The accompanying [implementation] document breaks the recommendations down into | ||
| concrete actions that can be implemented by project contributors. Its focus is | ||
| on drilling down to specific, achievable work that can be completed in | ||
|
|
@@ -175,8 +187,8 @@ documentation. We evaluate on the following: | |
| complete? (i.e., each product feature is documented) | ||
| - Are there step-by-step instructions (tasks, tutorials) documented for | ||
| features? | ||
| - Are there any key features which are documented but missing task | ||
| documentation? | ||
| - Are there any features that are documented (for example, described | ||
| conceptually) but are missing task documentation? | ||
| - Is the “happy path”/most common use case documented? Does task and tutorial | ||
| content demonstrate atomicity and isolation of concerns? (Are tasks clearly | ||
| named according to user goals?) | ||
|
|
||
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
New section. Please opine.
UPDATE: Nate and I discussed this and agreed it would be better in a separate topic. @nate-double-u - how about naming it ai-guidance.md?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The currently popular description seems to be "AI friendly." I like "optimization and discovery" better -- it's more precise -- but I'd put "AI friendly" in the description somewhere for searchability.
What's the rationale for having a separate document?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I guess because the topic of AI here is multi-faceted and could be distracting. There's the AI tools for analysis and the AI configurations of optimization and discovery. Probably others.