# Human Review

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-2b6f84e9dccd356b764afdfba48ac7c6fa164596%2Fimage.png?alt=media" alt=""><figcaption></figcaption></figure>

With the Human Review step, the user can be prompted to review, validate, and edit a text value (*Single Item*) or select and edit multiple values (*Multiple Values*) before continuing a workflow.

For example, you could create a list of 5 blog titles for a user to select from, ask the user to review and select the titles to publish with a review step, and finally publish the selected content to your blog.

## Review a Single Item

### What is a Single Item?

The single item allows the user to edit the text from a single-line text box:

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-6f8a4b2552eb96724ffabd44b9a6fb909003d205%2Fimage.png?alt=media" alt=""><figcaption><p>Single Item Review</p></figcaption></figure>

### How to Configure a Single Item

1. **Label the item:** the label will automatically create the variable name associated with your label. In the example below, we label our item "Blog Title", which also created the variable `blog_title`
2. **Assign the value of the item:** use Liquid syntax to pass the value that you want the user to edit and review. In the example below, this is `{{step_2.output}}`
3. **(Optional) Notify a Slack channel:** choose a Slack channel which will notify users to review the output

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-2070039c8f22261dfe5c044751779ba167d1b312%2Fimage.png?alt=media" alt=""><figcaption><p>Single Item Configuration</p></figcaption></figure>

## Review Multiple Values

### What is are Multiple Values?

Multiple values allow the user to select and edit multiple values at once:

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-b11f53cfec3e5cb902887473b394b6da5c85505e%2Fimage.png?alt=media" alt=""><figcaption><p>Multiple Values Review</p></figcaption></figure>

### How to Configure Multiple Values

1. Set up a list of options:

   1. **Generate a list:** use an LLM step to generate a list of items, it must be an Array

      <figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-e23d143f93fa0706d9642959dc0671ca56b6d87a%2Fimage.png?alt=media" alt=""><figcaption><p>A list of 5 blog titles</p></figcaption></figure>
   2. **Label the item:** the label will automatically create the variable name associated with your label. In the example below, we label our item "Blog Titles", which also created the variable `blog_titles`
   3. **Assign the value of the item:** use Liquid syntax to pass the list you generated in Step 1. In the example below, this is `{{step_2.output}}`
   4. **(Optional) Notify a Slack channel:** choose a Slack channel which will notify users to review the output

   <figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-4e22375198577ad8e34e1e1b04d8a4899654fb15%2Fimage.png?alt=media" alt=""><figcaption><p>Multiple Values Configuration</p></figcaption></figure>

## Referencing the Human Review Step

### How to Reference a Single Item

To reference a single item from the Human Review step, use the variable corresponding to the label you provided.

In this example, we named the item "Blog Title" which created the variable `{{step_3.output.blog_title}}` :

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-348bca7ac9b73a1f2d66a5ae34938afbd274e8c5%2Fimage.png?alt=media" alt=""><figcaption><p>Referencing a Single Item</p></figcaption></figure>

### How to Reference Multiple Values

To reference multiple values from the Human Review step, use the variable corresponding to the label you provided.

However, unlike referencing a single item, the output of a multiple value review is a list:

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-9b81096dcd6b5083f668adbbc07b9e8774b56de7%2Fimage.png?alt=media" alt=""><figcaption><p>Referencing Multiple Values</p></figcaption></figure>

In other words, `{{step_3.output.blog_titles}}` from the example above gives the user a list of blog titles. If you want to reference only the first blog title, you would need to modify your syntax to `{{step_3.output.blog_titles[0]}}`.

## Review Session

When a workflow reaches the review step, it pauses the execution, leaves the workflow in a pending state for review, and creates a review session where the user can review the content.

### How to Review Output

* **For single items,** you can edit the content using *markdown* syntax.
* **For multiple values,** you can edit the values and select/unselect them.
* After editing you can either choose to accept the reviewed content, or cancel the execution.

### Review in the Test Panel

As you test your workflow, you can access the review session by clicking on "Review":

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-d80e275affa4777ef605b9f7ca104770cf7f80e2%2Fimage.png?alt=media" alt=""><figcaption><p>Review in the test panel</p></figcaption></figure>

### Review in Real-Time when Running Once

When you Run Once, the review session will automatically appear, and your user can review the outputs in real-time:

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-e9f457e45c7160115776e0c755fc6044971698bc%2Fimage.png?alt=media" alt=""><figcaption><p>Review when running once</p></figcaption></figure>

### Review Asynchronously in the History

To review executions asynchronously, you can review them in the **History** tab:

1. Click on **History** to view all executions
2. Filter the **Status** to **Review needed**
3. Click on **View** in the Actions column
4. Click on **Review** to review the output and continue the execution

<figure><img src="https://3762890407-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FX2n5yPRPynbnWuO4SH0M%2Fuploads%2Fgit-blob-dd1da85790726c4d10ceb4b628c7704ff64eeaee%2Fimage.png?alt=media" alt=""><figcaption><p>Review from the history tab</p></figcaption></figure>
