Assign rows for review
You can assign rows in logs, experiments, and datasets to team members for review, analysis, or follow-up action. Assignments are particularly useful for human review workflows, where you can assign specific rows that need human evaluation and distribute review work across multiple team members. To assign a row to a team member from any table view (logs, experiments, or datasets):- Select the row.
- Select Assign.
- Choose a member to assign.
Filter review data
The Review page shows any spans that have been flagged for review within a given time range. Each project provides default table views with common filters, including:- Default view: shows all records.
- Awaiting review: shows only records flagged for review but not yet started.
- Assigned to me: shows only records assigned to you for review.
- Completed: shows only records that have finished review.
scores.Preference > 0.75) to find highly-rated examples, or use tags to mark items for “Triage” and review them all at once.
Customize the review table
Show and hide columns
Select Display > Columns and then:- Show or hide columns to focus on relevant data.
- Reorder columns by dragging them.
- Pin important columns to the left.
Free-form human review scores and scores that write to expected output appear automatically as columns in the dataset, review, logs, and experiment tables, marked with the review icon. You don’t need to add them as custom columns.
Use kanban layout
The kanban layout organizes flagged spans into three columns based on their review status:- Backlog: spans flagged for review but not yet started.
- Pending: spans currently being reviewed.
- Complete: spans that have finished review.
- On the Review page, select Display > Layout > Kanban.
- Drag cards between columns to update review status. Changes save automatically.
- Click any card to open the full trace for detailed review.
Create custom table views
To create or update a custom table view:- Apply the filters and display settings you want.
- Open the menu and select Save view… or Save view as….
Custom table views are visible to all project members. Creating or editing a table view requires the Update project permission.
Set default table views
You can set default views at three levels:- Organization default: Visible to all members when they open the page. This applies per page. For example, you can set separate organization defaults for Logs, Experiments, and Review. To set an organization default, you need the Manage settings organization permission (included by default in the Owner role). See Access control for details.
- Project default: Overrides the organization default for everyone viewing this project. To set a project default, you need the project-level Update permission. Project admins can set project defaults even without organization-level permissions. See Access control for details.
- Personal default: Overrides the project and organization defaults for you only. Personal defaults are stored in your browser, so they do not carry over across devices or browsers.
- Switch to the view you want by selecting it from the menu.
- Open the menu again and hover over the currently selected view to reveal its submenu.
- Choose Set as personal default view, Set as project default view, or Set as organization default view.
- Open the menu and hover over the currently selected view to reveal its submenu.
- Choose Clear personal default view, Clear project default view, or Clear organization default view.
Next steps
- Score traces and datasets in review mode
- Review with multiple reviewers on the same span
- Build datasets from reviewed logs