omp packages

@hcflabs/pi-advisor0.2.1

Opt-in second-model review of each Pi agent run after it settles, with graded notes and one blocker follow-up.

GitHub Actions Published 7 days ago MIT ~634 downloads/mo

Untested on omp

This is a pi package. No one has reported whether it works on omp yet. If you try it, add your result below.

Did it work for you?

Result

One report per person. A new report replaces your old one.

Reports 0

No reports yet.

Readme

@hcflabs/pi-advisor

Let a second model examine the tool calls and results of each agent run after Pi settles the run. The advisor returns graded notes. A blocker sends one follow-up message that makes the agent fix it.

Install

pi install npm:@hcflabs/pi-advisor

The advisor uses the pi-advisor/review Model Task. Its default Task Profile is balanced. Run /task-models to configure a route for that profile before you turn the advisor on.

Works with

Package Relationship Purpose
@hcflabs/pi-goal Improves Goal continuations stay in one run. The advisor examines all of that work after the run settles.
@hcflabs/pi-task-models Required Provides the advisor model route.

Use

Run /advisor on. Then send a prompt that makes the agent use tools. When the run settles, the advisor examines it in the background, and Pi shows the result.

Surface Type Purpose
/advisor on command Turn the advisor on for this conversation branch.
/advisor off command Turn the advisor off for this conversation branch.
/advisor status command Show branch state and the last review record in this session.
Advisor reviewing… ui Footer status while the review runs.

The advisor is off by default.

Status

Run /advisor status to inspect the branch state and the last review record. Without a review, Pi shows No advisor review in this session.

The record contains:

  • Start time and the route model that answered, or none if no route answered.
  • Failed route models and safe error codes.
  • Total duration in milliseconds.
  • Cost in USD, summed across failed and successful routes with known, finite, non-negative response costs. The status omits cost when none is known.
  • Verdict: pass, nit, concern, blocker, malformed, failed, aborted, or discarded. An active review shows reviewing.

The verdict uses the strongest Grade in the delivered Notes. A held Blocker remains blocker. The status also shows the session's malformed response count.

The command shows no user prompt, Review text, Notes, or error message text. Without UI, stdout contains the status.

Results

Reply What Pi shows Continuation
PASS The Advisor: PASS notice. No
Only nit notes One notice with all notes. No
A concern note One warning with all notes. No
A blocker note One warning with all notes. One follow-up for each user prompt
Malformed reply, or a reply longer than 8,000 characters One warning, one time in each session. No

Flow

Pi Advisor flow: after the run settles, review gates decide whether the advisor runs; a PASS or notes reply ends the review, and a blocker sends one follow-up message that starts a new turn

  1. A user prompt or a triggering custom message starts a run. Pi Advisor records where the run starts on the branch.
  2. Other extensions can continue the run. All of their turns stay in the same run.
  3. Pi settles the run. Pi Advisor does no review for a run without tool calls, an unfinished run, or a session without UI.
  4. Pi Advisor sends one tool-free request to the advisor model in the background. The request contains the latest user prompt and the run record.
  5. Pi shows the notes. For a blocker note when the editor is empty, Pi Advisor sends a visible pi-advisor-blocker follow-up message. The message starts a new run that fixes the blockers.
  6. The advisor also examines that new run. It shows the notes, but it sends no other follow-up until the next user prompt.

State and storage

Pi Advisor keeps no files. /advisor on and /advisor off append a pi-advisor custom entry to the conversation. The latest entry on the current branch sets the state, so branch navigation, /tree, forks, and rewinds show the state of the selected branch.

Each blocker follow-up is a visible pi-advisor-blocker message on the branch. Its details contain the notes.

The review record and malformed response count stay only in memory. Session start clears both. Branch navigation changes on/off state, not the review record.

Limits and recovery

Limit Behavior Recovery
Interactive only The advisor does not run in print mode or other modes without UI. Examine the run manually.
No route Pi shows a warning that names /task-models. The advisor does not use the session model. Run /task-models. Configure the balanced profile, or assign another configured profile to the pi-advisor/review Model Task.
Time limit The review stops after 90 seconds and Pi shows a warning. Pi shows no notes. Send the next prompt.
Cancel A new prompt, a new run, branch navigation, /advisor off, or session exit cancels the review. Pi shows no notice. Escape in an idle session does not cancel it. Send a prompt to cancel the review.
Old reply When the branch changes or Pi starts work before the reply arrives, Pi Advisor ignores the reply. Send a prompt to start a new run.
Model error Pi shows a warning. Pi shows no notes. Run /task-models to examine the route, or send the next prompt.
Run record size Each item is truncated to 4,000 characters, and the prompt to 8,000. The record keeps the newest 48,000 characters and marks earlier items as omitted. Ask for a smaller run when early steps must be examined.
One follow-up A blocker sends one follow-up message for each user prompt. Send a prompt to fix the remaining blockers.
Draft in the editor When the editor contains text, a blocker sends no follow-up message. Pi shows all notes and tells you to send a prompt. Send a prompt to fix the blockers.
Advice only The advisor sees only the run record. Its notes can be wrong. Examine each note before you accept it.