UiPath GenAI Activity Output Validation (Basic)

Predefined Action App template for adding human-in-the-loop validation of GenAI outputs for long running workflows

Action Apps are an excellent way to easily configure human-in-the-loop processes using all of the benefits and configurability available in a UiPath App.  In effect, Action Apps marry Action Center & UiPath Apps.

This is incredibly important for workflows containing Generative AI outputs where inferences should be validated by a human reviewer for accuracy and quality.  The UiPath GenAI Activities are a great example the kinds of outputs that should, under certain circumstances and according to the unique needs of the use case and business requirements, be validated.

Using this Action App, users can send one or many workflow variables/arguments to the Action App (via the action schema in the app + directly in the workflow) and via Action Center assign owners for these validation tasks.  They are meant to be used with Persistence activities like 'Create App Task' and 'Wait for App Task and Resume' which turn the process into a long running workflow meaning the robot pauses until the validation task is complete.

Within the Action App, the human validator can review the runtime values for the variable/argument, manually alter them or execute other App events (according to how the App was set up) before ultimately sending the result back to the robot in waiting.

In the context of Generative AI, users can set up circumstances under which outputs would need to be reviewed: perhaps a critical business process needs to be reviewed every time by a business owner OR you can use a separate, evaluator prompt (LLM-as-a-judge) to come up with a score and that score can be used to determine whether the output should be validated.

Steps for setting up

• Download app template and upload in the UiPath App Studio (using the existing file)
• Review the Action Schema and make any other customizations necessary for your use case (user interface alterations, additional events or display controls, etc.)
• Deploy the App to Orchestrator in Shared folder (Note: you must used a Shared Folder)
• In your Studio Process containing your UiPath GenAI Activity outputs that need to be validated, add a 'Create App Task' activity and pass in the required in and/or in/out variables.  IMPORTANT:  Make sure that you have set the appropriate Orchestrator Folder in Additional Options or you will get an authorization error.  It must be a Shared Folder as stated above.
• Ensure that you are referencing the correct version of the App deployed in Orchestrator
• Add 'Wait for App Task and Resume' activity
• Include additional steps actioning off of what the human validator selected in the validation step.  'If' statements will come in handy here
• Note that the In/Out variables have been updated according to what the human validator changed in the Action App
• If in debug mode, you have to manually restart the process once the task has been completed.  When the process is deployed, this will happen automatically

• Predefined, simple Action App schema with the ability to send a variable or argument into the Action App for validation
• Simple Boolean actions that can be used to tell the robot what to do next (ex. if approved, execute the following steps)
• Ability to manually update variables/arguments that get passed back to the robot