Manage your skillsUpdated 8 hours ago
Who can use this feature?
Once you create a skill, managing it is an ongoing part of working with AI Agent. You'll update instructions as your business changes, enable or disable skills, monitor their performance, restore previous versions when needed, and delete skills you no longer use.
This article walks you through the day-to-day operations of managing your skills. For how to create a new skill, see create a new skill for AI Agent. For the broader cycle of improving AI Agent over time, see how AI Agent improves over time.
In this article:
- Before you start
- Find your skills
- Edit a skill — update instructions, intents, knowledge; test, publish, and restore versions
- Enable or disable a skill
- View skill performance
- Delete a skill
Before you start
Make sure:
- You have at least one skill set up. See create a new skill for AI Agent.
- AI Agent is set up and connected to your Shopify store. See set up and go live with AI Agent.
Find your skills
In the menu, go to AI Agent > Skills. The Skills page lists all your skills in a table, showing each skill's name, linked intents, status, and key performance metrics.
To find and sort your skills:
- Use the search bar to find a specific skill by name.
- Click any column header to sort by ascending or descending order.
- Toggle between percentages and totals to change how the metrics display.
Edit a skill
Edit a skill any time you want to update its instructions, change its intents, or change how it uses knowledge. Your changes are saved as a draft, so the live version stays in place until you publish them. This lets you iterate safely without affecting how AI Agent is handling conversations right now.
To edit a skill:
- Click the dropdown menu in the top-left corner, then select AI Agent.
- In the menu, select Skills.
- Select the skill you want to edit.
- Make your changes in the editor.
- Test your draft to confirm AI Agent responds the way you intend. See preview AI Agent responses with test conversations.
- Click Publish changes in the editor.
- Optionally add a summary of your changes, then confirm.
Your draft replaces the live version. AI Agent uses the new version for matching conversations going forward. The previous version is saved in your skill's version history.
Keep your skill as a draft
If you're not ready to publish, your changes are saved as a draft and the live version remains unchanged.
When you have unpublished changes, a banner at the top of the editor lets you know you're viewing a draft. Click the options in the banner to:
- Switch between the draft and the live version to see each one in isolation.
- Turn on Compare to current to view your edits inline against the live version. Added text is highlighted in green; removed text is struck through in red.
Your changes are automatically saved as a draft as you work.
Restore a previous version
From the skill editor, you can use the version history to see what changes have been made to a skill and restore it to a previous version.
When you restore a previous version, a new draft is created so you can make edits before publishing. Your live version stays in place until you choose to publish your changes.
Version history works the same way for skills as it does for your help center articles and guidance. For the full walkthrough, see compare and restore previous versions.
Enable or disable a skill
Once you've enabled a skill, AI Agent starts using it in every conversation that matches the skill's intent.
Turn off a skill to stop AI Agent from using it. The skill stays in your library with its instructions, intents, and configuration preserved, and you can enable it again at any time. While a skill is turned off, AI Agent falls back to your knowledge to handle the intents it was covering.
To turn off a skill:
- Click the dropdown menu in the top-left corner, then select AI Agent.
- In the menu, select Skills.
- Select the skill you want to disable.
- Click Disable in the skill editor.
- Review the confirmation, then click Disable to confirm.
To enable a skill, follow the same steps and click Enable. Enabling takes effect right away.
If you want to permanently remove a skill, see Delete a skill below.
View skill performance
Each skill on the Skills page shows its own performance signals: ticket volume, handover rate, and average CSAT. These tell you which skills are working well and which need attention. A high handover rate or low CSAT points to a specific skill that needs work — reviewing those signals and updating your instructions is how AI Agent improves over time. For more on the process, see how AI Agent improves over time.
For a full guide to reading skill performance and acting on it, see see how your skills and knowledge are performing.
Delete a skill
If you no longer need a skill, you can delete it. Deleting a skill is permanent and cannot be undone. You'll need to recreate the skill from scratch if you want to bring it back. Consider disabling the skill instead if there's a chance you'll want to use it again.
When you delete a skill:
- Any intents linked to the skill become unlinked. AI Agent falls back to using your knowledge to handle those types of conversations.
- The skill's instructions, version history, and performance data are removed.
- Your other skills and knowledge are unaffected.
To delete a skill:
- Click the dropdown menu in the top-left corner, then select AI Agent.
- In the menu, select Skills.
- Select the skill you want to delete.
- Click Trash at the top of the skill editor.
- Click Delete to confirm.
Next steps
- Create a new skill for AI Agent — start a new skill from a template, from scratch, or from existing guidance
- How AI Agent improves over time — the cycle of training, testing, deploying, and analyzing
- Skills explained — what a skill is and how it fits with AI Agent