> ## Documentation Index
> Fetch the complete documentation index at: https://asapp-04-04-getting-started-ga.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# GenerativeAgent Updates

> New updates and improvements for the GenerativeAgent

<Update label="2025-06-17 - Evaluation for Scenario Testing">
  ## Evaluation for Scenario Testing

  **Test Scenarios** now support automated evaluation of simulated conversations through a new **Evaluations** section.

  With these updates, you can:

  * Define **applicability criteria** to control when evaluations should run
  * Specify **evaluation criteria** to automatically assess key outcomes in simulated conversations
  * View pass/fail results in the **Previewer**, side-by-side with the conversation
  * Rerun evaluations after editing the test scenario, using the **Run Eval Again** button
  * Set a **max number of turns** (default: 25) for simulations
  * Preview your test scenario directly from the test file after saving

  <Frame>
    <img width="500px" src="https://mintcdn.com/asapp-04-04-getting-started-ga/k7thOZ7QuDJg8OOE/images/generativeagent/EvaluationsResultsPanel.png?fit=max&auto=format&n=k7thOZ7QuDJg8OOE&q=85&s=dd7206d94951009a07413c532d4b5bd9" data-path="images/generativeagent/EvaluationsResultsPanel.png" />
  </Frame>

  <Card title="Using Evaluations in Test Scenarios" href="/generativeagent/configuring/tasks-and-functions/test-scenarios">
    Learn how to define and run evaluations on simulated customer conversations.
  </Card>
</Update>

<Update label="2025-05-27 - Scenario Testing">
  ## Scenario Testing

  **Test Scenarios** enable more efficient testing of GenerativeAgent configurations through automated simulations of customer interactions. They are an evolution from Test Users, offering not just mock API profiles, but also integrated goals, information customers have on them, and personalities to simulate a customer in a specific scenario.

  With Test Scenarios, you can:

  * Automatically generate mock API responses fitting a customer scenario
  * Add customer goals, information customers have, and personalities to vary how the simulated customer will interact with GenerativeAgent
  * Run simulated interactions and review how GenerativeAgent handles a customer with that scenario

  **Test Users** have been migrated to Test Scenarios

  All workflows involving Test Users will still be accessible through Test Scenarios and all Test Users have been migrated to Test Scenarios.

  <Frame>
    <img width="500px" src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/ScenarioTesting-changelog.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=a36ec207999407eeebfe05169f3d9764" data-path="images/generativeagent/ScenarioTesting-changelog.png" />
  </Frame>

  <Card title="Creating and running Test Scenarios" href="/generativeagent/configuring/tasks-and-functions/test-scenarios">
    Learn how to create Test Scenarios and use them to speed up testing of GenerativeAgent configurations.
  </Card>
</Update>

<Update label="2025-05-20 - Configuration Branches">
  ## Configuration Branches

  **Configuration Branches** enables seamless experimentation with GenerativeAgent configurations through local branching. This new feature allows you to safely test and iterate on changes without affecting your main environments.

  With Configuration Branches, you can:

  * Create isolated branches from Draft, Sandbox, or Production environments
  * Edit tasks, functions, and settings in a protected workspace
  * Preview changes before promoting them to main environments
  * Collaborate with team members on configuration improvements

  <Frame>
    <img width="500px" src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/LocalConfig.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=2737ab0e86802e5dfdc2352cad273f2a" data-path="images/generativeagent/LocalConfig.png" />
  </Frame>

  <Card title="Managing Configuration Branches" href="/generativeagent/configuring/tasks-and-functions/local-configs">
    Learn how to create branches, make configuration changes, and safely promote them to your main environments.
  </Card>
</Update>

<Update label="2025-05-07 - Advanced Syncing and Auto-Deploy for Knowledge Base Content">
  ## Advanced Syncing and Auto-Deploy for Knowledge Base Content

  We've launched enhanced controls for syncing and deploying your knowledge base, giving you the flexibility to prioritize critical updates and deliver the most current information through GenerativeAgent—automatically and with less manual overhead.

  **What’s new?**

  * **Configurable Sync Modes:** Set each content source to update with manual review, auto-deploy updates directly to production, or turn off syncing.
  * **Frequent Article Refresh:** Enable high-frequency (every 15 minutes) automatic updates and instant deployment for critical, time-sensitive articles.

  <Frame>
    <img width="500px" src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/KBAutoDeploy.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=8d2417947e979efb6bbdab394ad4c0be" data-path="images/generativeagent/KBAutoDeploy.png" />
  </Frame>

  <Frame>
    <img width="500px" src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/KBSetRefreshFrequency_DialogAutoDeploy.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=a43e368e0d542612b561f949058b5d3e" data-path="images/generativeagent/KBSetRefreshFrequency_DialogAutoDeploy.png" />
  </Frame>

  <Card title="Knowledge Base Syncing & Deploy Options" href="/generativeagent/configuring/connecting-your-knowledge-base">
    Learn how to configure syncing and deploy preferences for maximum accuracy and responsiveness.
  </Card>
</Update>

<Update label="2025-04-04 - Auto-generating Test Users">
  ## Auto-generating Test Users

  We've introduced the ability to **automatically generate test** users by describing test scenarios, making it easier to simulate API interactions for testing purposes.

  This feature accelerates your testing process by automatically creating realistic test data based on your scenario descriptions, helping you validate GenerativeAgent's behavior more efficiently.

  <Frame>
    <img width="500px" src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/TestUserCreate.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=c865c9940048b9522ec20c8473c9a47d" data-path="images/generativeagent/TestUserCreate.png" />
  </Frame>

  <Card title="Test Users" href="/generativeagent/configuring/tasks-and-functions/test-users">
    Learn how to create and configure test users to simulate API responses and test your GenerativeAgent's behavior
  </Card>
</Update>

<Update label="2025-02-20 - Pinned Versions">
  ## Pinned Versions

  **Pinned Versions** allows you to pin specific versions of GenerativeAgent to a deployment, enabling safer and more predictable deployments.

  This enables you to:

  * Maintain version stability in production environments
  * Control the rollout of new features
  * Test version changes in preview before deployment
  * Ensure consistent behavior across GenerativeAgent deployments

  <Frame>
    <img src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/PinnedVersionSelector.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=6141c0ee561148c6ee3e47665b99f806" width="426" height="393" data-path="images/generativeagent/PinnedVersionSelector.png" />
  </Frame>

  <Card title="Pinned Versions Documentation" href="/generativeagent/configuring/deploying-to-generativeagent#generativeagent-versions">
    Learn how to configure and manage GenerativeAgent versions
  </Card>
</Update>

<Update label="2025-01-28 - Scope and Safety">
  ## Scope and Safety

  **Scope and Safety Fine Tuning** allows customizable guardrails that let you define what's considered "in-scope" and "safe" for your specific use cases, while maintaining core safety protections.

  With this feature, you can:

  * Customize safety boundaries aligned with business policies
  * Expand permissible topics without compromising default protections
  * Control input safety and scope definitions with precision

  <Frame>
    <img src="https://mintcdn.com/asapp-04-04-getting-started-ga/k7thOZ7QuDJg8OOE/images/generativeagent/InputSafety.png?fit=max&auto=format&n=k7thOZ7QuDJg8OOE&q=85&s=41d168acd1f05e38d405014fd97669df" width="1408" height="1176" data-path="images/generativeagent/InputSafety.png" />

    <img src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/ScopeTopic.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=f71ddc90ea4b0e503b7746c5f0a28f03" width="1408" height="1416" data-path="images/generativeagent/ScopeTopic.png" />
  </Frame>

  <Card title="Safety Tuning Documentation" href="/generativeagent/configuring/safety/scope-and-safety-tuning">
    Learn how to configure safety and scope settings
  </Card>
</Update>

<Update label="2025-01-13 - Mock Functions">
  ## Mock Functions

  **Mock Functions** enable rapid prototyping and testing of GenerativeAgent integrations without requiring live API endpoints.

  This feature allows you to:

  * Prototype and validate Function behaviors before building actual APIs
  * Test GenerativeAgent's parameter handling and response processing
  * Accelerate development by simulating API responses during initial setup

  Once you have a working mock function, you can convert it to a live function by pointing it to your live API via an API connection.

  <Frame>
    <img src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/MockAPIExample.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=280a9d27282777e2b09fa2af6b586900" width="3302" height="1058" data-path="images/generativeagent/MockAPIExample.png" />
  </Frame>

  <Card title="Mock API Documentation" href="/generativeagent/configuring/tasks-and-functions/mock-api">
    Learn how to create and use Mock Functions
  </Card>
</Update>

<Update label="2024-11-22 - Turn Inspector">
  ## Turn Inspector

  **Turn Inspector** is an advanced diagnostic feature in [Previewer](/generativeagent/configuring/previewer) that provides granular visibility into GenerativeAgent's interaction workflow.

  It enables you to diagnose unexpected behaviors, fine-tune instructions, and ensure more predictable and reliable interactions with GenerativeAgent.

  You can inspect:

  * Active Task configuration
  * Current reference variables
  * Instruction parsing
  * Function call context
  * Execution state per turn

  <Frame>
    <img width="300px" src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/TurnInspector.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=6c86074995ea712e15f2d1230de3c6e8" data-path="images/generativeagent/TurnInspector.png" />
  </Frame>

  <Card title="Using the Previewer" href="/generativeagent/configuring/previewer">
    Learn how to use the Previewer to inspect and debug your GenerativeAgent workflows
  </Card>
</Update>

<Update label="2024-10-21 - KB Search">
  ## Knowledge Base Search

  **Knowledge Base Search** enables powerful free-text search across article titles, text, and URLs. The search includes metadata filtering capabilities for content source, creation details, and deployment status.

  This makes it easier to manage and navigate your Knowledge Base.

  <Frame>
    <img src="https://mintcdn.com/asapp-04-04-getting-started-ga/BwTK7Hrc1lRo0ZRw/images/generativeagent/KBSearch.png?fit=max&auto=format&n=BwTK7Hrc1lRo0ZRw&q=85&s=00eafd2e31843a47f0d2f607acb6d814" width="1600" height="909" data-path="images/generativeagent/KBSearch.png" />
  </Frame>

  <Tip>
    Users can combine multiple filters with AND operators, maintain search context while navigating, and perform bulk operations on search results.
  </Tip>

  <Card title="Managing Knowledge Base Content" href="/generativeagent/configuring/connecting-your-knowledge-base">
    Learn how to effectively manage and search your Knowledge Base content
  </Card>
</Update>

<Update label="2024-10-03 - KB Article API">
  ## Knowledge Base Article API

  The [Knowledge Base Article API](/apis/knowledge-base/create-a-submission) enables programmatic management of Knowledge Base articles, allowing you to programmatically add and modify articles within the GenerativeAgent Knowledge Base.

  Key use cases include:

  * Integration with private internal knowledge bases not publicly accessible
  * Importing content from non-scrapable sources like Content Management Systems (CMS)
  * Fine-grained programmatic control over knowledge ingestion and management

  <Card title="Article Submission API Documentation" href="/generativeagent/configuring/connecting-your-knowledge-base/add-via-api">Learn how to use the API</Card>
</Update>

<Update label="2024-10-03 - Trial Mode">
  ## Trial Mode

  **Trial Mode** allows you to safely deploy GenerativeAgent use cases by trialing functions in production. When developing AI applications, it's critical to validate how your AI system interacts with external functions and APIs before full deployment. Trial mode provides this safety layer.

  This can allow you to:

  * Ensure GenerativeAgent called the function properly given the conversation context.
  * Ensure GenerativeAgent interpreted the function response.
  * Be protected from unknown API response variations that you might not have accounted for during development and testing.

  <Frame>
    <img src="https://mintcdn.com/asapp-04-04-getting-started-ga/mfSZBtsWldXj5V1j/image/uuid-738fefcd-4a0f-936d-6456-12a389aac78e.png?fit=max&auto=format&n=mfSZBtsWldXj5V1j&q=85&s=1d7fd5f9a7f1fdaf6e4e866226b9747a" width="1600" height="788" data-path="image/uuid-738fefcd-4a0f-936d-6456-12a389aac78e.png" />
  </Frame>

  Check out the [Trial Mode guide](/generativeagent/configuring/tasks-and-functions/trial-mode) for more information.
</Update>
