Skip to content

WIP: Improvements in AI Scriptless testing#23

Draft
3dgiordano wants to merge 8 commits into
developmentfrom
AI_SCRIPTLESS_EDITOR
Draft

WIP: Improvements in AI Scriptless testing#23
3dgiordano wants to merge 8 commits into
developmentfrom
AI_SCRIPTLESS_EDITOR

Conversation

@3dgiordano
Copy link
Copy Markdown
Collaborator

@3dgiordano 3dgiordano commented May 27, 2026

This pull request introduces substantial enhancements and new functionality for handling AI Scriptless test data, command catalogs, and related API endpoints. The main changes include the addition of new utility functions for API endpoints, a comprehensive set of data models for AI Scriptless entities, and new formatters for transforming and presenting test, variable, snapshot, and command definition data. Additionally, improvements were made to utility functions to handle JSON decoding more robustly.

API Endpoint Utilities:

  • Added new functions in config/perfecto.py to generate URLs for AI Scriptless draft management, command repository, and repository management APIs, supporting new backend integrations.

AI Scriptless Data Models:

  • Introduced a new module models/ai_scriptless.py containing Pydantic models for representing script flow elements, test structures, command catalog entries, variables, snapshots, and command definitions. These models provide a structured and type-safe way to handle AI Scriptless test data.

AI Scriptless Formatters:

  • Implemented a new formatter module in formatters/ai_scriptless.py that includes:
    • A command selection policy helper for agents.
    • Functions to format test structures, command catalogs, variables, snapshots, and command definitions using the new models.
    • Helper functions for extracting and transforming command and step information from raw payloads. [1] [2]

Utility Improvements:

  • Updated the api_request function in tools/utils.py to more gracefully handle empty or non-JSON responses by returning the raw text if JSON decoding fails, improving robustness when dealing with diverse API responses. [1] [2]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants