GitHub Copilot Test
AI-generatedSummary
Execute various test functions to verify and evaluate GitHub Copilot API models using a selected GitHub Copilot API credential.
Inputs
- Test Function (required) — Select which test to execute: list available models, refresh the models cache, test embedding models, run comprehensive chat model tests, or test a single chat model with a custom message.
- Model Name or ID — Specify the chat model name or ID to test when using the 'Test Single Chat Model' function; options are loaded dynamically from available models.
- Test Message — Provide a custom message string to send to the chosen single chat model for testing; default is "Hello! Please respond with just 'OK' to confirm you're working."
- Tests Per Model — Define the number of test iterations per model when running the 'Test Chat Models' consolidated test (range 1 to 20, default 5).
- Advanced Options — Additional settings including enabling automatic retry on HTTP 403 quota errors and the maximum number of retry attempts.
Output shape
a JSON object with detailed results specific to the chosen test function
Outputs vary by test function: listing models returns available models data; refreshing cache returns cache state and models summary; testing embedding models returns per-model embedding test results; consolidated chat test returns detailed multi-model performance reports; single chat model test returns the response from the tested model. Supports retry on quota errors, includes timestamps, success flags, and error details if applicable.