GitHub Copilot Test icon

GitHub Copilot Test

Test GitHub Copilot API credentials with predefined functions

GitHub Copilot Test

AI-generated

Summary

Execute various test functions to verify and evaluate GitHub Copilot API models using a selected GitHub Copilot API credential.

Inputs

  • Test Function (required) — Select which test to execute: list available models, refresh the models cache, test embedding models, run comprehensive chat model tests, or test a single chat model with a custom message.
  • Model Name or ID — Specify the chat model name or ID to test when using the 'Test Single Chat Model' function; options are loaded dynamically from available models.
  • Test Message — Provide a custom message string to send to the chosen single chat model for testing; default is "Hello! Please respond with just 'OK' to confirm you're working."
  • Tests Per Model — Define the number of test iterations per model when running the 'Test Chat Models' consolidated test (range 1 to 20, default 5).
  • Advanced Options — Additional settings including enabling automatic retry on HTTP 403 quota errors and the maximum number of retry attempts.

Output shape

a JSON object with detailed results specific to the chosen test function

Outputs vary by test function: listing models returns available models data; refreshing cache returns cache state and models summary; testing embedding models returns per-model embedding test results; consolidated chat test returns detailed multi-model performance reports; single chat model test returns the response from the tested model. Supports retry on quota errors, includes timestamps, success flags, and error details if applicable.

Links

Discussion