About

Equistamp allows users to test and evaluate the performance of various AI models by running specified evaluations. Users have the flexibility to upload their AI models and custom evaluations or select from a range of pre-existing, commonly used models and evaluations. Evaluation runs can be purchased and scheduled to run once, or on a recurring basis - daily, weekly, fortnightly, monthly or quarterly.

Features

Model Management

• Upload Models: Connect your own AI models
• Pre-existing Models: Browse widely-used AI models and models connected by other users

Evaluations

• Custom Evaluations: Upload your own evaluations
• Standard Evaluations: Browse standard and user uploaded evaluations

Purchase Evaluation Runs

• One-Time Runs: Execute an evaluation run on demand.
• Recurring Runs: Configure scheduled runs (daily, weekly, fortnightly, monthly or quarterly** for your model-evaluation pairs.

Security and Privacy

• Paraphrased evaluations: Stop AI models from training for the test by ensuring that they only ever see paraphrases of the real questions and answers in your evaluations

API and Integrations

• RESTful API: Integrate model uploads and evaluations programmatically
• Typescript: A Typescript client for accessing Equistamp