Skip to content

Add Agnes-Claw model to default models list#13

Merged
olearycrew merged 2 commits intopinchbench:mainfrom
zujingya:main
Mar 20, 2026
Merged

Add Agnes-Claw model to default models list#13
olearycrew merged 2 commits intopinchbench:mainfrom
zujingya:main

Conversation

@zujingya
Copy link

Subject: Clarification on OpenRouter Requirement for PinchBench Leaderboard

Hi [PinchBench Team],

I hope you’re doing well.

We are currently preparing our model for benchmarking and have submitted an application to deploy it through OpenRouter. While the OpenRouter integration is being processed, we would like to clarify a few points:

Is being available on OpenRouter a strict requirement for appearing on the PinchBench leaderboard?

In the meantime, would it be possible to submit unofficial benchmark results for review or temporary display?

Could you please let us know how long the OpenRouter review process usually takes?

We want to ensure we follow the proper process while our OpenRouter application is under review.

Thank you very much for your guidance!

Best regards

Subject: Clarification on OpenRouter Requirement for PinchBench Leaderboard

Hi [PinchBench Team],

I hope you’re doing well.

We are currently preparing our model for benchmarking and have submitted an application to deploy it through OpenRouter. While the OpenRouter integration is being processed, we would like to clarify a few points:

Is being available on OpenRouter a strict requirement for appearing on the PinchBench leaderboard?

In the meantime, would it be possible to submit unofficial benchmark results for review or temporary display?

Could you please let us know how long the OpenRouter review process usually takes?

We want to ensure we follow the proper process while our OpenRouter application is under review.

Thank you very much for your guidance!

Best regards
@olearycrew
Copy link
Member

Is being available on OpenRouter a strict requirement for appearing on the PinchBench leaderboard?

Today, yes that is the only way official results happen. In the future we will expand it to the Kilo Gateway as well as maybe other gateways

@olearycrew olearycrew merged commit c2d8a3e into pinchbench:main Mar 20, 2026
1 check passed
- openrouter/z-ai/glm-4.5-air
- openrouter/z-ai/glm-5
- openrouter/z-ai/glm-5-turbo
- openrouter/kiwi//Agnes-Claw
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WARNING: Double slash in model identifier — openrouter/kiwi//Agnes-Claw

All other entries in this file use the pattern openrouter/<provider>/<model> with single slashes. The double slash (//) between kiwi and Agnes-Claw is likely a typo and could cause failures when resolving the model path via OpenRouter.

Suggested change
- openrouter/kiwi//Agnes-Claw
- openrouter/kiwi/Agnes-Claw

@kilo-code-bot
Copy link

kilo-code-bot bot commented Mar 20, 2026

Code Review Summary

Status: 1 Issue Found | Recommendation: Address before merge

Overview

Severity Count
CRITICAL 0
WARNING 1
SUGGESTION 0
Issue Details (click to expand)

WARNING

File Line Issue
default-models.yml 45 Double slash in model identifier openrouter/kiwi//Agnes-Claw — likely typo, should be openrouter/kiwi/Agnes-Claw
Files Reviewed (1 file)
  • default-models.yml - 1 issue

Fix these issues in Kilo Cloud


Reviewed by claude-4.6-opus-20260205 · 170,673 tokens

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants