Troubleshooting

Create Leaderboard is disabled

Add and validate an OpenRouter token in Settings → Integrations.

Hugging Face dataset cannot be checked

Confirm the URL is a Hugging Face .jsonl or .jsonl.gz file. Add a Hugging Face integration for private or gated datasets.

curl -sS -X POST "$API_BASE/api/datasets/huggingface/check" \
  -H "Authorization: Bearer $DRGERO_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"dataset_url":"https://huggingface.co/datasets/.../resolve/main/eval.jsonl"}' | jq

Inference returns 409

The leaderboard does not have a completed ranking or selected model yet. Add at least two candidate models and run the leaderboard.

Inference returns 403

Check token scope and plan entitlement. The token needs leaderboards:inference.

Traces are empty

Check:

• You are querying the correct leaderboard ID.
• source filter is not too narrow.
• limit, offset, and batch_limit are appropriate.
• The workspace plan includes trace access.

Push dataset accepts zero rows

Check daily/monthly quotas, max rows per request, row validity, and whether the leaderboard is actually PUSH type.

Custom model produces invalid output

Make the endpoint return OpenAI-compatible chat-completions JSON. Include choices[0].message.content when possible.

Token budget exhausted

Create a new token with a higher budget, wait for the reset interval, or lower usage. Inspect budget headers on inference responses.

Free plan limitations

The free tier may limit leaderboard count, deletion, auto-selection, token spend, and request volume. Upgrade or use a paid workspace for production automation.