Skip to content

Add ODean v21 submission#147

Open
kprofundis wants to merge 2 commits into
liamdugan:mainfrom
kprofundis:odean-v21-submission
Open

Add ODean v21 submission#147
kprofundis wants to merge 2 commits into
liamdugan:mainfrom
kprofundis:odean-v21-submission

Conversation

@kprofundis
Copy link
Copy Markdown

Adds the ODean v21 detector submission.

Files under leaderboard/submissions/ODean-v21/:

  • predictions.json — 672,000 predictions, one per RAID test row (id + score), every test id covered exactly once, no duplicates.
  • metadata.json — per leaderboard/template-metadata.json.

@github-actions
Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

ODean v21

Release date: 2026-05-17

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 87.91 and a TPR of 64.56% at FPR=5% and 53.06% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 89.56 and a TPR of 66.70% at FPR=5% and 54.49% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant