{"access":"open","annotations":"Weekly blinded evaluation of registered prediction servers on newly submitted binding and elution data.","article":"/blog/modele-prezentacji-antygenu","cancer_slugs":["pan-cancer"],"details":"WHY IT MATTERS.\n- Nearly every other published comparison was run by the authors of one of the compared tools \u2014 and the host tool wins every time.\n- PPV means at least three different things in this literature (1:99 vs 1:999 decoys, same-protein vs random decoys, top-N vs top-0.1%), so cross-paper tables are not comparable.","doi":null,"formats":["CSV"],"hf":null,"huggingface":null,"kind":"benchmark","license":"public","modalities":["protein-sequence"],"models":[{"name":"NetMHCpan-4.1","note":"","role":"benchmark","slug":"netmhcpan"},{"name":"MHCflurry 2.0","note":"","role":"benchmark","slug":"mhcflurry"},{"name":"MHCnuggets","note":"","role":"benchmark","slug":"mhcnuggets"}],"name":"IEDB automated benchmark (MHC class I)","page":"/ai-oncology/datasets/iedb-benchmark","provider":"La Jolla Institute for Immunology","size":{"notes_en":"runs continuously on newly deposited data, before it can leak into anyone's training set","notes_pl":"dzia\u0142a na bie\u017c\u0105co na \u015bwie\u017co deponowanych danych, zanim mog\u0105 trafi\u0107 do czyjegokolwiek zbioru treningowego"},"slug":"iedb-benchmark","sources":[{"label":"Trevizani R et al. Brief Bioinform 2022","url":"https://academic.oup.com/bib/article/23/4/bbac259/6632617"}],"summary":"The only prospective, third-party benchmark in the field. Its eight-year summary is sobering: leading methods are statistically indistinguishable, and a new method needs about four years before enough data accumulate to judge it.","tasks":["peptide-mhc-binding","antigen-presentation"],"url":"http://tools.iedb.org/auto_bench/mhci/weekly/","verified_at":"2026-09-05T22:25:59.140589"}