benchmark

KernelGen 1P

Optimize correct kernels for OpenAI first-party hardware.

On this page
AI-system improvement

What this measure tells us

Targets a specific AI-development task.

  • Internal suite; no cross-lab percentage comparison.
  • Not a demonstration of recursive improvement.

Results by version

GPT-6.1 Sol card snapshot, September 29, 2026

2026-09-29

Separate disclosure snapshot. The addendum refers to the Astra card methods but does not positively establish identical task snapshot or budgets. Do not treat later source date as a new best score.

Metric definitions

Mean kernel optimization reward (percent): Mean score on the kernel-optimization rubric, displayed as a percentage. It is not a percentage reduction in runtime or a task-success rate.

Published results · GPT-6.1 Sol card snapshot, September 29, 2026
KeySystem / organizationMetricReported resultDateProtocolVerificationEvidence
—GPT-6.1 SolMean kernel optimization reward60.44%2026-09-29kernelgen-1p-sol61-protocollab reported

Astra card snapshot, September 2026

2026-09-03

Version identity is this disclosure snapshot, not an invented upstream version.

Metric definitions

Mean kernel optimization reward (percent): Mean score on the kernel-optimization rubric, displayed as a percentage. It is not a percentage reduction in runtime or a task-success rate.

Published results · Astra card snapshot, September 2026
KeySystem / organizationMetricReported resultDateProtocolVerificationEvidence
—GPT-6 AstraMean kernel optimization reward66.72%2026-09-03kernelgen-1p-protocollab reported
—GPT-6 SolMean kernel optimization reward38.12%2026-09-03kernelgen-1p-protocollab reported
—GPT-5.6 SolMean kernel optimization reward61.08%2026-09-03kernelgen-1p-protocollab reported
—GPT-6 LunaMean kernel optimization reward21.83%2026-09-03kernelgen-1p-protocollab reported
—GPT-5.6 LunaMean kernel optimization reward22.4%2026-09-03kernelgen-1p-protocollab reported

Version lineage

  1. Astra card snapshot, September 2026
  2. GPT-6.1 Sol card snapshot, September 29, 2026

Reference points

No reference points are indexed for this measure.

Availability

What is publicly available
ResourceStatus
public descriptionyes
public resultsyes
public tasksno
public codeunknown
public evaluation serviceunknown

Official sources