benchmark

KernelGen 1P

Optimize correct kernels for OpenAI first-party hardware.

AI-system improvement

What this measure tells us

Targets a specific AI-development task.

  • Internal suite; no cross-lab percentage comparison.
  • Not a demonstration of recursive improvement.

Results by version

Astra card snapshot, September 2026

2026-09-03

Version identity is this disclosure snapshot, not an invented upstream version.

Metric definitions

Mean kernel optimization reward (percent): Mean score on the kernel-optimization rubric, displayed as a percentage. It is not a percentage reduction in runtime or a task-success rate.

Published results · Astra card snapshot, September 2026
KeySystem / organizationMetricReported resultDateProtocolVerificationEvidence
—GPT-6 AstraMean kernel optimization reward66.72%2026-09-03kernelgen-1p-protocollab reported
—GPT-6 SolMean kernel optimization reward38.12%2026-09-03kernelgen-1p-protocollab reported
—GPT-5.6 SolMean kernel optimization reward61.08%2026-09-03kernelgen-1p-protocollab reported
—GPT-6 LunaMean kernel optimization reward21.83%2026-09-03kernelgen-1p-protocollab reported
—GPT-5.6 LunaMean kernel optimization reward22.4%2026-09-03kernelgen-1p-protocollab reported

Version lineage

Reference points

No reference points are indexed for this measure.

Availability

What is publicly available
ResourceStatus
public descriptionyes
public resultsyes
public tasksno
public codeunknown
public evaluation serviceunknown

Official sources