Commits

Branch selector

 2420c62

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 28, 2024

• Updates on existing solvers and bugged tool eval (openai#1506)

  Show description for 2420c62
  

  4 peopleauthored
  2420c62

  Copy full SHA for 2420c62

Commits on Mar 27, 2024

• Update ReadMe with New Cookbook link (openai#1507)

  Show description for d9d2f5f
  royziv11

  authored
  d9d2f5f

  Copy full SHA for d9d2f5f

Commits on Mar 26, 2024

• Add Gemini Solver (openai#1503)

  Show description for 5a92ac3
  

  ojaffe

  and

  JunShern

  authored
  5a92ac3

  Copy full SHA for 5a92ac3

• Unified create_retrying for all solvers (openai#1501)

  Show description for 150dcb9
  ojaffe

  authored
  150dcb9

  Copy full SHA for 150dcb9

Commits on Mar 25, 2024

• Add info about logging and link to logviz (openai#1480)

  Show description for ac44aae
  JunShern

  authored
  ac44aae

  Copy full SHA for ac44aae

• Log model and usage stats in record.sampling (openai#1449)

  Show description for 9b2e1b1
  JunShern

  authored
  9b2e1b1

  Copy full SHA for 9b2e1b1

• Address sporadic hanging of evals on certain samples (openai#1482)

  Show description for bfe3925
  thesofakillers

  authored
  bfe3925

  Copy full SHA for bfe3925

Commits on Mar 22, 2024

• TogetherSolver (openai#1502)

  Show description for 5805c20
  

  3 peopleauthored
  5805c20

  Copy full SHA for 5805c20

Commits on Mar 21, 2024

• AnthropicSolver (openai#1498)

  Show description for e30e141
  thesofakillers

  authored
  e30e141

  Copy full SHA for e30e141

• Add Human-Relative MLAgentBench (openai#1496)

  Show description for 4f97ce6
  danesherbs

  authored
  4f97ce6

  Copy full SHA for 4f97ce6

• Add Multi-Step Web Tasks (openai#1500)

  Show description for 5b84993
  

  danesherbs

  and

  ianmckenzie-oai

  authored
  5b84993

  Copy full SHA for 5b84993

Commits on Mar 19, 2024

• Add In-Context RL eval (openai#1491)

  Show description for ff994b5
  james-aung

  authored
  ff994b5

  Copy full SHA for ff994b5

• Add Function Deduction eval (openai#1492)

  Show description for dfeaac4
  

  james-aung

  and

  johny-b

  authored
  dfeaac4

  Copy full SHA for dfeaac4

• Identifying Variables Eval (openai#1488)

  Show description for c207dba
  thesofakillers

  authored
  c207dba

  Copy full SHA for c207dba

• Track the Stat Eval (openai#1489)

  Show description for 99bfada
  thesofakillers

  authored
  99bfada

  Copy full SHA for 99bfada

• Already Said That Eval (openai#1490)

  Show description for baa12d0
  thesofakillers

  authored
  baa12d0

  Copy full SHA for baa12d0

• Add 20 questions eval (openai#1499)

  Show description for bd1736e
  inwaves

  authored
  bd1736e

  Copy full SHA for bd1736e

• Add skill acquisition eval (openai#1497)

  Show description for 76a9f4e
  inwaves

  authored
  76a9f4e

  Copy full SHA for 76a9f4e

• Error Recovery Eval (openai#1485)

  Show description for 80ac60d
  

  ojaffe

  and

  ianmckenzie-oai

  authored
  80ac60d

  Copy full SHA for 80ac60d

• Can't Do That Anymore Eval (openai#1487)

  Show description for f72afb9
  ojaffe

  authored
  f72afb9

  Copy full SHA for f72afb9

• Bugged Tools Eval (openai#1486)

  Show description for ad377e4
  ojaffe

  authored
  ad377e4

  Copy full SHA for ad377e4

Commits on Mar 13, 2024

• Updates on existing evals; readmes; solvers (openai#1483)

  Show description for 11c30b2
  ojaffe

  authored
  11c30b2

  Copy full SHA for 11c30b2

Commits on Mar 12, 2024

• Drop two datasets from steganography (openai#1481)

  Show description for 7e958fe
  thesofakillers

  authored
  7e958fe

  Copy full SHA for 7e958fe

Commits on Feb 23, 2024

• Suppress 'HTTP/1.1 200 OK' logs from openai library (openai#1468)

  Show description for 82ec660
  JunShern

  authored
  82ec660

  Copy full SHA for 82ec660

Commits on Feb 13, 2024

• Fix small typos and inconsistencies in README (openai#1464)

  Show description for 902f750
  kwinkunks

  authored
  902f750

  Copy full SHA for 902f750

Commits on Jan 29, 2024

• Updates for Solvers (openai#1461)

  Show description for 4a105ae
  

  4 peopleauthored
  4a105ae

  Copy full SHA for 4a105ae

Commits on Jan 26, 2024

• Logged spec now includes overridden args (openai#1460)

  Show description for 3040d6f
  ojaffe

  authored
  3040d6f

  Copy full SHA for 3040d6f

• Add run_id to final_report from LocalRecorder (openai#1452)

  Show description for cf002f2
  ianmckenzie-oai

  authored
  cf002f2

  Copy full SHA for cf002f2

Commits on Jan 10, 2024

• Fix formatting/typing so pre-commit hooks pass (openai#1451)

  Show description for c66b5c1
  ianmckenzie-oai

  authored
  c66b5c1

  Copy full SHA for c66b5c1

• icelandic gec eval (openai#1400)

  Show description for 105c2b9
  svanhvitlilja

  authored
  105c2b9

  Copy full SHA for 105c2b9

Commits on Jan 9, 2024

• Add eval yaml for Theory of Mind eval (openai#1453)

  Show description for 877d555
  ojaffe

  authored
  877d555

  Copy full SHA for 877d555

Commits on Jan 3, 2024

• Improve MMMU performance with prompt engineering (openai#1450)

  Show description for 2981e65
  etr2460

  authored
  2981e65

  Copy full SHA for 2981e65

• Add eval japanese prime minister (openai#1422)

  Show description for f1bb7cb
  return-nil

  authored
  f1bb7cb

  Copy full SHA for f1bb7cb

• Solve openai#1394 (openai#1395)

  Show description for 10b02c6
  

  Lorenzo Pacchiardi

  authored
  10b02c6

  Copy full SHA for 10b02c6

• Add a recorder for function calls (openai#1389)

  Show description for 0647721
  danesherbs

  authored
  0647721

  Copy full SHA for 0647721

Pagination

Previous

Next