[{"data":1,"prerenderedAt":4},["ShallowReactive",2],{"qy0P5Z25h3":3},"# Verified hand-written Lean solutions to HumanEval\n\n[HumanEval] is a collection of small programming tasks originally intended as a benchmark for LLMs.\nIn this repo, we collect hand-written _formally verified_ [Lean 4] solutions to these problems.\n\nThe idea is to build a small set of simple examples for verified software development using Lean.\nIt is inspired by [human-eval-verus], which does a similar thing for the Verus Rust verification\nplatform.\n\n## Contributions\n\nContributions are welcome! You can\n[look at the table](https://github.com/users/TwoFX/projects/2/views/1) to see\nwhich problems do not currently have a solution.\n\nFeel free to add your thoughts about\na problem to the corresponding issue. A rough estimation of the difficulty is already\nhelpful; I will add the corresponding label to the issue.\n\nWe accept\n\n- PRs adding complete solutions to unsolved problems,\n- PRs adding additional solutions to problems which are already solved,\n- PRs adding partial solutions (for example just the code and the correctness statement, with the correctness proof sorried, or just developing a bit of related theory), and\n- PRs improving the code of existing solutions.\n\nGolfing is welcome as long as the resulting code can still be considered idiomatic.\n\nWe use the [Lean 4 standard library style guide and naming convention](https://github.com/leanprover/lean4/tree/master/doc/std),\nbut we won't be very strict about enforcing it.\n\n### Missing lemmas\n\nOne of the goals of the goals of this project is to assess the out-of-the-box\nexperience of Lean 4 as a software verification tool, so this project will not\ntake on dependencies such as Batteries.\n\nSolutions to most tasks will encounter lemmas missing from Lean core. Some of the missing\nlemmas might be available in a place like Batteries and mathlib. The procedure in this case is\nto put the missing lemmas in the file where they are needed, with a note if they are available\nsomewhere else. In this way, the files in this repository clearly document what was missing\nfrom Lean core.\n\n[HumanEval]: https://github.com/openai/human-eval\n[Lean 4]: https://lean-lang.org/\n[human-eval-verus]: https://github.com/secure-foundations/human-eval-verus\n",1781732201015]