Oldal címe

LLM evaluation on APR task part 1

Címlapos tartalom

Automatic Program Repair requires understanding the source code in order to fix bugs. LLMs are actively used in software development both in source code modification and generation. LLMs can fix bugs according to related works, although these works are mostly evaluated on hand-crafted small projects or on data which is possibly was available during the training. In this project we aim to evaluate LLMs in real-life vulnerabilities, which require more understanding of the context.