Chenglei Si conducted a large human study finding that expert judges rated LLM research ideas above human ones, but human ideas worked better when executed.
Referenced in coverage
“Chenglei Si conducted a large human study finding that expert judges rated LLM research ideas above human ones, but human ideas worked better when executed.”