(논문 요약) SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering? (Paper)

핵심 내용: 소프트웨어 개발 데이터 셋 (task 및 보수)

• SWE-Lancer Diamond
  • 237 IC SWE tasks ($236,300)
  • 265 SWE Manager tasks ($264,500)
• SWE-Lancer full set
  • 764 IC SWE tasks ($414,775)
  • 724 SWE Manager tasks ($585,225)

실험 결과

• 현존하는 closed-AI 들이 꽤 잘 범.