Claude Code æéã¬ã€ãïŒbuild-evalã¯ç¡æããå®è¡ã³ã¹ããæ€èšŒ
Claude Code æéã®å èš³ããå ¬éã¯ãŒã¯ãããŒããªãŒã±ã¹ãã¬ãŒã·ã§ã³ãè©äŸ¡å¯Ÿè±¡ã¢ããªãã¢ãã«ãžã£ããžã®4å±€ã«åããŠè§£èª¬ããŸãã24ã±ãŒã¹Ã3åÃ2åè£ã§144åã«ãªãçç±ãšã宿ž¬ããŒã¯ã³ããClaude API æéãèŠç©ãã5ä»¶ãã€ãããã®é²ãæ¹ãŸã§å ·äœçã«æŽçããŸããã
å ¬éæ¥

çµè«ããèšãã°ãç¡æãšã¯éããŸãããClaude APIã®build-evalã¯ãŒã¯ãããŒèªäœã¯å ¬éãããŠããŸãããããã§å®è¡ããè©äŸ¡ãŸã§èªåçã«ç¡æã«ãªãããã§ã¯ãããŸãããClaude Code æéãèãããšãã¯ãç¡æã§èªããæé ãšèª²é察象ã®åŠçãåããå¿ èŠããããŸãã24ã±ãŒã¹ à 3åã®å埩 à 2ã€ã®ã¢ãã«åè£ãªããä»»æã®ãžã£ããžããªãã©ã€ãå ããåã®æ®µéã§ã¢ããªã±ãŒã·ã§ã³å®è¡ã¯144åã§ããä»åã®æ€èšŒã§ã¯æåã®ã¢ããªã±ãŒã·ã§ã³ãã€ãããã宿œã§ããªãã£ãããã144ã¯èšç®äžã®åæ°ã§ããã宿ž¬ããéé¡ã§ã¯ãããŸããã
Claude Code æéããèŠãbuild-evalã®ç¡æç¯å²
ã¯ãŒã¯ãããŒã®ãã¡ã€ã«ã¯ç¡æã§èªããŸãããè©äŸ¡ãå®è¡ãããš3ãæã§ææã®ã¢ãã«å©çšãçºçããå¯èœæ§ããããŸãã Claude Codeã¯ããµãã¹ã¯ãªãã·ã§ã³ãªãå©çšæ ãæ¶è²»ããAPIèªèšŒãªãåŸé課éã«ãªããŸããè©äŸ¡å¯Ÿè±¡ã®ã¢ããªã±ãŒã·ã§ã³ã¯ãèšå®ãããã¢ãã«ãããã€ããŒãåŒã³åºããŸããããã«ãä»»æã§ã¢ãã«ãžã£ããžã䜿ãã°ããã®åŒã³åºããå ãããŸããæ±ºå®è«çãªããŒã«ã«æ¡ç¹ãªã3ã€ç®ã®è²»çšã¯é¿ããããŸãããã¢ããªã±ãŒã·ã§ã³ã®åŒã³åºãã¯æ®ããŸãã
ãã®åºå¥ãéèŠãªã®ã¯ãbuild-evalãç¡æã®è©äŸ¡ã¯ã¬ãžãããæäŸããä»çµã¿ã§ã¯ãªãããã§ããæå
ã®ã¢ããªã±ãŒã·ã§ã³ã察象ã«è©äŸ¡ãçµã¿ç«ãŠãããã®ãClaude Codeã®ã¬ã€ãä»ãã¯ãŒã¯ãããŒã§ãããšã³ããªãŒãã€ã³ãã®ç¹å®ãã±ãŒã¹ã®äœæãæ¡ç¹æ¹æ³ã®éžæãã©ã³ããŒã®æ°èŠäœæã調æŽãã¬ãã¥ãŒå¯èœãªçµæã®åºåãæ¯æŽããŸããå
¬éãããŠããå®è£
ã¯Anthropicã®skillsãªããžããªã§ç¢ºèªã§ããŸããã宿ããã©ã³ããŒãå®è¡ããåŒã³åºãã«ã¯ãå©çšããã¢ã«ãŠã³ããšãããã€ããŒã®èª²éã«ãŒã«ãé©çšãããŸãã
ãããã£ãŠãçãã«ã¯æ¡ä»¶ãä»ããŸããè©äŸ¡ã®èšèšã¯ç¡æã§è¡ããäžæ¹ãå®è¡ãç¡æã«ãªãã®ã¯ã課é察象ã®åŒã³åºãããªãå Žåãããã¹ãŠã®å©çšéãæ¢ã«æ¯æã£ãŠããæ å ã«åãŸãå Žåã ãã§ãã ãã®å Žåã§ããç¡æããæå³ããã®ã¯è¿œå è«æ±ããªããšããããšã§ããã容éãç¡å¶éã«ãªãããã§ã¯ãããŸããã
9æ28æ¥ãš29æ¥ã«äœãå€ãã£ãã®ã
Anthropicã¯ãè©äŸ¡ã®æ§ç¯ãšå埩çãªæé©åãã2ã€ã®æç€ºçãªClaude Codeã¯ãŒã¯ãããŒãšããŠæäŸããŸããã 2026幎9æ28æ¥ã®ã¬ã€ãã§ã¯ãè©äŸ¡ãäœã /claude-api build-eval ãšãè©äŸ¡ã«æ²¿ã£ãŠã¢ããªã±ãŒã·ã§ã³ãæ¹åãã /claude-api hillclimb ã玹ä»ãããŸãããå®è£
ã¯9æ29æ¥02:20:03 UTCã«ã³ããã 8a1541c4ãšããŠå
¬éãããŠããŸãã
build-evalã¯ãã¢ããªã±ãŒã·ã§ã³ã®1ã€ã®åŠçãããŒããå§ããŸããæ¢åã®ãšã³ããªãŒãã€ã³ããèªã¿ã代衚çãªã±ãŒã¹ã®å
¥æå
ã確èªããåºåãæ£ããæž¬ãããã¡ã§æãå®äŸ¡ãªæ¡ç¹æ¹æ³ãææ¡ããŸãããããŠãå
¥åãšæ¡ç¹æ¹æ³ã®äž¡æ¹ã«ã€ããŠæç¢ºãªæ¿èªãæ±ããŸããæçµçã«ãã©ã³ããŒãresults.jsonlããã¬ãŒã¹ãã¬ããŒããªã©ãã³ãŒããšæ ¹æ ããªããžããªã«æ®ããŸãã
hillclimbã䜿ãã®ã¯ãã®åŸã§ããã±ãŒã¹ãèšç·ŽçšãšããŒã«ãã¢ãŠãã®ãã¹ãçšã«åãã倿Žãèš±å¯ããç®æã1ã€ãã€ä¿®æ£ããŠåè©äŸ¡ããæ§èœãäžãã£ã倿Žããèšç·ŽçšããŒã¿ã ãã§æ¹åãã倿Žã¯å
ã«æ»ããŸããããã³ãããã¢ãã«éžæãeffortãããŒã«ãã¢ããªã±ãŒã·ã§ã³ã®ã©ãããŒã³ãŒããæ¹åã§ããŸãããåè£ã詊ããã³ã«å®è¡åæ°ã¯å¢ããŸãã
æ¬è³ªçãªå€åã¯ãè©äŸ¡ãç¡æã«ãªã£ããããšã§ã¯ãããŸãããå¥ã®ãã¬ãŒã ã¯ãŒã¯ãå¿ é ã«ãããClaude Codeã§èŠåŸãšç£æ»å¯èœæ§ãåããè©äŸ¡ãããŒãçµã¿ç«ãŠãããããã«ãªã£ãããšã§ãããã®åå°ã«ãã課éã®ä»çµã¿ã¯å€ãã£ãŠããŸããã
Claude Code æéã4ã€ã®èª²éãã€ã³ãã«åãã
äºç®ãæ£ããçµãã«ã¯ã4ã€ã®èª²éãã€ã³ããåããŠèããå¿ èŠããããŸããæç¢ºã«ç¡æãªã®ã¯ããã®ãã¡1ã€ã ãã§ãã ãã¹ãŠãã²ãšãŸãšãã«ããŠãClaudeã®è²»çšããšåŒã¶ãšãäœã«ããã䜿ã£ãã®ã説æã§ããªããªããŸãã
- å ¬éã¯ãŒã¯ãããŒã ã¬ã€ããšã¹ãã«ãã¡ã€ã«ã¯å ¬éãããŠããŸããèªãããšãçæãããããŒã«ã«ãã¡ã€ã«ã確èªããããšã決å®è«çãªãã§ãã¯ãããŒã«ã«ã§å®è¡ããããšèªäœã«ã¯ãClaude APIã®ããŒã¯ã³æéã¯çºçããŸããã
- Claude Codeã«ãããªãŒã±ã¹ãã¬ãŒã·ã§ã³ã Claude Codeã¯ãªããžããªãèªã¿ãå¿ èŠäºé ã確èªããã©ã³ããŒãäœæããŠãçµæã®ç²Ÿæ»ãæ¯æŽããŸãããµãã¹ã¯ãªãã·ã§ã³å©çšè ã¯ãã©ã³ã®å©çšæ ãæ¶è²»ããAPIèªèšŒã®ã»ãã·ã§ã³ã¯ããŒã¯ã³ã®åŸé課éã«ãªããŸããAnthropicã®Claude Codeã³ã¹ãã«é¢ããããã¥ã¡ã³ãã«ãããšãããAPIå©çšè ã«è¡šç€ºãããã»ãã·ã§ã³è²»çšã¯æšå®å€ã§ããµãã¹ã¯ãªãã·ã§ã³å©çšè ã«ã¯ä»£ããã«ãã©ã³ã®äœ¿çšéã衚瀺ãããŸããçŸåšã®ãã©ã³ãšèªèšŒæ¹åŒã¯ãåœãµã€ãã®Claude Codeæéã¬ã€ãã§ç¢ºèªã§ããŸãã
- è©äŸ¡å¯Ÿè±¡ã®ã¢ããªã±ãŒã·ã§ã³ã ã©ã³ããŒã¯ãåçŽåããã¢ãã«ãªã¯ãšã¹ããäœãçŽãã®ã§ã¯ãªããæ¢åã¢ããªã±ãŒã·ã§ã³ã®ãšã³ããªãŒãã€ã³ããåŒã³åºãã¹ãã§ãããã®ããããµããŒããã±ããããªãã©ã€ãããŒã«ã®ã«ãŒããå埩ã®ãã³ã«ããã®ã¢ããªã±ãŒã·ã§ã³ãæ¢ã«å©çšããŠãããããã€ããŒãšã¢ã«ãŠã³ãã®äœ¿çšéãå¢ããŸãã
- æ¡ç¹åŠçã åºå®ã©ãã«ãã¹ããŒãæ€èšŒããŠããããã¹ããæçµç¶æ ã®ã¢ãµãŒã·ã§ã³ãªãããŒã«ã«ã§å®è¡ã§ããŸããèªç±åœ¢åŒã®åçã§ã¯ããã€ã³ãã¯ã€ãºãŸãã¯ãã¢ã¯ã€ãºã®ã¢ãã«ãžã£ããžãå¿ èŠã«ãªãå Žåãããããã®å ¥åãåºåããã£ãã·ã¥ãå Žåã«ãã£ãŠã¯ããŒã«å©çšãå ç®ãããŸãã

æåã«æ€èšãã¹ãç¯çŽçã¯ãå®ããžã£ããžãéžã¶ããšã§ã¯ãããŸãããæ£è§£ã®åœ¢åŒãéå®ãããŠãããªããããã°ã©ã ã§æ¡ç¹ããããšã§ããåºå®ãªã¹ããããã¥ãŒã1ã€è¿ããµããŒãã«ãŒã¿ãŒãªããã³ãŒãã§å€å®ã§ããŸããå¥ã®ã¢ãã«ãåŒã³åºããŠbillingãšbillingãäžèŽãããã確ãããã®ã¯ã決å®è«çã«çããããåãã«è²»çšããããããšã«ãªããŸãã
ã¢ãã«ãžã£ããžã䜿ãã¹ããªã®ã¯ãããšãã°ããšã¹ã«ã¬ãŒã·ã§ã³èŠçŽãäºå®ãæé ããã«é¡§å®¢ã®ç·æ¥åºŠãä¿ã£ãŠããããªã©ãæ¬åœã«å€æãèŠããæ§è³ªãè©äŸ¡ãããšãã§ãããã®å Žåã§ããã¢ããªã±ãŒã·ã§ã³ãšãžã£ããžã®äœ¿çšéã¯å¥ã®ãã£ãŒã«ãã«èšé²ããŠãã ãããå®ããžã£ããžã®é°ã«é«é¡ãªã¢ããªã±ãŒã·ã§ã³å®è¡ãé ããããšãããã®éããããŸãã
24ã±ãŒã¹ã144åã®ã¢ããªã±ãŒã·ã§ã³å®è¡ã«ãªãä»çµã¿
ã±ãŒã¹æ°ã¯ãæåã®æãç®ã«ãããŸããã Anthropicã®çºè¡šã¬ã€ãã«ã¯ã24ä»¶ã®å ¥åã䜿ãåä¿¡ãã¬ã€æ¯ãåãã®äŸããããŸãã2ã€ã®ã¢ãã«åè£ãæ¯èŒããåã±ãŒã¹ã3åãã€å埩ãããšãã¢ããªã±ãŒã·ã§ã³ã®å®è¡åæ°ã¯æ¬¡ã®ãšããã§ãã
24ã±ãŒã¹ à 3åã®å埩 à 2åè£ = 144åã®ã¢ããªã±ãŒã·ã§ã³å®è¡
ããã¯ãã¢ãã«ã«ããæ¡ç¹ã倱æãããªã¯ãšã¹ãã®ãªãã©ã€ãå ããåã®ãæäœå®è¡åæ°ã§ããåãå ¥åã§ãã¢ãã«ã®åçãå€ããåŸããããå埩ãå¿ èŠã§ãããŸããæ¯èŒã«ã¯äž¡æ¹ã®èšå®ããåºåãåŸãå¿ èŠããããããåè£ã®æ°ãæãåãããŸãã
次ã®åçãæ±ºããã®ã¯æ¡ç¹æ¹æ³ã§ãã
- ããã°ã©ã ã«ããæ¡ç¹ïŒ ã¢ãã«ãžã£ããžã®åŒã³åºãã¯0åã§ããã¢ããªã±ãŒã·ã§ã³å®è¡ã¯144åã®ãŸãŸã§ãã
- ãã¢ã¯ã€ãºãžã£ããžïŒ ã±ãŒã¹ãšå埩ã®çµã¿åããããšã«1åã®åŒã³åºãã§2åè£ãæ¯èŒãããªãããžã£ããžã¯72åã§ãã24 à 3 = 72çµã ããã§ãã
- ãã€ã³ãã¯ã€ãºãžã£ããžïŒ ã¢ããªã±ãŒã·ã§ã³ã®åºåã1ä»¶ãã€æ¡ç¹ãããªãããžã£ããžã¯144åã§ãããªãã©ã€ãClaude Codeã®ãªãŒã±ã¹ãã¬ãŒã·ã§ã³å©çšãé€ããŠããã¢ããªã±ãŒã·ã§ã³144åãšãžã£ããž144åãåèš288åã®ã¢ãã«åŒã³åºãã«ãªããŸãã

hillclimbingã§ã¯ãã©ãŠã³ãããšã«æ°ããåè£ãå®è¡ãããããæãç®ãããã«å¢ããŸããè€æ°ã®ãããã詊ãã«ãŒãã§ã¯ãäžæ¡çšã®ãããããã¹ãŠå ã«æ»ããŠããè©äŸ¡äžåŒãäœåºŠãå®è¡ããããšã«ãªããŸããæé©åãå§ããåã«ãã©ãŠã³ãæ°ãšæ¯åºã®äžéãæ±ºããŠãã ããããã¹ã³ã¢ãäžãããŸã§ç¶ãããã¯äºç®ãšã¯åŒã¹ãŸãããã¹ã³ã¢ã«ãã€ãºãããã°ãæ¢çŽ¢ãå»¶ã ãšç¶ãå¯èœæ§ãããããã§ãã
Claude API æéã¯å®æž¬ããå©çšéããèšç®ãã
1ã±ãŒã¹åœããã®åºå®äŸ¡æ Œã¯ãããŸããããã®ãããæ ¹æ ã®ããèŠç©ããã¯ãæåãã€ãããã§å®æž¬ãã䜿çšéãã£ãŒã«ãããå§ããå¿ èŠããããŸãã ãããã±ããã¯çãåé¡ã1ååŒã¶ã ããããããŸãããå¥ã®ãã±ããã¯ãé·ãã³ã³ããã¹ããè€æ°ã®ããŒã«ããªãã©ã€ããžã£ããžãå¿ èŠãšããå ŽåããããŸããã©ã¡ãããè©äŸ¡ã±ãŒã¹1ä»¶ããšããŠäŸ¡æ Œãä»ããã°ãè«æ±é¡ãå·Šå³ããå·®ãèŠããªããªããŸãã
Anthropicã®çŽæ¥å¥çŽAPIã®æé衚ã¯ã2026幎9æ29æ¥ã«ç¢ºèªããŸããã以äžã¯100äžããŒã¯ã³åœããã®æéã§ãã
åºå žïŒAnthropicã®ææ°Claude APIæéããŒãžãAmazon BedrockãŸãã¯Google Cloudãå©çšããå Žåã¯ãããã«ããçŽæ¥å¥çŽAPIã®æéã転èšãããåãããã€ããŒã®æé衚ã䜿çšããŠãã ããã
ãã€ãããã®åè¡ã«ã€ããŠã次ã®é ç®ãèšç®ããŸãã
ã¢ããªã±ãŒã·ã§ã³ã®æ°èŠå ¥å + ã¢ããªã±ãŒã·ã§ã³ã®åºå + ã¢ããªã±ãŒã·ã§ã³ã®ãã£ãã·ã¥æžã蟌㿠+ ã¢ããªã±ãŒã·ã§ã³ã®ãã£ãã·ã¥èªã¿åã + ãžã£ããžã®æ°èŠå ¥å + ãžã£ããžã®åºå + ãžã£ããžã®ãã£ãã·ã¥æžã蟌㿠+ ãžã£ããžã®ãã£ãã·ã¥èªã¿åã + ææã®ãµãŒããŒãµã€ãããŒã«
ããŒã¯ã³ã®åºåããšã«ããã®åŠçãå®è¡ããã¢ãã«ã®å䟡ãæããŸãããã£ãã·ã¥ããŒã¯ã³ãæ°èŠå ¥åã«ãŸãšããŠã¯ãããŸãããäžè¬çãªç°¡æèšç®ã§ã¯ã5åãã£ãã·ã¥ãžã®æžã蟌ã¿ãå ¥åæéã®1.25åãèªã¿åãã0.1åãšããŸãããçŸåšã®æé衚ã«ã¯éèŠãªäŸå€ããããŸããFable 5.1ã®èªã¿åãã¯å ¥åæéã®0.025åãOpus 5.5ã¯0.05åã§ããäžåŸã«0.1åã䜿ããšãã©ã¡ããé倧ã«èŠç©ããããšã«ãªããŸãã
ãžã£ããžã«ãåãååãé©çšããŸããã¢ããªã±ãŒã·ã§ã³ãSonnet 5.5ããžã£ããžãHaiku 4.5ãªããããããã®äœ¿çšéãšæéã§èšç®ããŸããã¢ããªã±ãŒã·ã§ã³ã«ã¯ã©ãŠãã®å¥çŽæéãé©çšããããªãããã®å¥çŽã䜿ããŸãããµãŒããŒãµã€ãããŒã«ã«æäœåäœã®æéãããå Žåã¯ãå¥éå ç®ããŠãã ãããã¯ã©ã€ã¢ã³ããµã€ãããŒã«ãã¢ãã«ã®ã³ã³ããã¹ããå¢ãããããããŒã¯ã³æéã«ã¯åœ±é¿ããŸãã
ããã«å®æž¬ã®éé¡ããªãã®ã¯ãä»åã®å ¬éäœæ¥ã§ã¯ã¢ããªã±ãŒã·ã§ã³ã®ãšã³ããªãŒãã€ã³ãããããã€ããŒã®ã¢ã«ãŠã³ããæ¿èªæžã¿ã®æåãã€ããããçšæã§ããªãã£ãããã§ããããŒã¯ã³æ°ãäœãäžããã°ãèŠæ ãã®ããæ°åã¯åºããŠããäºç®ã«ã¯åœ¹ç«ã¡ãŸãããæé衚ã¯ç¢ºèªæžã¿ã§ãããå®è¡ç·é¡ã¯äœ¿çšéã宿ž¬ãããŸã§ç¢ºå®ã§ããŸããã
Claude API è©äŸ¡ã¯5ä»¶ã®ãã€ãããããå§ãã
æåã®äžæ©ãšããŠé©åãªã®ã¯ãæ¢åã®ãµããŒãã«ãŒã¿ãŒã®ãšã³ããªãŒãã€ã³ãã«5ä»¶ã®ãã±ãããéããè¡ããšã®äœ¿çšéã確èªããããšã§ãã 5ä»¶ã§ã¯æ¬çªå質ãä¿èšŒã§ããŸãããããããæ¬æ Œçãªè©äŸ¡äžåŒã«èª€ããåºããåã«ãã©ã³ããŒãæ¡ç¹åŠçããã¬ãŒã¹ãè²»çšèšæž¬ãæ£ããæ¥ç¶ãããŠãããã確ãããã«ã¯ååã§ãã
顧客ããŒã¿ãã³ããŒãããæ¯ãåãã®ç°ãªãæåã詊ãã5ä»¶ã®åæãã±ããã䜿çšããŸãã
- 顧客ãè«æ±ããŒã¿ã«ãéããªãã
- ã«ãŒãã«åãè«æ±ã2åä»ããããã«èŠããã
- 顧客ã幎éãã©ã³ã®è¿éå¯åŠãå°ããŠããã
- æ¬çªç°å¢ã®é害ã«ã€ããŠãç·æ¥ã®ãšã¹ã«ã¬ãŒã·ã§ã³ãå¿ èŠã§ããã
- æ³äººã®è³Œå ¥æ åœè ãå¥çŽå€æŽãæ±ããŠããã
ããã¯ææ¡ãããã€ãããçšã±ãŒã¹ã§ããã宿œæžã¿ã®ãã¹ãçµæã§ã¯ãããŸãããå€éšãžã®å¯äœçšãåé¢ããããã§ãæ¬çªã«ãŒã¿ãŒãšåã颿°ããšã³ããã€ã³ããã¹ã¯ãªããã«å ¥åããŠãã ãããæ¬çªãããŒãã¡ãŒã«éä¿¡ãããŒã¿ããŒã¹å€æŽããšã³ãžãã¢ã®åŒã³åºããè¡ãå¯èœæ§ããããªãããã®å¯äœçšã ãããã¹ãçšãã£ã¯ã¹ãã£ã«çœ®ãæããŸããããã³ããã®çµã¿ç«ãŠãã¢ãã«ã®åŒã³åºããããŒã«ããªãã©ã€ãã¬ã¹ãã³ã¹ã®è§£æã¯æ¬çªçžåœã®ãŸãŸã«ããªããã°ãå¥ã®ã·ã¹ãã ã®è²»çšã枬ãããšã«ãªããŸãã
ãšã³ããªãŒãã€ã³ããšèª²éäž»äœã確èªãã
ã¢ããªã±ãŒã·ã§ã³ã®é¢æ°ãŸãã¯ãšã³ããã€ã³ããã¢ãã«ããããã€ããŒãã¢ã«ãŠã³ããããã³ãããããŒã«ãåºå圢åŒãèšé²ããŸããClaude Codeèªäœã®èªèšŒæ¹åŒãèšé²ããŠãã ãããããã«ãããåŠçãå§ããåã«ããã©ã³ã®å©çšæ ãšã¢ããªã±ãŒã·ã§ã³APIã®äœ¿çšéãåºå¥ã§ããŸãã
5ä»¶ã®å ¥åãšæ¡ç¹æ¹æ³ãæ¿èªãã
åæãã±ããã1ä»¶ãã€ç¢ºèªããæåŸ ããæ¯ãåãå ãæ¿èªããŸããåºå®ããããã¥ãŒã®ã©ãã«ãªããããã°ã©ã ã«ããæ¡ç¹ã䜿ããŸããã³ãŒãã§å€å®ã§ããªãæ§è³ªã«éã£ãŠã¢ãã«ãžã£ããžã远å ããè©äŸ¡å¯Ÿè±¡ã®ã¢ãã«èªèº«ã«ã¯æ±ºããŠæ¡ç¹ãããªãã§ãã ããã
æåãã€ãããã1åå®è¡ãã
5ã±ãŒã¹ à 1åã®å埩 à 1ã€ã®ã¢ããªã±ãŒã·ã§ã³åè£ãã€ãŸãã¢ããªã±ãŒã·ã§ã³ã5åå®è¡ããŸããå ¬éãããã¯ãŒã¯ãããŒã§ã¯ãæåã®ææå®è¡åã«æç¢ºãªåæãæ±ããŠããŸããæ¿èªæžã¿ã®äºç®ããªããã°ãæéãæå®ãããå®è¡ã§ããç¶æ ãŸã§æºåãããšããã§æ¢ããŸãã
ã³ã³ãœãŒã«ã®èŠåºãã§ã¯ãªããåè¡ã確èªãã
results.jsonlãšãã¬ãŒã¹ã1ã€éããŸããæåããè¡ã®modelãšusageã空ã§ãªãããšããšã³ããªãŒãã€ã³ããstop_reasonãå ¬éããŠããããšãã¢ããªã±ãŒã·ã§ã³ãšãžã£ããžã®äœ¿çšéãåºå¥ã§ããããšã確èªããŸãããã£ãã·ã¥ã®æžã蟌ã¿ãšèªã¿åãã®ãã£ãŒã«ãã¯ãå ¥åã«ãŸãšãããã®ãŸãŸä¿æããŸããæ¬æ¥0ã§ã¯ãªãå€ã0ãªããç¡æã®åŒã³åºãã§ã¯ãªãã©ã³ããŒã®äžå ·åã§ããæéãèšç®ããå šäœã®å®è¡åœ¢ç¶ãæ¿èªãã
å®éã®ãããã€ããŒæéã§5è¡åãèšç®ãã1ã±ãŒã¹åœããã®æå°å€ãäžå€®å€ãæå€§å€ãå ±åããŠãããæ¿èªããã±ãŒã¹æ°ãšååŸ©åæ°ãæããŸããæ¡çšããæ¡ç¹æ¹æ³ããªãã©ã€ãhillclimbã®äžéãå ããŠãã ãããå šäœã®å®è¡æ¿èªãæ±ããåã«ããã®èšç®åŒãæç€ºããŸãã

ãã®é çªã¯å ¬éãããå®è£ ã«æ²¿ã£ãŠããŸãããŸããæåãã€ãããã1åæž¬å®ãã䜿çšéã粟æ»ããŠãããè©äŸ¡äžåŒã®è²»çšãèŠç©ãããŸãããã£ãã·ã¥ã®ç¶æ ãããŒã«ã®ã«ãŒããeffortããªãã©ã€ãåºåé·ã¯ãã®ã¢ããªã±ãŒã·ã§ã³åºæã®ãã®ã§ãããå¹³åçãªã¢ããªã±ãŒã·ã§ã³ã®å€ã§ã¯ãªããããéå»ã®å¹³åã§çœ®ãæããããšã¯ã§ããŸããã
éçºè ãéçšæ åœè ãè³Œå ¥æ åœè ãžã®åœ±é¿
éçºè
ã¯ãã¢ããªã±ãŒã·ã§ã³å¢çã§è²»çšã芳枬ã§ããããã«ããå¿
èŠããããŸãã ãšã³ããªãŒãã€ã³ããmodelãusageãstop_reasonãè¿ããŠããªããªããã©ã³ããŒå
šäœãæžãåã«æçµã€ãã³ããžè¿œå ããŸãããããã€ããŒåºæã®ãã£ãã·ã¥ãã£ãŒã«ããä¿æãããžã£ããžã®äœ¿çšéã¯å¥ã«èšé²ããŠãã ãããå€ãã®ããŒã ãçŽé¢ããã®ã¯ãè¡ããŒã¿ãäžå®å
šãªã®ã«ã¬ããŒãã ããæŽã£ãŠããç¶æ
ã§ããå
šäœã®å®è¡ãçµãã£ãŠããã§ã¯ãæ¬ ããããŒã¯ã³åºåã埩å
ã§ããªãããšãå°ãªããããŸããã
éçšæ åœè ã¯ãæãç®ãšæ¿èªã²ãŒãã«è²¬ä»»ãæã€å¿ èŠããããŸãã ã±ãŒã¹æ°ãååŸ©åæ°ãåè£æ°ãæ¡ç¹ã®åŒã³åºãåæ°ããªãã©ã€æ¹éãhillclimbã®æå€§ã©ãŠã³ãæ°ã1ããŒãžã«ãŸãšããŸããã24ã±ãŒã¹ããšããæžãããŠããªãäºç®ã¯äžå®å šã§ãã144åã®ã¢ããªã±ãŒã·ã§ã³å®è¡ãæ¡ç¹æ¹æ³ã宿ž¬ããã±ãŒã¹åœããã®äœ¿çšéã忢äžéãŸã§ããã°ã¬ãã¥ãŒã§ããŸãã
è³Œå ¥æ åœè ã¯ãæç€ºãããäŸ¡æ Œã«ã©ã®å±€ãŸã§å«ãŸããã確èªããå¿ èŠããããŸãã Claude Codeã®ãªãŒã±ã¹ãã¬ãŒã·ã§ã³ãã¢ããªã±ãŒã·ã§ã³ã¢ãã«ããžã£ããžãã¯ã©ãŠããããã€ããŒã®äžä¹ããããŒã«æéããªãã©ã€ãæé©åã©ãŠã³ãã¯å«ãŸããŠããã§ãããããã¢ããªã±ãŒã·ã§ã³å®è¡ãæ¯åºã®å€§åãå ããŠããŠãããããé€å€ããŠå®äŸ¡ãªãžã£ããžã ããæç€ºããããšã¯å¯èœã§ããåèšé¡ã ãã§ãªãããã€ãããã®åè¡ãšèšç®åŒãæ±ããŠãã ããã
ä»ããåãã¹ãå ŽåãåŸ ã€ã¹ãå Žåããã©ã°ã€ã³è©äŸ¡ãç¶ããå Žå
ã¢ããªã±ãŒã·ã§ã³ã«å®å®ãããšã³ããªãŒãã€ã³ãã1ã€ããã倿ãã¹ãäºé ããããå®å šã«ã¬ãã¥ãŒã§ãã代衚çãªã±ãŒã¹ã5ä»¶çšæã§ãããªããä»ããå§ãã䟡å€ããããŸãã ããã³ããç§»è¡ãã¢ãã«å€æŽãæ¯ãåãããªã·ãŒã®æ¹å®ãããŒã«å€æŽã¯ãå ·äœçãªå€æŽååŸãæ¯èŒã§ããããé©ããŠããŸãã
ã©ã³ããŒããæ¬çªããžãã¯ãå®å šã«åŒã³åºããªããªãããã£ããåŸ ã€ã¹ãã§ãã ãŸããããŒã¿ããŒã¹ãžã®æžã蟌ã¿ãå€éšãžã®ã¡ãã»ãŒãžãç Žå£çãªããŒã«ã倿Žå¯èœãªå€éšç¶æ ãåé¢ããŠãã ãããå ¥åãæ¡ç¹æ¹æ³ãæ¿èªã§ããæ åœè ãããªãå ŽåãåŸ ã€å¿ èŠããããŸãã誀ã£ã課é¡ã枬ã£ãŠããè©äŸ¡ã¯ãå®è¡åæ°ãå¢ãããŠãæ¹åããŸããã
Claude Codeãã©ã°ã€ã³ã«äŸ¡å€ããããã確ãããããªããå°çšã®ãã©ã°ã€ã³è©äŸ¡ã䜿ãç¶ããŠãã ããã ãã®ã¯ãŒã¯ãããŒã¯ããã©ã°ã€ã³ãããšãã©ã°ã€ã³ãªãã®ã»ãã·ã§ã³ãæ¯èŒããããã«èšèšãããŠããŸããåœãµã€ãã®Claude Codeãã©ã°ã€ã³ãè©äŸ¡ã§ãã¹ãããã¬ã€ãã§ã¯ããã®å°çšã®æ¯èŒæ¹æ³ã解説ããŠããŸããã¢ããªã±ãŒã·ã§ã³ã®build-evalã¯ã¢ããªã®ãšã³ããªãŒãã€ã³ããè©äŸ¡ãããã®ã§ããããã©ã°ã€ã³çšã®æ¯èŒãäžè¬çãªãã³ãããŒã¯ã«çœ®ãæãããã®ã§ã¯ãããŸããã
ä¿¡é Œã§ããã©ã³ããŒãšæ¡ç¹åŠçãæ¢ã«ãããªãã圱é¿ã¯ãããŸããã ãã®ãŸãŸåå©çšããŠãã ãããå ¬éå®è£ ã§ããæ¢åã®éšåãæ°ãããã¬ãŒã ã¯ãŒã¯ã§çœ®ãæããã®ã§ã¯ãªãã調æŽããŠäœ¿ãããšãæç¢ºã«åªå ããŠããŸããæ°ãããã¹ãåºç€ãããæ¿èªæé ã䜿çšéã®ååŸãhillclimbã®ã«ãŒãã ãã圹ç«ã€å ŽåããããŸãã
é倧è©äŸ¡ãããŠããç¹
ãã®ã¯ãŒã¯ãããŒã¯æºåã®æéãæžãããŸãããè©äŸ¡ãèªåã客芳çãç¡æã«ãããã®ã§ã¯ãããŸããã Claudeã¯ã±ãŒã¹ãææ¡ã§ããŸãããæ¬çªã代衚ããŠãããã倿ããã®ã¯äººã§ããæ¡ç¹æ¹æ³ãææ¡ã§ããŸãããæ£è§£äŸãåæ Œã«ããç¡åçãäžåæ Œã«ããã¢ãã«ãžã£ããžãæ£ããããæäœãè©äŸ¡ããŠããªãããã人ã確ãããå¿ èŠããããŸãã
hillclimbingãç¡æã®æé©åæ©èœã§ã¯ãããŸãããè€æ°ã®åè£ãæå³çã«å®è¡ãã倱æãèªã¿ãããããææ¡ããŠãåã³è©äŸ¡ããŸããããŒã«ãã¢ãŠãåå²ã¯ç¹å®ã®éåŠç¿ãé²ããŸãããååãªã±ãŒã¹æ°ãšååŸ©åæ°ãæ¯åºäžéãå¿ èŠãªããšã¯å€ãããŸããã
ã¬ããŒããæ ¹æ ã«ãªãã®ã¯ãåè¡ã®ããŒã¿ãæã£ãŠããå Žåã ãã§ãã空ã®usageãã£ãŒã«ãã䞊ã¶çŸããreport.htmlã§ã¯ãè²»çšã®åãã«çããããŸãããä»®å®ããããŒã¯ã³æ°ããç®åºããç·é¡ãåãã§ããæåãã€ãããã宿œããåã«æç€ºã§ããå
å®ãªææç©ã¯ãå®è¡èšç»ãšææ°ã®æé衚ã§ããã宿ž¬ç·é¡ã¯ç©ºæ¬ã®ãŸãŸã«ããŠããã¹ãã§ãã
æææ¥ã«å®è¡ããããš
ãè©äŸ¡ãäœãããšããééã®ãªãæç€ºã§ã¯ãªããç¯å²ãéå®ãããã€ãããã1äººã®æ åœè ã«ä»»ããŸãã æææ¥ã«ãæ¢åã®ãµããŒãã«ãŒã¿ãŒã®ãšã³ããªãŒãã€ã³ããéžã³ãäžèšã®5ä»¶ã®åæãã±ãããäœæããåºå®ã©ãã«ãå€å®ããããã°ã©ã æ¡ç¹ãçšæããŸããå ¥åãšæåŸ ããæ¯ãåãå ã¯ããµããŒãããªã·ãŒãæ åœããéçšè²¬ä»»è ãšç¢ºèªããŠãã ããã
ãã®åŸãã¢ããªã±ãŒã·ã§ã³ãã¡ããã©5åå®è¡ããæ¿èªãæ±ããŸããresults.jsonlããã¬ãŒã¹1ä»¶ããã¹ãŠã®äœ¿çšéåºåãstop_reason ã確èªããå®éã®ãããã€ããŒæéã§åè¡ãèšç®ããŸãããã®äœæ¥ãçµããŠåããŠã24ã±ãŒã¹ã3åã®å埩ã2åè£ãšããå®è¡åœ¢ç¶ãšãæ¡ç¹ããªãã©ã€ãhillclimbã®äžéãææ¡ããŸãã
å€æåºæºã¯æå¿«ã§ããå®å šãªãã€ããã䜿çšéããªããã°ãå šäœå®è¡ã®äºç®ã¯æ¿èªããŸããã
- å ¬éæ¥
- ã«ããŽãªãŒ
- Build
- èšèª








