¼Ì¿¿ ºòº£¡¢ÆüËܤǤϡ¢Ê£¿ô¤Î´ë¶È¤¬Æȼ«¤ËÆüËܸì¤ÎLLM¡ÊÂ絬ÌϸÀ¸ì¥â¥Ç¥ë¡Ë¤Î³«È¯¤Ë¼è¤êÁȤó¤Ç¤¤¤Þ¤¹¡£
¤·¤«¤·¡¢2Ãû¥È¡¼¥¯¥ó¤â¤Î¥Æ¥¥¹¥È¤Ç³Ø½¬¤µ¤ì¤¿Meta Platforms, Inc.¡Ê°Ê²¼¡¢Meta¡Ë¤ÎLLM¡ÖLlama 2¡×¤Ê¤É¤ÈÈæ³Ó¤¹¤ë¤È¡¢¤Þ¤À¤Þ¤À¾®µ¬ÌϤʤâ¤Î¤Ëα¤Þ¤Ã¤Æ¤¤¤ë¤Î¤¬¸½¾õ¤Ç¤¹¡£
¤½¤ÎÇطʤˤϡ¢·×»»¥ê¥½¡¼¥¹¤ÎÉÔ¤䡢ÆüËܸì¤ÇÍøÍѤǤ¤ë¥Æ¥¥¹¥È¥Ç¡¼¥¿¤Î¾¯¤Ê¤µ¤Ê¤É¤¬¤¢¤ê¤Þ¤¹¡£¤Þ¤¿¡¢°ì¤«¤éLLM¤Î»öÁ°³Ø½¬¤ò¹Ô¤¦¤Ë¤ÏËÄÂç¤Ê¥³¥¹¥È¤¬¤«¤«¤ë¤¿¤á¡¢¸¦µæ¤ò¹Ô¤¨¤Æ¤¤¤ë¤Î¤Ï°ìÉô¤ÎÂç´ë¶È¤ä¸¦µæµ¡´Ø¤Î¤ß¤È¤Ê¤Ã¤Æ¤¤¤Þ¤¹¡£
¤½¤ó¤Ê¤Ê¤«ÅìµþÂç³Ø¾¾Èø¸¦µæ¼¼È¯¡¦AI¥¹¥¿¡¼¥È¥¢¥Ã¥×¤Î³ô¼°²ñ¼ÒELYZA¡Ê°Ê²¼¡¢ELYZA¡Ë¤Ï¡¢¡ÖLlama 2¡×¤ËÂФ·ÆüËܸì¤Ë¤è¤ëÄɲûöÁ°³Ø½¬¤ò¹Ô¤¤¡¢¾¦ÍÑÍøÍѲÄǽ¤Ê70²¯¥Ñ¥é¥á¡¼¥¿¤ÎÆüËܸìLLM¡ÖELYZA-japanese-Llama-2-7b¡×¤ò³«È¯¤·¡¢°ìÈ̸ø³«¤·¤Þ¤·¤¿¡£
±Ñ¸ì¥Ù¡¼¥¹¤ÎÂ絬ÌϸÀ¸ì¥â¥Ç¥ë¡ÖLlama 2¡×¡ÖLlama 2¡×¤Ï¡¢2023ǯ7·î18Æü¤ËMeta¤¬¸ø³«¤·¤¿±Ñ¸ì¥Ù¡¼¥¹¤ÎÂ絬ÌϸÀ¸ì¥â¥Ç¥ë¡£Àè¤Ë¸ø³«¤µ¤ì¤¿¡ÖLLaMA¡×¤¬¸¦µæÍÑÅӤ˸ÂÄꤵ¤ì¤Æ¤¤¤¿¤Î¤ËÂФ·¡¢¡ÖLlama 2¡×¤Ï¾¦ÍÑÍøÍѤ¬²Äǽ¤Ç¤¹¡£
¸ø³«¤µ¤ì¤Æ¤¤¤ë¥â¥Ç¥ë¤È¤·¤Æ¤ÏÈó¾ï¤ËÀǽ¤¬¹â¤¤¤³¤È¤«¤é¡¢OpenAI¤Î¡ÖGPT-4¡×¤äGoogle¤Î¡ÖPaLM¡×¤Ê¤É¤Î¥¯¥í¡¼¥º¥É¤ÊLLM¤È¶¥¹ç¤¹¤ë·Á¤Ç¡¢±Ñ¸ì·÷¤Ç¤Ï¤¹¤Ç¤Ë¥ª¡¼¥×¥ó¥â¥Ç¥ë¤Î¥Ç¥Õ¥¡¥¯¥È¥¹¥¿¥ó¥À¡¼¥É¤È¤Ê¤ê¤Ä¤Ä¤¢¤ê¤Þ¤¹¡£
¥µ¥¤¥º¤Ï70²¯¡¢130²¯¡¢700²¯¤Î3¼ïÎà¡£¤¤¤º¤ì¤Î¥â¥Ç¥ë¤â¶µ»Õ¤¢¤ê¥Õ¥¡¥¤¥ó¥Á¥å¡¼¥Ë¥ó¥°¡ÊSupervised Fine-Tuning¡¢SFT¡Ë¤ª¤è¤Ó¡¢¿Í´Ö¤«¤é¤Î¥Õ¥£¡¼¥É¥Ð¥Ã¥¯¤Ë´ð¤Å¤¤¤¿¶¯²½³Ø½¬¡ÊReinforcement Learning from Human Feedback¡¢RLHF¡Ë¤ò»Ü¤·¤¿chat¥â¥Ç¥ë¤òƱ»þ¤Ë¸ø³«¤·¤Æ¤¤¤Þ¤¹¡£
¾¦ÍÑÍøÍѲÄǽ¤Ê70²¯¥Ñ¥é¥á¡¼¥¿¤ÎÆüËܸìLLMº£²ó°ìÈ̸ø³«¤µ¤ì¤¿¡ÖELYZA-japanese-Llama-2-7b¡×¤Ï¡¢¡ÖLlama 2¡×¤ÎºÇ¤â¾®¤µ¤¤¥µ¥¤¥º¤Ç¤¢¤ë70²¯¥Ñ¥é¥á¡¼¥¿¤Î¥â¥Ç¥ë¤ò¥Ù¡¼¥¹¤Ë¡¢Ìó180²¯¥È¡¼¥¯¥ó¤ÎÆüËܸì¥Æ¥¥¹¥È¤ÇÄɲûöÁ°³Ø½¬¤ò¹Ô¤Ã¤¿¥â¥Ç¥ë¤Ç¤¹¡£
ELYZAÆȼ«¤Î»ö¸å³Ø½¬¤ò»Ü¤·¤¿¡ÖELYZA-japanese-Llama-2-7b-instruct¡×¤ä¡¢ÆüËܸì¤Î¸ì×ÃÄɲäˤè¤ê¹â®²½¤ò¹Ô¤Ã¤¿¡ÖELYZA-japanese-Llama-2-7b-fast-instruct¡×¤Ê¤É¡¢Ê£¿ô¤Î¥Ð¥ê¥¨¡¼¥·¥ç¥ó¤òÍÑ°Õ¤·¤Æ¤¤¤Þ¤¹¡£
Ʊ¥â¥Ç¥ë¤Ï³Ø½¬¤ËOSCAR¤äWikipedia¤Ê¤É¤Ë´Þ¤Þ¤ì¤ëÆüËܸì¥Æ¥¥¹¥È¥Ç¡¼¥¿¤ò³èÍÑ¡£LLAMA 2 Community License¤È¤¤¤¦¥é¥¤¥»¥ó¥¹¤Ë½àµò¤·¤Æ¤ª¤ê¡¢Acceptable Use Policy¤Ë½¾¤¦¸Â¤ê¤Ï¡¢¸¦µæ¤ª¤è¤Ó¾¦¶ÈÌÜŪ¤Ç¤ÎÍøÍѤ¬²Äǽ¤Ç¤¹¡£
ELYZAÆȼ«ºîÀ®¤ÎÀǽɾ²Á¤Î·ë²Ì¡¢1750²¯¥Ñ¥é¥á¡¼¥¿¤òͤ¹¤ë¡ÖGPT-3.5¡Êtext-davinci-003¡Ë¡×¤ËɤŨ¤¹¤ë¥¹¥³¥¢¤¬»»½Ð¤µ¤ì¤Æ¤ª¤ê¡¢ÆüËܸì¤Î¸ø³«¥â¥Ç¥ë¤Î¤Ê¤«¤Ç¤Ï¹â¤¤Àǽ¤ò¸Ø¤Ã¤Æ¤¤¤Þ¤¹¡£
¼ÂºÝ¤Ë¥Ç¥â¤ò»ÈÍѤ·¤Æ¤ß¤¿¼ÂºÝ¤Ë¡ÖELYZA-japanese-Llama-2-7b¡×¡ÊELYZA-japanese-Llama-2-7b-instruct¡Ë¤Î¥Ç¥â¤òÍøÍѤ·¤Æ¤ß¤¿ÍͻҤò¾Ò²ð¤·¤Þ¤¹¡£
¡Ö²ñ¼Ò¤ÇAI¤ò»È¤¦¥á¥ê¥Ã¥È¤È¥Ç¥á¥ê¥Ã¥È¤ò¶µ¤¨¤Æ¡×¤ÈÆþÎϤ·¤¿¤È¤³¤í¡¢¿ôÉøå¤ËAI¤ÎƳÆþ¤Ë¤è¤ë²ñ¼Ò¤Ç¤Î¥á¥ê¥Ã¥È¤È¥Ç¥á¥ê¥Ã¥È¤Ë´Ø¤¹¤ë¾ðÊó¤¬É½¼¨¤µ¤ì¤Þ¤·¤¿¡£
³¤¤¤Æ¡ÖAI¤Î²ÄǽÀ¤Ë¤Ä¤¤¤Æ¶µ¤¨¤Æ¡×¤È¤ä¤äÃê¾ÝŪ¤Ê¼ÁÌ䤷¤¿¤È¤³¤í¡¢AI¤Î²ÄǽÀ¤Ë10¹àÌܤβóÅú¤¬Ê֤äƤ¤Þ¤·¤¿¡£ÉÔ¼«Á³¤Êɽ¸½¤ä½ÅÊ£²Õ½ê¤¬¤Ê¤¯¡¢¼«Á³¤Êʸ¾Ï¤¬À¸À®¤µ¤ì¤Æ¤¤¤ë¤³¤È¤¬¤¦¤«¤¬¤¨¤Þ¤¹¡£
º£²ó¤Î¡ÖELYZA-japanese-Llama-2-7b¡×¤Ï¡ÖLlama 2¡×¤ÎºÇ¤â¾®¤µ¤¤¥µ¥¤¥º¤Ç¤¢¤ë70²¯¥Ñ¥é¥á¡¼¥¿¤Î¥â¥Ç¥ë¤ò¥Ù¡¼¥¹¤Ë³«È¯¤·¤¿¤â¤Î¤Ç¤¹¤¬¡¢ELYZA¤Ï¤¹¤Ç¤Ë130²¯¡¢700²¯¥Ñ¥é¥á¡¼¥¿¤Î¥â¥Ç¥ë¤Î³«È¯¤Ë¤âÃå¼ê¤·¤Æ¤¤¤ë¤È¤Î¤³¤È¤Ç¤¹¡£º£¸å¡¢¤è¤ê¥Ñ¥ï¡¼¥¢¥Ã¥×¤·¤¿¥â¥Ç¥ë¤Î¸ø³«¤Ë´üÂÔ¤·¤¿¤¤¤È¤³¤í¤Ç¤¹¡£
»²¹Í¸µ¡§https://prtimes.jp/main/html/rd/p/000000034.000047565.html
¡ÖELYZA-japanese-Llama-2-7b-instruct¡×¥Ç¥â¡§https://huggingface.co/spaces/elyza/ELYZA-japanese-Llama-2-7b-instruct-demo
¡ÖELYZA-japanese-Llama-2-7b-fast-instruct¡×¥Ç¥â¡§https://huggingface.co/spaces/elyza/ELYZA-japanese-Llama-2-7b-fast-instruct-demo
¡Êʸ¡¦Haruka Isobe¡Ë