0
2024ǯ06·î16Æü 08:01 ITmedia NEWS
¡¡ÊÆNVIDIA¤Ï6·î14Æü¡Ê¸½ÃÏ»þ´Ö¡Ë¡¢LLM¤Î¥È¥ì¡¼¥Ë¥ó¥°ÍÑ¥ª¡¼¥×¥ó¹çÀ®¥Ç¡¼¥¿À¸À®¥â¥Ç¥ë¥·¥ê¡¼¥º¡ÖNemotron-4 340B¡×¤òȯɽ¤·¤¿¡£Æȼ«¤Î¥ª¡¼¥×¥ó¥â¥Ç¥ë¥é¥¤¥»¥ó¥¹¡ÊPDF¡Ë¤Î²¼¡¢¡Ö¤¢¤é¤æ¤ë¶È³¦¤Î¾¦ÍÑ¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¸þ¤±LLM¡×¤Î¥È¥ì¡¼¥Ë¥ó¥°¤Ë»È¤¦¥Ç¡¼¥¿¥»¥Ã¥È¤ò¹çÀ®¤Ç¤¤ë¤È¤·¤Æ¤¤¤ë¡£¤Ä¤Þ¤ê¡¢¾¦ÍÑÍøÍѤâ²Äǽ¤À¡£
¡¡LLM¤Î³«È¯¤Ç¤Ï¡¢¹âÉʼÁ¤Ç¿Íͤʥǡ¼¥¿¥»¥Ã¥È¤Ç¤Î¥È¥ì¡¼¥Ë¥ó¥°¤¬ÉԲķç¤À¤¬¡¢¥Í¥Ã¥È¤Ê¤É¤«¤é¼ý½¸¤·¤¿¥Ç¡¼¥¿¤Ë¤ÏÊФê¤äÉÔÀµ³Î¤Ê¤â¤Î¤¬´Þ¤Þ¤ì¤ë²ÄǽÀ¤¬¤¢¤ê¡¢Î̤ˤâ¸Â¤ê¤¬¤¢¤ë¡£¤½¤Î¤¿¤á¡¢¹çÀ®¥Ç¡¼¥¿¤ÎÀ¸À®¤ËÃíÌܤ¬½¸¤Þ¤Ã¤Æ¤¤¤ë¡£
¡¡Nemotron-4 340B¤Ë¤Ï¡¢¹çÀ®¥Ç¡¼¥¿À¸À®¤Î¥Ñ¥¤¥×¥é¥¤¥ó¤ò·ÁÀ®¤¹¤ëbase¡¢instruct¡¢reward¤Î3¤Ä¤Î¥â¥Ç¥ë¤¬´Þ¤Þ¤ì¤ë¡£base¥â¥Ç¥ë¤Ï¡¢9Ãû¸Ä¤Î¥È¡¼¥¯¤Ç¥È¥ì¡¼¥Ë¥ó¥°¤µ¤ì¤¿¥«¥¹¥¿¥Þ¥¤¥º¤Î´ðÈפȤʤë¥â¥Ç¥ë¡£Æȼ«¥Ç¡¼¥¿¤òÁȤ߹þ¤à¤³¤È¤Ç¡¢¤³¤Î¥â¥Ç¥ë¤ò¥«¥¹¥¿¥Þ¥¤¥º¤Ç¤¤ë¡£instruct¥â¥Ç¥ë¤Ï¡¢¸½¼ÂÀ¤³¦¤Î¥Ç¡¼¥¿¤ÎÆÃÀ¤òÌÏÊ路¤¿Â¿ÍͤʹçÀ®¥Ç¡¼¥¿¤òÀ¸À®¤¹¤ë¤è¤¦À߷פµ¤ì¤Æ¤ª¤ê¡¢¥É¥á¥¤¥ó¸ÇͤιçÀ®¥È¥ì¡¼¥Ë¥ó¥°¥Æ¥¥¹¥È¤òÀ¸À®¤¹¤ë¡£reward¥â¥Ç¥ë¤Ï¡¢À¸À®¤µ¤ì¤¿½ÐÎϤÎÉʼÁ¤òɾ²Á¤¹¤ë¤¿¤á¤Î¥â¥Ç¥ë¡£instruct¤Î½ÐÎϤ¬¡¢ÀßÄꤷ¤¿´ð½à¤È¤É¤ÎÄøÅÙ°ìÃפ·¤Æ¤¤¤ë¤«¤Ë´ð¤Å¤¤¤Æ¥¹¥³¥¢¤òÉÕ¤±¤Æ¹âÉʼÁ¤Î±þÅú¤òÂ¥¿Ê¤·¡¢AI¥·¥¹¥Æ¥à¤Î²þÁ±¤òÂ¥¤¹¡£
¡¡NVIDIA¤Ï¡¢¤³¤Î¥â¥Ç¥ë¤Ï¡Ö8¤Ä¤ÎGPU¤òÈ÷¤¨¤ëñ°ì¤ÎDGX H100¤Ë¼ý¤Þ¤ë¥µ¥¤¥º¤Ë¤Ê¤Ã¤Æ¤¤¤ë¡×¤È¤·¤Æ¤¤¤ë¡£
|
|
¡¡¥â¥Ç¥ë¤Ï¡¢¥ª¡¼¥×¥ó¥½¡¼¥¹¥Õ¥ì¡¼¥à¥ï¡¼¥¯Nvidia NeMo¤ª¤è¤ÓNvidia TensorRT-LLM¥é¥¤¥Ö¥é¥ê¤ò»ÈÍѤ·¤¿¿äÏÀÍѤ˺ÇŬ²½¤µ¤ì¤Æ¤¤¤ë¡£¤¹¤Ù¤Æ¤Î¥Ç¡¼¥¿¤ÏHuggingface¤ÇÆþ¼ê¤Ç¤¤ë¡£
|
|
|
|
Copyright(C) 2024 ITmedia Inc. All rights reserved. µ»ö¡¦¼Ì¿¿¤Î̵ÃÇžºÜ¤ò¶Ø¤¸¤Þ¤¹¡£
·ÇºÜ¾ðÊó¤ÎÃøºî¸¢¤ÏÄ󶡸µ´ë¶È¤Ëµ¢Â°¤·¤Þ¤¹¡£
¡ÖÇÏ·ôÇ㤦¤ä¤Ä¡×ÏÃÂê¤ÎÄ«¿©·ô¡Ê¼Ì¿¿¡§¤Í¤È¤é¤Ü¡Ë111
¡ÖÇÏ·ôÇ㤦¤ä¤Ä¡×ÏÃÂê¤ÎÄ«¿©·ô¡Ê¼Ì¿¿¡§¤Í¤È¤é¤Ü¡Ë111