{"id":35852,"date":"2025-10-15T09:09:52","date_gmt":"2025-10-15T00:09:52","guid":{"rendered":"https:\/\/uxdaystokyo.com\/articles\/?post_type=glossary&#038;p=35852"},"modified":"2025-10-15T09:09:52","modified_gmt":"2025-10-15T00:09:52","slug":"mixture-of-experts","status":"publish","type":"glossary","link":"https:\/\/uxdaystokyo.com\/articles\/glossary\/mixture-of-experts\/","title":{"rendered":"MoE"},"content":{"rendered":"<p>Mixture of Experts\uff08\u5c02\u9580\u5bb6\u6df7\u5408\u30e2\u30c7\u30eb\uff09\u3068\u306f\u3001\u8907\u6570\u306e\u7570\u306a\u308b\u300c\u5c02\u9580\u5bb6\u30e2\u30c7\u30eb\uff08Expert\uff09\u300d\u3092\u7d44\u307f\u5408\u308f\u305b\u3001\u305d\u308c\u305e\u308c\u304c\u5f97\u610f\u5206\u91ce\u306e\u30bf\u30b9\u30af\u3092\u62c5\u5f53\u3059\u308b\u3053\u3068\u3067\u3001\u5168\u4f53\u3068\u3057\u3066\u9ad8\u3044\u6027\u80fd\u3068\u52b9\u7387\u3092\u5b9f\u73fe\u3059\u308bAI\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u3067\u3042\u308b\u3002<\/p>\n<p>\u5404\u5c02\u9580\u5bb6\uff08Expert\uff09\u306f\u30cb\u30e5\u30fc\u30e9\u30eb\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u306e\u4e00\u90e8\u3068\u3057\u3066\u5b58\u5728\u3057\u3001\u5165\u529b\u30c7\u30fc\u30bf\u306e\u5185\u5bb9\u306b\u5fdc\u3058\u3066\u300c\u3069\u306e\u5c02\u9580\u5bb6\u3092\u4f7f\u3046\u304b\u300d\u3092\u5236\u5fa1\u3059\u308b\u300c\u30b2\u30fc\u30c6\u30a3\u30f3\u30b0\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\uff08Gating Network\uff09\u300d\u304c\u9078\u629e\u3092\u884c\u3046\u3002<\/p>\n<ul>\n<li data-start=\"2355\" data-end=\"2466\">\n<p data-start=\"2357\" data-end=\"2466\"><strong data-start=\"2357\" data-end=\"2372\">\u30ab\u30b9\u30bf\u30de\u30fc\u30b5\u30dd\u30fc\u30c8AI<\/strong><br data-start=\"2372\" data-end=\"2375\" \/>\u3000FAQ\u56de\u7b54\u3001\u611f\u60c5\u5206\u6790\u3001\u5546\u54c1\u63d0\u6848\u306a\u3069\u3092\u62c5\u5f53\u3059\u308b\u300c\u5c02\u9580AI\u300d\u3092\u5206\u3051\u3066\u8a2d\u8a08\u3057\u3001\u6587\u8108\u306b\u5fdc\u3058\u3066\u5207\u66ff\u3048\u308b\u3002<br data-start=\"2423\" data-end=\"2426\" \/>\u3000\u2192 \u5229\u7528\u8005\u306f\u4e00\u3064\u306e\u30c1\u30e3\u30c3\u30c8\u4f53\u9a13\u3060\u304c\u3001\u88cf\u3067\u306f\u8907\u6570\u306e\u5c02\u9580\u5bb6AI\u304c\u9023\u643a\u3057\u3066\u3044\u308b\u3002<\/p>\n<\/li>\n<li data-start=\"2468\" data-end=\"2571\">\n<p data-start=\"2470\" data-end=\"2571\"><strong data-start=\"2470\" data-end=\"2483\">\u30c7\u30b6\u30a4\u30f3\u652f\u63f4\u30c4\u30fc\u30eb<\/strong><br data-start=\"2483\" data-end=\"2486\" \/>\u3000\u300c\u30c6\u30ad\u30b9\u30c8\u2192\u30ec\u30a4\u30a2\u30a6\u30c8\u751f\u6210\u300d\u300c\u8272\u5f69\u63d0\u6848\u300d\u300c\u6587\u4f53\u8abf\u6574\u300d\u306a\u3069\u306e\u5c02\u9580AI\u3092MoE\u69cb\u9020\u3067\u7d44\u307f\u5408\u308f\u305b\u308b\u3002<br data-start=\"2534\" data-end=\"2537\" \/>\u3000\u2192 \u30c7\u30b6\u30a4\u30ca\u30fc\u306f\u76ee\u7684\u306b\u96c6\u4e2d\u3057\u3064\u3064\u3001AI\u304c\u9069\u5207\u306b\u5206\u62c5\u51e6\u7406\u3092\u884c\u3046\u3002<\/p>\n<\/li>\n<\/ul>\n<h2 data-start=\"397\" data-end=\"411\">\u63d0\u5531\u8005\u3068\u8d77\u6e90<\/h2>\n<p data-start=\"413\" data-end=\"668\">Mixture of Experts \u306e\u6982\u5ff5\u306f\u3001<strong data-start=\"437\" data-end=\"468\">Geoffrey Hinton\uff08\u30b8\u30a7\u30d5\u30ea\u30fc\u30fb\u30d2\u30f3\u30c8\u30f3\uff09<\/strong>\u3001<strong data-start=\"469\" data-end=\"502\">Michael I. Jordan\uff08\u30de\u30a4\u30b1\u30eb\u30fb\u30b8\u30e7\u30fc\u30c0\u30f3\uff09<\/strong>\u3001**Robert A. Jacobs\uff08\u30ed\u30d0\u30fc\u30c8\u30fb\u30b8\u30a7\u30a4\u30b3\u30d6\u30b9\uff09**\u3089\u306b\u3088\u3063\u30661990\u5e74\u4ee3\u521d\u982d\u306b\u63d0\u5531\u3055\u308c\u305f\u3002<br data-start=\"556\" data-end=\"559\" \/>\u7279\u306b\u30011991\u5e74\u306e\u8ad6\u6587 <em data-start=\"571\" data-end=\"609\">\u201cAdaptive Mixtures of Local Experts\u201d<\/em>\uff08Neural Computation\u8a8c\uff09\u3067\u4f53\u7cfb\u7684\u306b\u7d39\u4ecb\u3055\u308c\u3001\u73fe\u5728\u306e\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\uff08LLM\uff09\u306b\u3082\u5fdc\u7528\u3055\u308c\u3066\u3044\u308b\u3002<\/p>\n<h2 data-start=\"1415\" data-end=\"1437\">\u30c7\u30b6\u30a4\u30f3\uff0f\u30d7\u30ed\u30c0\u30af\u30c8\u3067\u306e\u5fdc\u7528<\/h2>\n<p data-start=\"1439\" data-end=\"1562\">Mixture of Experts \u306e\u8003\u3048\u65b9\u306f\u3001AI\u30e2\u30c7\u30eb\u8a2d\u8a08\u3060\u3051\u3067\u306a\u304f\u300c\u4f53\u9a13\u30c7\u30b6\u30a4\u30f3\u300d\u3084\u300c\u60c5\u5831\u69cb\u9020\u8a2d\u8a08\u300d\u306b\u3082\u5fdc\u7528\u3067\u304d\u308b\u3002<br data-start=\"1501\" data-end=\"1504\" \/>AI\u3084UX\u306e\u89b3\u70b9\u3067\u306f\u3001\u300c\u4e00\u4eba\u306e\u4e07\u80fd\u30a8\u30fc\u30b8\u30a7\u30f3\u30c8\u3067\u306f\u306a\u304f\u3001\u5c02\u9580\u5bb6\u305f\u3061\u304c\u5354\u8abf\u3059\u308b\u69cb\u9020\u300d\u3068\u3057\u3066\u7406\u89e3\u3059\u308b\u3068\u5b9f\u8df5\u7684\u3067\u3042\u308b\u3002<\/p>\n<h3 data-start=\"1564\" data-end=\"1580\">\u30c7\u30b6\u30a4\u30f3\u4e0a\u306e\u6d3b\u7528\u65b9\u6cd5<\/h3>\n<ol data-start=\"1582\" data-end=\"1898\">\n<li data-start=\"1582\" data-end=\"1713\">\n<p data-start=\"1585\" data-end=\"1713\"><strong data-start=\"1585\" data-end=\"1601\">\u5c02\u9580\u30e2\u30b8\u30e5\u30fc\u30eb\u306e\u5206\u696d\u8a2d\u8a08<\/strong><br data-start=\"1601\" data-end=\"1604\" \/>\u3000\u30e6\u30fc\u30b6\u30fc\u304c\u884c\u3046\u8907\u96d1\u306a\u30bf\u30b9\u30af\u3092\u3001\u7570\u306a\u308bAI\u30a8\u30fc\u30b8\u30a7\u30f3\u30c8\u3084\u30e2\u30b8\u30e5\u30fc\u30eb\u304c\u5206\u62c5\u3057\u3066\u652f\u63f4\u3059\u308b\u8a2d\u8a08\u304c\u53ef\u80fd\u3067\u3042\u308b\u3002<br data-start=\"1655\" data-end=\"1658\" \/>\u3000\u4f8b\uff1a\u30c6\u30ad\u30b9\u30c8\u751f\u6210AI\u3068\u753b\u50cf\u751f\u6210AI\u3092\u9023\u643a\u3055\u305b\u3001\u30d7\u30ed\u30f3\u30d7\u30c8\u2192\u30d3\u30b8\u30e5\u30a2\u30eb\u5316\u2192\u4fee\u6b63\u306e\u4e00\u9023\u306e\u6d41\u308c\u3092\u7d71\u5408\u3059\u308bUX\u3002<\/p>\n<\/li>\n<li data-start=\"1715\" data-end=\"1830\">\n<p data-start=\"1718\" data-end=\"1830\"><strong data-start=\"1718\" data-end=\"1736\">\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306b\u5fdc\u3058\u305fAI\u9078\u629e<\/strong><br data-start=\"1736\" data-end=\"1739\" \/>\u3000\u30e6\u30fc\u30b6\u30fc\u306e\u64cd\u4f5c\u3084\u6587\u8108\u306b\u5fdc\u3058\u3066\u3001\u7570\u306a\u308bAI\u3092\u30d0\u30c3\u30af\u30a8\u30f3\u30c9\u3067\u5207\u308a\u66ff\u3048\u308b\u3002<br data-start=\"1774\" data-end=\"1777\" \/>\u3000\u4f8b\uff1a\u88fd\u9020\u73fe\u5834\u3067\u306f\u4e0d\u826f\u691c\u51faAI\u3001\u54c1\u8cea\u4e88\u6e2cAI\u3001\u5728\u5eab\u6700\u9069\u5316AI\u304c\u4e26\u5b58\u3057\u3001\u72b6\u6cc1\u306b\u5fdc\u3058\u3066\u6700\u9069\u306a\u30e2\u30c7\u30eb\u3092\u9078\u629e\u3002<\/p>\n<\/li>\n<li data-start=\"1832\" data-end=\"1898\">\n<p data-start=\"1835\" data-end=\"1898\"><strong data-start=\"1835\" data-end=\"1847\">AI\u306e\u900f\u660e\u6027\u8a2d\u8a08<\/strong><br data-start=\"1847\" data-end=\"1850\" \/>\u3000\u3069\u306e\u300c\u5c02\u9580\u5bb6\u300d\u304c\u5224\u65ad\u3057\u305f\u306e\u304b\u3092\u53ef\u8996\u5316\u3059\u308b\u3053\u3068\u3067\u3001\u4fe1\u983c\u6027\u3092\u9ad8\u3081\u308b\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u8a2d\u8a08\u304c\u53ef\u80fd\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>\u5177\u4f53\u7684\u306a\u4e8b\u4f8b<\/h2>\n<table>\n<thead>\n<tr>\n<th>\u5206\u91ce<\/th>\n<th>MoE\u6d3b\u7528\u306e\u4f8b<\/th>\n<th>\u30c7\u30b6\u30a4\u30f3\u7684\u89b3\u70b9<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>Google Gemini 1.5<\/strong><\/td>\n<td>100\u4ee5\u4e0a\u306e\u5c02\u9580\u30e2\u30c7\u30eb\u3092\u30bf\u30b9\u30af\u306b\u5fdc\u3058\u3066\u52d5\u7684\u306b\u5207\u66ff\u3002<\/td>\n<td>\u8907\u6570\u5c02\u9580AI\u306e\u5354\u50cd\u3092\u96a0\u3059\u4e00\u8cab\u3057\u305fUX\u3002<\/td>\n<\/tr>\n<tr>\n<td><strong>Mistral \u201cMixtral 8\u00d77B\u201d<\/strong><\/td>\n<td>8\u3064\u306e\u5c02\u9580\u5bb6\u30e2\u30c7\u30eb\u306e\u3046\u30612\u3064\u306e\u307f\u3092\u540c\u6642\u4f7f\u7528\u3057\u3001\u7701\u96fb\u529b\u5316\u3002<\/td>\n<td>\u9ad8\u901f\u5fdc\u7b54\u3068\u5c02\u9580\u7cbe\u5ea6\u306e\u4e21\u7acb\u8a2d\u8a08\u3002<\/td>\n<\/tr>\n<tr>\n<td><strong>\u533b\u7642AI\u30a2\u30b7\u30b9\u30bf\u30f3\u30c8<\/strong><\/td>\n<td>\u653e\u5c04\u7dda\u753b\u50cf\u30fb\u8840\u6db2\u691c\u67fb\u30fb\u30ab\u30eb\u30c6\u8981\u7d04\u306a\u3069\u3092\u5225\u30e2\u30c7\u30eb\u3067\u5206\u62c5\u3002<\/td>\n<td>\u533b\u5e2b\u306e\u5224\u65ad\u30d5\u30ed\u30fc\u306b\u5bc4\u308a\u6dfb\u3046UI\u8a2d\u8a08\u3002<\/td>\n<\/tr>\n<tr>\n<td><strong>\u6559\u80b2\u7cfbAI\u30c1\u30e5\u30fc\u30bf\u30fc<\/strong><\/td>\n<td>\u6570\u5b66\u30fb\u4f5c\u6587\u30fb\u82f1\u8a9e\u306e\u5404\u5206\u91ceAI\u3092\u7d71\u5408\u3002<\/td>\n<td>\u5b66\u7fd2\u8005\u306e\u5f31\u70b9\u306b\u5408\u308f\u305b\u305f\u500b\u5225\u6700\u9069UX\u3002<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2 data-start=\"413\" data-end=\"668\">\u95a2\u9023\u7528\u8a9e<\/h2>\n<ul>\n<li>Neural Network\uff08\u30cb\u30e5\u30fc\u30e9\u30eb\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\uff09 \u4eba\u5de5\u77e5\u80fd\u306e\u57fa\u672c\u69cb\u9020\u3002\u8133\u306e\u795e\u7d4c\u7d30\u80de\u3092\u6a21\u5023\u3002 MoE\u306e\u57fa\u76e4\u69cb\u9020\u3068\u306a\u308b<\/li>\n<li>Gating Network\uff08\u30b2\u30fc\u30c6\u30a3\u30f3\u30b0\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\uff09 \u5165\u529b\u306b\u5fdc\u3058\u3066\u3001\u3069\u306e\u5c02\u9580\u5bb6\u3092\u4f7f\u3046\u304b\u9078\u629e\u3059\u308b\u5236\u5fa1\u90e8\u5206\u3002 MoE\u306e\u4e2d\u6838<\/li>\n<li>Sparse Activation\uff08\u30b9\u30d1\u30fc\u30b9\u6d3b\u6027\u5316\uff09 \u3059\u3079\u3066\u306e\u5c02\u9580\u5bb6\u3067\u306f\u306a\u304f\u3001\u4e00\u90e8\u306e\u307f\u3092\u6d3b\u6027\u5316\u3059\u308b\u8a2d\u8a08\u3002 \u8a08\u7b97\u52b9\u7387\u5411\u4e0a\u306e\u9375<\/li>\n<li>Transformer\uff08\u30c8\u30e9\u30f3\u30b9\u30d5\u30a9\u30fc\u30de\u30fc\uff09 \u73fe\u5728\u306eLLM\u306e\u4e3b\u8981\u69cb\u9020\u3002MoE\u3068\u7d44\u307f\u5408\u308f\u305b\u3066\u6027\u80fd\u5411\u4e0a\u304c\u53ef\u80fd\u3002 Google\u3084OpenAI\u304c\u63a1\u7528<\/li>\n<li>Mixture of Experts LLM\uff08MoE-LLM\uff09 MoE\u69cb\u9020\u3092\u6301\u3064\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\u3002\u4f8b\uff1aGemini 1.5\u3001Mixtral\u306a\u3069\u3002 \u5b9f\u7528\u6bb5\u968e\u306e\u6280\u8853<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>\u8907\u6570\u306e\u7570\u306a\u308b\u300c\u5c02\u9580\u5bb6\u30e2\u30c7\u30eb\uff08Expert\uff09\u300d\u3092\u7d44\u307f\u5408\u308f\u305b\u3001\u305d\u308c\u305e\u308c\u304c\u5f97\u610f\u5206\u91ce\u306e\u30bf\u30b9\u30af\u3092\u62c5\u5f53\u3059\u308b\u3053\u3068\u3067\u3001\u5168\u4f53\u3068\u3057\u3066\u9ad8\u3044\u6027\u80fd\u3068\u52b9\u7387\u3092\u5b9f\u73fe\u3059\u308bAI\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3<\/p>\n","protected":false},"author":5,"featured_media":35866,"template":"","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"English":"Mixture of Experts","footnotes":""},"glossary-category":[418],"glossary_tag":[],"class_list":["post-35852","glossary","type-glossary","status-publish","has-post-thumbnail","hentry","glossary-category-technology"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/glossary\/35852","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/glossary"}],"about":[{"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/types\/glossary"}],"author":[{"embeddable":true,"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/users\/5"}],"version-history":[{"count":2,"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/glossary\/35852\/revisions"}],"predecessor-version":[{"id":35854,"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/glossary\/35852\/revisions\/35854"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/media\/35866"}],"wp:attachment":[{"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/media?parent=35852"}],"wp:term":[{"taxonomy":"glossary-category","embeddable":true,"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/glossary-category?post=35852"},{"taxonomy":"glossary_tag","embeddable":true,"href":"https:\/\/uxdaystokyo.com\/articles\/wp-json\/wp\/v2\/glossary_tag?post=35852"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}