{"id":1103,"date":"2024-09-12T11:49:40","date_gmt":"2024-09-12T03:49:40","guid":{"rendered":"http:\/\/www.15zhi.net\/blog\/?p=1103"},"modified":"2024-09-12T11:49:40","modified_gmt":"2024-09-12T03:49:40","slug":"202409-%e8%ae%ba%e6%96%87%e7%a0%94%e8%af%bb-examining-inter-consistency-of-large-language-models-collaboration-an-in-depth-analysis-via-debate","status":"publish","type":"post","link":"https:\/\/www.15zhi.net\/blog\/202409-%e8%ae%ba%e6%96%87%e7%a0%94%e8%af%bb-examining-inter-consistency-of-large-language-models-collaboration-an-in-depth-analysis-via-debate\/","title":{"rendered":"202409 \u8bba\u6587\u7814\u8bfb-Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li>\u5355\u4f4d\uff1a\u793e\u4f1a\u8ba1\u7b97\u548c\u4fe1\u606f\u68c0\u7d22\u7814\u7a76\u4e2d\u5fc3\uff0c\u54c8\u5c14\u6ee8\u5de5\u4e1a\u5927\u5b66\uff0c\u65b0\u52a0\u5761\u7ba1\u7406\u5927\u5b66<\/li>\n\n\n\n<li>\u6765\u6e90\uff1aEMNLP<\/li>\n\n\n\n<li>\u5e74\u4efd\uff1a2023<\/li>\n<\/ul>\n\n\n\n<h1 class=\"wp-block-heading\">\u6838\u5fc3\u5185\u5bb9<\/h1>\n\n\n\n<p>\u672c\u6587\u5173\u6ce8\u7684\u662f\u591a\u4e2aLLM\u4e00\u8d77\u8fa9\u8bba\u5e76\u9010\u6e10\u8fbe\u6210\u5171\u8bc6\u7684\u8fc7\u7a0b\u4e2d\u7684\u81ea\u6d3d\u6027\u95ee\u9898\u3002\u4e3a\u4e86\u7814\u7a76\u8fd9\u4e2a\u95ee\u9898\u672c\u6587\u63d0\u51fa\u4e86\u4e00\u4e2a\u53eb\u505a\u6b63\u5f0f\u8ba8\u8bba\u6846\u67b6\uff08FORD\uff09\u6765\u4e3b\u6301\u4e09\u9636\u6bb5\u8ba8\u8bba\u3002\u6700\u7ec8\u53d1\u73b0\uff0c\u5373\u4f7f\u6709\u89c2\u70b9\u76f8\u4e92\u77db\u76fe\uff0cLLM \u4eec\u4e5f\u53ef\u4ee5\u5728\u8ba8\u8bba\u4e2d\u9010\u6e10\u8fbe\u6210\u5171\u8bc6\u3002\u5b9e\u9a8c\u4e2d\u8fd8\u53d1\u73b0\uff0c\u5982\u679c\u5404\u4e2aLLM\u7684\u667a\u5546\u4e0d\u5747\u8861\u7684\u8bdd\uff0c\u9ad8\u667a\u5546LLM\u7684\u610f\u89c1\u5c31\u4f1a\u5360\u636e\u7edf\u6cbb\u5730\u4f4d\u3002\u56e0\u6b64\u53ef\u4ee5\u8003\u8651\u7528\u9ad8\u667a\u5546LLM\u4f5c\u4e3a\u88c1\u5224\u6765\u4e3b\u5bfc\u8ba8\u8bba\uff0c\u8fd9\u6837\u53ef\u4ee5\u83b7\u5f97\u66f4\u597d\u7684\u6548\u679c\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h1 class=\"wp-block-heading\">\u80cc\u666f<\/h1>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5927\u8bed\u8a00\u6a21\u578b\uff08LLM\uff09\u5c55\u73b0\u51fa\u4e86\u5f3a\u5927\u7684\u901a\u7528\u667a\u80fd\uff0c\u5e76\u4e14\u73b0\u5728\u5df2\u7ecf\u88ab\u5e7f\u6cdb\u5e94\u7528\uff1b<\/li>\n\n\n\n<li>\u5f53\u524d\uff0c\u4eba\u4eec\u5df2\u7ecf\u8bad\u7ec3\u51fa\u4e86\u4e13\u95e8\u9488\u5bf9\u5404\u79cd\u4e0b\u6e38\u5b50\u4efb\u52a1\u7684\u5927\u8bed\u8a00\u6a21\u578b\uff1b\u73b0\u5728\u4eba\u4eec\u8bd5\u56fe\u8ba9\u8fd9\u4e9b\u5927\u6a21\u578b\u5f7c\u6b64\u5408\u4f5c\u6765\u89e3\u51b3\u66f4\u52a0\u590d\u6742\u7684\u95ee\u9898\uff1b<\/li>\n\n\n\n<li>\u76ee\u524d\u7edd\u5927\u591a\u6570\u7814\u7a76\u90fd\u5c06\u7126\u70b9\u7f6e\u4e8e\u5355\u4e2a\u5927\u6a21\u578b\u7684\u903b\u8f91\u81ea\u6d3d\u6027\u4e0a\u9762\uff0c\u5c11\u6709\u4eba\u7814\u7a76\u591a\u4e2a\u5927\u6a21\u578b\u4e4b\u95f4\u7684\u903b\u8f91\u81ea\u6d3d\u6027\u3002<\/li>\n<\/ol>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h1 class=\"wp-block-heading\">\u65b9\u6cd5\u8bba<\/h1>\n\n\n\n<h2 class=\"wp-block-heading\">INCON<\/h2>\n\n\n\n<p>INCON \u5373 inconsistency\uff0c\u662f\u8861\u91cf\u4e00\u7ec4\u6a21\u578b\u4e2d\u7684\u4e0d\u81ea\u6d3d\u6027\u7684\u6307\u6807\u3002\u8ba9\u4e00\u7ec4 LLM \u56de\u7b54\u4e00\u7ec4\u95ee\u9898\uff0cLLM \u4eec\u4e0d\u80fd\u8fbe\u6210\u5171\u8bc6\u7684\u95ee\u9898\u5360\u6240\u6709\u95ee\u9898\u7684\u6bd4\u4f8b\u5c31\u662f INCON\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"392\" height=\"112\" src=\"http:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-5.png\" alt=\"\" class=\"wp-image-1104\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-5.png 392w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-5-300x86.png 300w\" sizes=\"auto, (max-width: 392px) 100vw, 392px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"571\" height=\"186\" src=\"http:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-6.png\" alt=\"\" class=\"wp-image-1105\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-6.png 571w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-6-300x98.png 300w\" sizes=\"auto, (max-width: 571px) 100vw, 571px\" \/><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">FORD<\/h2>\n\n\n\n<p>FORD\u5047\u5b9a\u4e86\u8fa9\u8bba\u53cc\u65b9\u548c\u88c1\u5224\u8fd9\u4e09\u4e2aLLM\u5b58\u5728\uff0c\u4e00\u5171\u5305\u542b\u4e09\u6b65\uff1a<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u9009\u8fb9\u7ad9\uff1a\u9488\u5bf9\u6570\u636e\u96c6\u4e2d\u67d0\u4e2a\u95ee\u9898\uff0c\u8fa9\u8bba\u53cc\u65b9\u72ec\u7acb\u56de\u7b54\u5e76\u4e14\u7ed9\u51fa\u7406\u7531\uff1b<\/li>\n\n\n\n<li>\u5927\u8ba8\u8bba\uff1a\u53cc\u65b9\u8f6e\u6d41\u5750\u5e84\uff0c\u4e92\u76f8\u6311\u6218\u5bf9\u65b9\u7684\u89c2\u70b9\uff0c\u76f4\u5230\u4e00\u65b9\u59a5\u534f\u6216\u8fbe\u5230\u6700\u5927\u6b21\u6570\uff1b<\/li>\n\n\n\n<li>\u88c1\u5224\u603b\u7ed3\uff1a\u88c1\u5224\u603b\u7ed3\u8fa9\u8bba\u5185\u5bb9\uff0c\u5f97\u51fa\u6700\u7ec8\u7ed3\u8bba\u3002<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"537\" src=\"http:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-7-1024x537.png\" alt=\"\" class=\"wp-image-1106\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-7-1024x537.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-7-300x157.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-7-768x403.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-7.png 1285w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h1 class=\"wp-block-heading\">\u5b9e\u9a8c<\/h1>\n\n\n\n<p>\u672c\u7814\u7a76\u7ec4\u7ec7\u4e86\u4e09\u8f6e\u5b9e\u9a8c\uff1a<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5e73\u7b49\u8fa9\u8bba\uff1a\u80fd\u529b\u76f8\u4f3c\u7684\u4e24\u4e2a LLM \u8fdb\u884c\u8fa9\u8bba\uff1b<\/li>\n\n\n\n<li>\u4e0d\u5e73\u7b49\u8fa9\u8bba\uff1a\u80fd\u529b\u76f8\u5dee\u60ac\u6b8a\u7684\u4e24\u4e2a LLM \u8fdb\u884c\u8fa9\u8bba\uff1b<\/li>\n\n\n\n<li>\u5706\u684c\u8fa9\u8bba\uff1a\u591a\u4e8e 2 \u4e2a LLM \u53c2\u4e0e\u8fa9\u8bba\uff1b\n<ol class=\"wp-block-list\">\n<li>\u4e09\u4e2a\u80fd\u529b\u76f8\u4f3c\u7684 LLM \u8fdb\u884c\u5706\u684c\u8fa9\u8bba\uff1b<\/li>\n\n\n\n<li>\u4e24\u4e2a\u76f8\u5bf9\u5f31\u548c\u4e00\u4e2a\u76f8\u5bf9\u5f3a\u7684 LLM \u4e00\u8d77\u5706\u684c\u8fa9\u8bba\u3002<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>\u4e09\u7ec4\u5e73\u7b49\u8fa9\u8bba\u5b9e\u9a8c\u7684\u7ed3\u679c\uff08\u52a0\u7c97\u6570\u5b57\u4e3a\u6700\u9ad8\u56de\u7b54\u6b63\u786e\u7387\uff09\uff1a<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"478\" src=\"http:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-8-1024x478.png\" alt=\"\" class=\"wp-image-1107\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-8-1024x478.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-8-300x140.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-8-768x358.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-8.png 1269w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><br><img decoding=\"async\" src=\"Assets\/Pasted_image_\u6b63\u5f0f\u8fa9\u8bba\u6846\u67b6_2024_09_10_1.png\" alt=\"\"><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>\u4e24\u7ec4\u4e0d\u5e73\u7b49\u8fa9\u8bba\u5b9e\u9a8c\u7684\u7ed3\u679c\uff1a<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"622\" height=\"469\" src=\"http:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-9.png\" alt=\"\" class=\"wp-image-1108\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-9.png 622w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-9-300x226.png 300w\" sizes=\"auto, (max-width: 622px) 100vw, 622px\" \/><\/figure>\n\n\n\n<p><br><img decoding=\"async\" src=\"Assets\/Pasted_image_\u6b63\u5f0f\u8fa9\u8bba\u6846\u67b6_2024_09_10_2.png\" alt=\"\"><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>\u4e24\u7ec4\u5706\u684c\u8fa9\u8bba\u548c\u4e0e\u4e4b\u5bf9\u6bd4\u7684\u5355 LLM \u548c\u53cc LLM \u8fa9\u8bba\u7684\u5b9e\u9a8c\u7ed3\u679c\uff1a<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"633\" height=\"500\" src=\"http:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-10.png\" alt=\"\" class=\"wp-image-1109\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-10.png 633w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/09\/image-10-300x237.png 300w\" sizes=\"auto, (max-width: 633px) 100vw, 633px\" \/><\/figure>\n\n\n\n<p><br><img decoding=\"async\" src=\"Assets\/Pasted_image_\u6b63\u5f0f\u8fa9\u8bba\u6846\u67b6_2024_09_10_3.png\" alt=\"\"><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h1 class=\"wp-block-heading\">\u7ed3\u8bba<\/h1>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u540c\u4e00\u4e2a\u57fa\u7840\u6a21\u578b\u5fae\u8c03 (Han \u7b49, 2024) \u5f97\u5230\u7684\u4e0d\u540c\u5927\u6a21\u578b\u5bf9\u540c\u4e00\u4e2a\u95ee\u9898\u4e5f\u4f1a\u6709\u5de8\u5927\u7684\u5206\u6b67\uff1b<\/li>\n\n\n\n<li>LLM \u5929\u7136\u5c31\u6709\u534f\u4f5c\u8ba8\u8bba\u7684\u80fd\u529b\uff0c\u800c\u4e14\u8ba8\u8bba\u672c\u8eab\u5c31\u53ef\u4ee5\u589e\u5f3aLLM\u7684\u903b\u8f91\u81ea\u6d3d\u6027\uff1b<\/li>\n\n\n\n<li>\u76f8\u4f3c\u80fd\u529b\u7684 LLM \u4e4b\u95f4\u8fa9\u8bba\u5f62\u6210\u59a5\u534f\u540e\u7ed9\u51fa\u7b54\u6848\uff0c\u6bd4\u5b83\u4eec\u5404\u81ea\u72ec\u7acb\u56de\u7b54\u6b63\u786e\u7387\u8981\u9ad8\uff0c\u4e14\u4e0d\u540c\u7cfb\u5217\u7684 LLM \u5408\u4f5c\u83b7\u5f97\u7684\u6548\u679c\u66f4\u597d\uff1b<\/li>\n\n\n\n<li>\u5728\u4e0d\u5339\u914d\uff08mismatched\uff09\u8ba8\u8bba\u4e2d\uff0c\u5f3aLLM\u4f1a\u66f4\u503e\u5411\u4e8e\u575a\u6301\u5df1\u89c1\uff0c\u4f46\u662f\u4f1a\u88ab\u67d0\u4e9b\u987d\u56fa\u7684\u5f31LLM\u5206\u6563\u6ce8\u610f\u529b\u4ece\u800c\u5f71\u54cd\u8868\u73b0.<\/li>\n<\/ol>\n\n\n\n<h1 class=\"wp-block-heading\">\u542f\u53d1\u4e0e\u8bc4\u4ef7<\/h1>\n\n\n\n<ol class=\"wp-block-list\">\n<li>INCON \u7684\u5b9a\u4e49\u6bd4\u8f83\u5408\u7406\uff0c\u53ef\u4ee5\u7cbe\u51c6\u5730\u91cf\u5316 LLM \u4e4b\u95f4\u7684\u4e0d\u4e00\u81f4\u6027\u6c34\u5e73\uff1b<\/li>\n\n\n\n<li>\u7528\u81ea\u7136\u79d1\u5b66\u7684\u5b9e\u9a8c\u624b\u6bb5\u5bf9\u591a\u4e2aLLM \u5171\u540c\u8fa9\u8bba\u8fc7\u7a0b\u4e2d\u7684\u81ea\u6d3d\u6027\u8fdb\u884c\u4e86\u5145\u5206\u7684\u5b9e\u9a8c\uff0c\u63a2\u660e\u4e86 LLM \u5f7c\u6b64\u4ea4\u4e92\u65f6\u7684\u4e00\u4e9b\u7279\u70b9\uff0c\u8bc1\u660e\u4e86 LLM \u62e5\u6709\u7c7b\u4f3c\u4eba\u7c7b\u7684\u5408\u4f5c\u80fd\u529b\uff1b\u8fd9\u6837\u7684\u5b9e\u9a8c\u65b9\u6cd5\u53ef\u4ee5\u88ab\u7528\u4e8e\u7814\u7a76\u5176\u4ed6\u9ed1\u76d2\u6a21\u578b\uff1b<\/li>\n\n\n\n<li>\u53c2\u4e0e\u5b9e\u9a8c\u7684\u5927\u6a21\u578b\u5e76\u4e0d\u591a\uff0c\u600e\u4e48\u6311\u9009\u53c2\u4e0e\u8fa9\u8bba\u7684\u5927\u6a21\u578b\u3001\u600e\u4e48\u6700\u5927\u9650\u5ea6\u4e0a\u63d0\u9ad8\u6548\u679c\u4e0a\u8fd8\u6709\u7814\u7a76\u7a7a\u95f4\u3002<\/li>\n<\/ol>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6838\u5fc3\u5185\u5bb9 \u672c\u6587\u5173\u6ce8\u7684\u662f\u591a\u4e2aLLM\u4e00\u8d77\u8fa9\u8bba\u5e76\u9010\u6e10\u8fbe\u6210\u5171\u8bc6\u7684\u8fc7\u7a0b\u4e2d\u7684\u81ea\u6d3d\u6027\u95ee\u9898\u3002\u4e3a\u4e86\u7814\u7a76\u8fd9\u4e2a\u95ee\u9898\u672c\u6587\u63d0\u51fa\u4e86\u4e00\u4e2a\u53eb\u505a [&hellip;]<\/p>\n","protected":false},"author":59,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1103","post","type-post","status-publish","format-standard","hentry","category-events"],"_links":{"self":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts\/1103","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/users\/59"}],"replies":[{"embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/comments?post=1103"}],"version-history":[{"count":1,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts\/1103\/revisions"}],"predecessor-version":[{"id":1110,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts\/1103\/revisions\/1110"}],"wp:attachment":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/media?parent=1103"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/categories?post=1103"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/tags?post=1103"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}