{"id":1876,"date":"2024-12-11T09:29:40","date_gmt":"2024-12-11T01:29:40","guid":{"rendered":"https:\/\/www.15zhi.net\/blog\/?p=1876"},"modified":"2024-12-11T09:29:40","modified_gmt":"2024-12-11T01:29:40","slug":"202412-%e8%ae%ba%e6%96%87%e7%a0%94%e8%af%bb-end-to-end-object-detection-with-adaptive-clustering-transformer","status":"publish","type":"post","link":"https:\/\/www.15zhi.net\/blog\/202412-%e8%ae%ba%e6%96%87%e7%a0%94%e8%af%bb-end-to-end-object-detection-with-adaptive-clustering-transformer\/","title":{"rendered":"202412 \u8bba\u6587\u7814\u8bfb-End-to-End Object Detection with Adaptive  Clustering Transformer"},"content":{"rendered":"\n<p>\u6765\u6e90:arXiv<\/p>\n\n\n\n<p>\u4f5c\u8005:Minghua Zheng, Peng Gao, Renrui Zhang<\/p>\n\n\n\n<p>\u5355\u4f4d:\u5317\u4eac\u5927\u5b66\u3001\u4e0a\u6d77AI\u5b9e\u9a8c\u5ba4<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u4e00\u3001\u8bba\u6587\u4e3b\u8981\u5de5\u4f5c\u53ca\u8d21\u732e<\/h2>\n\n\n\n<p>\uff081\uff09\u8fd9\u7bc7\u6587\u7ae0\u63d0\u51fa\u4e86\u4e00\u79cd\u65b0\u7684\u65b9\u6cd5\uff0c\u79f0\u4e3a\u81ea\u9002\u5e94\u805a\u7c7btransformer\uff08ACT\uff09\uff0c\u5b83\u53ef\u4ee5\u964d\u4f4eDETR(\u76ee\u6807\u68c0\u6d4btransformer)\u7684\u63a8\u7406\u6210\u672c\u3002ACT\u53ef\u4ee5\u964d\u4f4e\u539ftransformer\u7684\u4e8c\u6b21\u590d\u6742\u5ea6\uff0c\u540c\u65f6\u4e0e\u539ftransformer\u5b8c\u5168\u517c\u5bb9\u3002<\/p>\n\n\n\n<p>\uff082\uff09\u5728\u6ca1\u6709\u4efb\u4f55\u8bad\u7ec3\u8fc7\u7a0b\u7684\u60c5\u51b5\u4e0b\uff0cACT\u5c06DETR\u7684FLOPS\u4ece73.4 Gflops\u964d\u4f4e\u523058.2 Gflops\uff08\u4e0d\u5305\u62ec\u9aa8\u5e72Resnet FLOPS\uff09\uff0c\u800cAP\u7684\u635f\u5931\u4ec5\u4e3a0.7%\u3002<\/p>\n\n\n\n<p>\uff083\uff09\u901a\u8fc7\u591a\u4efb\u52a1\u77e5\u8bc6\u84b8\u998f\uff08MTKD\uff09\uff0c\u53ef\u4ee5\u8fdb\u4e00\u6b65\u5c06AP\u635f\u8017\u964d\u4f4e\u52300.2%\uff0c\u4ece\u800c\u5b9e\u73b0ACT\u548c\u539f\u59cbtransformer\u4e4b\u95f4\u7684\u65e0\u7f1d\u5207\u6362\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u4e8c\u3001\u6a21\u578b\u6846\u67b6<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"564\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72471-1024x564.png\" alt=\"\" class=\"wp-image-1877\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72471-1024x564.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72471-300x165.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72471-768x423.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72471-1536x846.png 1536w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72471.png 1539w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"333\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72472-1024x333.png\" alt=\"\" class=\"wp-image-1878\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72472-1024x333.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72472-300x97.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72472-768x250.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72472-1536x499.png 1536w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72472.png 1579w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"156\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72473-1024x156.png\" alt=\"\" class=\"wp-image-1879\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72473-1024x156.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72473-300x46.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72473-768x117.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72473-1536x233.png 1536w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72473.png 1554w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"339\" height=\"143\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72474.png\" alt=\"\" class=\"wp-image-1880\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72474.png 339w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72474-300x127.png 300w\" sizes=\"auto, (max-width: 339px) 100vw, 339px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"532\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72475-1024x532.png\" alt=\"\" class=\"wp-image-1881\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72475-1024x532.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72475-300x156.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72475-768x399.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72475-1536x798.png 1536w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72475.png 1570w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"709\" height=\"512\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72476.png\" alt=\"\" class=\"wp-image-1882\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72476.png 709w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72476-300x217.png 300w\" sizes=\"auto, (max-width: 709px) 100vw, 709px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"168\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72477-1024x168.png\" alt=\"\" class=\"wp-image-1883\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72477-1024x168.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72477-300x49.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72477-768x126.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72477-1536x251.png 1536w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72477.png 1540w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u4e09\u3001\u5b9e\u9a8c\u7ed3\u679c<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"266\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72478-1024x266.png\" alt=\"\" class=\"wp-image-1884\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72478-1024x266.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72478-300x78.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72478-768x199.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72478-1536x398.png 1536w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72478.png 1569w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"547\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72479-1024x547.png\" alt=\"\" class=\"wp-image-1885\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72479-1024x547.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72479-300x160.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72479-768x410.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u72479.png 1392w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"338\" src=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u724710-1024x338.png\" alt=\"\" class=\"wp-image-1886\" srcset=\"https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u724710-1024x338.png 1024w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u724710-300x99.png 300w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u724710-768x253.png 768w, https:\/\/www.15zhi.net\/blog\/wp-content\/uploads\/2024\/12\/\u56fe\u724710.png 1425w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u56db\u3001\u603b\u7ed3\u4e0e\u601d\u8003<\/h2>\n\n\n\n<p>\uff08\u4e00\uff09\u3001\u8bba\u6587\u7684\u6838\u5fc3\u5185\u5bb9:<\/p>\n\n\n\n<p>&nbsp;&nbsp;&nbsp; 1.\u63d0\u51fa\u4e86\u81ea\u9002\u5e94\u805a\u7c7btransformer\uff08ACT\uff09\u6765\u51cf\u5c11\u76ee\u6807\u68c0\u6d4b\u7684\u8ba1\u7b97\u548c\u5185\u5b58\u5f00\u9500\u3002\u5927\u591a\u6570\u4ee5\u524d\u7684\u9ad8\u6548transformer\u5728\u5e94\u7528\u4e8eDETR\u65f6\u9700\u8981\u91cd\u65b0\u57f9\u8bad\u3002\u7531\u4e8eACT\u548cTransformer\u4e4b\u95f4\u7684\u517c\u5bb9\u6027\uff0c\u8fd9\u7bc7\u6587\u7ae0\u63d0\u51fa\u7684ACT\u4e0d\u9700\u8981\u4efb\u4f55\u518d\u57f9\u8bad\u8fc7\u7a0b\u3002<\/p>\n\n\n\n<p>\uff08\u4e8c\uff09\u3001\u7efc\u5408\u5bf9\u9f50\u601d\u8003:<\/p>\n\n\n\n<p>1.\u6587\u7ae0\u4e2d\u7684\u81ea\u9002\u5e94\u805a\u7c7btransformer\u4e3b\u8981\u662f\u9488\u5bf9\u6bcf\u4e2aquery\u8fdb\u884c\u805a\u7c7b\uff0c\u7136\u540e\u4f7f\u7528\u4e00\u4e9b\u4ee3\u8868\u8868\u5f81\u6765\u66ff\u4ee3\u8fd9\u4e9bquery\u8fdb\u884ctransformer\u53d8\u6362\u3002\u662f\u5426\u53ef\u4ee5\u62d3\u5c55\u5e94\u7528ACT\uff0c\u5c06\u5176\u5e94\u7528\u5728\u7ed3\u6784\u5316\u6570\u636e\u7684\u805a\u7c7b\u4e0a\u3002\u5bf9\u6bcf\u4e00\u6761\u6570\u636e\u8fdb\u884c\u81ea\u9002\u5e94\u7684\u805a\u7c7b\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6765\u6e90:arXiv \u4f5c\u8005:Minghua Zheng, Peng Gao, Renrui Zhang \u5355\u4f4d:\u5317\u4eac [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1876","post","type-post","status-publish","format-standard","hentry","category-events"],"_links":{"self":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts\/1876","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/comments?post=1876"}],"version-history":[{"count":1,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts\/1876\/revisions"}],"predecessor-version":[{"id":1887,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/posts\/1876\/revisions\/1887"}],"wp:attachment":[{"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/media?parent=1876"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/categories?post=1876"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.15zhi.net\/blog\/wp-json\/wp\/v2\/tags?post=1876"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}