ÈÕǰ£¬µÚ13½ì¹ú¼Êѧϰ±íÕ÷¾Û»á£¨International Conference on Learning Representations£¬¼ò³ÆICLR£©Ðû²¼ÂÛÎÄÈÎÃüЧ¹û£¬k¶¹Ç®°ü4ƪÂÛÎı»ÈÎÃü¡£¡£
¹ØÓÚICLR
ICLR ÊÇÉî¶ÈѧϰÁìÓòµÄ¶¥¼¶¾Û»á£¬¹Ø×¢ÓйØÉî¶Èѧϰ¸÷¸ö·½ÃæµÄÇ°ÑØÑо¿£¬ÔÚÈ˹¤ÖÇÄÜ¡¢¡¢¡¢Í³¼ÆºÍÊý¾Ý¿ÆÑ§ÁìÓòÒÔ¼°»úеÊÓ¾õ¡¢¡¢¡¢ÓïÒôʶ±ð¡¢¡¢¡¢Îı¾Ã÷È·µÈÖ÷ÒªÓ¦ÓÃÁìÓòÖÐÐû²¼ÁËÖڶ༫ÆäÓÐÓ°ÏìÁ¦µÄÂÛÎÄ¡£¡£»£»£¾Û»á¾ßÓÐÆÕ±éÇÒÉîÔ¶µÄ¹ú¼ÊÓ°ÏìÁ¦£¬Óë NeurIPS¡¢¡¢¡¢ICML ²¢³ÆÎª»úеѧϰÁìÓòÈý´ó¶¥»á¡£¡£
ÈÎÃüÂÛÎÄÒ»ÀÀ
1. ¡¶Taming Transformer Without Using Learning Rate Warmup¡·
TransformerÄ£×ÓÊÇÏÖÔÚ´óÄ£×ÓµÄ×îÖ÷ÒªµÄ»ù´¡Ä£×Ó£¬µ«ÑµÁ·Àú³ÌÖУ¬Ëü¾³£ÃæÁÙÖîÈçÌݶȱ¬Õ¨¡¢¡¢¡¢Ä£×ÓÍß½âµÈÎÊÌâ¡£¡£ÕâÆªÂÛÎÄ´Ó¾ØÕó΢·ÖµÄ½Ç¶ÈÍÆµ¼ÁËself-attentionµÄ·´ÏòÌݶȹ«Ê½£¬Í¨¹ý¸Ã·´ÏòÈö²¥¹«Ê½µÄÍÆµ¼£¬×÷Õß¶¨Î»µ½ÁËÄ£×ÓÍß½âµÄÒ»¸ö½¹µãÎÊÌ⣺£º£º(Wq)'Wk¾ØÕóÔÚѵÁ·µÄÀú³ÌÖУ¬ËüµÄÆ×ÄÜÁ¿¼¯Öе½Á˼¸¸öÆ«Ïò£¬×îÖÕµ¼ÖÂËùÓеÄXËúÏݵ½Ò»¸öµãÉÏ¡£¡£Í¨¹ýÀíÂÛµÄÍÆµ¼£¬×÷ÕߵóöÁËÒ»ÖÖ¼òÆÓµÄ·½°¸£¬Í¨¹ý¿ØÖÆ£¨Wq)'Wk¾ØÕóµÄÆæÒìÖµµÄ¿ìËÙÔöÌí£¬À´×èÖ¹ÄÜÁ¿µÄÌ«¹ý¼¯ÖУ¬×÷Õß½«Ìá³öµÄÒªÁì³ÆÖ®ÎªAdamW2¡£¡£
ʵÑé֤ʵ£¬¸ÃÒªÁìÎÞÐèÒÀÀµÑ§Ï°ÂÊÔ¤ÈÈ£¨Learning Rate Warmup£©£¬¾Í¿ÉÒÔÓÐÓûº½âѵÁ·³õÆÚÒòѧϰÂʹý´óµ¼ÖµIJ»Îȹ̻ò·¢É¢ÎÊÌâ¡£¡£×÷Õßͨ¹ýÔÚViT¡¢¡¢¡¢GPTºÍSwin-TransformerÄ£×ÓÉϵĴó×ÚʵÑ飬ÑéÖ¤ÁËAdamW2µÄÓÐÓÃÐÔ£¬Ö¤ÊµÆäÔÚÎÞÐèѧϰÂÊÔ¤ÈȵÄÇéÐÎÏ£¬ÒÀÈ»Äܹ»ÊµÏÖÎȹÌѵÁ·£¬²¢È¡µÃÓëʹÓÃѧϰÂÊÔ¤ÈÈÏ൱µÄÐÔÄÜ¡£¡£ÕâһЧ¹ûΪTransformerÄ£×ÓµÄѵÁ·ÌṩÁËȫеÄÊӽǺÍÒªÁ죬¾ßÓÐÖ÷ÒªµÄÀíÂÛÒâÒåºÍʵ¼ù¼ÛÖµ¡£¡£
ÂÛÎĵص㣺£º£º
https://openreview.net/forum?id=GeUK3zGreN&referrer=%5BAuthor%20Console%5D(%2Fgroup%3Fid%3DICLR.cc%2F2025%2FConference%2FAuthors%23your-submissions)
2.¡¶BiGR : Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities¡·
ÕâÆªÂÛÎĽéÉÜÁËÒ»¸öеÄͼÏñÌìÉúÄ£×Ó BiGR£¬ËüÄÜÌìÉú¸ßÖÊÁ¿µÄͼÏñ£¬Í¬Ê±»¹ÄÜÌáÉýͼÏñµÄÊÓ¾õÌåÏÖÄÜÁ¦¡£¡£BiGR ͨ¹ýʹÓöþ½øÖÆ´úÂëÀ´ÌåÏÖͼÏñ£¬²¢Á¬ÏµÒ»ÖÖÌØÊâµÄ±àÂëÆ÷Ï¢ÕùÂëÆ÷À´ÌìÉúͼÏñ¡£¡£Ä£×Ó»ùÓÚ Transformer ¼Ü¹¹£¬Ê¹ÓÃÑÚÂ뽨ģҪÁì¾ÙÐÐѵÁ·£¬Í¨¹ýÔ¤²â±»ÑÚÂëµÄ¶þ½øÖÆ´úÂëÀ´ÌìÉúͼÏñ¡£¡£
×÷ÕßÔÚ¶à¸öʹÃüÉ϶ÔBiGR¾ÙÐÐÁËÑéÖ¤£¬°üÀ¨ÖÖ±ðÉúͼ¡¢¡¢¡¢ÎÄÉúͼ¡£¡£ÊµÑéÅú×¢£¬BiGR ÔÚÌìÉúͼÏñµÄÖÊÁ¿ºÍÊÓ¾õÌåÏÖÄÜÁ¦É϶¼ÓÅÓÚÏÖÓеÄÄ£×Ó¡£¡£±ðµÄ£¬BiGR »¹Õ¹Ê¾ÁËÔÚ¶àÖÖÊÓ¾õʹÃüÉϵÄÁãÑù±¾·º»¯ÄÜÁ¦£¬ºÃ±ÈͼÏñÐÞ¸´¡¢¡¢¡¢±à¼ºÍ²åÖµµÈ£¬ÎÞÐèÕë¶ÔÌØ¶¨Ê¹Ãü¾ÙÐнṹµ÷½â»ò²ÎÊý΢µ÷£¬ÊÇÒ»¸öÔÚͼÏñÌìÉúºÍÊÓ¾õÌåÏÖ·½Ãæ¶¼ºÜÓÐDZÁ¦µÄÄ£×Ó¡£¡£
ÂÛÎĵص㣺£º£º
https://openreview.net/forum?id=1Z6PSw7OL8&referrer=%5BAuthor%20Console%5D(%2Fgroup%3Fid%3DICLR.cc%2F2025%2FConference%2FAuthors%23your-submissions)
3. ¡¶Exploring A Principled Framework for Deep Subspace Clustering¡·
ÏÖÓÐÉî¶È×Ó¿Õ¼ä¾ÛÀàÒªÁìÔÚ´¦ÀíÖØ´óÊý¾Ýʱ³£ÃæÁÙÌØÕ÷Íß½âµÄÎÊÌ⣬¼´Ñ§Ï°µ½µÄÌØÕ÷ËúËõÖÁµÍά¿Õ¼ä£¬µ¼Ö¾ÛÀàЧ¹û²»²ÇÏë¡£¡£ÎªÓ¦¶ÔÕâÒ»ÌôÕ½£¬±¾ÎÄÌá³öÁËÒ»ÖÖÃûΪPRO-DSC£¨Principled fRamewOrk for Deep Subspace Clustering£©µÄÉî¶È×Ó¿Õ¼ä¾ÛÀà¿ò¼Ü¡£¡£Í¨¹ýÒýÈëÓÐÓõÄÕýÔò»¯Ï¸ÃÒªÁìÀֳɻº½âÁËÌØÕ÷Íß½âÕ÷Ï󡣡£
ʵÑéЧ¹ûÏÔʾ£¬PRO-DSCÔںϳÉÊý¾Ý¼°¶à¸öÕæÊµÊý¾Ý¼¯ÉϵÄÌåÏÖ¾ùÓÅÓÚÏÖÓÐÒªÁì¡£¡£ÀýÈ磬ÔÚCIFAR-10ºÍCIFAR-100Êý¾Ý¼¯ÉÏ£¬Æä¾ÛÀà׼ȷÂÊ»®·ÖµÖ´ï97.2%ºÍ71.6%£¬ÏÔÖøÓâÔ½ÆäËûÒªÁì¡£¡£ÕâÒ»Ñо¿ÎªÉî¶È×Ó¿Õ¼ä¾ÛÀàÌṩÁËȫеĸßЧ½â¾ö·½°¸¡£¡£
ÂÛÎĵص㣺£º£º
https://openreview.net/forum?id=7psWohxvxp&referrer=%5BAuthor%20Console%5D(%2Fgroup%3Fid%3DICLR.cc%2F2025%2FConference%2FAuthors%23your-submissions)
4. ¡¶Unposed Sparse Views Room Layout Reconstruction in the Age of Pretrain Model¡·
¸ÃÂÛÎÄÌá³öÁËÒ»ÖÖÁ¢ÒìµÄ3D»ù´¡Ä£×Ó¡ª¡ªPlane-DUSt3R£¬Äܹ»Ö±½Ó´Ó¶àÕÅÕÕÆ¬ÖÐÒ»²½Íê³É·¿¼ä3D½á¹¹µÄÖØÐÞ£¬¼«´ó¼ò»¯Á˹ŰåÁ÷³Ì¡£¡£¸ÃÒªÁìÎÞÐèÔ¤ÏÈ»ñÈ¡Ïà»úµÄλÖúͽǶÈÐÅÏ¢£¬Ò²²»ÒªÇóÕÕÆ¬Ö®¼ä±£´æÖصþ²¿·Ö£¬¼´¿ÉʵÏÖ·¿¼ä½á¹¹µÄÖØÐÞ¡£¡£ÕâÒ»ÌØÕ÷ÔÚÏÖʵӦÓÃÖÐÓÈΪÊÊÓã¬ÓÉÓÚÐí¶àÇéÐÎÏ£¬ÎÒÃÇÊÖÍ·µÄÕÕÆ¬ÍùÍùÊÇËæÒâÅÄÉãµÄ£¬ÅÄÉã½Ç¶ÈºÍλÖò¢²»Àο¿¡£¡£¶ø¹Å°åÒªÁìͨ³£ÐèÒª¾ÓÉÖØ´ó·½·¨£¬ÀýÈçÏÈÔ¤¼ÆÏà»úλÖÃÓë½Ç¶È£¬ÔÙ¾ÙÐÐͼÏñÆ¥ÅäºÍÈý½ÇÕÉÁ¿£¬Õâ²»µ«Á÷³Ì·±Ëö£¬»¹ÈÝÒ×ÍÉ»¯¡£¡£DUSt3RµÄÒýÈëÏÔÖø¼ò»¯ÁËÕâÒ»Àú³Ì¡£¡£k¶¹Ç®°üÒªÁìPlane-DUSt3RÔÚDUSt3R»ù´¡ÉÏ£¬Ìá³öÁËÒ»ÖÖÐÂÓ±µÄ×ÔÁ¦µÄ¶àÊÓͼ£¨Ï£º±ÊÓͼ£©·¿¼ä½á¹¹Ô¤¼ÆÒªÁì¡£¡£
ʵÑéЧ¹ûÏÔʾ£¬¸ÃÒªÁìÔÚ¶à¸öÊý¾Ý¼¯ÉϾùÌåÏÖ¾«²Ê£¬²»µ«ÔںϳÉÊý¾Ý¼¯ÉÏÓÅÓÚÏÖÓÐÒªÁ죬ÔÚÕæÊµÌìϵÄÊý¾Ý¼¯ÉÏÒ²Õ¹ÏÖÁËǿʢµÄ·º»¯ÄÜÁ¦¡£¡£ÀýÈ磬ÔÚStructure3DÊý¾Ý¼¯ÉÏ£¬Plane-DUSt3RÔÚ3DÆ½Ãæ¾«¶ÈºÍÕÙ»ØÂÊ·½Ãæ¾ùʵÏÖÁËÁè¼Ý5%µÄÌáÉý£¬½øÒ»²½ÑéÖ¤ÁËÆä׿ԽÐÔÄÜ¡£¡£
ÂÛÎĵص㣺£º£º
https://openreview.net/forum?id=DugT77rRhW&referrer=%5BAuthor%20Console%5D(%2Fgroup%3Fid%3DICLR.cc%2F2025%2FConference%2FAuthors%23your-submissions)