A 7M parameter network just outscored many models on ARC AGI

%PDF-1.7 %???? 1 0 obj << /Metadata 3 0 R /Names 4 0 R /OpenAction 5 0 R /PageMode /UseNone /Pages 6 0 R /Type /Catalog >> endobj 2 0 obj << /Author (Alexia Jolicoeur-Martineau) /Creator (arXiv GenPDF \(tex2pdf:\)) /DOI (https://doi.org/10.48550/arXiv.2510.04871) /License (http://arxiv.org/licenses/nonexclusive-distrib/1.0/) /PTEX.Fullbanner (This is pdfTeX, Version 3.141592653-2.6-1.40.28 \(TeX Live 2025\) kpathsea version 6.4.1) /Producer (pikepdf 8.15.1) /Title (Less is More: Recursive Reasoning with Tiny Networks) /Trapped /False /arXivID (https://arxiv.org/abs/2510.04871v1) >> endobj 3 0 obj << /Subtype /XML /Type /Metadata /Length 1588 >> stream <?xpacket begin="" id="W5M0MpCehiHzreSzNTczkc9d"?>

Less is More: Recursive Reasoning with Tiny Networks

Alexia Jolicoeur-Martineau

http://arxiv.org/licenses/nonexclusive-distrib/1.0/

cs.LG

cs.AI

<?xpacket end="w"?> endstream endobj 4 0 obj << /Dests 7 0 R >> endobj 5 0 obj << /D [ 8 0 R /Fit ] /S /GoTo >> endobj 6 0 obj << /Count 12 /Kids [ 9 0 R 10 0 R ] /Type /Pages >> endobj 7 0 obj << /Kids [ 11 0 R 12 0 R ] /Limits [ (Doc-Start) (table.5) ] >> endobj 8 0 obj << /Annots [ 13 0 R 14 0 R 15 0 R 16 0 R 17 0 R 18 0 R 19 0 R ] /Contents [ 20 0 R 21 0 R 22 0 R 23 0 R ] /Group 24 0 R /MediaBox [ 0 0 612 792 ] /Parent 9 0 R /Resources 25 0 R /Type /Page >> endobj 9 0 obj << /Count 6 /Kids [ 8 0 R 26 0 R 27 0 R 28 0 R 29 0 R 30 0 R ] /Parent 6 0 R /Type /Pages >> endobj 10 0 obj << /Count 6 /Kids [ 31 0 R 32 0 R 33 0 R 34 0 R 35 0 R 36 0 R ] /Parent 6 0 R /Type /Pages >> endobj 11 0 obj << /Kids [ 37 0 R 38 0 R 39 0 R 40 0 R 41 0 R 42 0 R ] /Limits [ (Doc-Start) (subsection.3.3) ] >> endobj 12 0 obj << /Kids [ 43 0 R ] /Limits [ (subsection.4.1) (table.5) ] >> endobj 13 0 obj << /A << /D (cite.wei2022chain) /S /GoTo >> /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 246.966 192.685 289.181 204.745 ] /Subtype /Link /Type /Annot >> endobj 14 0 obj << /A << /D (cite.wei2022chain) /S /GoTo >> /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 54.444 180.73 75.963 192.79 ] /Subtype /Link /Type /Annot >> endobj 15 0 obj << /A << /D (cite.snell2024scaling) /S /GoTo >> /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 216.379 180.73 262.201 192.79 ] /Subtype /Link /Type /Annot >> endobj 16 0 obj << /A << /D (cite.snell2024scaling) /S /GoTo >> /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 264.969 180.73 286.488 192.79 ] /Subtype /Link /Type /Annot >> endobj 17 0 obj << /A << /D (cite.snell2024scaling) /S /GoTo >> /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 162.02 73.134 208.983 85.193 ] /Subtype /Link /Type /Annot >> endobj 18 0 obj << /A << /D (cite.snell2024scaling) /S /GoTo >> /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 211.972 73.134 233.89 85.193 ] /Subtype /Link /Type /Annot >> endobj 19 0 obj << /A << /S /URI /URI (https://arxiv.org/abs/2510.04871v1) >> /BS << /W 0 >> /NM (fitz-L0) /Rect [ 12 227.69 32 564.31 ] /Subtype /Link >> endobj 20 0 obj << /Length 10 /Filter /FlateDecode >> stream x?+? ? | endstream endobj 21 0 obj << /Filter /FlateDecode /Length 3198 >> stream xڝZݏ?6߿?/????DJp??M?&?51Ї?Z?k?bK?%?f????P??u?+`?)??=??,?L??a???{u??ֳtv??t%?Mgr?e˜???0v??]??W:[??/?T??=??v3?[h???W??ۿW??$U6?Fhc?lq7?? '?-Ra33[?f&o|?^?U?&?o?????\?4y?????=ͼ?e??U??LJ??Poq?eIU???o?{h???\????3?R??]??2Z??*?|*m????j ̈?[??*??_?m?l|??y2[???e???^Z??r"?j6?R???ܵ}?????D?????Vd??R?K>(k??<N9l?9_ni ?R?v&g??j???t?X6? ?S1???Ҡ?yQ???Q?:*??m??ewn? ?hd??Lhkg??????^?W?P .7???k'?&? e????f????B#i ? ????gN?ZH??ius?)??r??c]Ҕ? ??-ۤM??h?ݕ?-?ՠ?׾???@?y<ψ¸Y??P??#??+???"?A8?ʎ?Uuw-???z.???ÔN???S??e?[??Y??T??3?i!?eno?f۬Q?[?)Y8p?v_)+??n?p?֗]K?7????????|M?DT?/???u?C???G??y?%??HSS??cV?????+[r}<2?'g??f?e??<)[j????c?E?|?7<_????????W?酇M??8???$??. : ?<|5 [?h#?k?V?-M??C ?????3" D?pX?<4?[?k?堏3&?!?jf??iT???`"?m??xۖ?kx??s???=??2??? 4?5?h?:"vv?#un=?m?? h?f?%\i“,??LQgR???}ę;̪??*<?s1 *?X9???;?<M;: ? ?H]0k/??????}??G?|'y???]UW??&?<>?+Jd???i????CF???n`?L@`?????]????Bp?>d???| ?+d?q?k??ͪ_F? ?4CT3? ,???y????r?z?c???!?A?$??x?}?W? ?"Dy?'?:x??d?v??"? ????u?b????8`?L??D?/???? ??N?i?h??z*:??W??3C??9E?5??#??????2?;C?JDP??b?PR??=@?U????X$??T??O??0?}v4?5}M???IshXJ??^??&AC֩?cU}?u%0??t m5? A??Hq?v?V?m??Hj&?H??L?ԡ?e??z??#!<?PE ?rm??????Mw ?9??f?40T2?????=A??Nr]? *Z?? w?|=??ཛ˛}a27?TX?`f?tS&WG0?1?&??ia?i?e?????5????q??2??H?Va????a`?<ǒ???A??Y??-=ıTh???~Kn^??w%'??nc?? 3?~? m ?*2?>m 1?;???>α????q!$Rϥ??P7????D??1@??H??=??S "()h???????o?]B?Cq"??>???;J8??ɭ????5?:????s??oap??!^t|?3S?nJ?2±op)d?XF5?!D???c???Ly_V??DD?0?a???}{??n?ϨD*@m????k4gqXSȊ? ??@G:?p?)?^???????;????g"?b> J?5k= ?EM?????u:t?Ò?L?F?lEB?F???? !?~???ؚ??Bs?G??R??l?%M?/@?#@?M o?fL???J?H??FH?&?(??c0?^?Z@?\?| b#?F鈃?????D?];??گFڳנ?.?KV?????????ӕ?+L|c? SR?ix??????wr?Cs??? 60?'?GG?=,@?Tf ?L?Nȼ?)?氒?O՚|?a? _???#?р:?l?](?Bꬹn??0?jd?jd x?en?;G?w?? ?PS ?SԴdv{????;?F̂?4????aS??鞏G??aXSd??Jb?bJf???.dC j??_?v?!R\<ʥ??q%ׄ~w?W??i9??o?n??_???L ?????? ? PL?pE??W]nx?aJ;??4 ?a?&????j??7ʧ?nP???-#?????m??'?<]:ڂ?9=]?????@G?{?????u9??? ?ȃ?>[ ???L?I??9y?Kl[?z??x?h??/)?X!!L????9?d?R?m?*?{?,y?d????U???g???[? ?2G??l>xY?\6=?? !?Mנ{j9?窉T4C^??m????mωr`?h??P??Y' [N?՗?^???a?LZ??$?B?W????d???? ?=?y?©?\??-*K?0???K*?l??tQ?? h?TUw?t?ͦyl???/?n??b?—??. eSZP$?9}?oЗr?x??E}i">????s[?u &%? ??3??ZXS?:?z??b?ѩ=??PHq??? C 5=??KaN?y????????eP??e/4S,(Ȫ??SADC?? ߐ????t??K$? "??? %TN?I??'????iI???N??6?'??ή?܀?H)\???y@?"?̟??`??^??@??p??Wi???? ??O??ՊTڶ?s?@!?\Ĕ?(5?Z>R?")?7??????=11?/T?}??> stream x?? ? ? f endstream endobj 23 0 obj << /Filter /FlateDecode /Length 140 >> stream x?E?K ?@D?}??@bw?|???1&?b???D?*x??A?D?ʕ?|2d???Y?C??S?E???Uu???؄?ĵ?????y??2h4߄6?0x(?FDh?jb?O?\??????Mź†y~uL;?$??9&? endstream endobj 24 0 obj << /CS /DeviceRGB /I true /S /Transparency /Type /Group >> endobj 25 0 obj << /ColorSpace 44 0 R /ExtGState 45 0 R /Font << /F125 46 0 R /F131 47 0 R /F141 48 0 R /F151 49 0 R /F152 50 0 R /F169 51 0 R /Times-Roman 52 0 R >> /Pattern 53 0 R /ProcSet [ /PDF /Text /ImageC ] /XObject << /Im1 54 0 R >> >> endobj 26 0 obj << /Annots [ 55 0 R 56 0 R 57 0 R 58 0 R 59 0 R 60 0 R 61 0 R 62 0 R 63 0 R 64 0 R 65 0 R 66 0 R 67 0 R 68 0 R 69 0 R 70 0 R 71 0 R 72 0 R 73 0 R 74 0 R 75 0 R 76 0 R 77 0 R 78 0 R 79 0 R 80 0 R 81 0 R ] /Contents 82 0 R /MediaBox [ 0 0 612 792 ] /Parent 9 0 R /Resources 83 0 R /Type /Page >> endobj 27 0 obj << /Annots [ 84 0 R 85 0 R 86 0 R 87 0 R 88 0 R 89 0 R 90 0 R 91 0 R 92 0 R 93 0 R 94 0 R 95 0 R 96 0 R 97 0 R 98 0 R 99 0 R 100 0 R 101 0 R 102 0 R 103 0 R 104 0 R 105 0 R 106 0 R ] /Contents 107 0 R /MediaBox [ 0 0 612 792 ] /Parent 9 0 R /Resources 108 0 R /Type /Page >> endobj 28 0 obj << /Annots [ 109 0 R 110 0 R 111 0 R 112 0 R 113 0 R ] /Contents 114 0 R /MediaBox [ 0 0 612 792 ] /Parent 9 0 R /Resources 115 0 R /Type /Page >> endobj 29 0 obj << /Annots [ 116 0 R 117 0 R 118 0 R 119 0 R 120 0 R ] /Contents 121 0 R /MediaBox [ 0 0 612 792 ] /Parent 9 0 R /Resources 122 0 R /Type /Page >> endobj 30 0 obj << /Annots [ 123 0 R 124 0 R 125 0 R 126 0 R ] /Contents 127 0 R /MediaBox [ 0 0 612 792 ] /Parent 9 0 R /Resources 128 0 R /Type /Page >> endobj 31 0 obj << /Annots [ 129 0 R 130 0 R 131 0 R 132 0 R 133 0 R 134 0 R 135 0 R 136 0 R 137 0 R 138 0 R 139 0 R 140 0 R 141 0 R 142 0 R 143 0 R 144 0 R 145 0 R 146 0 R 147 0 R 148 0 R 149 0 R 150 0 R 151 0 R 152 0 R 153 0 R 154 0 R 155 0 R 156 0 R 157 0 R 158 0 R ] /Contents 159 0 R /MediaBox [ 0 0 612 792 ] /Parent 10 0 R /Resources 160 0 R /Type /Page >> endobj 32 0 obj << /Annots [ 161 0 R 162 0 R 163 0 R 164 0 R 165 0 R 166 0 R 167 0 R 168 0 R 169 0 R 170 0 R 171 0 R 172 0 R ] /Contents 173 0 R /MediaBox [ 0 0 612 792 ] /Parent 10 0 R /Resources 174 0 R /Type /Page >> endobj 33 0 obj << /Annots [ 175 0 R 176 0 R 177 0 R 178 0 R 179 0 R ] /Contents 180 0 R /MediaBox [ 0 0 612 792 ] /Parent 10 0 R /Resources 181 0 R /Type /Page >> endobj 34 0 obj << /Annots [ 182 0 R 183 0 R ] /Contents 184 0 R /MediaBox [ 0 0 612 792 ] /Parent 10 0 R /Resources 185 0 R /Type /Page >> endobj 35 0 obj << /Annots [ 186 0 R 187 0 R 188 0 R 189 0 R 190 0 R 191 0 R 192 0 R 193 0 R 194 0 R 195 0 R 196 0 R 197 0 R 198 0 R 199 0 R 200 0 R 201 0 R 202 0 R 203 0 R 204 0 R ] /Contents 205 0 R /MediaBox [ 0 0 612 792 ] /Parent 10 0 R /Resources 206 0 R /Type /Page >> endobj 36 0 obj << /Contents 207 0 R /MediaBox [ 0 0 612 792 ] /Parent 10 0 R /Resources 208 0 R /Type /Page >> endobj 37 0 obj << /Kids [ 209 0 R 210 0 R 211 0 R 212 0 R 213 0 R 214 0 R ] /Limits [ (Doc-Start) (cite.tdoku) ] >> endobj 38 0 obj << /Kids [ 215 0 R 216 0 R 217 0 R 218 0 R 219 0 R 220 0 R ] /Limits [ (cite.tolstikhin2021mlp) (lstnumber.-1.26) ] >> endobj 39 0 obj << /Kids [ 221 0 R 222 0 R 223 0 R 224 0 R 225 0 R 226 0 R ] /Limits [ (lstnumber.-1.27) (lstnumber.-2.20) ] >> endobj 40 0 obj << /Kids [ 227 0 R 228 0 R 229 0 R 230 0 R 231 0 R 232 0 R ] /Limits [ (lstnumber.-2.21) (lstnumber.-3.27) ] >> endobj 41 0 obj << /Kids [ 233 0 R 234 0 R 235 0 R 236 0 R 237 0 R 238 0 R ] /Limits [ (lstnumber.-3.28) (lstnumber.-4.7) ] >> endobj 42 0 obj << /Kids [ 239 0 R 240 0 R 241 0 R 242 0 R 243 0 R 244 0 R ] /Limits [ (lstnumber.-4.8) (subsection.3.3) ] >> endobj 43 0 obj << /Kids [ 245 0 R 246 0 R 247 0 R ] /Limits [ (subsection.4.1) (table.5) ] >> endobj 44 0 obj << /pgfprgb [ /Pattern /DeviceRGB ] >> endobj 45 0 obj << >> endobj 46 0 obj << /BaseFont /MVUUHL+URWPalladioL-Bold /Encoding 248 0 R /FirstChar 2 /FontDescriptor 249 0 R /LastChar 121 /Subtype /Type1 /ToUnicode 250 0 R /Type /Font /Widths 251 0 R >> endobj 47 0 obj << /BaseFont /BDJOHD+URWPalladioL-Roma /Encoding 248 0 R /FirstChar 2 /FontDescriptor 252 0 R /LastChar 180 /Subtype /Type1 /ToUnicode 253 0 R /Type /Font /Widths 254 0 R >> endobj 48 0 obj << /BaseFont /WMGZNO+CMSY10 /FirstChar 0 /FontDescriptor 255 0 R /LastChar 32 /Subtype /Type1 /ToUnicode 256 0 R /Type /Font /Widths 257 0 R >> endobj 49 0 obj << /BaseFont /RQTDIV+URWPalladioL-Ital /Encoding 248 0 R /FirstChar 44 /FontDescriptor 258 0 R /LastChar 122 /Subtype /Type1 /ToUnicode 259 0 R /Type /Font /Widths 260 0 R >> endobj 50 0 obj << /BaseFont /PDHARR+URWPalladioL-Roma-Slant_167 /Encoding 248 0 R /FirstChar 46 /FontDescriptor 261 0 R /LastChar 117 /Subtype /Type1 /ToUnicode 262 0 R /Type /Font /Widths 263 0 R >> endobj 51 0 obj << /BaseFont /SOSTRQ+CMR10 /FirstChar 40 /FontDescriptor 264 0 R /LastChar 93 /Subtype /Type1 /ToUnicode 265 0 R /Type /Font /Widths 266 0 R >> endobj 52 0 obj << /BaseFont /Times-Roman /Encoding /WinAnsiEncoding /Subtype /Type1 /Type /Font >> endobj 53 0 obj << >> endobj 54 0 obj << /BitsPerComponent 8 /ColorSpace /DeviceRGB /Filter /FlateDecode /Height 2372 /SMask 267 0 R /Subtype /Image /Type /XObject /Width 1200 /Length 120004 >> stream x??? ?ս?n%b?\?????\?1?čĨQc0?PP??-EA? ?B?EEA0(?,*Q@DET?AT???嚘???]??|?T??? ?z??b]??L?nݏ?۱?)?? ȃƇ?c;?# 4k׮?t??????Z??u۱۱???_? ??؎?ȃ