solver fnd ok sat uns fld dis to mo s11 s6 sig uk real time space max suprove 230 124 46 78 106 0 97 7 0 0 0 2 9746 59412 184515 12886 simpsat 230 116 50 66 114 0 101 9 0 0 0 4 9205 80997 192784 13590 v3 230 103 36 67 127 0 121 1 5 0 0 0 7754 48806 102596 9190 iimc 230 102 36 66 128 0 126 0 2 0 0 0 10953 70839 82053 5986 nuxmv 230 100 31 69 130 0 115 15 0 0 0 0 8035 39136 163217 14140 avy 230 100 30 70 130 0 123 7 0 0 0 0 11361 64809 174491 8587 tip 230 79 27 52 151 0 151 0 0 0 0 0 4894 4855 5804 678 v3db 230 79 37 42 151 0 145 6 0 0 0 0 5818 27700 115127 8898 blimc 230 40 38 2 190 0 171 2 0 0 0 17 4431 4415 9949 1312 tipbmc 230 34 34 0 196 0 150 2 0 0 0 44 1296 1278 3757 541 shiftbmcpar 230 33 33 0 197 0 185 10 0 0 0 2 3217 10125 41764 12713 shiftbmc 230 31 31 0 199 0 164 13 0 0 0 22 2423 2410 11570 3070 aigbmc 230 31 31 0 199 0 188 7 0 0 0 4 2445 2434 10350 1436 supdeep 230 0 0 0 230 0 36 53 0 0 0 141 0 0 0 0 79 benchmarks remain unsolved in the 'single' track: 6s309b034 6s29 intel032 6s342rb122 6s280r 6s340rb27 oski1rub09i 6s45 6s268r 6s392r intel066 6s35 6s24 intel048 beemkrebs4b1 6s387rb181 intel027 intel016 6s398b09 6s44 6s351rb02 6s365r 6s382r 6s188 oski1rub01i 6s195 beemskbn2b1 6s274r beemextnc1b1 6s22 6s329rb20 intel012 6s366r bob12s06 intel067 6s267rb3 6s33 6s279r 6s284rb1 6s39 6s13 6s171 6s377r 6s329rb19 6s322rb646 6s23 beemloyd3b1 6s399b02 6s160 nusmvdme116 6s399b03 6s339rb19 bobsmminiuart 6s402rb0342 oski2ub0i 6s148 bobsmcodic 6s398b16 bobpcihm intel065 6s516r oski1rub08i 6s367r 6s387rb291 6s517rb0 6s340rb63 6s514r 6s393r oski1rub00i beemptrsn7f1 6s376r 6s161 oski1rub10i 6s105 6s119 6s266rb2 oski1rub02i 6s341r intel013 10 solvers with deep bounds: aigbmc blimc iimc nuxmv shiftbmc supdeep tip tipbmc v3 v3db 6s309b034 52 98.1% 64 98.5% -1 0.0% 51 98.1% 58 98.3% 64 98.5% 8 90.0% 64 98.5% 50 98.1% 52 98.1% 6s29 116 99.2% 130 99.2% -1 0.0% 36 97.4% 93 98.9% 129 99.2% 34 97.2% 137 99.3% 119 99.2% 119 99.2% intel032 64 98.5% 71 98.6% -1 0.0% 63 98.5% 63 98.5% 65 98.5% 4 83.3% 65 98.5% 59 98.4% 59 98.4% 6s342rb122 146 99.3% 176 99.4% -1 0.0% 180 99.5% 166 99.4% 231 99.6% 4 83.3% 205 99.5% 153 99.4% 161 99.4% 6s280r 15 94.1% 15 94.1% -1 0.0% 15 94.1% 15 94.1% 15 94.1% 4 83.3% 15 94.1% 13 93.3% 14 93.8% 6s340rb27 15 94.1% 15 94.1% -1 0.0% 13 93.3% 15 94.1% 13 93.3% 6 87.5% 13 93.3% 12 92.9% 12 92.9% oski1rub09i 20 95.5% 19 95.2% -1 0.0% 17 94.7% 18 95.0% 19 95.2% 13 93.3% 20 95.5% 17 94.7% 17 94.7% 6s45 99 99.0% 99 99.0% -1 0.0% 98 99.0% 98 99.0% 98 99.0% 4 83.3% 98 99.0% 95 99.0% 95 99.0% 6s268r 61 98.4% 129 99.2% -1 0.0% 49 98.0% 129 99.2% 129 99.2% 4 83.3% 129 99.2% 129 99.2% 126 99.2% 6s392r 44 97.8% 76 98.7% -1 0.0% 13 93.3% 50 98.1% -1 0.0% 34 97.2% 125 99.2% 62 98.4% 79 98.8% intel066 4 83.3% 4 83.3% -1 0.0% 4 83.3% 6 87.5% 5 85.7% 3 80.0% 4 83.3% 4 83.3% 3 80.0% 6s35 64 98.5% 60 98.4% -1 0.0% 65 98.5% 69 98.6% 70 98.6% 4 83.3% 59 98.4% 67 98.6% 69 98.6% 6s24 25 96.3% 26 96.4% -1 0.0% 23 96.0% 28 96.7% 26 96.4% 4 83.3% 24 96.2% 20 95.5% 21 95.7% intel048 15 94.1% 19 95.2% -1 0.0% 15 94.1% 15 94.1% 15 94.1% 4 83.3% 15 94.1% 15 94.1% 15 94.1% beemkrebs4b1 81 98.8% 83 98.8% 81 98.8% 81 98.8% 81 98.8% 81 98.8% 4 83.3% 81 98.8% 79 98.8% 80 98.8% 6s387rb181 10 91.7% 10 91.7% -1 0.0% 10 91.7% 10 91.7% 16 94.4% 4 83.3% 17 94.7% 10 91.7% 10 91.7% intel027 76 98.7% 100 99.0% -1 0.0% 88 98.9% 88 98.9% 93 98.9% 4 83.3% 92 98.9% 79 98.8% 80 98.8% intel016 64 98.5% 74 98.7% -1 0.0% 60 98.4% 60 98.4% 62 98.4% 4 83.3% 62 98.4% 51 98.1% 55 98.2% 6s398b09 -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% 6s44 29 96.8% 31 97.0% -1 0.0% 30 96.9% 31 97.0% 32 97.1% 4 83.3% 31 97.0% 29 96.8% 29 96.8% 6s351rb02 113 99.1% 128 99.2% -1 0.0% 33 97.1% 91 98.9% 127 99.2% 34 97.2% 127 99.2% 109 99.1% 109 99.1% 6s365r 109 99.1% 285 99.7% 381 99.7% 306 99.7% 288 99.7% 484 99.8% 4 83.3% 442 99.8% 184 99.5% 197 99.5% 6s382r 40 97.6% 88 98.9% -1 0.0% 11 92.3% 46 97.9% -1 0.0% 34 97.2% 207 99.5% 32 97.1% 66 98.5% 6s188 31 97.0% 31 97.0% -1 0.0% 35 97.3% 32 97.1% 37 97.4% 4 83.3% 37 97.4% 30 96.9% 30 96.9% oski1rub01i 20 95.5% 20 95.5% -1 0.0% 18 95.0% 18 95.0% 20 95.5% 13 93.3% 21 95.7% 17 94.7% 17 94.7% 6s195 128 99.2% 364 99.7% -1 0.0% 158 99.4% 168 99.4% 250 99.6% 5 85.7% 766 99.9% 519 99.8% 519 99.8% beemskbn2b1 19 95.2% 19 95.2% 32 97.1% 14 93.8% 18 95.0% 17 94.7% 4 83.3% 14 93.8% 11 92.3% 9 90.9% 6s274r 1000 99.9% 1000 99.9% -1 0.0% 3415 100.0% 1000 99.9% -1 0.0% 4 83.3% 1001 99.9% 1249 99.9% 1789 99.9% beemextnc1b1 24 96.2% 26 96.4% -1 0.0% 16 94.4% 17 94.7% 17 94.7% 4 83.3% 16 94.4% 13 93.3% 7 88.9% 6s22 38 97.5% 44 97.8% -1 0.0% 26 96.4% 42 97.7% 42 97.7% 4 83.3% 44 97.8% 39 97.6% 40 97.6% 6s329rb20 21 95.7% 33 97.1% -1 0.0% 25 96.3% 22 95.8% 30 96.9% 4 83.3% 31 97.0% 25 96.3% 25 96.3% intel012 32 97.1% 92 98.9% -1 0.0% 80 98.8% 72 98.6% 84 98.8% 4 83.3% 84 98.8% 79 98.8% 79 98.8% 6s366r 58 98.3% 53 98.2% -1 0.0% 68 98.6% 69 98.6% 92 98.9% 4 83.3% 69 98.6% 66 98.5% 64 98.5% bob12s06 17 94.7% 25 96.3% -1 0.0% 19 95.2% 17 94.7% 33 97.1% 4 83.3% 26 96.4% 17 94.7% 17 94.7% intel067 4 83.3% 4 83.3% -1 0.0% 4 83.3% 6 87.5% 5 85.7% 3 80.0% 4 83.3% 4 83.3% 3 80.0% 6s267rb3 23 96.0% 22 95.8% -1 0.0% 23 96.0% 23 96.0% 24 96.2% 5 85.7% 24 96.2% 19 95.2% 19 95.2% 6s33 28 96.7% 28 96.7% 27 96.6% 29 96.8% 27 96.6% 30 96.9% 4 83.3% 29 96.8% 22 95.8% 25 96.3% 6s279r 13 93.3% 14 93.8% -1 0.0% 13 93.3% 14 93.8% 14 93.8% 4 83.3% 13 93.3% 11 92.3% 11 92.3% 6s284rb1 67 98.6% 73 98.7% -1 0.0% 32 97.1% 94 99.0% 96 99.0% 5 85.7% 101 99.0% 59 98.4% 81 98.8% 6s39 102 99.0% 110 99.1% -1 0.0% 90 98.9% 94 99.0% 115 99.1% 9 90.9% 114 99.1% 90 98.9% 99 99.0% 6s13 6 87.5% 6 87.5% -1 0.0% 6 87.5% 6 87.5% 6 87.5% 4 83.3% 6 87.5% 4 83.3% 2 75.0% 6s171 136 99.3% 352 99.7% -1 0.0% 157 99.4% 148 99.3% 224 99.6% 5 85.7% 764 99.9% 509 99.8% 509 99.8% 6s377r 50 98.1% 55 98.2% -1 0.0% 20 95.5% 51 98.1% 58 98.3% 4 83.3% 57 98.3% 49 98.0% 49 98.0% 6s329rb19 20 95.5% 29 96.8% -1 0.0% 23 96.0% 22 95.8% 30 96.9% 4 83.3% 33 97.1% 25 96.3% 25 96.3% 6s322rb646 4 83.3% 7 88.9% -1 0.0% 7 88.9% 7 88.9% -1 0.0% 4 83.3% 13 93.3% 5 85.7% 11 92.3% 6s23 24 96.2% 24 96.2% -1 0.0% 22 95.8% 22 95.8% 26 96.4% 4 83.3% 22 95.8% 19 95.2% 20 95.5% beemloyd3b1 29 96.8% 29 96.8% 23 96.0% 27 96.6% 27 96.6% 26 96.4% 4 83.3% 24 96.2% 19 95.2% 19 95.2% 6s399b02 0 50.0% 0 50.0% -1 0.0% 0 50.0% 0 50.0% 0 50.0% 2 75.0% 2 75.0% 0 50.0% 0 50.0% 6s160 97 99.0% 113 99.1% -1 0.0% 81 98.8% 97 99.0% 121 99.2% 7 88.9% 121 99.2% 89 98.9% 89 98.9% nusmvdme116 85 98.9% 90 98.9% 166 99.4% 72 98.6% 81 98.8% 89 98.9% 4 83.3% 84 98.8% 69 98.6% 69 98.6% 6s399b03 0 50.0% 0 50.0% -1 0.0% 0 50.0% 0 50.0% 0 50.0% 2 75.0% 2 75.0% 0 50.0% 0 50.0% 6s339rb19 74 98.7% 77 98.7% 91 98.9% 78 98.8% 58 98.3% 81 98.8% 5 85.7% 76 98.7% 79 98.8% 90 98.9% bobsmminiuart 246 99.6% 1000 99.9% 60427 100.0% 1254 99.9% 1000 99.9% 14357 100.0% 4 83.3% 1001 99.9% 1160 99.9% 1325 99.9% 6s402rb0342 14 93.8% 14 93.8% -1 0.0% 14 93.8% 14 93.8% 14 93.8% 4 83.3% 14 93.8% 14 93.8% 14 93.8% oski2ub0i 27 96.6% 27 96.6% -1 0.0% 20 95.5% 21 95.7% 23 96.0% 13 93.3% 25 96.3% 13 93.3% 14 93.8% 6s148 19 95.2% 24 96.2% -1 0.0% 18 95.0% 26 96.4% 23 96.0% 6 87.5% 24 96.2% 19 95.2% 19 95.2% bobsmcodic 19 95.2% 19 95.2% -1 0.0% 16 94.4% 19 95.2% 19 95.2% 4 83.3% 19 95.2% 19 95.2% 19 95.2% 6s398b16 -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% -1 0.0% bobpcihm 16 94.4% 22 95.8% -1 0.0% 14 93.8% 18 95.0% 65 98.5% 7 88.9% 19 95.2% 57 98.3% 43 97.8% intel065 5 85.7% 5 85.7% -1 0.0% 5 85.7% 6 87.5% 5 85.7% 4 83.3% 5 85.7% 5 85.7% 5 85.7% 6s516r 15 94.1% 15 94.1% -1 0.0% 15 94.1% 15 94.1% 15 94.1% 4 83.3% 14 93.8% 13 93.3% 14 93.8% oski1rub08i 30 96.9% 29 96.8% -1 0.0% 29 96.8% 29 96.8% 30 96.9% 13 93.3% 30 96.9% 29 96.8% 27 96.6% 6s367r 43 97.8% 43 97.8% -1 0.0% 61 98.4% 72 98.6% 68 98.6% 4 83.3% 44 97.8% 72 98.6% 72 98.6% 6s387rb291 11 92.3% 13 93.3% -1 0.0% 11 92.3% 13 93.3% 18 95.0% 4 83.3% 19 95.2% 12 92.9% 12 92.9% 6s517rb0 14 93.8% 14 93.8% -1 0.0% 13 93.3% 14 93.8% 13 93.3% 4 83.3% 13 93.3% 11 92.3% 11 92.3% 6s340rb63 17 94.7% 18 95.0% -1 0.0% 15 94.1% 18 95.0% 16 94.4% 6 87.5% 16 94.4% 13 93.3% 13 93.3% 6s514r 17 94.7% 17 94.7% 15 94.1% 15 94.1% 17 94.7% 17 94.7% 4 83.3% 16 94.4% 14 93.8% 14 93.8% 6s393r 14 93.8% 28 96.7% 9 90.9% 12 92.9% 13 93.3% 22 95.8% 4 83.3% 20 95.5% 10 91.7% 9 90.9% oski1rub00i 20 95.5% 20 95.5% -1 0.0% 18 95.0% 18 95.0% 20 95.5% 13 93.3% 21 95.7% 17 94.7% 17 94.7% beemptrsn7f1 37 97.4% 37 97.4% 35 97.3% 32 97.1% 35 97.3% 35 97.3% 4 83.3% 33 97.1% 29 96.8% 30 96.9% 6s376r 68 98.6% 68 98.6% -1 0.0% 20 95.5% 150 99.3% 108 99.1% 4 83.3% 139 99.3% 89 98.9% 90 98.9% 6s161 12 92.9% 13 93.3% 11 92.3% 13 93.3% 12 92.9% 13 93.3% 4 83.3% 14 93.8% 12 92.9% 11 92.3% oski1rub10i 21 95.7% 21 95.7% -1 0.0% 19 95.2% 19 95.2% 20 95.5% 13 93.3% 21 95.7% 17 94.7% 17 94.7% 6s105 25 96.3% 25 96.3% 21 95.7% 26 96.4% 26 96.4% 26 96.4% 4 83.3% 27 96.6% 22 95.8% 21 95.7% 6s119 43 97.8% 45 97.9% -1 0.0% 42 97.7% 44 97.8% 47 98.0% 4 83.3% 47 98.0% 39 97.6% 40 97.6% 6s266rb2 23 96.0% 23 96.0% -1 0.0% 23 96.0% 24 96.2% 24 96.2% 5 85.7% 24 96.2% 19 95.2% 20 95.5% oski1rub02i 16 94.4% 16 94.4% -1 0.0% 15 94.1% 16 94.4% 16 94.4% 13 93.3% 16 94.4% 5 85.7% 14 93.8% 6s341r 15 94.1% 15 94.1% -1 0.0% 12 92.9% 13 93.3% 12 92.9% 4 83.3% 12 92.9% 12 92.9% 11 92.3% intel013 61 98.4% 77 98.7% -1 0.0% 35 97.3% 73 98.7% 81 98.8% 4 83.3% 89 98.9% 70 98.6% 69 98.6% aigbmc blimc iimc nuxmv shiftbmc supdeep tip tipbmc v3 v3db tipbmc 93.28 73.69 3535 blimc 92.61 73.16 3468 shiftbmc 92.52 73.09 3315 aigbmc 92.26 72.88 3132 nuxmv 91.93 72.63 2787 v3 91.88 72.58 3154 v3db 91.83 72.55 3250 supdeep 87.82 69.38 3335 tip 83.18 65.71 589 iimc 15.91 12.57 655 tipbmc 93.28 73.69 3535 shiftbmc 92.52 73.09 3315 nuxmv 91.93 72.63 2787 v3 91.88 72.58 3154 v3db 91.83 72.55 3250 supdeep 87.82 69.38 3335 tip 83.18 65.71 589 iimc 15.91 12.57 655