eval12

Overview

Overall Solving Statistics

SOLVERSATUNSATTOTAL
ghostq-bq-cegar.sh113100213
run_rareqs99105204
bdepqbf10099199
ghostq-cegar.sh10592197
hiqqer39398191
ghostq.sh9085175
pre_dual_ooq.py8290172
qube7.26581146
runAqme.sh5788145
dual_ooq6877145
squeezebf1.2-qube7.2.pl7469143
squeezebf1.2-qube3.06267129
depqbf4366109
qcnf2z34759106
ooq3466100
StruQS483987
Number of Solved Formulas

solverAVERAGESUM
ghostq-bq-cegar.sh499.34172273.53
run_rareqs522.99180433.65
bdepqbf544.24187764.78
ghostq-cegar.sh555.80191753.38
hiqqer3578.59199613.82
ghostq.sh625.34215744.65
pre_dual_ooq.py642.68221725.77
dual_ooq726.59250674.16
runAqme.sh727.30250920.02
qube7.2750.61258963.68
squeezebf1.2-qube7.2.pl755.18260538.78
squeezebf1.2-qube3.0792.21273314.08
qcnf2z3844.43291330.29
depqbf855.80295251.77
ooq877.54302753.84
StruQS940.21324375.42
Time Statistics (overall runtime, average runtime)

formula
test1_quant_squaring3.qdimacs
C5315.blif_0.10_0.20_0_0_inp_exact.qdimacs
adder-12-unsat.qdimacs
test4_quant_squaring4.qdimacs
connect_7x6_4_R.qdimacs
cube_c11_ser--opt-42_.qdimacs
connect_9x8_3_R.qdimacs
k6_4_3.qdimacs
c4_Debug_s3_f2_e1_v3.qdimacs
b04_C_2_20.qdimacs
k_ph_p-18.qdimacs
k12_3_3.qdimacs
audio_ddksynth_voice.cpp.qdimacs
s38584_3_238.qdimacs
test2_quant2.qdimacs
s1269_d10_s.qdimacs
filesys_cdfs_namesup.c.qdimacs
k_ph_p-17.qdimacs
k_ph_p-16.qdimacs
uclid-pipe2.qdimacs
adder-16-unsat.qdimacs
ev-pr-8x8-19-7-0-1-2-lg.qdimacs
test4_quant4.qdimacs
test2_quant_squaring2.qdimacs
C6288.blif_0.10_0.20_0_1_out_exact.qdimacs
ring_r6_ser--opt-17_.qdimacs
b22_C_2_12.qdimacs
C499.blif_0.10_0.20_0_1_out_exact.qdimacs
filesys_fastfat_allocsup.c.qdimacs
test1_quant2.qdimacs
test3_quant_squaring4.qdimacs
k12_2_2.qdimacs
k12_2_3.qdimacs
C6288.blif_0.10_0.20_0_1_inp_exact.qdimacs
filesys_smbmrx_smbxchng.c.qdimacs
b21_C_3_206.qdimacs
C5315.blif_0.10_0.20_0_1_out_exact.qdimacs
filesys_fastfat_easup.c.qdimacs
C499.blif_0.10_0.20_0_0_out_exact.qdimacs
s1269_d13_u.qdimacs
C5315.blif_0.10_0.20_0_0_out_exact.qdimacs
blocks_enc_2_b4_ser--opt-26_.qdimacs
C6288.blif_0.10_1.00_0_0_inp_exact.qdimacs
b14_C_3_105.qdimacs
k_ph_p-12.qdimacs
adder-12-sat.qdimacs
b20_C_3_2.qdimacs
k12_4_2.qdimacs
C6288.blif_0.10_0.20_0_0_out_exact.qdimacs
test1_quant_squaring2.qdimacs
test1_quant3.qdimacs
s1269_d15_u.qdimacs
Number of Unsolved Formulas (solved by no solver)

FORMULASOLVER
adder-10-sat.qdimacsrunAqme.sh
adder-14-unsat.qdimacssqueezebf1.2-qube7.2.pl
audio_ac97_wavepcistream3.cpp.qdimacsrun_rareqs
biu.mv.xl_ao.bb-b003-p020-IPF01-c05.blif-biu.inv.prop.bb-bmc.with-IOC.unfold-009.qdimacsrun_rareqs
c3_Debug_s3_f2_e2_v2.qdimacssqueezebf1.2-qube7.2.pl
c4_Debug_s3_f1_e1_v3.qdimacssqueezebf1.2-qube7.2.pl
C880.blif_0.10_0.20_0_0_inp_exact.qdimacsghostq.sh
C880.blif_0.10_0.20_0_1_inp_exact.qdimacsghostq.sh
cube_c7_ser---23_.qdimacsrun_rareqs
emptyroom_e4_ser--opt-44_.qdimacsrun_rareqs
ev-pr-6x6-5-5-0-1-2-s.qdimacsrunAqme.sh
k14_3_3.qdimacssqueezebf1.2-qube7.2.pl
k_branch_n-14.qdimacshiqqer3
k_branch_n-20.qdimacshiqqer3
k_branch_n-21.qdimacshiqqer3
k_branch_p-21.qdimacshiqqer3
ring_r7_ser--opt-20_.qdimacssqueezebf1.2-qube7.2.pl
s3330_d10_u.qdimacssqueezebf1.2-qube7.2.pl
s3330_d11_u.qdimacssqueezebf1.2-qube7.2.pl
s3330_d13_u.qdimacssqueezebf1.2-qube7.2.pl
s3330_d14_u.qdimacssqueezebf1.2-qube7.2.pl
stmt31_276_328.qdimacspre_dual_ooq.py
stmt41_286_385.qdimacspre_dual_ooq.py
Formulas only solved by one solver

bdepqbf2745.9363
runAqme.sh1716.0413
pre_dual_ooq.py1598.6791
depqbf1469.2686
hiqqer31436.5385
dual_ooq1376.7589
ooq945.1932
StruQS938.4002
squeezebf1.2-qube7.2.pl796.9986
qube7.2775.9945
squeezebf1.2-qube3.0718.19336
ghostq-bq-cegar.sh619.00415
ghostq-cegar.sh548.77136
ghostq.sh504.85596
run_rareqs95.47191
qcnf2z354.761627
SOTA Ranking

Formulas with Discrepancies

FORMULASATUNSAT
AR-fixpoint-2.qdimacs12
C880.blif_0.10_1.00_0_0_inp_exact.qdimacs15
ev-pr-6x6-7-5-0-1-2-s.qdimacs11
fpu-01Xh-error02-nonuniform-depth-23.qdimacs115
fpu-10Xe-correct02-nonuniform-depth-27.qdimacs115
k_branch_n-10.qdimacs21
k_branch_n-7.qdimacs51
ring_r7_ser---19_.qdimacs11
Formulas with Discrepancies

formulasolverresult
AR-fixpoint-2.qdimacsdepqbf1
AR-fixpoint-2.qdimacsbdepqbf1
AR-fixpoint-2.qdimacsrunAqme.sh1
AR-fixpoint-2.qdimacsStruQS1
AR-fixpoint-2.qdimacsooq1
AR-fixpoint-2.qdimacspre_dual_ooq.py1
AR-fixpoint-2.qdimacsdual_ooq1
AR-fixpoint-2.qdimacshiqqer31
AR-fixpoint-2.qdimacssqueezebf1.2-qube7.2.pl10
AR-fixpoint-2.qdimacsqube7.220
AR-fixpoint-2.qdimacssqueezebf1.2-qube3.020
AR-fixpoint-2.qdimacsghostq.sh1
AR-fixpoint-2.qdimacsghostq-bq-cegar.sh1
AR-fixpoint-2.qdimacsghostq-cegar.sh1
AR-fixpoint-2.qdimacsqcnf2z31
AR-fixpoint-2.qdimacsrun_rareqs1

formulasolverresult
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsbdepqbf1
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsdepqbf1
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsStruQS1
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsrunAqme.sh1
C880.blif_0.10_1.00_0_0_inp_exact.qdimacspre_dual_ooq.py1
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsdual_ooq1
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsooq1
C880.blif_0.10_1.00_0_0_inp_exact.qdimacshiqqer320
C880.blif_0.10_1.00_0_0_inp_exact.qdimacssqueezebf1.2-qube3.01
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsqube7.210
C880.blif_0.10_1.00_0_0_inp_exact.qdimacssqueezebf1.2-qube7.2.pl99
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsghostq-cegar.sh20
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsghostq-bq-cegar.sh20
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsghostq.sh20
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsrun_rareqs20
C880.blif_0.10_1.00_0_0_inp_exact.qdimacsqcnf2z344

formulasolverresult
ev-pr-6x6-7-5-0-1-2-s.qdimacsbdepqbf1
ev-pr-6x6-7-5-0-1-2-s.qdimacsdepqbf1
ev-pr-6x6-7-5-0-1-2-s.qdimacsrunAqme.sh20
ev-pr-6x6-7-5-0-1-2-s.qdimacsStruQS1
ev-pr-6x6-7-5-0-1-2-s.qdimacsdual_ooq1
ev-pr-6x6-7-5-0-1-2-s.qdimacspre_dual_ooq.py1
ev-pr-6x6-7-5-0-1-2-s.qdimacsooq1
ev-pr-6x6-7-5-0-1-2-s.qdimacshiqqer3152
ev-pr-6x6-7-5-0-1-2-s.qdimacsqube7.21
ev-pr-6x6-7-5-0-1-2-s.qdimacssqueezebf1.2-qube3.01
ev-pr-6x6-7-5-0-1-2-s.qdimacssqueezebf1.2-qube7.2.pl10
ev-pr-6x6-7-5-0-1-2-s.qdimacsghostq-bq-cegar.sh1
ev-pr-6x6-7-5-0-1-2-s.qdimacsghostq.sh1
ev-pr-6x6-7-5-0-1-2-s.qdimacsghostq-cegar.sh1
ev-pr-6x6-7-5-0-1-2-s.qdimacsrun_rareqs1
ev-pr-6x6-7-5-0-1-2-s.qdimacsqcnf2z31

formulasolverresult
fpu-01Xh-error02-nonuniform-depth-23.qdimacsdepqbf20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsbdepqbf20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsStruQS20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsrunAqme.sh20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsooq20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsdual_ooq20
fpu-01Xh-error02-nonuniform-depth-23.qdimacspre_dual_ooq.py20
fpu-01Xh-error02-nonuniform-depth-23.qdimacshiqqer320
fpu-01Xh-error02-nonuniform-depth-23.qdimacssqueezebf1.2-qube3.020
fpu-01Xh-error02-nonuniform-depth-23.qdimacssqueezebf1.2-qube7.2.pl10
fpu-01Xh-error02-nonuniform-depth-23.qdimacsqube7.220
fpu-01Xh-error02-nonuniform-depth-23.qdimacsghostq-bq-cegar.sh20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsghostq-cegar.sh20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsghostq.sh20
fpu-01Xh-error02-nonuniform-depth-23.qdimacsqcnf2z320
fpu-01Xh-error02-nonuniform-depth-23.qdimacsrun_rareqs20

formulasolverresult
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsbdepqbf20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsdepqbf20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsStruQS20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsrunAqme.sh20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacspre_dual_ooq.py20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsooq20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsdual_ooq20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacshiqqer320
fpu-10Xe-correct02-nonuniform-depth-27.qdimacssqueezebf1.2-qube7.2.pl10
fpu-10Xe-correct02-nonuniform-depth-27.qdimacssqueezebf1.2-qube3.020
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsqube7.220
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsghostq-cegar.sh20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsghostq.sh20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsghostq-bq-cegar.sh20
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsqcnf2z320
fpu-10Xe-correct02-nonuniform-depth-27.qdimacsrun_rareqs20

formulasolverresult
k_branch_n-10.qdimacsdepqbf1
k_branch_n-10.qdimacsbdepqbf10
k_branch_n-10.qdimacsStruQS1
k_branch_n-10.qdimacsrunAqme.sh1
k_branch_n-10.qdimacsdual_ooq1
k_branch_n-10.qdimacspre_dual_ooq.py1
k_branch_n-10.qdimacsooq1
k_branch_n-10.qdimacshiqqer320
k_branch_n-10.qdimacsqube7.21
k_branch_n-10.qdimacssqueezebf1.2-qube3.0134
k_branch_n-10.qdimacssqueezebf1.2-qube7.2.pl99
k_branch_n-10.qdimacsghostq-cegar.sh1
k_branch_n-10.qdimacsghostq.sh1
k_branch_n-10.qdimacsghostq-bq-cegar.sh1
k_branch_n-10.qdimacsqcnf2z31
k_branch_n-10.qdimacsrun_rareqs10

formulasolverresult
k_branch_n-7.qdimacsbdepqbf10
k_branch_n-7.qdimacsdepqbf1
k_branch_n-7.qdimacsStruQS1
k_branch_n-7.qdimacsrunAqme.sh1
k_branch_n-7.qdimacspre_dual_ooq.py1
k_branch_n-7.qdimacsdual_ooq1
k_branch_n-7.qdimacsooq1
k_branch_n-7.qdimacshiqqer320
k_branch_n-7.qdimacssqueezebf1.2-qube3.01
k_branch_n-7.qdimacsqube7.21
k_branch_n-7.qdimacssqueezebf1.2-qube7.2.pl99
k_branch_n-7.qdimacsghostq-cegar.sh1
k_branch_n-7.qdimacsghostq-bq-cegar.sh10
k_branch_n-7.qdimacsghostq.sh10
k_branch_n-7.qdimacsrun_rareqs10
k_branch_n-7.qdimacsqcnf2z310

formulasolverresult
ring_r7_ser---19_.qdimacsbdepqbf1
ring_r7_ser---19_.qdimacsdepqbf1
ring_r7_ser---19_.qdimacsrunAqme.sh1
ring_r7_ser---19_.qdimacsStruQS1
ring_r7_ser---19_.qdimacsooq1
ring_r7_ser---19_.qdimacspre_dual_ooq.py1
ring_r7_ser---19_.qdimacsdual_ooq1
ring_r7_ser---19_.qdimacshiqqer31
ring_r7_ser---19_.qdimacsqube7.21
ring_r7_ser---19_.qdimacssqueezebf1.2-qube3.01
ring_r7_ser---19_.qdimacssqueezebf1.2-qube7.2.pl10
ring_r7_ser---19_.qdimacsghostq-bq-cegar.sh1
ring_r7_ser---19_.qdimacsghostq.sh1
ring_r7_ser---19_.qdimacsghostq-cegar.sh1
ring_r7_ser---19_.qdimacsrun_rareqs20
ring_r7_ser---19_.qdimacsqcnf2z31