Additional results for Ace (using version 1.0)

Note that more recent versions of Ace may produce better results

Grid:

The following benchmarks were used to illustrate the performance of an adaptation of the the model counter Cachet to probabilistic inference.

Result generated on a 2.4GHz Xeon processor with 4GB of RAM using Ace 1.0 (note that better performance might be achieved using a more recent version of Ace) and c2d version 2.20 with the following options: (1) edit compile and evaluate to allocate 2500 megabytes of memory; (2) compile with "compile -iip -dtClauseMinfilll foo.net"; (3) evaluate with "evaluate foo.net".

Network	Ace Compile Time(s)	Ace Online Time(ms)	Ace Median Compile Time(s)	Ace Average Compile Time(s)
50-10-01.dne	1.98	135	1.5975	1.8451
50-10-02.dne	3.439	235
50-10-03.dne	2.628	273
50-10-04.dne	1.41	92
50-10-05.dne	1.121	48
50-10-06.dne	1.461	98
50-10-07.dne	1.535	123
50-10-08.dne	1.66	108
50-10-09.dne	1.522	94
50-10-10.dne	1.695	133
50-12-01.dne	2.662	197	6.383	6.0812
50-12-02.dne	3.024	191
50-12-03.dne	6.762	218
50-12-04.dne	5.289	186
50-12-05.dne	7.934	262
50-12-06.dne	3.541	282
50-12-07.dne	6.92	288
50-12-08.dne	10.153	262
50-12-09.dne	6.004	216
50-12-10.dne	8.523	250
50-14-01.dne	58.305	639	37.1145	39.581
50-14-02.dne	27.705	475
50-14-03.dne	37.82	687
50-14-04.dne	16.105	354
50-14-05.dne	62.126	801
50-14-06.dne	36.409	484
50-14-07.dne	62.161	782
50-14-08.dne	11.633	306
50-14-09.dne	59.967	849
50-14-10.dne	23.579	448
50-16-01.dne	497.332	3814	329.2745	538.7215
50-16-02.dne	319.416	3276
50-16-03.dne	106.524	747
50-16-04.dne	339.133	2201
50-16-05.dne	807.169	4639
50-16-06.dne	89.745	1221
50-16-07.dne	87.499	1014
50-16-08.dne	248.028	2377
50-16-09.dne	2508.582	10717
50-16-10.dne	383.787	3201
50-18-01.dne	684.528	3983	722.73	1153.250714
50-18-02.dne	978.377	7031
50-18-03.dne	177.917	1130
50-18-04.dne	Out of memory	n/a
50-18-05.dne	File size too big	n/a
50-18-06.dne	2068.656	15195
50-18-07.dne	539.411	4303
50-18-08.dne	722.73	4377
50-18-09.dne	2901.136	15078
50-18-10.dne	File size too big	n/a
75-10-01.dne	0.886	12	0.881	0.898
75-10-02.dne	1.059	47
75-10-03.dne	0.85	32
75-10-04.dne	0.799	23
75-10-05.dne	0.876	21
75-10-06.dne	0.811	15
75-10-07.dne	0.942	23
75-10-08.dne	0.975	36
75-10-09.dne	0.974	29
75-10-10.dne	0.808	13
75-12-01.dne	1.364	64	1.4885	1.4222
75-12-02.dne	1.095	28
75-12-03.dne	1.641	149
75-12-04.dne	1.086	46
75-12-05.dne	1.63	71
75-12-06.dne	1.599	97
75-12-07.dne	1.585	94
75-12-08.dne	1.641	96
75-12-09.dne	1.392	58
75-12-10.dne	1.189	36
75-14-01.dne	1.902	88	2.9865	3.5674
75-14-02.dne	1.907	65
75-14-03.dne	2.573	132
75-14-04.dne	2.783	132
75-14-05.dne	3.97	184
75-14-06.dne	5.194	228
75-14-07.dne	3.19	148
75-14-08.dne	3.843	185
75-14-09.dne	7.826	198
75-14-10.dne	2.486	199
75-16-01.dne	4.292	248	10.687	16.3266
75-16-02.dne	15.044	243
75-16-03.dne	20.361	353
75-16-04.dne	22.168	391
75-16-05.dne	2.952	182
75-16-06.dne	3.397	233
75-16-07.dne	22.522	346
75-16-08.dne	6.33	256
75-16-09.dne	61.443	872
75-16-10.dne	4.757	224
75-18-01.dne	9.962	214	10.6365	36.1906
75-18-02.dne	8.55	253
75-18-03.dne	245.916	2202
75-18-04.dne	7.919	201
75-18-05.dne	4.866	189
75-18-06.dne	11.311	262
75-18-07.dne	17.728	274
75-18-08.dne	34.461	480
75-18-09.dne	8.534	259
75-18-10.dne	12.659	233
75-20-01.dne	313.486	1626	143.12	155.0433
75-20-02.dne	238.627	1894
75-20-03.dne	227.714	829
75-20-04.dne	36.642	389
75-20-05.dne	17.172	278
75-20-06.dne	44.512	340
75-20-07.dne	345.153	1898
75-20-08.dne	86.365	694
75-20-09.dne	40.887	513
75-20-10.dne	199.875	653
75-22-01.dne	427.883	2394	498.349	809.4255
75-22-02.dne	1838.316	11376
75-22-03.dne	1427.561	6230
75-22-04.dne	Out of memory	n/a
75-22-05.dne	Out of memory	n/a
75-22-06.dne	1637.686	5820
75-22-07.dne	568.815	3545
75-22-08.dne	104.106	647
75-22-09.dne	322.232	1571
75-22-10.dne	148.805	1148
75-24-01.dne	1253.765	5805	1253.765	1485.722
75-24-02.dne	1515.167	6182
75-24-03.dne	Out of memory	n/a
75-24-04.dne	350.6	1371
75-24-05.dne	4065.514	32
75-24-06.dne	2305.231	10618
75-24-07.dne	180.002	638
75-24-08.dne	200.972	1336
75-24-09.dne	1075.565	4756
75-24-10.dne	2424.682	9387
90-10-01.dne	0.848	11	0.8	0.7873
90-10-02.dne	0.742	8
90-10-03.dne	0.797	9
90-10-04.dne	0.815	7
90-10-05.dne	0.824	8
90-10-06.dne	0.756	8
90-10-07.dne	0.735	8
90-10-08.dne	0.803	8
90-10-09.dne	0.74	9
90-10-10.dne	0.813	8
90-12-01.dne	1.032	13	0.9265	0.9472
90-12-02.dne	0.86	11
90-12-03.dne	0.905	14
90-12-04.dne	0.882	17
90-12-05.dne	0.871	9
90-12-06.dne	0.97	27
90-12-07.dne	1.033	20
90-12-08.dne	1.068	20
90-12-09.dne	0.903	13
90-12-10.dne	0.948	26
90-14-01.dne	1.153	21	1.118	1.1392
90-14-02.dne	1.097	20
90-14-03.dne	0.953	12
90-14-04.dne	1.192	22
90-14-05.dne	1.499	88
90-14-06.dne	1.005	16
90-14-07.dne	1.124	16
90-14-08.dne	1.112	16
90-14-09.dne	1.091	18
90-14-10.dne	1.166	27
90-16-01.dne	1.973	65	1.262	1.356
90-16-02.dne	1.157	14
90-16-03.dne	1.258	34
90-16-04.dne	1.399	45
90-16-05.dne	1.247	27
90-16-06.dne	1.326	49
90-16-07.dne	1.266	27
90-16-08.dne	1.194	29
90-16-09.dne	1.604	43
90-16-10.dne	1.136	18
90-18-01.dne	4.672	137	1.6705	2.03
90-18-02.dne	1.674	37
90-18-03.dne	1.667	27
90-18-04.dne	1.574	32
90-18-05.dne	2.387	62
90-18-06.dne	1.943	51
90-18-07.dne	1.559	36
90-18-08.dne	1.633	34
90-18-09.dne	1.441	38
90-18-10.dne	1.75	49
90-20-01.dne	1.912	34	2.3745	2.7119
90-20-02.dne	2.385	65
90-20-03.dne	2.227	61
90-20-04.dne	1.857	39
90-20-05.dne	3.503	117
90-20-06.dne	1.699	51
90-20-07.dne	4.931	149
90-20-08.dne	2.736	60
90-20-09.dne	2.364	49
90-20-10.dne	3.505	143
90-22-01.dne	7.722	187	3.658	3.8033
90-22-02.dne	4.885	140
90-22-03.dne	3.027	84
90-22-04.dne	3.314	88
90-22-05.dne	4.002	140
90-22-06.dne	1.956	42
90-22-07.dne	2.723	70
90-22-08.dne	2.091	46
90-22-09.dne	4.145	152
90-22-10.dne	4.168	118
90-24-01.dne	5.043	170	4.5515	5.1782
90-24-02.dne	2.552	59
90-24-03.dne	4.173	140
90-24-04.dne	4.012	110
90-24-05.dne	6.022	93
90-24-06.dne	4.813	142
90-24-07.dne	3.612	108
90-24-08.dne	4.29	117
90-24-09.dne	5.081	131
90-24-10.dne	12.184	288
90-26-01.dne	10.672	182	47.8675	56.0283
90-26-02.dne	91.13	596
90-26-03.dne	142.154	533
90-26-04.dne	12.934	197
90-26-05.dne	8.621	165
90-26-06.dne	66.838	361
90-26-07.dne	12.966	240
90-26-08.dne	28.897	318
90-26-09.dne	82.26	303
90-26-10.dne	103.811	300
90-30-01.dne	219.384	903	49.45	79.2023
90-30-02.dne	32.12	285
90-30-03.dne	15.316	262
90-30-04.dne	17.151	213
90-30-05.dne	121.313	443
90-30-06.dne	16.538	216
90-30-07.dne	21.406	207
90-30-08.dne	178.515	419
90-30-09.dne	103.5	480
90-30-10.dne	66.78	417
90-34-01.dne	6454.413	6433	190.9715	1102.0429
90-34-02.dne	39.327	231
90-34-03.dne	154.46	594
90-34-04.dne	35.44	292
90-34-05.dne	16.407	276
90-34-06.dne	16.995	214
90-34-07.dne	1943.598	3065
90-34-08.dne	1176.101	2204
90-34-09.dne	227.483	1048
90-34-10.dne	956.205	989
90-38-01.dne	2821.545	2138	2450.761	3174.670375
90-38-02.dne	3287.742	4268
90-38-03.dne	8301.217	6288
90-38-04.dne	1954.432	2266
90-38-05.dne	5183.046	5111
90-38-06.dne	2079.977	1794
90-38-07.dne	Out of memory	n/a
90-38-08.dne	1709.458	1941
90-38-09.dne	59.946	304
90-38-10.dne	Out of memory	n/a

DQMR:

Network	Ace Compile Time(s)	Ace Online Time(ms)	Ace Median Compile Time(s)	Ace Average Compile Time(s)
or-50-05-1.dne	2.08	132	3.2585	13.4264
or-50-05-10.dne	1.181	33
or-50-05-2.dne	66.624	433
or-50-05-3.dne	0.97	16
or-50-05-4.dne	16.301	245
or-50-05-5.dne	27.507	262
or-50-05-6.dne	0.997	18
or-50-05-7.dne	12.087	255
or-50-05-8.dne	3.204	186
or-50-05-9.dne	3.313	185
or-50-10-1.dne	6.922	236	2.3145	13.7998
or-50-10-10.dne	1.155	56
or-50-10-2.dne	0.986	22
or-50-10-3.dne	1.373	75
or-50-10-4.dne	3.478	202
or-50-10-5.dne	3.322	142
or-50-10-6.dne	1.902	127
or-50-10-7.dne	115.091	511
or-50-10-8.dne	1.042	22
or-50-10-9.dne	2.727	171
or-50-20-1.dne	52.871	454	5.5665	33.3894
or-50-20-10.dne	2.958	227
or-50-20-2.dne	173.285	910
or-50-20-3.dne	26.632	318
or-50-20-4.dne	1.256	49
or-50-20-5.dne	6.953	218
or-50-20-6.dne	4.18	203
or-50-20-7.dne	2.322	131
or-50-20-8.dne	1.156	42
or-50-20-9.dne	62.281	408
or-60-05-1.dne	1.128	40	2.265	21.2536
or-60-05-10.dne	1.485	79
or-60-05-2.dne	1.812	129
or-60-05-3.dne	150.362	1062
or-60-05-4.dne	1.108	21
or-60-05-5.dne	2.718	181
or-60-05-6.dne	6.793	272
or-60-05-7.dne	1.279	67
or-60-05-8.dne	42.787	473
or-60-05-9.dne	3.064	203
or-60-10-1.dne	106.95	732	10.957	66.8847
or-60-10-10.dne	82.258	1081
or-60-10-2.dne	16.204	286
or-60-10-3.dne	297.99	2584
or-60-10-4.dne	5.71	204
or-60-10-5.dne	2.158	133
or-60-10-6.dne	152.328	1061
or-60-10-7.dne	2.497	177
or-60-10-8.dne	1.194	47
or-60-10-9.dne	1.558	118
or-60-20-1.dne	357.056	2521	222.1515	364.8567
or-60-20-10.dne	34.221	541
or-60-20-2.dne	221.054	1413
or-60-20-3.dne	1.932	126
or-60-20-4.dne	395.671	1921
or-60-20-5.dne	576.021	3147
or-60-20-6.dne	1809.041	4563
or-60-20-7.dne	223.249	997
or-60-20-8.dne	22.789	382
or-60-20-9.dne	7.533	301
or-70-05-1.dne	10.164	240	10.4375	124.1708
or-70-05-10.dne	11.262	261
or-70-05-2.dne	10.711	297
or-70-05-3.dne	1.01	12
or-70-05-4.dne	165.89	1241
or-70-05-5.dne	3.563	227
or-70-05-6.dne	922.665	3581
or-70-05-7.dne	108.35	547
or-70-05-8.dne	6.801	304
or-70-05-9.dne	1.292	43
or-70-10-1.dne	2.884	173	131.8835	268.9098
or-70-10-10.dne	354.221	1836
or-70-10-2.dne	547.123	3107
or-70-10-3.dne	3.484	192
or-70-10-4.dne	1075.912	7021
or-70-10-5.dne	234.54	2542
or-70-10-6.dne	29.227	327
or-70-10-7.dne	435.808	1585
or-70-10-8.dne	3.472	233
or-70-10-9.dne	2.427	219
or-70-20-1.dne	9.462	256	170.31	1221.260333
or-70-20-10.dne	112.987	844
or-70-20-2.dne	88.148	745
or-70-20-3.dne	Out of memory	n/a
or-70-20-4.dne	2916.704	11272
or-70-20-5.dne	1312.5	7342
or-70-20-6.dne	246.671	1806
or-70-20-7.dne	170.31	1122
or-70-20-8.dne	6133.133	17717
or-70-20-9.dne	1.428	92