Browse Source

[ENH] add memory comparison on MNIST example

pull/8/head
Gao Enhao 1 year ago
parent
commit
a371b776f9
2 changed files with 71 additions and 2 deletions
  1. +41
    -1
      docs/Examples/MNISTAdd.rst
  2. +30
    -1
      examples/mnist_add/README.md

+ 41
- 1
docs/Examples/MNISTAdd.rst View File

@@ -371,6 +371,40 @@ Log:
abl - INFO - Evaluation ended, mnist_add/character_accuracy: 0.991 mnist_add/reasoning_accuracy: 0.980


Environment
-----------

For all experiments, we used a single linux server. Details on the specifications are listed in the table below.

.. raw:: html

<style type="text/css">
.tg {border-collapse:collapse;border-spacing:0;margin-bottom:20px;}
.tg td, .tg th {border:1px solid #ddd;padding:8px 22px;text-align:center;}
.tg th {background-color:#f5f5f5;color:#333333;}
.tg tr:nth-child(even) {background-color:#f9f9f9;}
.tg tr:nth-child(odd) {background-color:#ffffff;}
</style>

<table class="tg" style="margin-left: auto; margin-right: auto;">
<thead>
<tr>
<th>CPU</th>
<th>GPU</th>
<th>Memory</th>
<th>OS</th>
</tr>
</thead>
<tbody>
<tr>
<td>2 * Xeon Platinum 8358, 32 Cores, 2.6 GHz Base Frequency</td>
<td>A100 80GB</td>
<td>512GB</td>
<td>Ubuntu 20.04</td>
</tr>
</tbody>
</table>


Performance
-----------
@@ -398,6 +432,7 @@ We present the results of ABL as follows, which include the reasoning accuracy (
<th>Method</th>
<th>Accuracy</th>
<th>Time to achieve the Acc. (s)</th>
<th>Peak Memory Usage (MB)</th>
</tr>
</thead>
<tbody>
@@ -405,26 +440,31 @@ We present the results of ABL as follows, which include the reasoning accuracy (
<td>NeurASP</td>
<td>96.2</td>
<td>966</td>
<td>3552</td>
</tr>
<tr>
<td>DeepProbLog</td>
<td>97.1</td>
<td>2045</td>
<td>3521</td>
</tr>
<tr>
<td>LTN</td>
<td>97.4</td>
<td>251</td>
<td>3860</td>
</tr>
<tr>
<td>DeepStochLog</td>
<td>97.5</td>
<td>257</td>
<td>3545</td>
</tr>
<tr>
<td>ABL</td>
<td><span style="font-weight:bold">98.1</span></td>
<td><span style="font-weight:bold">47</span></td>
<td><span style="font-weight:bold">47</span></td>
<td><span style="font-weight:bold">2482</span></td>
</tr>
</tbody>
</table>

+ 30
- 1
examples/mnist_add/README.md View File

@@ -47,6 +47,29 @@ optional arguments:

```

## Environment

For all experiments, we used a single linux server. Details on the specifications are listed in the table below.

<table class="tg" style="margin-left: auto; margin-right: auto;">
<thead>
<tr>
<th>CPU</th>
<th>GPU</th>
<th>Memory</th>
<th>OS</th>
</tr>
</thead>
<tbody>
<tr>
<td>2 * Xeon Platinum 8358, 32 Cores, 2.6 GHz Base Frequency</td>
<td>A100 80GB</td>
<td>512GB</td>
<td>Ubuntu 20.04</td>
</tr>
</tbody>
</table>


## Performance

@@ -63,6 +86,7 @@ We present the results of ABL as follows, which include the reasoning accuracy (
<th>Method</th>
<th>Accuracy</th>
<th>Time to achieve the Acc. (s)</th>
<th>Peak Memory Usage (MB)</th>
</tr>
</thead>
<tbody>
@@ -70,26 +94,31 @@ We present the results of ABL as follows, which include the reasoning accuracy (
<td>NeurASP</td>
<td>96.2</td>
<td>966</td>
<td>3552</td>
</tr>
<tr>
<td>DeepProbLog</td>
<td>97.1</td>
<td>2045</td>
<td>3521</td>
</tr>
<tr>
<td>LTN</td>
<td>97.4</td>
<td>251</td>
<td>3860</td>
</tr>
<tr>
<td>DeepStochLog</td>
<td>97.5</td>
<td>257</td>
<td>3545</td>
</tr>
<tr>
<td>ABL</td>
<td><span style="font-weight:bold">98.1</span></td>
<td><span style="font-weight:bold">47</span></td>
<td><span style="font-weight:bold">47</span></td>
<td><span style="font-weight:bold">2482</span></td>
</tr>
</tbody>
</table>

Loading…
Cancel
Save