Performance#
Accuracy Performance#
To measure the accuracy of MAISI, synthetic images along with their annotated labels are generated. The VISTA-3D model is then used to evaluate the image quality. The table below shows the Dice score calculated between the MAISI-generated label and the VISTA-3D segmentation for specific anatomies. All tests are conducted with a spacing of 1mm.
Accuracy#
Case |
Body Region |
Anatomy |
Image Size |
Dice Score |
|---|---|---|---|---|
1 |
chest |
aorta |
256x256x256 |
0.938 |
2 |
chest |
left lung upper lobe |
256x256x128 |
0.819 |
3 |
abdomen |
liver |
256x256x256 |
0.945 |
4 |
abdomen |
spleen |
256x256x128 |
0.940 |
Speed Performance#
The speed is measured for generating different body regions, anatomies, and image sizes. The table below shows the generation speed on different GPUs. All tests are conducted with a spacing of 1mm.
Case |
Body Region |
Anatomy |
Image Size |
Speed on A100 (seconds) |
Speed on H100 (seconds) |
|---|---|---|---|---|---|
1 |
chest |
aorta |
256x256x256 |
72 |
28 |
2 |
chest |
left lung upper lobe |
256x256x128 |
25 |
13 |
3 |
abdomen |
liver |
256x256x256 |
82 |
59 |
4 |
abdomen |
spleen |
256x256x128 |
26 |
14 |
5 |
chest |
aorta |
512x512x512 |
95 |
55 |
6 |
abdomen |
spleen |
512x512x512 |
93 |
56 |
Note
You may experience a slowdown when using Windows Subsystem for Linux (WSL).*