Performance#
Accuracy Performance#
To measure the accuracy of MAISI, synthetic images along with their annotated labels are generated. The VISTA-3D model is then used to evaluate the image quality. The table below shows the Dice score calculated between the MAISI-generated label and the VISTA-3D segmentation for specific anatomies. All tests are conducted with a spacing of 1mm.
Accuracy#
Case |
Body Region |
Anatomy |
Image Size |
Dice Score |
---|---|---|---|---|
1 |
chest |
aorta |
256x256x256 |
0.885 |
2 |
chest |
left lung upper lobe |
256x256x128 |
0.777 |
3 |
abdomen |
liver |
256x256x256 |
0.909 |
4 |
abdomen |
spleen |
256x256x128 |
0.935 |
Speed Performance#
The speed is measured for generating different body regions, anatomies, and image sizes. The table below shows the generation speed on different GPUs. All tests are conducted with a spacing of 1mm.
Case |
Body Region |
Anatomy |
Image Size |
Speed on A100 (seconds) |
Speed on H100 (seconds) |
---|---|---|---|---|---|
1 |
chest |
aorta |
256x256x256 |
158 |
102 |
2 |
chest |
left lung upper lobe |
256x256x128 |
122 |
82 |
3 |
abdomen |
liver |
256x256x256 |
190 |
138 |
4 |
abdomen |
spleen |
256x256x128 |
123 |
82 |
5 |
chest |
aorta |
512x512x512 |
649 |
455 |
6 |
abdomen |
spleen |
512x512x512 |
651 |
456 |
Note: You may experience a slowdown when using Windows Subsystem for Linux (WSL).