ZBrushCentral

Medical App using ZBrush

Just wanted to let everyone know that an app we built using ZBrush launched to the App Store yesterday. Surgical Anatomy of the Liver is our first app at Emory.

We have a brief making of video, where you see me working a little in ZBrush:

[youtubehd]f4eCHLqqsv8[/youtubehd]

Happy ZBrushing,

Michael Konomos, MS, CMI
Medical Illustrator
Visual Medical Education
Emory University School of Medicine
[email protected]

Attachments

liver app.jpg

We created our app for surgical residents and medical students. They normally have to learn the liver through CT scans (if you can imagine that!).

The liver is on the left, and we are looking at the body from the perspective of the feet. I used this image, among many others, as reference for the liver, as well as working with Dr. Shishir Maithel, a surgical oncologist that is a real expert on liver anatomy.


So we built the liver, all of the segments, and the vessels in Zbrush. It was a really fun experience. I’ve used other 3D platforms before but it’s only in ZBrush that I feel like an artist.

This view of the liver show the realistic texture of the liver, that we start the user off with in the app.


I had the privilege to view surgical procedures that served as great reference materials for this educational tool. I blurred out most of the surgical field in this image, but I wanted to show what the real live human liver looks like. As you can hopefully see in the previous image I posted, I took a lot of inspiration from these observations in the textures that I painted.


In these details of the liver texture, you can see how I used Polypaint to capture the liver texture. I considered using the actual photos and projecting them onto the liver, but you can’t really see the back of the liver in surgery, so I just painted it from scratch. I picked an overall hue for the liver, filled the model, and then used the standard brush loaded with different reds, magentas, and light blues and an alpha turned on to get the subtleties of the liver surface to be believable.

What I find interesting is that every liver I have seen in life is different, just as every human face is different. Slightly different shapes and colors make us all unique.


I built the vessels using zspheres. Then I made them into meshes and cut the caps and did some subtle sculpting with the move brush to make them look a little more organic.

In order to prep them for Unity3D, I had to ZRemesh them and then paint on polygroups, which Unity3D can use as separate sub models when we have polygroups checked on during MM Exporter. We then used these sub models to allow the user to select each branch of the vessel and get a label for it, without creating too many draw calls in the process. Couldn’t have built the app without that ability!


Here are the other vessels as well. These vessels hide within the tissue of the liver in surgery, and so it’s important for the surgeon to know where they are. Our app gives the learner the ability to turn off the liver, like you can in ZBrush sub tools, and see what is underneath.

Surgeons will sometimes remove parts of the liver without removing the whole thing, so they have to be able to imagine right where the vessels are.

Dr. Maithel and I would sit side by side in front of my Cintiq and he would give me specific instructions about the normal placement of the vessels in ZBrush. In realtime I would use the move tool or the move brush and change, ever so slightly, the location of a vessel to ensure it was in just the right place. Often we would have the position everything in the view that the surgeon was used to looking at the liver in - either a sideways view like in the OR, or more often the bottom-up view of the CT scan. Dr. Maithel was great to work with. Really passionate about getting the details right, and also really tickled by what we could do in ZBrush. I even let him try it out himself and he seemed to enjoy that.

Low poly meshes.

great work! Love seeing it in the context of the app. I work for a medical agency right now and we’ve been drilling zbrush into our pipeline these past few months. Just lends itself so well to all the anatomy/micro detail work :slight_smile:
Thanks for sharing! :smiley:

I love the use of 3D graphics in science. I hope this will be the direction in which education will go.
Great work, congratulations.

Fascinating and great work - thanks for sharing.

Great stuff thanks for posting.

Very nice work!