This technology includes a fully automatic 3D image processing system to segment the heart as well as other organs from contrast-enhanced cardiac computed tomography (CCT) images. Our method detects four cardiac chambers including left ventricle, right ventricle, left atrium, right atrium, as well as the ascending aorta and left ventricular myocardium. It also classifies noncardiac tissue structures in the CCT images such as lung, chest wall, spine, descending aorta, and liver. This automated system is based on computer vision algorithms to improve commonly used multi-atlas approach for automated segmentation of both cardiac and non-cardiac structures.