Research Projects |
![]() ![]() ![]() ![]() |
The speed and quality of imaging cardiac structures (coronary arteries, cardiac valves etc) in MR can be improved by tracking and predicting their motion in MR images. The problem is challenging not only due to the complex motion of these structures that significantly changes the appearance of the region of interest, but also the ability to track at different spatial and temporal resolutions depending on the application. We have developed a multiple template-based tracking method to track these cardiac structures reliably and accurately in MR images. Depending on the cardiac structure being imaged, we have proposed subject-specific approaches that provide better motion compensation. In MR coronary angiography, we proposed an approach to track coronary artery in high speed, low-resolution MR images, and to use the extracted motion information to 'servo' the MR imaging slice to compensate for motion, thereby acquiring the data as if the structure was stationary (see top two figures on the left). In cardiac valve MR imaging, we developed an image-based tracking approach that estimates the valve plane motion through the cardiac cycle in high-resolution cine images taken during a pre-scan, which can then be used to adaptively re-position the acquisition slice during data acquisiton. Also, real-time tracking of the valve planes can be employed to account for shifts between pre-scan and data acqusiition (see bottom two figures on the left).
|
|
Multiple Kernel SSD tracking Optimal Kernel Tracking
|
|
![]() ![]() |
Vision-based Virtual Fixtures for Human-Machine Cooperative Manipulation
Vision-based Assistance for Ophthalmic Micro-Surgery
For more information regarding the project, see the
Human Machine Collaborative Systems (HMCS) website.
The project involved the development of a system for 6-DOF human-machine cooperative motion using vision-based virtual fixtures for applications in retinal micro-surgery. The system makes use of a calibrated stereo imaging system to track surfaces in the environment, and simultaneously tracks a tool held by the JHU Steady-Hand Robot. As the robot is guided using force inputs from the user, a relative error between the estimated surface and the tool position is established. Vision-based virtual fixtures are used to guide the user along the surface in both position and orientation. Preliminary results in the macro-scale show the effectiveness of the system in guiding a user along the surface and performing different sub-tasks such as tool alignment and targeting within the resolution of the visual system.
|
|
We have proposed a subspace labeling technique for global
Image segmentation in a particular feature subspace is a fairly well
understood problem. However, it is well known that operating in only a
single feature subspace, e.g. color, texture, etc, seldom yields a good
segmentation for real images. However, combining information from
multiple subspaces in an optimal manner is a difficult problem to solve
algorithmically. We propose a solution that fuses contributions from
multiple feature subspaces using an energy minimization approach. For
each subspace, we compute a per-pixel quality measure and perform a
partitioning through the standard normalized cut algorithm. To fuse the
subspaces into a final segmentation, we compute a subspace label for
every pixel. The labeling is computed through the graph-cut energy
minimization framework proposed by Boykov et al. Finally, we combine
the initial subspace segmentation with the subspace labels obtained from
the energy minimization to yield the final segmentation.
|





