Research Projects








Motion Compensation in Cardiac MR

The speed and quality of imaging cardiac structures (coronary arteries, cardiac valves etc) in MR can be improved by tracking and predicting their motion in MR images. The problem is challenging not only due to the complex motion of these structures that significantly changes the appearance of the region of interest, but also the ability to track at different spatial and temporal resolutions depending on the application. We have developed a multiple template-based tracking method to track these cardiac structures reliably and accurately in MR images. Depending on the cardiac structure being imaged, we have proposed subject-specific approaches that provide better motion compensation.

In MR coronary angiography, we proposed an approach to track coronary artery in high speed, low-resolution MR images, and to use the extracted motion information to 'servo' the MR imaging slice to compensate for motion, thereby acquiring the data as if the structure was stationary (see top two figures on the left).

In cardiac valve MR imaging, we developed an image-based tracking approach that estimates the valve plane motion through the cardiac cycle in high-resolution cine images taken during a pre-scan, which can then be used to adaptively re-position the acquisition slice during data acquisiton. Also, real-time tracking of the valve planes can be employed to account for shifts between pre-scan and data acqusiition (see bottom two figures on the left).

  • M Dewan, GD Hager, CH Lorenz. Image-based Coronary Tracking and Beat-to-Beat Motion Compensation for Robust Coronary MR Angiography. Submitted to Magnetic Resonance in Medicine .
  • M Dewan, D Mayhew, A Greiser, GD Hager, CH Lorenz. Image-based Tracking of Heart Valves for Improved Motion Compensation. Submitted to International Society for Magnetic Resonance Medicine (ISMRM), 2007.
  • M Dewan, GD Hager, SM Shea, CH Lorenz. Compensating for Beat-to-Beat Variation in Coronary Motion Improves Image Quality in Coronary MR. In Proceedings of the International Society for Magnetic Resonance Medicine (ISMRM), 14th Scientific Meeting in Seattle, page 2159, May 2006.
  • M Dewan, GD Hager, CH Lorenz. Image-Based Tracking and Prediction of Coronary Motion for Coronary MR Angiography. In Proceedings of the 9th Annual Meeting of the Society for Cardiovascular Magnetic Resonance (SCMR), January 2006.

back to top







Kernel-Based Tracking

Multiple Kernel SSD tracking
Kernel-based tracking methods have recently gained popularity primarily due to their broad range of convergence and their robustness to unmodelled spatial deformations. We demonstrated a connection between kernel-based algorithms and more traditional template tracking methods. There is a well known equivalence between the kernel-based objective function and an SSD-like measure on kernel-modulated histograms, that can be optimized using Newton-style iterations. This method of optimization is more efficient (requires fewer steps to converge) than gradient descent mean shift and makes fewer assumptions on the form of the underlying kernel structure. In addition, the method naturally extends to objective functions optimizing more elaborate parametric motion models using multiple spatially distributed kernels. The multi-kernel methods are demonstrated on a variety of examples ranging from tracking of unstructured objects in image sequences to stereo tracking of structured objects.

Optimal Kernel Tracking
In practice, the design and development of tracking algorithms is still relatively ad-hoc leading to sub-optimal performance. The two primary drawbacks of the current kernel-based tracking approaches are 1) the same kernel is used for all image projections, and 2) kernel parameters (location and scale) are chosen in ad-hoc manner. The location is chosen at the center of the image with the scale equal to the size of target. We present an objective approach for developing optimal tracking methods, and have demonstrated this approach for the specific case of kernel-based tracking. We have shown that this optimization can be performed using effective approximations for one-dimensional and two-dimensional cases. In addition, the optimization can be easily generalized to higher-dimensional problems. The results on several examples illustrate the potential advantages of the optimizing a target-specific kernel. Finally, we believe these results point the way towards a more principled and consistent methodology for the design of visual tracking algorithms.

  • M Dewan, GD Hager. Toward Optimal Kernel-based Tracking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1:618-625, June 2006
  • GD Hager, M Dewan, CV Stewart. Multiple Kernel Tracking with SSD. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2004), volume 1, pages 790-797, 2004.

back to top




Vision-based Virtual Fixtures for Human-Machine Cooperative Manipulation

Vision-based Assistance for Ophthalmic Micro-Surgery
The project involved the development of a system for 6-DOF human-machine cooperative motion using vision-based virtual fixtures for applications in retinal micro-surgery. The system makes use of a calibrated stereo imaging system to track surfaces in the environment, and simultaneously tracks a tool held by the JHU Steady-Hand Robot. As the robot is guided using force inputs from the user, a relative error between the estimated surface and the tool position is established. Vision-based virtual fixtures are used to guide the user along the surface in both position and orientation. Preliminary results in the macro-scale show the effectiveness of the system in guiding a user along the surface and performing different sub-tasks such as tool alignment and targeting within the resolution of the visual system.

For more information regarding the project, see the Human Machine Collaborative Systems (HMCS) website.

  • M Dewan, P Marayong, AM Okamura, GD Hager. Vision-Based Assistance for Ophthalmic Microsurgery. In Seventh International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2004, Vol. 2, pp. 49-57.

back to top



Subspace Labeling and Fusion via Energy Minimization

[Click for detailed project page on subspace fusion for global segmentation.]

We have proposed a subspace labeling technique for global Image segmentation in a particular feature subspace is a fairly well understood problem. However, it is well known that operating in only a single feature subspace, e.g. color, texture, etc, seldom yields a good segmentation for real images. However, combining information from multiple subspaces in an optimal manner is a difficult problem to solve algorithmically. We propose a solution that fuses contributions from multiple feature subspaces using an energy minimization approach. For each subspace, we compute a per-pixel quality measure and perform a partitioning through the standard normalized cut algorithm. To fuse the subspaces into a final segmentation, we compute a subspace label for every pixel. The labeling is computed through the graph-cut energy minimization framework proposed by Boykov et al. Finally, we combine the initial subspace segmentation with the subspace labels obtained from the energy minimization to yield the final segmentation.

  • JJ Corso, M Dewan, GD Hager. Image Segmentation Through Energy Minimization Based Subspace Fusion. In Proceedings of 17th International Conference on Pattern Recogntion (ICPR 2004), 2004.
  • JJ Corso, M Dewan, GD Hager. Image Segmentation Through Energy Minimization Based Subspace Fusion. Technical Report  CIRL-TR-04-01, The Johns Hopkins University, 2004.

back to top

My graduate work was funded by the graduate student fellowship from Siemens Corporate Research and the National Science Foundation.