article

Dynamic distortion maps for image retargeting

Authors:

Deepu RajanAuthors Info & Claims

Journal of Visual Communication and Image Representation, Volume 24, Issue 1

Pages 81 - 92

https://doi.org/10.1016/j.jvcir.2012.11.002

Published: 01 January 2013 Publication History

Abstract

We present an image retargeting method that incorporates image content distortion into a mesh optimization process through the generation of dynamic distortion maps. The warping process is driven by the distortion produced by the warping process itself. We retarget the image through an iterative mesh optimization process to minimize the visual distortion. An adaptive distortion map is iteratively constructed to describe the visual distortion between the original image and the retargeted image. The mesh mapping from the source image to the retargeted image is optimized through an energy minimization process. The objective of the optimization is to allow the distortion produced by the retargeting process to be distributed to smooth and highly textured regions which cause less visual distortion while preserving the geometrical structure of the mesh at regions that may cause distortion after retargeting. Experimental evaluation of the algorithm is done both subjectively and objectively.

References

[1]

F. Liu, M. Gleicher, Video retargeting: automating pan and scan, in: ACM International Conference on Multimedia, Santa Barbara, CA, USA, 2006, pp. 241-250.

[2]

T. Deselaers, P. Dreuw, H. Ney, Pan, zoom, scan - time-coherent, trained automatic video cropping, in: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, 2008, p. 1.

[3]

C. Tao, J. Jia, H. Sun, Active window oriented dynamic video retargeting, in: IEEE International Conference on Computer Vision-WDV, Rio de Janeiro, Brazil, 2007, p. 1.

[4]

R. Gal, O. Sorkine, D. Cohen-Or, Feature-aware texturing, in: Eurographics Symposium on Rendering, Nicosia, Cyprus, 2006, pp. 297-303.

[5]

Wang, Y.S., Tai, C.L., Sorkine, O. and Lee, T.Y., Optimized scale-and-stretch for image resizing. ACM Transactions on Graphics. v27 i5. 118

[6]

Y. Niu, F. Liu, X. Li, M. Gleicher, Warp propagation for video resizing, in: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, 2010, pp. 537-544.

[7]

Wang, Y.S., Lin, H.C., Sorkine, O. and Lee, T.Y., Motion-based video retargeting with optimized crop-and-warp. ACM Transactions on Graphics. v29 i4. 1

[8]

F. Liu, M. Gleicher, Automatic image retargeting with Fisheye-view warping, in: ACM Annual Symposium on User Interface Software and Technology, Seattle, WA, USA, 2005, pp. 153-162.

[9]

Guo, Y., Liu, F., Shi, J., Zhou, Z. and Gleicher, M., Image retargeting using mesh parameterization. IEEE Transactions on Multimedia. v11 i5. 856-867.

[10]

Karni, Z., Freedman, D. and Gotsman, C., Energy-based image deformation. Computer Graphics Forum. v28 i5. 1257-1268.

[11]

Jin, Y., Liu, L. and Wu, Q., Nonhomogeneous scaling optimization for realtime image resizing. The Visual Computer. v26 i6-8. 769-778.

[12]

Rubinstein, M., Shamir, A. and Avidan, S., Improved seam carving for video retargeting. ACM Transactions on Graphics. v27 i3. 1

[13]

Rubinstein, M., Gutierrez, D., Sorkine, O. and Shamir, A., A comparative study of image retargeting. ACM Transactions on Graphics. v29 i6. 160

[14]

A. Shamir, O. Sorkine, Visual media retargeting, ACM SIGGRAPH Asia Courses, 2009, p. 1.

[15]

Avidan, S. and Shamir, A., Seam carving for content-aware image resizing. ACM Transactions on Graphics. v26 i3. 10

[16]

M. Grundmann, V. Kwatra, M. Han, I. Essa, Discontinuous seam-carving for video retargeting, in: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, 2010, pp. 569-576.

[17]

Y. Pritch, E. Kav-venaki, S. Peleg, Shift-map image editing, in: IEEE International Conference on Computer Vision, Kyoto, Japan, 2009, pp. 151-158.

[18]

T.S. Cho, M. Butman, S. Avidan, W.T. Freeman, The patch transform and its applications to image editing, in: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, 2008, p. 1.

[19]

Rubinstein, M., Shamir, A. and Avidan, S., Multi-operator media retargeting. ACM Transactions on Graphics. v28 i3.

[20]

L. Wolf, M. Guttmann, D. Cohen-Or, Content-driven video retargeting, in: IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil, 2007, pp. 1-6.

[21]

Krahenbuhl, P., Lang, M., Hornung, A. and Gross, M., A system for retargeting of streaming video. ACM Transactions on Graphics. v28 i5. 1

[22]

J.S. Kim, J.H. Kim, C.S. Kim, Adaptive image and video retargeting technique based on Fourier analysis, in: IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 2009, pp. 1730-1737.

[23]

Y. Hu, D. Rajan, L.T. Chia, Adaptive local context suppression of multiple cues for salient visual attention detection, in: International Conference on Multimedia & Expo, Amsterdam, The Netherlands, 2005, pp. 346-349.

[24]

Koenderink, J.J., The structure of images. Biological Cybernetics. v50 i5. 363-370.

[25]

O. Pele, M. Werman, Fast and robust earth mover's distances, in: IEEE International Conference on Computer Vision, Kyoto, Japan, 2009, pp. 460-467.

[26]

C. Liu, J. Yuen, A. Torralba, J. Sivic, W.T. Freeman, Sift flow: dense correspondence across different scenes, in: European Conference on Computer Vision, Marseille, France, 2008, pp. 28-42.

Digital Library

Cited By

Karimi MSamavi SKarimi NSoroushmehr SLin WNajarian K(2017)Quality assessment of retargeted images by salient region deformity analysisJournal of Visual Communication and Image Representation10.1016/j.jvcir.2016.12.01143:C(108-118)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1016/j.jvcir.2016.12.011

Recommendations

Image retargeting using mesh parametrization

Image retargeting aims to adapt images to displays of small sizes and different aspect ratios. Effective retargeting requires emphasizing the important content while retaining surrounding context with minimal visual distortion. In this paper, we present ...
Image Retargeting by Combining Region Warping and Occlusion
Advances in Multimedia Information Processing – PCM 2013
Abstract
Image retargeting aims to avoid visual distortion while retaining important image content in resizing. However, current image retargeting methods usually fail in difficult situations, such as complex structures and intricate arrangements of ...
Image retargeting with a 3D saliency model

Image retargeting is an attractive topic since variety devices are with different resolutions. So far, there are two main strategies for this problem. One is removing or adding appropriate pixels in image directly, such as the seam carving approach, and ...

Comments

Information & Contributors

Information

Published In

cover image Journal of Visual Communication and Image Representation

Journal of Visual Communication and Image Representation Volume 24, Issue 1

January, 2013

93 pages

ISSN:1047-3203

Issue’s Table of Contents

Copyright © Elsevier Inc. © 2012.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 January 2013

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Karimi MSamavi SKarimi NSoroushmehr SLin WNajarian K(2017)Quality assessment of retargeted images by salient region deformity analysisJournal of Visual Communication and Image Representation10.1016/j.jvcir.2016.12.01143:C(108-118)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1016/j.jvcir.2016.12.011

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents