skip to main content
10.1145/2632856.2632915acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicimcsConference Proceedingsconference-collections
research-article

Image Super-Resolution Using Deep Belief Networks

Published: 10 July 2014 Publication History

Abstract

In this paper, we aim at using Deep Belief Networks (DBNs) to solve the problem of image super-resolution (SR). We exploit the hierarchical structure of the DBNs to capture the non-linear mapping from low-resolution (LR) patches to their high-resolution (HR) counterpart. When a query LR image is input, we divide it into a list of patches, then we put each patch into a forward propagation network which is a trained deep belief network. The output is the predicted HR patches. Finally, we combine the HR patches into expected HR images. We evaluate our approach on a popular dataset which is used in other super-resolution literature. Experimental results demonstrate the performance of our method is superior to several state-of-the-art super-resolution methods both quantitatively and perceptually.

References

[1]
X. Li and M. T. Orchard, "New Edge-Directed Interpolation," IEEE TRANSACTIONS ON IMAGE PROCESSING, vol. 10, pp. 1521, 2001.
[2]
R. Schultz and R. Stevenson, "A Bayesian approach to image expansion for improved definition," IEEE Transactions on Image Processing, vol. 3, pp. 233--242, 1994.
[3]
W.-S. Tam, C.-W. Kok, and W.-C. Siu, "Modified edge-directed interpolation for images," Journal of Electronic Imaging, vol. 19, pp. 013011-013011-20, 2010.
[4]
J. Sun, Z. Xu, and H.-Y. Shum, "Image super-resolution using gradient profile prior," Computer Vision and Pattern Recognition 2008, pp. 1--8, 2008.
[5]
S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 1167--1183, 2002.
[6]
M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution, occlusion, and transparency," Journal of Visual Communication and Image Representation, vol. 4, pp. 324--335, 1993.
[7]
K.-W. Hung and W.-C. Siu, "New motion compensation model via frequency classification for fast video super-resolution," Image Processing, pp. 1193--1196, 2009.
[8]
B. S. Morse and D. Schwartzwald, "Image magnification using-level-set reconstruction," CVPR 2001, pp. I-333--I-340 vol. 1, 2001.
[9]
Q. Shan, Z. Li, J. Jia, and C.-K. Tang, "Fast image/video upsampling," ACM Transactions on Graphics, pp. 153, 2008.
[10]
W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based super-resolution," Computer Graphics and Applications, IEEE, vol. 22, pp. 56--65, 2002.
[11]
H. Chang, D.-Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," CVPR 2004, pp. I-275--I-282 Vol. 1, 2004.
[12]
C. Liu, H.-Y. Shum, and W. T. Freeman, "Face hallucination: Theory and practice," International Journal of Computer Vision, vol. 75, pp. 115--134, 2007.
[13]
Q. Wang, X. Tang, and H. Shum, "Patch based blind image super resolution," Computer Vision, pp. 709--716, 2005.
[14]
J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," CVPR 2008, pp. 1--8, 2008.
[15]
K. S. Ni and T. Q. Nguyen, "Image super-resolution using support vector regression," IEEE Transactions on Image Processing, vol. 16, pp. 1596--1610, 2007.
[16]
H. He and W.-C. Siu, "Single image super-resolution using Gaussian process regression," CVPR 2011, pp. 449--456, 2011.
[17]
J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Transactions on Image Processing, vol. 19, pp. 2861--2873, 2010.
[18]
K. I. Kim and Y. Kwon, "Single-image super-resolution using sparse regression and natural image prior," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, pp. 1127--1133, 2010.
[19]
G. E. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural Computation, vol. 18, pp. 1527--1554, 2006.
[20]
V. Nair and G. Hinton, "3-D object recognition with deep belief nets," Advances in Neural Information Processing Systems 22, pp. 1339--1347, 2009.
[21]
D. Ciresan, U. Meier and J. Schmidhuber. "Multi-column Deep Neural Networks for Image Classification." Computer Vision and Pattern Recognition, pp. 3642--3649, 2012.
[22]
A. Mohamed, G. Dahl, and G. Hinton, "Acoustic Modeling using Deep Belief Networks," IEEE Trans. on Audio, Speech, and Language Procesing, vol. 20, no. 1, pp. 14--22, 2012.

Cited By

View all

Index Terms

  1. Image Super-Resolution Using Deep Belief Networks

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICIMCS '14: Proceedings of International Conference on Internet Multimedia Computing and Service
    July 2014
    430 pages
    ISBN:9781450328104
    DOI:10.1145/2632856
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • NSF of China: National Natural Science Foundation of China
    • Beijing ACM SIGMM Chapter

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 July 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Deep Belief Networks
    2. Super-resolution

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICIMCS '14

    Acceptance Rates

    Overall Acceptance Rate 163 of 456 submissions, 36%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 21 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media