skip to main content
10.1145/2627369.2627645acmconferencesArticle/Chapter ViewAbstractPublication PagesislpedConference Proceedingsconference-collections
research-article

StoRM: a stochastic recognition and mining processor

Published: 11 August 2014 Publication History

Abstract

Recognition and Mining are emerging application domains that are becoming prevalent across the entire spectrum of computing platforms, and place very high demands on their capabilities. We propose a Stochastic Recognition and Mining processor (StoRM), which uses Stochastic Computing (SC) to efficiently realize computational kernels from these domains. Stochastic computing facilitates compact, power-efficient realization of arithmetic operations by representing and processing information as pseudo-random bit-streams. However, the overhead of conversion between representations, and the exponential relationship between precision and bit-stream length, are key challenges that limit the efficiency of stochastic designs. The proposed architecture for StoRM consists of a 2D array of Stochastic Processing Elements (StoPEs) with a streaming memory hierarchy, enabling binary-to-stochastic conversion to be amortized across rows or columns of StoPEs. We propos vector processing and segmented stochastic processing in the StoPEs to mitigate the unfavorable tradeoff between precision and bit-stream length. We also exploit the compactness of StoPEs to increase parallelism, thereby improving performance and energy efficiency. Finally, leveraging the resilience of RM applications to approximations in their computations, we design StoRM to support modulation of the stochastic bit-stream length, and utilize this capability to to optimize energy for a desired output quality. StoRM achieves 2-3X energy-delay improvements over a conventional design without sacrificing output quality, and upto 10X (20X) improvements when upto 5% (10%) loss in output quality is allowed. Our results also demonstrate that the proposed design techniques greatly enhance the applicability and benefits of stochastic computing.

References

[1]
C. Chu et. al. Map-reduce for machine learning on multicore. Proc. NIPS, 2007.
[2]
J. Meng et. al. Best-effort parallel execution framework for recognition and mining applications. Proc. IPDPS, 2009.
[3]
A. Majumdar et. al. A massively parallel, energy efficient programmable accelerator for learning and classification. ACM Trans. Architecture Code Optimization, 2012.
[4]
R. Iyer et. al. CogniServe: Heterogeneous server architecture for large-scale recognition. IEEE MICRO, 2011.
[5]
S. Lee et. al. A 345mw heterogeneous many-core processor with an intelligent inference engine for robust object recognition. In Proc. ISSCC, 2010.
[6]
B. R. Gaines. Stochastic computing. In Proc. SJCC, 1967.
[7]
A. Alaghi et. al. Survey of stochastic computing. Trans. Embedded Computing Systems, 2013.
[8]
V. K. Chippa et. al. Analysis and characterization of inherent application resilience for approximate computing. In Proc. DAC, 2013.
[9]
V. C. Gaudet. Iterative decoding using stochastic computation. Electronics Letters, 2003.
[10]
P. Li et. al. Using stochastic computing to implement digital image processing algorithms. In Proc. ICCD, 2011.
[11]
W. Qian et. al. An architecture for fault-tolerant computation with stochastic logic. IEEE Trans. on Computers, 2011.
[12]
A. Alaghi et. al. Stochastic circuits for real-time image-processing applications. In Proc. DAC, 2013.
[13]
S. T. Chakradhar et. al. Best-effort computing: Re-thinking parallel software and hardware. In Proc. DAC, 2010.
[14]
V. K. Chippa, H. Jayakumar, D. Mohapatra, K. Roy, and A. Raghunathan. Energy-efficient recognition and mining processor using scalable effort design. In Proc. CICC, 2013.
[15]
R. Hegde et. al. Energy-efficient signal Processing via algorithmic noise-tolerance. In Proc. ISLPED, 1999.
[16]
K. Palem et. al. Sustaining moore's law in embedded computing through probabilistic and approximate design: retrospects and prospects. In Proc. CASES, 2009.
[17]
V. Gupta et. al. IMPACT: Imprecise adders for low-power approximate computing. In Proc. ISLPED, 2011.
[18]
A. Lingamneni et al. Energy parsimonious circuit design through probabilistic pruning. In Proc. DATE, 2011.
[19]
S. Venkataramani et. al. SALSA: Systematic logic synthesis of approximate circuits. In Proc. DAC, 2012.
[20]
V. K. Chippa et. al. Scalable effort hardware design: Exploiting algorithmic resilience for energy efficiency. In Proc. DAC, 2010.
[21]
S. Venkataramani et. al. Quality programmable vector processors for approximate computing. In Proc. MICRO, 2013.
[22]
W. J. Poppelbaum et. al. Stochastic computing elements and systems. In Proc. JCC, 1967.
[23]
B. D. Brown et. al. Stochastic neural computation. I. Computational elements. IEEE Trans. on Computers, 2001.
[24]
J. M. Quero et. al. Continuous time controllers using digital programmable devices. In Proc. IECON, 1999.

Cited By

View all

Index Terms

  1. StoRM: a stochastic recognition and mining processor

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ISLPED '14: Proceedings of the 2014 international symposium on Low power electronics and design
    August 2014
    398 pages
    ISBN:9781450329750
    DOI:10.1145/2627369
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 August 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. approximate computing
    2. inherent application resilience
    3. recognition and mining applications
    4. rms
    5. stochastic computing

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    ISLPED'14
    Sponsor:

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 30 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media