skip to main content
research-article

Structure-oriented networks of shape collections

Published: 05 December 2016 Publication History

Abstract

We introduce a co-analysis technique designed for correspondence inference within large shape collections. Such collections are naturally rich in variation, adding ambiguity to the notoriously difficult problem of correspondence computation. We leverage the robustness of correspondences between similar shapes to address the difficulties associated with this problem. In our approach, pairs of similar shapes are extracted from the collection, analyzed and matched in an efficient and reliable manner, culminating in the construction of a network of correspondences that connects the entire collection. The correspondence between any pair of shapes then amounts to a simple propagation along the minimax path between the two shapes in the network. At the heart of our approach is the introduction of a robust, structure-oriented shape matching method. Leveraging the idea of projective analysis, we partition 2D projections of a shape to obtain a set of 1D ordered regions, which are both simple and efficient to match. We lift the matched projections back to the 3D domain to obtain a pairwise shape correspondence. The emphasis given to structural compatibility is a central tool in estimating the reliability and completeness of a computed correspondence, uncovering any non-negligible semantic discrepancies that may exist between shapes. These detected differences are a deciding factor in the establishment of a network aiming to capture local similarities. We demonstrate that the combination of the presented observations into a co-analysis method allows us to establish reliable correspondences among shapes within large collections.

Supplementary Material

ZIP File (a171-fish.zip)
Supplemental file.

References

[1]
Alhashim, I., Xu, K., Zhuang, Y., Cao, J., Simari, P., and Zhang, H. 2015. Deformation-driven topology-varying 3D shape correspondence. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, 236:1--13.
[2]
Bronstein, A. M., Bronstein, M. M., Guibas, L. J., and Ovsjanikov, M. 2011. Shape Google: Geometric words and expressions for invariant shape retrieval. ACM Trans. Graph. 30, 1, 1:1--20.
[3]
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., Xiao, J., Yi, L., and Yu, F. 2015. ShapeNet: An Information-Rich 3D Model Repository. Tech. Rep. arXiv:1512.03012 {cs.GR}, Stanford University --- Princeton University --- Toyota Technological Institute at Chicago.
[4]
Chen, D.-Y., Tian, X.-P., Shen, Y.-T., and Ouhyoung, M. 2003. On visual similarity based 3D model retrieval. Computer Graphics Forum (Eurographics) 22, 3, 223--232.
[5]
Coifman, R. R., and Lafon, S. 2006. Diffusion maps. Applied and Computational Harmonic Analysis 21, 1, 5--30.
[6]
Dalal, N., and Triggs, B. 2005. Histograms of oriented gradients for human detection. In Proc. IEEE Conf. Comp. Vis. and Pat. Rec. (CVPR), vol. 1, 886--893.
[7]
Hu, R., Fan, L., and Liu, L. 2012. Co-segmentation of 3D shapes via subspace clustering. Computer Graphics Forum (SGP) 31, 5, 1703--1713.
[8]
Huang, Q., and Guibas, L. 2013. Consistent shape maps via semidefinite programming. Computer Graphics Forum (SGP) 32, 5, 177--186.
[9]
Huang, Q., Koltun, V., and Guibas, L. 2011. Joint shape segmentation with linear programming. ACM Trans. Graph. (SIGGRAPH Asia) 30, 6, 125:1--12.
[10]
Huang, Q., Zhang, G., Gao, L., Hu, S., Bustcher, A., and Guibas, L. 2012. An optimization approach for extracting and encoding consistent maps in a shape collection. ACM Trans. Graph. (SIGGRAPH Asia) 31, 6, 167:1--11.
[11]
Huang, Q., Wang, F., and Guibas, L. 2014. Functional map networks for analyzing and browsing large shape collections. ACM Trans. Graph. (SIGGRAPH) 33, 4, 36:1--11.
[12]
Kaibel, V., and Peinhardt, M. A. 2006. On the bottleneck shortest path problem. Konrad-Zuse-Zentrum für Informationstechnik.
[13]
Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3D mesh segmentation and labeling. ACM Trans. Graph. (SIGGRAPH) 29, 4, 102:1--12.
[14]
Kim, V., Lipman, Y., and Funkhouser, T. 2011. Blended intrinsic maps. ACM Trans. Graph. (SIGGRAPH) 30, 4.
[15]
Kim, V. G., Li, W., Mitra, N. J., Chaudhuri, S., DiVerdi, S., and Funkhouser, T. 2013. Learning part-based templates from large collections of 3d shapes. ACM Trans. Graph. (SIGGRAPH) 32, 4, 70:1--12.
[16]
Kleiman, Y., van Kaick, O., Sorkine-Hornung, O., and Cohen-Or, D. 2015. SHED: Shape edit distance for fine-grained shape similarity. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, 235:1--11.
[17]
Laga, H., Mortara, M., and Spagnuolo, M. 2013. Geometry and context for semantic correspondences and functionality recognition in man-made 3D shapes. ACM Trans. Graph. 32, 5, 150:1--16.
[18]
Li, Y., Su, H., Qi, C. R., Fish, N., Cohen-Or, D., and Guibas, L. J. 2015. Joint embeddings of shapes and images via CNN image purification. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, 234:1--12.
[19]
Litman, R., Bronstein, A., Bronstein, M., and Castellani, U. 2014. Supervised learning of bag-of-features shape descriptors using sparse coding. Computer Graphics Forum (SGP) 33, 5, 127--136.
[20]
Nguyen, A., Ben-Chen, M., Welnicka, K., Ye, Y., and Guibas, L. 2011. An optimization approach to improving collections of shape maps. Computer Graphics Forum 30, 5, 1481--1491.
[21]
Ovsjanikov, M., Mérigot, Q., Mémoli, F., and Guibas, L. 2010. One point isometric matching with the heat kernel. Computer Graphics Forum (SGP) 29, 5, 1555--1564.
[22]
Rustamov, R. M. 2007. Laplace-Beltrami eigenfunctions for deformation invariant shape representation. In Proc. Symp. Geometry Processing, 225--233.
[23]
Savva, M., Yu, F., Su, H., Aono, M., Chen, B., Cohen-Or, D., Deng, W., Su, H., Bai, S., Bai, X., Fish, N., Han, J., Kalogerakis, E., Learned-Miller, E. G., Li, Y., Liao, M., Maji, S., Tatsuma, A., Wang, Y., Zhang, N., and Zhou, Z. 2016. Large-Scale 3D Shape Retrieval from ShapeNet Core55. In Eurographics Workshop on 3D Object Retrieval, The Eurographics Association, A. Ferreira, A. Giachetti, and D. Giorgi, Eds.
[24]
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., and Cohen-Or, D. 2011. Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering. ACM Trans. Graph. (SIGGRAPH Asia) 30, 6, 126:1--10.
[25]
Solomon, J., Peyré, G., Kim, V., and Sra, S. 2016. Entropic metric alignment for correspondence problems. ACM Trans. Graph. (SIGGRAPH), to appear.
[26]
Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. 2015. Multi-view convolutional neural networks for 3D shape recognition. In Proc. ICCV, 945--953.
[27]
Tangelder, J. W. H., and Veltkamp, R. C. 2008. A survey of content based 3D shape retrieval methods. Multimedia Tools and Applications 39, 3, 441--471.
[28]
Tenenbaum, J. B., de Silva, V., and Langford, J. C. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500, 2319--2323.
[29]
van Kaick, O., Tagliasacchi, A., Sidi, O., Zhang, H., Cohen-Or, D., Wolf, L., and Hamarneh, G. 2011. Prior knowledge for part correspondence. Computer Graphics Forum (Eurographics) 30, 2, 553--562.
[30]
van Kaick, O., Zhang, H., Hamarneh, G., and Cohen-Or, D. 2011. A survey on shape correspondence. Computer Graphics Forum 30, 6, 1681--1707.
[31]
Wang, Y., Asafi, S., van Kaick, O., Zhang, H., Cohen-Or, D., and Chen, B. 2012. Active co-analysis of a set of shapes. ACM Trans. Graph. (SIGGRAPH Asia) 31, 6, 165:1--10.
[32]
Wang, Y., Gong, M., Wang, T., Cohen-Or, D., Zhang, H., and Chen, B. 2013. Projective analysis for 3D shape segmentation. ACM Trans. Graph. (SIGGRAPH Asia) 32, 6, 192:1--12.

Cited By

View all

Index Terms

  1. Structure-oriented networks of shape collections

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Graphics
    ACM Transactions on Graphics  Volume 35, Issue 6
    November 2016
    1045 pages
    ISSN:0730-0301
    EISSN:1557-7368
    DOI:10.1145/2980179
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 December 2016
    Published in TOG Volume 35, Issue 6

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. correspondence
    2. segmentation transfer
    3. shape collections
    4. similarity

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media