course

Semantics and multimedia: an introduction to symbolic artificial intelligence applied to multimedia

Authors:

Guilherme Lima,

Marcio MorenoAuthors Info & Claims

WebMedia '19: Proceedings of the 25th Brazillian Symposium on Multimedia and the Web

Pages 7 - 9

https://doi.org/10.1145/3323503.3345031

Published: 29 October 2019 Publication History

Abstract

This short course is an introduction to symbolic artificial intelligence (AI) applied to multimedia. We assume no previous knowledge of AI and only basic knowledge of multimedia. The short course is divided into three parts. In the first part, we present general notions of AI and discuss the challenges involved in the construction of intelligent multimedia applications, that is, applications enriched with the capacity for semantic query, reasoning, and recommendation. In the second part, we detail the main technologies for symbolic AI and discuss their application to multimedia. In particular, we present the ontology languages RDF(S) and OWL, the description logics (DLs) which give these languages a formal basis, the SPARQL query language, and the vocabularies and extensions that allow us to apply these technologies to multimedia data. In the third and last part, we discuss the Hyperknowledge model: a hybrid model for the representation of knowledge and content. The Hyperknowledge model extends the NCM model, a classic hypermedia model, with the notion of semantic links, which allow for the integrated representation of multimedia content together with its semantic description.

References

[1]

Anicic, D., Fodor, P., Rudolph, S., and Stojanovic, N. EP-SPARQL: A unified language for event processing and stream reasoning. In Proc. 20th Int. Conf. World Wide Web (New York, NY, USA, 2011), WWW '11, ACM, pp. 635--644.

[2]

Arndt, R., Troncy, R., Staab, S., Hardman, L., and Vacura, M. COMM: Designing a well-founded multimedia ontology for the web. In The Semantic Web (Berlin, 2007), Springer, pp. 30--43.

[3]

Baader, F., Calvanese, D., McGuinness, D. L., Nardi, D., and Patel-Schneider, P. F., Eds. The Description Logic Handbook: Theory, Implementation and Applications, 2nd ed. Cambridge University Press, Cambridge, UK, 2007.

[4]

Eissing, D., Scherp, A., and Saathoff, C. Integration of existing multimedia metadata formats and metadata standards in the M3O. In Semantic Multimedia (Berlin, 2011), Springer, pp. 48--63.

[5]

Guarino, N., Oberle, D., and Staab, S. What is an Ontology?, 2nd ed. Springer-Verlag Berlin Heidelberg, Berlin, Germany, 2009, pp. 1--17.

[6]

Kurz, T., Schlegel, K., and Kosch, H. Enabling access to linked media with SPARQL-MM. In Proc. 24th Int. Conf. World Wide Web (New York, NY, USA, 2015), WWW'15 Companion, ACM, pp. 721--726.

[7]

Moreno, M. F., Brandao, R., and Cerqueira, R. Extending hypermedia conceptual models to support hyperknowledge specifications. International Journal of Semantic Computing 11, 01 (2017), 43--64.

[8]

Nimkanjana, K., and Witosurapot, S. A simple approach for enabling SPARQL-based temporal queries for media fragments. In Proc. 2018 7th Int. Conf. Software and Computer Applications (New York, NY, USA, 2018), ICSCA 2018, ACM, pp. 212--216.

[9]

Perry, M., Jain, P., and Sheth, A. P. SPARQL-ST: Extending SPARQL to Support Spatiotemporal Queries. Springer US, Boston, MA, 2011, pp. 61--86.

[10]

Rudolph, S. Foundations of Description Logics. Springer Berlin Heidelberg, Berlin, Germany, 2011, pp. 76--136.

[11]

Sa, I., Dayoub, Z. G. F., Upcroft, B., Perez, T., and McCool, C. Deepfruits: A fruit detection system using deep neural networks. Sensors 16, 8 (2016).

[12]

Sikos, L. F. Description Logics in Multimedia Reasoning. Springer International Publishing AG, Cham, Switzerland, 2017.

[13]

Soares, L. F. G., and Rodrigues, R. F. Nested context model 3.0 part 1: NCM core. Monographs in computer science, Informatics Department, PUC-Rio, Rio de Janeiro, RJ, Brazil, 2005.

[14]

Söderberg, J., Stegmaier, F., Strassner, J., Bürger, T., Evain, J., Sasaki, F.,Malaisé, V., Lee, W., Bailer, W., Michel, T., and Champin, P. Ontology for media resources 1.0. W3C recommendation, W3C, February 2012. http://www.w3.org/TR/2012/REC-mediaont-10-20120209/.

[15]

user:Marobi1. The Semantic Web stack. https://en.wikipedia.org/wiki/File:Semantic-web-stack.png, CC0, https://commons.wikimedia.org/w/index.php?curid=35013850., 2019. Accessed September 6, 2019.

Cited By

Zhao HLi TMoaiad A(2023)User Research Based on Artificial Intelligence Semantic Analysis TechnologyProceedings of the 2nd International Conference on Cognitive Based Information Processing and Applications (CIPA 2022)10.1007/978-981-19-9373-2_15(135-144)Online publication date: 11-Apr-2023
https://doi.org/10.1007/978-981-19-9373-2_15
Carvalho LSuzano JSantoro FOliveira JPimentel M(2022)Ethics: What is the Research Scenario in the Brazilian Symposium WebMedia?Proceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3557932(1-10)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3557932

Index Terms

Semantics and multimedia: an introduction to symbolic artificial intelligence applied to multimedia
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Jena: implementing the semantic web recommendations
WWW Alt. '04: Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters

The new Semantic Web recommendations for RDF, RDFS and OWL have, at their heart, the RDF graph. Jena2, a second-generation RDF toolkit, is similarly centered on the RDF graph. RDFS and OWL reasoning are seen as graph-to-graph transforms, producing ...
Using the relation ontology Metarel for modelling Linked Data as multi-digraphs
Linked Data for Health Care and the Life Sciences

The Semantic Web standards OWL and RDF are often used to represent biomedical information as Linked Data; however, the OWL/RDF syntax, which combines both, was never optimised for querying. By combining two formal paradigms for modelling Linked Data, ...
Parsing owl dl: trees or triples?
WWW '04: Proceedings of the 13th international conference on World Wide Web

The Web Ontology Language (OWL) defines three classes of documents: Lite, DL, and Full. All RDF/XML documents are OWL Full documents, some OWL Full documents are also OWL DL documents, and some OWL DL documents are also OWL Lite documents. This paper ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WebMedia '19: Proceedings of the 25th Brazillian Symposium on Multimedia and the Web

October 2019

537 pages

ISBN:9781450367639

DOI:10.1145/3323503

General Chairs:
Joel dos Santos
CEFET/RJ
,
Débora Christina Muchaluat Saade
UFF
,
Maria da Graça C. Pimentel
University of Sao Paulo, Brazil
,
Alessandra Alaniz Macedo
University of Sao Paulo, Brazil

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2019

Check for updates

Author Tags

Qualifiers

Course

Conference

WebMedia '19

WebMedia '19: Brazilian Symposium on Multimedia and the Web

October 29 - November 1, 2019

Rio de Janeiro, Brazil

Acceptance Rates

Overall Acceptance Rate 270 of 873 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
128
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhao HLi TMoaiad A(2023)User Research Based on Artificial Intelligence Semantic Analysis TechnologyProceedings of the 2nd International Conference on Cognitive Based Information Processing and Applications (CIPA 2022)10.1007/978-981-19-9373-2_15(135-144)Online publication date: 11-Apr-2023
https://doi.org/10.1007/978-981-19-9373-2_15
Carvalho LSuzano JSantoro FOliveira JPimentel M(2022)Ethics: What is the Research Scenario in the Brazilian Symposium WebMedia?Proceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3557932(1-10)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3557932

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents