research-article

Automatic preparation of media objects in multimedia applications

Authors:

Marcelo F. Moreno,

Débora C. Muchaluat-SaadeAuthors Info & Claims

WebMedia '19: Proceedings of the 25th Brazillian Symposium on Multimedia and the Web

Pages 289 - 296

https://doi.org/10.1145/3323503.3360617

Published: 29 October 2019 Publication History

Abstract

In multimedia applications, spatiotemporal relationships among media objects should be controlled during the execution phase in order to preserve the quality of presentation. When the content that composes the application is delivered over a communication network, some delays may occur due to network congestion problems. In order to avoid synchronization faults during the presentation of the distributed multimedia applications, this work proposes the automatic preparation of media objects. The automatic preparation of media objects aim to ensure that all media objects are available in the receiver device at their presentation moment. In our proposal, the multimedia presentation engine (formatter) builds a preparation plan based on the network conditions and the presentation behavior learned from the multimedia document that defines the application. As proof of concept, we implemented the automatic creation of the preparation plan in the Ginga-NCL middleware. Furthermore, a use case is presented to demonstrate the automatic preparation for NCL applications. Finally, a brief discussion about garbage collection in multimedia applications containing non-deterministic events is also presented.

References

[1]

ABNT. 2016. NBR 15606-2: Codificação de dados e especificações de transmissão para radiodifusão digital, Parte 2: Ginga-NCL para receptores fixos e móveis-Linguagem de aplicação XML para codificação de aplicações. Technical Report.

[2]

M. C. Buchanan and P. T. Zellweger. 1993. Automatic temporal layout mechanisms. In Proceedings of the first ACM international conference on Multimedia. ACM, 341--350.

[3]

R. M. R. Costa and L. F. G. Soares. 2007. Modelo Temporal Hipermídia para Suporte a Apresentações em Ambientes Interativos. In Proceedings of the 13rd Brazillian Symposium on Multimedia and the Web. ACM.

[4]

M. F. de Sousa, C. A. G. Ferraz, R. Kulesza, I. Ayres, and M. Lima. 2017. MulSeMaker: An MDD Tool for MulSeMedia Web Application Development. In Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web. ACM, 317--324.

[5]

M. F. de Sousa, R. Kulesza, and C. A. G. Ferraz. 2016. A Model-driven Approach for MulSeMedia Application Domain. In Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web - WebMedia'16. ACM, 111--118.

Digital Library

[6]

Amparito Alexandra Morales Figueroa. 2014. Pré-Busca de Conteúdo em Apresentações Multimídia. Master's thesis. Programa de Pós-graduação em Informática da PUC-Rio.

[7]

David Flanagan. 2006. JavaScript: the definitive guide. " O'Reilly Media, Inc.".

[8]

Roberto Ierusalimschy. 2006. Programming in lua (2nd ed.).

[9]

ITU-Recommendation. 2009. Nested Context Language (NCL) and Ginga-NCL for IPTV Services. (April 2009).

[10]

M. Josue, R. Abreu, F. Barreto, D. P. Mattos, G. Amorim, J. A. F. Dos Santos, and D. C. Muchaluat-Saade. 2018. Modeling Sensory Effects as First-Class Entities in Multimedia Applications. In ACM Multimedia Systems Conference, 2018, Amsterdam. MMSys 2018. ACM, 1--12.

[11]

Marina Josué, Marcelo Moreno, and Romualdo Costa. 2017. An Adaptable Transmission Management Framework for Push-mode Hypermedia Content. In Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web. ACM, 349--356.

Digital Library

[12]

Marina Josué, Marcelo Moreno, and Débora Muchaluat-Saade. 2019. Mulsemedia preparation: a new event type for preparing media object presentation and sensory effect rendering. In Proceedings of the 10th ACM Multimedia Systems Conference. ACM, 110--120.

Digital Library

[13]

Marina Josué, Débora Muchaluat-Saade, and Marcelo Moreno. 2018. Preparation of Media Object Presentation and Sensory Effect Rendering in Mulsemedia Applications. In Proceedings of the 24th Brazilian Symposium on Multimedia and the Web. ACM, 45--52.

Digital Library

[14]

Douglas P Mattos and Débora C Muchaluat-Saade. 2018. MultiSEM: A Mulsemedia Model for Supporting the Development of Authoring Tools. In Proceedings of the 24th Brazilian Symposium on Multimedia and the Web. ACM, 109--116.

Digital Library

[15]

Oracle. 2019. Java Garbage Collection Basics. https://www.oracle.com/webfolder/technetwork/tutorials/obe/java/gc01/index.html.

[16]

G. V. Rossum, J. Jansen, K. S. Mullender, and D. C. Bulterman. 1993. CMIFed: a presentation environment for portable hypermedia documents. In Proceedings of the first ACM international conference on Multimedia. ACM, 183--188.

[17]

E. B. Saleme and C. A. S. Santos. 2015. PlaySEM: a platform for rendering MulSeMedia compatible with MPEG-V. In Proceedings of the 21st Brazilian Symposium on Multimedia and the Web - WebMedia '15. ACM, 145--148.

Digital Library

[18]

Luiz Fernando G Soares and Simone DJ Barbosa. 2009. Programando em NCL 3.0: Desenvolvimento de aplicações para o middleware Ginga. Campus, Rio de Janeiro, RJ (2009).

[19]

Wei-Guang Teng, Cheng-Yue Chang, and Ming-Syan Chen. 2005. Integrating web caching and web prefetching in client-side proxies. IEEE Transactions on Parallel and Distributed Systems 16, 5 (2005), 444--455.

Digital Library

[20]

W3C. 2008. Synchronized Multimedia Integration Language - SMIL 3.0 Specification. http://www.w3c.org/TR/SMIL3. World-Wide Web Consortium Recommendation.

[21]

W3C. 2018. HTML5. https://www.w3schools.com/.

Cited By

Moreno MPeters Nde Almeida PPernisa C(2023)Towards a representation model and fog-based device orchestration for audio-centric pervasive storytelling2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335450(1-10)Online publication date: 26-Oct-2023
https://doi.org/10.1109/IEEECONF59510.2023.10335450
Almeida PPernisa Jr CMoreno M(2022)Representation model and cloud-based orchestrator for pervasive storytellingProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3558047(339-347)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3558047

Index Terms

Automatic preparation of media objects in multimedia applications
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia streaming

Recommendations

Mulsemedia preparation: a new event type for preparing media object presentation and sensory effect rendering
MMSys '19: Proceedings of the 10th ACM Multimedia Systems Conference

In multimedia applications, a short delay in content delivery may cause synchronization failures among media objects, decreasing the presentation quality and user quality of experience. Moreover, some applications incorporate sensory effects to ...
Preparation of Media Object Presentation and Sensory Effect Rendering in Mulsemedia Applications
WebMedia '18: Proceedings of the 24th Brazilian Symposium on Multimedia and the Web

Nowadays multimedia applications are employed in different fields as entertainment, education, government services, health and e-commerce. Moreover, some applications incorporate sensory effects along with traditional multimedia content, stimulating ...
Automatic Preparation of Sensory Effects: Managing Synchronization in Mulsemedia Applications
MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference

Traditional audiovisual multimedia applications can be synchronized with sensory effects to further enhance the users' quality of experience. These applications are named mulsemedia applications and stimulate other human senses, such as touch, smell, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WebMedia '19: Proceedings of the 25th Brazillian Symposium on Multimedia and the Web

October 2019

537 pages

ISBN:9781450367639

DOI:10.1145/3323503

General Chairs:
Joel dos Santos
CEFET/RJ
,
Débora Christina Muchaluat Saade
UFF
,
Maria da Graça C. Pimentel
University of Sao Paulo, Brazil
,
Alessandra Alaniz Macedo
University of Sao Paulo, Brazil

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WebMedia '19

WebMedia '19: Brazilian Symposium on Multimedia and the Web

October 29 - November 1, 2019

Rio de Janeiro, Brazil

Acceptance Rates

Overall Acceptance Rate 270 of 873 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
63
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Moreno MPeters Nde Almeida PPernisa C(2023)Towards a representation model and fog-based device orchestration for audio-centric pervasive storytelling2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335450(1-10)Online publication date: 26-Oct-2023
https://doi.org/10.1109/IEEECONF59510.2023.10335450
Almeida PPernisa Jr CMoreno M(2022)Representation model and cloud-based orchestrator for pervasive storytellingProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3558047(339-347)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3558047

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents