The State-of-the-art on Image Reading for Visually Impaired Citizens: a Systematic Mapping in Patent Documents

Authors

  • João Marcelo dos Santos Marques Federal University of the State of Rio de Janeiro (UNIRIO) / O Instituto Brasileiro de Geografia e Estatistica (IBGE)
  • Maria Augusta Silveira Netto Nunes Federal University of the State of Rio de Janeiro (UNIRIO)
  • Rita Pinheiro Machado National Institute of Industrial Property (INPI)
  • Simone Bacellar Leal Ferreira Federal University of the State of Rio de Janeiro (UNIRIO)

DOI:

https://doi.org/10.5753/isys.2021.974

Keywords:

Mapeamento sistemático, Documentos de patente, Deficientes visuais, Leitura de imagens

Abstract

With the advent of the industrial revolution, several technological innovations emerged, aiming to solve some problems in a society's daily life. This paper aims to carry out systematic mapping of the state of the art in patent documents to identify the technologies developed for reading images' descriptions aimed at visually impaired citizens. During the mapping, we found 491 primary studies that passed through filters (inclusion, exclusion criteria, and quality issues), in which we could extract 46 relevant patent documents. Of these 46 documents, we observed that there is still few participation by the academic community in patenting their inventions and that 6% of these documents can be located in periodical libraries.

Downloads

Download data is not yet available.

Author Biographies

João Marcelo dos Santos Marques, Federal University of the State of Rio de Janeiro (UNIRIO) / O Instituto Brasileiro de Geografia e Estatistica (IBGE)

PhD student (2020) in Informatics from the Federal University of the State of Rio de Janeiro. Master (2017) in Informatics from UNIRIO. Specialization Latu-Sensu (2000) in Analysis, Design and Management of Systems by the Pontifical Catholic University of Rio de Janeiro. Bachelor (1997) in Informatics and Information Technology at the State University of Rio de Janeiro. Collaborator of the Accessibility and Usability Unit at UNIRIO. Author of an article nominated for the Best Paper Awards at ICEIS (2017) on the track IHC - Human-Computer Interaction, held in the city of Porto / Portugal. Manager of the Information Systems and Interoperability Services Administration area at the Brazilian Institute of Geography and Statistics. Head representative of IBGE on the National Open Data Infrastructure Management Committee - INDA. Representative for the Directorate of Informatics of IBGE in the National Association of Institutions of Planning, Research and Statistics. Participant of GT4 - INDA Metadata Standards Working Group. Responsible for incorporating the DDI (Data Documentation Initiative) data and metadata standard in the IBGE Statistical Metadata Bank. He acted as a supervisor in defining the automation processes for the 2010 Codification, Imputation and Critical Monitoring System of the 2010 Demographic Census production line. He has experience in the Computer Science area in the themes: open data, metadata, interoperability standards of data and metadata, accessibility, usability, human-computer interaction and organizational transparency. Lattes: http://lattes.cnpq.br/6922844909943922

Maria Augusta Silveira Netto Nunes, Federal University of the State of Rio de Janeiro (UNIRIO)

Productivity Scholarship Tec. and Innovative Extension of CNPq - Level 1D - Technological and Industrial Development Program
Associate Professor II, Department of Computing, Federal University of the State of Rio de Janeiro (UNIRIO). Member of the Graduate Program in Computer Science (PROCC) at the Federal University of Sergipe. Permanent member of the Postgraduate Program in Informatics PPGI (UNIRIO) (cycle March 2020). Post-doctorate by the LINE laboratory, Université Côte d'Azur / Nice Sophia Antipolis / Nice-France (2019). Post-doctorate by the National Institute of Industrial Property (INPI) (2016). PhD in "Informatique by the Université de Montpellier II - LIRMM in Montpellier, France (2008). She completed a doctoral internship (doc-sandwich) at INESC-ID-IST Lisbon- Portugal (Aug 2007-Feb 2008). Master in Computer Science at Federal University of Rio Grande do Sul (1998) Graduated in Computer Science from the University of Passo Fundo-RS (1995). Has academic-technological experience in the area of ​​Computer Science and Technological Innovation-Intellectual Property. CNPq. Currently, his research is mainly focused on the use of HQs in Education and Computational Thinking. Also in Technological Innovation using Affective Computing in Computational decision-making, He also works in Intellectual Property for Computing. da Computação "approved by SBC, http://almanaquesdacomputacao.com.br/ http://scholar.google.com.br/citations?user=rte6o8YAAAAJ
Lattes: http://lattes.cnpq.br/9923270028346687

Rita Pinheiro Machado, National Institute of Industrial Property (INPI)

Graduated in Biological Sciences at Universidade Santa Úrsula (1984). Master (1999) and Doctorate (2004) in Biological Chemistry, both with emphasis on Management, Education and Diffusion of Biosciences, held at the Institute of Medical Biochemistry at the Federal University of Rio de Janeiro. He is currently a Senior Specialist in Intellectual Property at the National Institute of Industrial Property (INPI) where he started working as a patent examiner (2002 - 2004); she was Coordinator of National Cooperation (2005 - 2007), working in the articulation of partnerships with the different actors of the national innovation system. In 2008, he coordinated the Academy of Intellectual Property and Innovation where short, medium and long-term training courses are organized, including Lato and Stricto sensu graduate courses. Between 2009 - 2013 she served as General Coordinator of Regional Action coordinating the INPI's activities in the States of the Federation. Between 2013 and March 2018 he once again coordinated the INPI's Academy of Intellectual Property, Innovation and Development. Since 2006, she has been a Professor of the Professional Master's in Intellectual Property and Innovation at INPI and since 2013 of the Doctorate in Intellectual Property and Innovation at INPI.
Lattes: http: //lattes.cnpq.br/2397508258376320

Simone Bacellar Leal Ferreira, Federal University of the State of Rio de Janeiro (UNIRIO)

Associate Professor of Information Systems courses (doctorate, master and undergraduate) at the Department of Applied Informatics at the Federal University of the State of Rio de Janeiro (UNIRIO); founder and coordinator of NAU - UNIRIO's Accessibility and Usability Center. He holds a Doctorate in Informatics (User Interface), a Master's in Informatics (Computer Graphics), both from the Pontifical Catholic University of Rio de Janeiro (PUC Rio) and a BA in Oceanography, from the State University of Rio de Janeiro - UERJ (1983) . Areas of expertise and interest: Human-Computer Interaction, (Usability, Accessibility), Information Systems and Use of Colors. He coordinated the development of the NAU website (http://nau.uniriotec.br/index.php/sobre), which was awarded the second best project in the Governmental Web Projects category of the National Accessibility Award - Todos @ Web 2016, an initiative of the Centro de Studies on Web Technologies (Ceweb.br) from the Ponto BR Information and Coordination Center (NIC.br) and from the Internet Management Committee in Brazil (CGI.br), which is supported by the Brazilian office of the World Wide Web Consortium (W3C) Brazil). Author of the book e-Usabilidade (ISBN 978-85-216-1651-1) published and released in September 2008, by Editora LTC (http://www.ltceditora.com.br/).

References

Baranauskas, M. C. C., Souza, C. S., and Pereira, R. (2012). Relatório Técnico. I GranDIHC-BR - Grandes Desafios de Pesquisa em Interação Humano-Computador no Brasil, 06 de novembro de 2012, Cuiabá - MT. http://comissoes.sbc.org.br/ce-ihc/wp-content/uploads/2017/10/rt_grandes_desafios_ihc_2012.pdf.

Canaltech. (2020). 15 inovações tecnológicas surgidas nos últimos 15 anos. https://canaltech.com.br/entretenimento/15-inovacoes-tecnologicas-surgidas-nos-ultimos-15-anos-52773/.

CreativeBloq. (2020). As patentes da Apple nos dão uma ideia do futuro. Você ficará surpreso com o que está por vir! https://www.creativebloq.com/features/apple-patents.

EPO. (2020). The European Patent Convention. https://www.epo.org/law-practice/legal-texts/epc.html.

Felizardo, K. R., Nakagawa, E. Y., Fabbri, S. C. P. F., and Ferrari, F. C. (2017). Revisão Sistemática da Literatura em Engenharia de Software - Teoria e Prática. 1. Ed. Rio de Janeiro: Elsevier, 2017.

Gazeta. (2021). Deficiente visual inventa dispositivo para medir insulina injetável. Gazeta do Povo. https://www.gazetadopovo.com.br/curitiba/deficiente-visual-inventa-dispositivo-para-medir-insulina-injetavel/.

Google. (2020). Dicionário de Filosofia. https://sites.google.com/view/sbgdicionariodefilosofia/m%C3%A9todo.

IBGE. (2010). Censo Demográfico 2010: Características gerais da população, religião e pessoas com deficiência. https://biblioteca.ibge.gov.br/pt/biblioteca-catalogo?view=detalhes&id=794.

INPI. (2020). Patentes. https://www.gov.br/inpi/pt-br/servicos/perguntas-frequentes/patentes#tipos.

Kitchenham, B. (2004) Procedures for Performing Systematic Revi0ews, Keele, Reino Unido Keele University 33, 2004.

Latipat. (2020). Espacenet - Pesquisa de patentes. Um serviço prestado em cooperação com a IEP. Classificação Internacional de Patentes (CIP). https://lp.espacenet.com/help?locale=pt_LP&method=handleHelpTopic&topic=ipc.

LibreOffice. (2020). The Document Foundation. https://pt-br.libreoffice.org/.

Marques, J. M. S. (2017). Catálogo de Entendimento de Informações Gráficas para Cidadãos Cegos, 2017. f 176. Dissertação (Mestrado) - Universidade Federal do Estado do Rio de Janeiro, Departamento de Informática, 2017, Rio de Janeiro, 2017. http://ppgi.uniriotec.br/banco-de-dissertacoes-ppgi-unirio/ano-2017/catalogo-de-entendimento-de-informacoes-graficas-para-cidadaos-cegos/view.

MCTIC. (2020). Ministério da Ciência, Tecnologia, Inovações e Comunicações. Tecnologia Assistiva. https://www.mctic.gov.br/mctic/opencms/ciencia/tecnologia_assistiva/_assistiva/Tecnologia_Assistiva.html.

Nunes, M. A. S. N. and Pinheiro, R. M. (2017). Propriedade Intelectual e Busca de Informação Tecnológica na área da Computação In: ARAUJO, R.M. e CHUERI, L.O.V. (orgs) Pesquisa e Inovação: Visões e Interseções . PUBL!T Soluções Editoriais, 2017, 1a edição. pg 67-92. http://almanaquesdacomputacao.com.br/gutanunes/publications/Draft-PI-Nunes&Machado.pdf.

OMPI. (2016). Organização Mundial da Propriedade Intelectual. WIPO - Internet Domain Name Processes. 2016. http://www.wipo.int/amc/en/processes/.

OMS. (2020). Blindness and vision impairment. Definitions. https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment.

OMS. (2020a). Blindness and vision impairment, World Health Organization. https://www.who.int/health-topics/blindness-and-vision-loss#tab=tab_1.

Report (2009). International Search Report/ Written Opinion received for PCT Patent Application No. PCT/US2008/084584, pp. 11.

Ryerson, M. K. (2010). Exploring Sensory Substitution Techniques: Crossmodal Audio-Tactile displays Using the skin to hear, Tutorial Proposal for ACHI 2010, The Third International Conference on Advances in Computer-Human Interactions, 2010. https://www.iaria.org/conferences2010/filesACHI10/T2.pdf;

Ryerson, M. K. (2015). Report Office I. P. Combined search and Examination Report under Sections 17 & 18(3), UK, 2015.

Ryerson, M. K. (2015a). Musitek (2015). SmartScore X2, Piano edition description from website: http://www.musitek.com/smartscore-piano.html, printout of website page taken, 2015.

Sidra. (2020). Banco de Tabelas Estatísticas. Censo Demográfico. Tabela 3426 - População residente por tipo de deficiência, segundo o sexo e a cor ou raça - Amostra - Características Gerais da População. https://sidra.ibge.gov.br/tabela/3426#resultado.

Silva, I. D., Nunes, M. A. S. N., Rodrigues, R. C., Machado, R. P., and Santos, A. C. (2018). Gibis da área da Ciência da Computação. Metodologia Científica e Tecnológica, série 6. Almanaques para a Popularização da Ciência da Computação, Volume 1 - Informação Tecnológica.

Stanford, U. (2015). Image Descriptions, Stanford Online Accessibility Program, University Stanford. https://soap.stanford.edu/tips-and-tools/tips/image-descriptions, Jun. 9, 2015, 3 pages.

Statista. (2020). Number of smartphone users worldwide from 2016 to 2021. https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/.

Techtudo. (2020). Celulares e Tablets. O primeiro celular da história. https://www.techtudo.com.br/noticias/noticia/2011/07/o-primeiro-celular-da-historia.html#:~:text=A%20tecnologia%20necess%C3%A1ria%20para%20desenvolver,coisa%20aconteceu%20antes%20desse%20lan%C3%A7amento.

Via. (2018). O que são núcleos de inovação tecnológica (NITs)? https://via.ufsc.br/o-que-sao-nucleos-de-inovacao-tecnologica-nits/.

WIPO. (2020). World Intellectual Property Organization - Patents. What is Patent? https://www.wipo.int/patents/en/.

WIPO. (2020a). PCT – The International Patent System. https://www.wipo.int/pct/en/

Downloads

Published

2021-05-14

How to Cite

Marques, J. M. dos S., Nunes, M. A. S. N., Machado, R. P., & Ferreira, S. B. L. (2021). The State-of-the-art on Image Reading for Visually Impaired Citizens: a Systematic Mapping in Patent Documents. ISys - Brazilian Journal of Information Systems, 14(1), 89–118. https://doi.org/10.5753/isys.2021.974

Issue

Vol. 14 No. 1 (2021)

Section

Surveys

License

Copyright (c) 2021 The authors

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.