Open Access
Open access
JMIR Public Health and Surveillance, volume 6, issue 2, pages e16119

Participatory Surveillance Based on Crowdsourcing During the Rio 2016 Olympic Games Using the Guardians of Health Platform: Descriptive Study

Onicio Leal Neto 1
Oswaldo Ricciardi Cruz 2
Jones O Albuquerque 3
Mariana Nacarato de Sousa 3
Mark S. Smolinski 4
Eduarda Cesse 5
Marlo Libel 4
Wayner Vieira de Souza 5
2
 
Scientific Computation Program, Oswaldo Cruz Foundation, Rio de Janeiro, Brazil.
3
 
Epitrack, Recife, Brazil.
4
 
Ending Pandemics, San Francisco, CA, United States.
5
 
Aggeu Magalhães Research Center,Oswaldo Cruz Foundation,Recife,Brazil.
Publication typeJournal Article
Publication date2020-01-28
scimago Q1
SJR1.421
CiteScore13.7
Impact factor3.5
ISSN23692960
PubMed ID:  32254042
Public Health, Environmental and Occupational Health
Health Informatics
Abstract
Background

With the evolution of digital media, areas such as public health are adding new platforms to complement traditional systems of epidemiological surveillance. Participatory surveillance and digital epidemiology have become innovative tools for the construction of epidemiological landscapes with citizens’ participation, improving traditional sources of information. Strategies such as these promote the timely detection of warning signs for outbreaks and epidemics in the region.

Objective

This study aims to describe the participatory surveillance platform Guardians of Health, which was used in a project conducted during the 2016 Olympic and Paralympic Games in Rio de Janeiro, Brazil, and officially used by the Brazilian Ministry of Health for the monitoring of outbreaks and epidemics.

Methods

This is a descriptive study carried out using secondary data from Guardians of Health available in a public digital repository. Based on syndromic signals, the information subsidy for decision making by policy makers and health managers becomes more dynamic and assertive. This type of information source can be used as an early route to understand the epidemiological scenario.

Results

The main result of this research was demonstrating the use of the participatory surveillance platform as an additional source of information for the epidemiological surveillance performed in Brazil during a mass gathering. The platform Guardians of Health had 7848 users who generated 12,746 reports about their health status. Among these reports, the following were identified: 161 users with diarrheal syndrome, 68 users with respiratory syndrome, and 145 users with rash syndrome.

Conclusions

It is hoped that epidemiological surveillance professionals, researchers, managers, and workers become aware of, and allow themselves to use, new tools that improve information management for decision making and knowledge production. This way, we may follow the path for a more intelligent, efficient, and pragmatic disease control system.

Fujibayashi K., Takahashi H., Tanei M., Uehara Y., Yokokawa H., Naito T.
JMIR mHealth and uHealth scimago Q1 wos Q1 Open Access
2018-04-22 citations by CoLab: 20 Abstract  
Influenza infections can spread rapidly, and influenza outbreaks are a major public health concern worldwide. Early detection of signs of an influenza pandemic is important to prevent global outbreaks. Development of information and communications technologies for influenza surveillance, including participatory surveillance systems involving lay users, has recently increased. Many of these systems can estimate influenza activity faster than the conventional influenza surveillance systems. Unfortunately, few of these influenza-tracking systems are available in Japan.This study aimed to evaluate the flu-tracking ability of Flu-Report, a new influenza-tracking mobile phone app that uses a self-administered questionnaire for the early detection of influenza activity.Flu-Report was used to collect influenza-related information (ie, dates on which influenza infections were diagnosed) from November 2016 to March 2017. Participants were adult volunteers from throughout Japan, who also provided information about their cohabiting family members. The utility of Flu-Report was evaluated by comparison with the conventional influenza surveillance information and basic information from an existing large-scale influenza-tracking system (an automatic surveillance system based on electronic records of prescription drug purchases).Information was obtained through Flu-Report for approximately 10,094 volunteers. In total, 2134 participants were aged
Swain C., Sawicki S., Addison D., Katz B., Piersanti K., Baim-Lance A., Gordon D., Anderson B.J., Nash D., Steinbock C., Agins B.
AIDS and Behavior scimago Q1 wos Q2
2018-04-02 citations by CoLab: 5 Abstract  
Existing data dissemination structures primarily rely on top-down approaches. Unless designed with the end user in mind, this may impair data-driven clinical improvements to Human Immunodeficiency Virus (HIV) prevention and care. In this study, we implemented a data visualization activity to create region-specific data presentations collaboratively with HIV providers, consumers of HIV care, and New York State (NYS) Department of Health AIDS Institute staff for use in local HIV care decision-making. Data from the NYS HIV Surveillance Registry (2009–2013) and HIV care facilities (2010–2015) participating in a Health Resources and Services Administration (HRSA) Systems Linkages and Access to Care project were used. Each data package incorporated visuals for: linkage to HIV care, retention in care and HIV viral suppression. End-users were vocal about their data needs and their capacity to interpret public health data. This experience suggests that data dissemination strategies should incorporate input from the end user to improve comprehension and optimize HIV care.
Kecojevic A., Basch C., Basch C., Kernan W.
2018-02-16 citations by CoLab: 19 Abstract  
Antiretroviral (ARV) medicines reduce the risk of transmitting the HIV virus and are recommended as daily pre-exposure prophylaxis (PrEP) in combination with safer sex practices for HIV-negative individuals at a high risk for infection, but are underused in HIV prevention. Previous literature suggests that YouTube is extensively used to share health information. While pre-exposure prophylaxis (PrEP) is a novel and promising approach to HIV prevention, there is limited understanding of YouTube videos as a source of information on PrEP.The objective of this study was to describe the sources, characteristics, and content of the most widely viewed PrEP YouTube videos published up to October 1, 2016.The keywords "pre-exposure prophylaxis" and "Truvada" were used to find 217 videos with a view count >100. Videos were coded for source, view count, length, number of comments, and selected aspects of content. Videos were also assessed for the most likely target audience.The total cumulative number of views was >2.3 million, however, a single Centers for Disease Control and Prevention video accounted for >1.2 million of the total cumulative views. A great majority (181/217, 83.4%) of the videos promoted the use of PrEP, whereas 60.8% (132/217) identified the specific target audience. In contrast, only 35.9% (78/217) of the videos mentioned how to obtain PrEP, whereas less than one third addressed the costs, side effects, and safety aspects relating to PrEP. Medical and academic institutions were the sources of the largest number of videos (66/217, 30.4%), followed by consumers (63/217, 29.0%), community-based organizations (CBO; 48/217, 22.1%), and media (40/217, 18.4%). Videos uploaded by the media sources were more likely to discuss the cost of PrEP (P
Lu F.S., Hou S., Baltrusaitis K., Shah M., Leskovec J., Sosic R., Hawkins J., Brownstein J., Conidi G., Gunn J., Gray J., Zink A., Santillana M.
2018-01-09 citations by CoLab: 78 Abstract  
Background: Influenza outbreaks pose major challenges to public health around the world, leading to thousands of deaths a year in the United States alone. Accurate systems that track influenza activity at the city level are necessary to provide actionable information that can be used for clinical, hospital, and community outbreak preparation. Objective: Although Internet-based real-time data sources such as Google searches and tweets have been successfully used to produce influenza activity estimates ahead of traditional health care–based systems at national and state levels, influenza tracking and forecasting at finer spatial resolutions, such as the city level, remain an open question. Our study aimed to present a precise, near real-time methodology capable of producing influenza estimates ahead of those collected and published by the Boston Public Health Commission (BPHC) for the Boston metropolitan area. This approach has great potential to be extended to other cities with access to similar data sources. Methods: We first tested the ability of Google searches, Twitter posts, electronic health records, and a crowd-sourced influenza reporting system to detect influenza activity in the Boston metropolis separately. We then adapted a multivariate dynamic regression method named ARGO (autoregression with general online information), designed for tracking influenza at the national level, and showed that it effectively uses the above data sources to monitor and forecast influenza at the city level 1 week ahead of the current date. Finally, we presented an ensemble-based approach capable of combining information from models based on multiple data sources to more robustly nowcast as well as forecast influenza activity in the Boston metropolitan area. The performances of our models were evaluated in an out-of-sample fashion over 4 influenza seasons within 2012-2016, as well as a holdout validation period from 2016 to 2017. Results: Our ensemble-based methods incorporating information from diverse models based on multiple data sources, including ARGO, produced the most robust and accurate results. The observed Pearson correlations between our out-of-sample flu activity estimates and those historically reported by the BPHC were 0.98 in nowcasting influenza and 0.94 in forecasting influenza 1 week ahead of the current date. Conclusions: We show that information from Internet-based data sources, when combined using an informed, robust methodology, can be effectively used as early indicators of influenza activity at fine geographic resolutions.
Salathé M.
2018-01-04 citations by CoLab: 139 PDF Abstract  
Digital Epidemiology is a new field that has been growing rapidly in the past few years, fueled by the increasing availability of data and computing power, as well as by breakthroughs in data analytics methods. In this short piece, I provide an outlook of where I see the field heading, and offer a broad and a narrow definition of the term.
Karimuribo E.D., Mutagahywa E., Sindato C., Mboera L., Mwabukusi M., Kariuki Njenga M., Teesdale S., Olsen J., Rweyemamu M.
2017-12-18 citations by CoLab: 72 Abstract  
Background We describe the development and initial achievements of a participatory disease surveillance system that relies on mobile technology to promote Community Level One Health Security (CLOHS) in Africa. Objective The objective of this system, Enhancing Community-Based Disease Outbreak Detection and Response in East and Southern Africa (DODRES), is to empower community-based human and animal health reporters with training and information and communication technology (ICT)–based solutions to contribute to disease detection and response, thereby complementing strategies to improve the efficiency of infectious disease surveillance at national, regional, and global levels. In this study, we refer to techno-health as the application of ICT-based solutions to enhance early detection, timely reporting, and prompt response to health events in human and animal populations. Methods An EpiHack, involving human and animal health experts as well as ICT programmers, was held in Tanzania in 2014 to identify major challenges facing early detection, timely reporting, and prompt response to disease events. This was followed by a project inception workshop in 2015, which brought together key stakeholders, including policy makers and community representatives, to refine the objectives and implementation plan of the DODRES project. The digital ICT tools were developed and packaged together as the AfyaData app to support One Health disease surveillance. Community health reporters (CHRs) and officials from animal and human health sectors in Morogoro and Ngorongoro districts in Tanzania were trained to use the AfyaData app. The AfyaData supports near- to real-time data collection and submission at both community and health facility levels as well as the provision of feedback to reporters. The functionality of the One Health Knowledge Repository (OHKR) app has been integrated into the AfyaData app to provide health information on case definitions of diseases of humans and animals and to synthesize advice that can be transmitted to CHRs with next step response activities or interventions. Additionally, a WhatsApp social group was made to serve as a platform to sustain interactions between community members, local government officials, and DODRES team members. Results Within the first 5 months (August-December 2016) of AfyaData tool deployment, a total of 1915 clinical cases in livestock (1816) and humans (99) were reported in Morogoro (83) and Ngorongoro (1832) districts. Conclusions These initial results suggest that the DODRES community-level model creates an opportunity for One Health engagement of people in their own communities in the detection of infectious human and animal disease threats. Participatory approaches supported by digital and mobile technologies should be promoted for early disease detection, timely reporting, and prompt response at the community, national, regional, and global levels.
Leal Neto O.B., Albuquerque J., Cruz O.G., Cesse E., Souza W.V.
Cadernos de Saude Publica scimago Q2 wos Q3 Open Access
2017-11-21 citations by CoLab: 1
Olson D., Lamb M., Lopez M.R., Colborn K., Paniagua-Avila A., Zacarias A., Zambrano-Perilla R., Rodríguez-Castro S.R., Cordon-Rosales C., Asturias E.J.
2017-11-09 citations by CoLab: 32 Abstract  
With their increasing availability in resource-limited settings, mobile phones may provide an important tool for participatory syndromic surveillance, in which users provide symptom data directly into a centralized database.We studied the performance of a mobile phone app-based participatory syndromic surveillance system for collecting syndromic data (acute febrile illness and acute gastroenteritis) to detect dengue virus and norovirus on a cohort of children living in a low-resource and rural area of Guatemala.Randomized households were provided with a mobile phone and asked to submit weekly reports using a symptom diary app (Vigilant-e). Participants reporting acute febrile illness or acute gastroenteritis answered additional questions using a decision-tree algorithm and were subsequently visited at home by a study nurse who performed a second interview and collected samples for dengue virus if confirmed acute febrile illness and norovirus if acute gastroenteritis. We analyzed risk factors associated with decreased self-reporting of syndromic data using the Vigilant-e app and evaluated strategies to improve self-reporting. We also assessed agreement between self-report and nurse-collected data obtained during home visits.From April 2015 to June 2016, 469 children in 207 households provided 471 person-years of observation. Mean weekly symptom reporting rate was 78% (range 58%-89%). Households with a poor (
Brownstein J.S., Chu S., Marathe A., Marathe M.V., Nguyen A.T., Paolotti D., Perra N., Perrotta D., Santillana M., Swarup S., Tizzoni M., Vespignani A., Vullikanti A.K., Wilson M.L., Zhang Q.
2017-11-01 citations by CoLab: 41 Abstract  
Influenza outbreaks affect millions of people every year and its surveillance is usually carried out in developed countries through a network of sentinel doctors who report the weekly number of Influenza-like Illness cases observed among the visited patients. Monitoring and forecasting the evolution of these outbreaks supports decision makers in designing effective interventions and allocating resources to mitigate their impact.Describe the existing participatory surveillance approaches that have been used for modeling and forecasting of the seasonal influenza epidemic, and how they can help strengthen real-time epidemic science and provide a more rigorous understanding of epidemic conditions.We describe three different participatory surveillance systems, WISDM (Widely Internet Sourced Distributed Monitoring), Influenzanet and Flu Near You (FNY), and show how modeling and simulation can be or has been combined with participatory disease surveillance to: i) measure the non-response bias in a participatory surveillance sample using WISDM; and ii) nowcast and forecast influenza activity in different parts of the world (using Influenzanet and Flu Near You).WISDM-based results measure the participatory and sample bias for three epidemic metrics i.e. attack rate, peak infection rate, and time-to-peak, and find the participatory bias to be the largest component of the total bias. The Influenzanet platform shows that digital participatory surveillance data combined with a realistic data-driven epidemiological model can provide both short-term and long-term forecasts of epidemic intensities, and the ground truth data lie within the 95 percent confidence intervals for most weeks. The statistical accuracy of the ensemble forecasts increase as the season progresses. The Flu Near You platform shows that participatory surveillance data provide accurate short-term flu activity forecasts and influenza activity predictions. The correlation of the HealthMap Flu Trends estimates with the observed CDC ILI rates is 0.99 for 2013-2015. Additional data sources lead to an error reduction of about 40% when compared to the estimates of the model that only incorporates CDC historical information.While the advantages of participatory surveillance, compared to traditional surveillance, include its timeliness, lower costs, and broader reach, it is limited by a lack of control over the characteristics of the population sample. Modeling and simulation can help overcome this limitation as well as provide real-time and long-term forecasting of influenza activity in data-poor parts of the world.
Smolinski M.S., Crawley A.W., Olsen J.M., Jayaraman T., Libel M.
2017-10-11 citations by CoLab: 80 Abstract  
Since 2012, the International Workshop on Participatory Surveillance (IWOPS) has served as an informal network to share best practices, consult on analytic methods, and catalyze innovation to advance the burgeoning method of direct engagement of populations in voluntary monitoring of disease.This landscape provides an overview of participatory disease surveillance systems in the IWOPS network and orients readers to this growing field of practice.Authors reviewed participatory approaches that include human and animal health surveillance, both syndromic (self- reported symptoms) and event-based, and how these tools have been leveraged for disease modeling and forecasting. The authors also discuss benefits, challenges, and future directions for participatory disease surveillance.There are at least 23 distinct participatory surveillance tools or programs represented in the IWOPS network across 18 countries. Organizations supporting these tools are diverse in nature.Participatory disease surveillance is a promising method to complement both traditional, facility-based surveillance and newer digital epidemiology systems.
Lwin M.O., Jayasundar K., Sheldenkar A., Wijayamuni R., Wimalaratne P., Ernst K.C., Foo S.
2017-10-02 citations by CoLab: 37 Abstract  
Approximately 128 countries and 3.9 billion people are at risk of dengue infection. Incidence of dengue has increased over the past decades, becoming a growing public health concern for countries with populations that are increasingly susceptible to this vector-borne disease, such as Sri Lanka. Almost 55,150 dengue cases were reported in Sri Lanka in 2016, with more than 30.40% of cases (n=16,767) originating from Colombo, which struggles with an outdated manual paper-based dengue outbreak management system. Community education and outreach about dengue are also executed using paper-based media channels such as pamphlets and brochures. Yet, Sri Lanka is one of the countries with the most affordable rates of mobile services in the world, with penetration rates higher than most developing countries.To combat the issues of an exhausted dengue management system and to make use of new technology, in 2015, a mobile participatory system for dengue surveillance called Mo-Buzz was developed and launched in Colombo, Sri Lanka. This paper describes the system's components and uptake, along with other similar disease surveillance systems.We developed Mo-Buzz and tested its feasibility for dengue. Two versions of the app were developed. The first was for use by public health inspectors (PHIs) to digitize form filling and recording of site visit information, and track dengue outbreaks on a real-time dengue hotspot map using the global positioning system technology. The system also provides updated dengue infographics and educational materials for the PHIs to educate the general public. The second version of Mo-Buzz was created for use by the general public. This system uses dynamic mapping to help educate and inform the general public about potential outbreak regions and allow them to report dengue symptoms and post pictures of potential dengue mosquito-breeding sites, which are automatically sent to the health authorities. Targeted alerts can be sent to users depending on their geographical location.We assessed the usage and the usability of the app and its impact on overall dengue transmission in Colombo. Initial uptake of Mo-Buzz for PHIs was low; however, after more training and incentivizing of usage, the uptake of the app in PHIs increased from less than 10% (n=3) to 76% (n=38). The general public user evaluation feedback was fruitful in providing improvements to the app, and at present, a number of solutions are being reviewed as viable options to boost user uptake.From our Mo-Buzz study, we have learned that initial acceptance of such systems can be slow but eventually positive. Mobile and social media interventions, such as Mo-Buzz, are poised to play a greater role in shaping risk perceptions and managing seasonal and sporadic outbreaks of infectious diseases in Asia and around the world.
Koppeschaar C.E., Colizza V., Guerrisi C., Turbelin C., Duggan J., Edmunds W.J., Kjelsø C., Mexia R., Moreno Y., Meloni S., Paolotti D., Perrotta D., van Straten E., Franco A.O.
2017-09-19 citations by CoLab: 55 Abstract  
The wide availability of the Internet and the growth of digital communication technologies have become an important tool for epidemiological studies and health surveillance. Influenzanet is a participatory surveillance system monitoring the incidence of influenza-like illness (ILI) in Europe since 2003. It is based on data provided by volunteers who self-report their symptoms via the Internet throughout the influenza season and currently involves 10 countries.In this paper, we describe the Influenzanet system and provide an overview of results from several analyses that have been performed with the collected data, which include participant representativeness analyses, data validation (comparing ILI incidence rates between Influenzanet and sentinel medical practice networks), identification of ILI risk factors, and influenza vaccine effectiveness (VE) studies previously published. Additionally, we present new VE analyses for the Netherlands, stratified by age and chronic illness and offer suggestions for further work and considerations on the continuity and sustainability of the participatory system.Influenzanet comprises country-specific websites where residents can register to become volunteers to support influenza surveillance and have access to influenza-related information. Participants are recruited through different communication channels. Following registration, volunteers submit an intake questionnaire with their postal code and sociodemographic and medical characteristics, after which they are invited to report their symptoms via a weekly electronic newsletter reminder. Several thousands of participants have been engaged yearly in Influenzanet, with over 36,000 volunteers in the 2015-16 season alone.In summary, for some traits and in some countries (eg, influenza vaccination rates in the Netherlands), Influenzanet participants were representative of the general population. However, for other traits, they were not (eg, participants underrepresent the youngest and oldest age groups in 7 countries). The incidence of ILI in Influenzanet was found to be closely correlated although quantitatively higher than that obtained by the sentinel medical practice networks. Various risk factors for acquiring an ILI infection were identified. The VE studies performed with Influenzanet data suggest that this surveillance system could develop into a complementary tool to measure the effectiveness of the influenza vaccine, eventually in real time.Results from these analyses illustrate that Influenzanet has developed into a fast and flexible monitoring system that can complement the traditional influenza surveillance performed by sentinel medical practices. The uniformity of Influenzanet allows for direct comparison of ILI rates between countries. It also has the important advantage of yielding individual data, which can be used to identify risk factors. The way in which the Influenzanet system is constructed allows the collection of data that could be extended beyond those of ILI cases to monitor pandemic influenza and other common or emerging diseases.
Dalton C., Carlson S., Butler M., Cassano D., Clarke S., Fejsa J., Durrheim D.
2017-08-17 citations by CoLab: 32 Abstract  
Flutracking is a weekly Web-based survey of influenza-like illness (ILI) in Australia that has grown from 400 participants in 2006 to over 26,000 participants every week in 2016. Flutracking monitors both the transmission and severity of ILI across Australia by documenting symptoms (cough, fever, and sore throat), time off work or normal duties, influenza vaccination status, laboratory testing for influenza, and health seeking behavior. Recruitment of Flutrackers commenced via health department and other organizational email systems, and then gradually incorporated social media promotion and invitations from existing Flutrackers to friends to enhance participation. Invitations from existing participants typically contribute to over 1000 new participants each year. The Flutracking survey link was emailed every Monday morning in winter and took less than 10 seconds to complete. To reduce the burden on respondents, we collected only a minimal amount of demographic and weekly data. Additionally, to optimize users' experiences, we maintained a strong focus on "obvious design" and repeated usability testing of naïve and current participants of the survey. In this paper, we share these and other insights on recruitment methods and user experience principles that have enabled Flutracking to become one of the largest online participatory surveillance systems in the world. There is still much that could be enhanced in Flutracking; however, we believe these principles could benefit others developing similar online surveillance systems.
Quade P., Nsoesie E.O.
2017-07-05 citations by CoLab: 20 Abstract  
Underreporting of foodborne illness makes foodborne disease burden estimation, timely outbreak detection, and evaluation of policies toward improving food safety challenging.The objective of this study was to present and evaluate Iwaspoisoned.com, an openly accessible Internet-based crowdsourcing platform that was launched in 2009 for the surveillance of foodborne illness. The goal of this system is to collect data that can be used to augment traditional approaches to foodborne disease surveillance.Individuals affected by a foodborne illness can use this system to report their symptoms and the suspected location (eg, restaurant, hotel, hospital) of infection. We present descriptive statistics of users and businesses and highlight three instances where reports of foodborne illness were submitted before the outbreaks were officially confirmed by the local departments of health.More than 49,000 reports of suspected foodborne illness have been submitted on Iwaspoisoned.com since its inception by individuals from 89 countries and every state in the United States. Approximately 95.51% (42,139/44,119) of complaints implicated restaurants as the source of illness. Furthermore, an estimated 67.55% (3118/4616) of users who responded to a demographic survey were between the ages of 18 and 34, and 60.14% (2776/4616) of the respondents were female. The platform is also currently used by health departments in 90% (45/50) of states in the US to supplement existing programs on foodborne illness reporting.Crowdsourced disease surveillance through systems such as Iwaspoisoned.com uses the influence and familiarity of social media to create an infrastructure for easy reporting and surveillance of suspected foodborne illness events. If combined with traditional surveillance approaches, these systems have the potential to lessen the problem of foodborne illness underreporting and aid in early detection and monitoring of foodborne disease outbreaks.
Mansourihanis O., Hemmati M., Afshar S.V., Eshaghi S., Varinlioğlu G.
Case Studies in the Environment scimago Q3 wos Q4
2025-01-13 citations by CoLab: 0 Abstract  
Global climate disruptions pose escalating threats to tourism networks, necessitating innovative resilience solutions tailored for regional interdependencies. This review examines research on location-based games for enhancing climate resilience across interconnected tourism economies. Analyzing 75 studies, strengths and limitations are delineated. While confirming augmented reality, virtual reality, and geo-tagging versatility for promotion, analysis, and experience enhancement, findings reveal gaps in leveraging these technologies for systemic coordination, participatory governance, embodied vulnerability assessment, and social learning. Immersive climate visualizations, policy simulations, and multiplayer interfaces emerge as frontiers enabling collaborative adaptation. The top priorities are (1) integrating localized climate projections with human perceptions through interactive visualizations to create tangible threats, (2) designing policy simulations for participatory governance of resilience investments across sectors, (3) developing embodied social learning vulnerability assessments highlighting differential exposures, and (4) designing multiplayer games to facilitate the co-creation of equitable, robust adaptation strategies by communities. Targeted research advancing location-based platforms to link science, policy, and community priorities is essential for tourism networks to navigate intensifying climate disruptions collaboratively. This review thus delineates critical next steps in utilizing geo-technologies’ participatory, experiential promise to inform and connect stakeholders in steering tourism toward resilient pathways.
Mesquita S., Perfeito L., Paolotti D., Gonçalves-Sá J.
2025-01-13 citations by CoLab: 0 PDF Abstract  
Epidemiology and Public Health have increasingly relied on structured and unstructured data, collected inside and outside of typical health systems, to study, identify, and mitigate diseases at the population level. Focusing on infectious diseases, we review the state of Digital Epidemiology at the beginning of 2020 and how it changed after the COVID-19 pandemic, in both nature and breadth. We argue that Epidemiology’s progressive use of data generated outside of clinical and public health systems creates several technical challenges, particularly in carrying specific biases that are almost impossible to correct for a priori. Using a statistical perspective, we discuss how a definition of Digital Epidemiology that emphasizes “data-type” instead of “data-source,” may be more operationally useful, by clarifying key methodological differences and gaps. Therefore, we briefly describe some of the possible biases arising from varied collection methods and sources, and offer some recommendations to better explore the potential of Digital Epidemiology, particularly on how to help reduce inequity.
Melo C.L., Mageste L.R., Guaraldo L., Paula D.P., Wakimoto M.D.
2024-11-18 citations by CoLab: 0 Abstract  
Background The development of technology and information systems has led to important changes in public health surveillance. Objective This scoping review aimed to assess the available evidence and gather information about the use of digital tools for arbovirus (dengue virus [DENV], zika virus [ZIKV], and chikungunya virus [CHIKV]) surveillance. Methods The databases used were MEDLINE, SCIELO, LILACS, SCOPUS, Web of Science, and EMBASE. The inclusion criterion was defined as studies that described the use of digital tools in arbovirus surveillance. The exclusion criteria were defined as follows: letters, editorials, reviews, case reports, series of cases, descriptive epidemiological studies, laboratory and vaccine studies, economic evaluation studies, and studies that did not clearly describe the use of digital tools in surveillance. Results were evaluated in the following steps: monitoring of outbreaks or epidemics, tracking of cases, identification of rumors, decision-making by health agencies, communication (cases and bulletins), and dissemination of information to society). Results Of the 2227 studies retrieved based on screening by title, abstract, and full-text reading, 68 (3%) studies were included. The most frequent digital tools used in arbovirus surveillance were apps (n=24, 35%) and Twitter, currently called X (n=22, 32%). These were mostly used to support the traditional surveillance system, strengthening aspects such as information timeliness, acceptability, flexibility, monitoring of outbreaks or epidemics, detection and tracking of cases, and simplicity. The use of apps to disseminate information to society (P=.02), communicate (cases and bulletins; P=.01), and simplicity (P=.03) and the use of Twitter to identify rumors (P=.008) were statistically relevant in evaluating scores. This scoping review had some limitations related to the choice of DENV, ZIKV, and CHIKV as arboviruses, due to their clinical and epidemiological importance. Conclusions In the contemporary scenario, it is no longer possible to ignore the use of web data or social media as a complementary strategy to health surveillance. However, it is important that efforts be combined to develop new methods that can ensure the quality of information and the adoption of systematic measures to maintain the integrity and reliability of digital tools’ data, considering ethical aspects.
Valerio M.G., Laher B., Phuka J., Lichand G., Paolotti D., Leal Neto O.
2024-07-16 citations by CoLab: 0 Abstract  
Background Cholera-like diarrheal disease (CLDD) outbreaks are complex and influenced by environmental factors, socioeconomic conditions, and population dynamics, leading to limitations in traditional surveillance methods. In Malawi, cholera is considered an endemic disease. Its epidemiological profile is characterized by seasonal patterns, often coinciding with the rainy season when contamination of water sources is more likely. However, the outbreak that began in March 2022 has extended to the dry season, with deaths reported in all 29 districts. It is considered the worst outbreak in the past 10 years. Objective This study aims to evaluate the feasibility and outcomes of participatory surveillance (PS) using interactive voice response (IVR) technology for the early detection of CLDD outbreaks in Malawi. Methods This longitudinal cohort study followed 740 households in rural settings in Malawi for 24 weeks. The survey tool was designed to have 10 symptom questions collected every week. The proxies’ rationale was related to exanthematic, ictero-hemorragica for endemic diseases or events, diarrhea and respiratory/targeting acute diseases or events, and diarrhea and respiratory/targeting seasonal diseases or events. This work will focus only on the CLDD as a proxy for gastroenteritis and cholera. In this study, CLDD was defined as cases where reports indicated diarrhea combined with either fever or vomiting/nausea. Results During the study period, our data comprised 16,280 observations, with an average weekly participation rate of 35%. Maganga TA had the highest average of completed calls, at 144.83 (SD 10.587), while Ndindi TA had an average of 123.66 (SD 13.176) completed calls. Our findings demonstrate that this method might be effective in identifying CLDD with a notable and consistent signal captured over time (R2=0.681404). Participation rates were slightly higher at the beginning of the study and decreased over time, thanks to the sensitization activities rolled out at the CBCCs level. In terms of the attack rates for CLDD, we observed similar rates between Maganga TA and Ndindi TA, at 16% and 15%, respectively. Conclusions PS has proven to be valuable for the early detection of epidemics. IVR technology is a promising approach for disease surveillance in rural villages in Africa, where access to health care and traditional disease surveillance methods may be limited. This study highlights the feasibility and potential of IVR technology for the timely and comprehensive reporting of disease incidence, symptoms, and behaviors in resource-limited settings.
Oliveira J.A., Favacho A.R., Juliano R.S., Barros L.F., Zeno P., Pauvolid-Corrêa A., Chame M.
2024-04-08 citations by CoLab: 0 Abstract  
RESUMO O projeto ‘Saúde Única no Pantanal: participação da sociedade na vigilância de emergência de zoonoses como efeito pós-incêndios no território e formação de estratégias integradas’ objetivou integrar representações institucionais e da sociedade local; ampliar o uso do Sistema de Informação em Saúde Silvestre (SISS-Geo) para o monitoramento da fauna; identificar áreas prioritárias para vigilância de zoonoses e construir caminhos envolvendo a Saúde Única (SU). Realizou webinário, apontando a necessidade de eventos mais amplos com a participação de lideranças em cada um dos territórios escolhidos. Foram executados seminários e oficinas nos estados de Mato Grosso do Sul (MS), com a participação de gestores do serviço de saúde da Província de Santa Cruz, Bolívia, e de Mato Grosso. A representatividade dos diferentes segmentos nos eventos possibilitou a articulação de cidadãos e gestores locais. Nas comunidades tradicionais, foi possível abordar os impactos dos incêndios e dar oportunidade para que essas pessoas manifestassem suas prioridades e demandas de saúde, antes e depois dos incêndios. A Oficina Síntese realizada em Corumbá, MS possibilitou a devolutiva dos resultados e a integração com representantes de diferentes instituições do Brasil e da Bolívia, além da prospecção e priorização de enfermidades a serem incorporadas em modelo de SU para o Pantanal e fronteira oeste do Brasil.
Dai P., Qi L., Jia M., Li T., Ran H., Jiang M., Tang W., Yan C., Yang W., Ren Y., Feng L.
BMJ Open scimago Q1 wos Q1 Open Access
2024-02-16 citations by CoLab: 1 Abstract  
ObjectivesThis study aimed to assess the healthcare-seeking behaviour and related factors of people with acute respiratory symptoms in the rural areas of central and western China to estimate the disease burden of influenza more accurately.DesignCross-sectional survey.SettingsFifty-two communities/villages in the Wanzhou District, Chongqing, China, a rural area in southwest China, from May 2022 to July 2022.ParticipantsThe participants were those who had been living in Wanzhou District continuously for more than 6 months and consented to participate.Outcome measuresA semistructured questionnaire was used to determine the healthcare-seeking behaviour of participants, and the dichotomous response of ‘yes’ or ‘no’ was used to assess whether participants had acute respiratory symptoms and their healthcare-seeking behaviour.ResultsOnly 50.92% (360 of 707) of the patients with acute respiratory infection visited medical and health institutions for treatment, whereas 49.08% (347 of 707) avoided treatment or opted for self-medication. The primary reason for not seeing a doctor was that patients felt their condition was not serious and visiting a medical facility for treatment was unnecessary. Short distance (87.54%) and reasonable charges (49.48%) were ranked as the most important reasons for choosing treatment at primary medical and health facilities (80.27%). The primary reasons for which patients visited secondary and tertiary hospitals (7.78% and 8.61%, respectively) were that doctors in such facilities were better at diagnosis (57.14%) and at treatment (87.10%).ConclusionThe findings provided in this study indicated that regular healthcare-seeking behaviour investigations should be conducted. The disease burden of influenza can be calculated more accurately when healthcare-seeking behaviour investigations are combined with surveillance in the hospitals.
Ninsiima M., Wanyana M.W., Kiggundu T., King P., Lubwama B., Migisha R., Bulage L., Kadobera D., Ario A.R.
2024-01-25 citations by CoLab: 0 PDF Abstract  
Mass gatherings frequently include close, prolonged interactions between people, which presents opportunities for infectious disease transmission. Over 20,000 pilgrims gathered at Namugongo Catholic and Protestant shrines to commemorate 2022 Uganda Martyr’s Day. We described syndromes suggestive of key priority diseases particularly COVID–19 and viral hemorrhagic fever (VHF) among visiting pilgrims during May 25–June 5, 2022. We conducted a survey among pilgrims at the catholic and protestant shrines based on signs and symptoms for key priority diseases: COVID–19 and VHF. A suspected COVID–19 case was defined as acute respiratory illness (temperature greater 37.5°C and at least one sign/symptom of respiratory infection such as cough or shortness of breath) whereas a suspected VHF case was defined as fever >37.5°C and unexplained bleeding among pilgrims who visited Namugongo Catholic and Protestant shrines from May 25 to June 5, 2022. Pilgrims were sampled systematically at entrances and demarcated zonal areas to participate in the survey. Additionally, we extracted secondary data on pilgrims who sought emergency medical services from Health Management Information System registers. Descriptive analysis was conducted to identify syndromes suggestive of key priority diseases. Among 1,350 pilgrims interviewed, 767 (57%) were female. The mean age was 37.9 (±17.9) years. Nearly all pilgrims 1,331 (98.6%) were Ugandans. A total of 236 (18%) reported ≥1 case definition symptom and 42 (3%) reported ≥2 symptoms. Thirty-nine (2.9%) were suspected COVID–19 cases and three (0.2%) were suspected VHF cases from different regions of Uganda. Among 5,582 pilgrims who sought medical care from tents, 628 (11.3%) had suspected COVID–19 and one had suspected VHF. Almost one in fifty pilgrims at the 2022 Uganda Martyrs’ commemoration had at least one symptom of COVID–19 or VHF. Intensified syndromic surveillance and planned laboratory testing capacity at mass gatherings is important for early detection of public health emergencies that could stem from such events.
Leal Neto O., Paolotti D., Dalton C., Carlson S., Susumpow P., Parker M., Phetra P., Lau E.H., Colizza V., Jan van Hoek A., Kjelsø C., Brownstein J.S., Smolinski M.S.
2023-09-01 citations by CoLab: 9 Abstract  
Participatory surveillance (PS) has been defined as the bidirectional process of transmitting and receiving data for action by directly engaging the target population. Often represented as self-reported symptoms directly from the public, PS can provide evidence of an emerging disease or concentration of symptoms in certain areas, potentially identifying signs of an early outbreak. The construction of sets of symptoms to represent various disease syndromes provides a mechanism for the early detection of multiple health threats. Global Flu View (GFV) is the first-ever system that merges influenza-like illness (ILI) data from more than 8 countries plus 1 region (Hong Kong) on 4 continents for global monitoring of this annual health threat. GFV provides a digital ecosystem for spatial and temporal visualization of syndromic aggregates compatible with ILI from the various systems currently participating in GFV in near real time, updated weekly. In 2018, the first prototype of a digital platform to combine data from several ILI PS programs was created. At that time, the priority was to have a digital environment that brought together different programs through an application program interface, providing a real time map of syndromic trends that could demonstrate where and when ILI was spreading in various regions of the globe. After 2 years running as an experimental model and incorporating feedback from partner programs, GFV was restructured to empower the community of public health practitioners, data scientists, and researchers by providing an open data channel among these contributors for sharing experiences across the network. GFV was redesigned to serve not only as a data hub but also as a dynamic knowledge network around participatory ILI surveillance by providing knowledge exchange among programs. Connectivity between existing PS systems enables a network of cooperation and collaboration with great potential for continuous public health impact. The exchange of knowledge within this network is not limited only to health professionals and researchers but also provides an opportunity for the general public to have an active voice in the collective construction of health settings. The focus on preparing the next generation of epidemiologists will be of great importance to scale innovative approaches like PS. GFV provides a useful example of the value of globally integrated PS data to help reduce the risks and damages of the next pandemic.
Sarker F., Chowdhury M.H., Ratul I.J., Islam S., Mamun K.A.
Frontiers in Digital Health scimago Q1 wos Q2 Open Access
2023-05-11 citations by CoLab: 2 PDF Abstract  
BackgroundCOVID-19 has affected many people globally, including in Bangladesh. Due to a lack of preparedness and resources, Bangladesh has experienced a catastrophic health crisis, and the devastation caused by this deadly virus has not yet been halted. Hence, precise and rapid diagnostics and infection tracing are essential for managing the condition and limiting its spread. The conventional screening procedure, such as reverse transcription polymerase chain reaction (RT-PCR), is not available in most rural areas and is time-consuming. Therefore, a data-driven intelligent surveillance system can be advantageous for rapid COVID-19 screening and risk estimation.ObjectivesThis study describes the design, development, implementation, and characteristics of a nationwide web-based surveillance system for educating, screening, and tracking COVID-19 at the community level in Bangladesh.MethodsThe system consists of a mobile phone application and a cloud server. The data is collected by community health professionals via home visits or telephone calls and analyzed using rule-based artificial intelligence (AI). Depending on the results of the screening procedure, a further decision is made regarding the patient. This digital surveillance system in Bangladesh provides a platform to support government and non-government organizations, including health workers and healthcare facilities, in identifying patients at risk of COVID-19. It refers people to the nearest government healthcare facility, collecting and testing samples, tracking and tracing positive cases, following up with patients, and documenting patient outcomes.ResultsThis study began in April 2020, and the results are provided in this paper till December 2022. The system has successfully completed 1,980,323 screenings. Our rule-based AI model categorized them into five separate risk groups based on the acquired patient information. According to the data, around 51% of the overall screened populations are safe, 35% are low risk, 9% are high risk, 4% are mid risk, and the remaining 1% is very high risk. The dashboard integrates all collected data from around the nation onto a single platform.ConclusionThis screening can help the symptomatic patient take immediate action, such as isolation or hospitalization, depending on the severity. This surveillance system can also be utilized for risk mapping, planning, and allocating health resources to more vulnerable areas to reduce the virus's severity.
Wittwer S., Paolotti D., Lichand G., Leal Neto O.
2023-04-26 citations by CoLab: 6 Abstract  
Background The ongoing COVID-19 pandemic has emphasized the necessity of a well-functioning surveillance system to detect and mitigate disease outbreaks. Traditional surveillance (TS) usually relies on health care providers and generally suffers from reporting lags that prevent immediate response plans. Participatory surveillance (PS), an innovative digital approach whereby individuals voluntarily monitor and report on their own health status via web-based surveys, has emerged in the past decade to complement traditional data collection approaches. Objective This study compared novel PS data on COVID-19 infection rates across 9 Brazilian cities with official TS data to examine the opportunities and challenges of using PS data, and the potential advantages of combining the 2 approaches. Methods The TS data for Brazil are publicly accessible on GitHub. The PS data were collected through the Brazil Sem Corona platform, a Colab platform. To gather information on an individual’s health status, each participant was asked to fill out a daily questionnaire on symptoms and exposure in the Colab app. Results We found that high participation rates are key for PS data to adequately mirror TS infection rates. Where participation was high, we documented a significant trend correlation between lagged PS data and TS infection rates, suggesting that PS data could be used for early detection. In our data, forecasting models integrating both approaches increased accuracy up to 3% relative to a 14-day forecast model based exclusively on TS data. Furthermore, we showed that PS data captured a population that significantly differed from a traditional observation. Conclusions In the traditional system, the new recorded COVID-19 cases per day are aggregated based on positive laboratory-confirmed tests. In contrast, PS data show a significant share of reports categorized as potential COVID-19 cases that are not laboratory confirmed. Quantifying the economic value of PS system implementation remains difficult. However, scarce public funds and persisting constraints to the TS system provide motivation for a PS system, making it an important avenue for future research. The decision to set up a PS system requires careful evaluation of its expected benefits, relative to the costs of setting up platforms and incentivizing engagement to increase both coverage and consistent reporting over time. The ability to compute such economic tradeoffs might be key to have PS become a more integral part of policy toolkits moving forward. These results corroborate previous studies when it comes to the benefits of an integrated and comprehensive surveillance system, and shed light on its limitations and on the need for additional research to improve future implementations of PS platforms.
Leal Neto O., Paolotti D., Dalton C., Carlson S., Susumpow P., Parker M., Phetra P., Lau E.H., Colizza V., Jan van Hoek A., Kjelsø C., Brownstein J.S., Smolinski M.S.
2023-02-20 citations by CoLab: 1 Abstract  
UNSTRUCTURED Participatory surveillance (PS) has been defined as the bidirectional process of transmitting and receiving data for action by directly engaging the target population. Often represented as self-reported symptoms directly from the public, PS can provide evidence of an emerging disease or concentration of symptoms in certain areas, potentially identifying signs of an early outbreak. The construction of sets of symptoms to represent various disease syndromes provides a mechanism for the early detection of multiple health threats. Global Flu View (GFV) is the first-ever system that merges influenza-like illness (ILI) data from more than 8 countries plus 1 region (Hong Kong) on 4 continents for global monitoring of this annual health threat. GFV provides a digital ecosystem for spatial and temporal visualization of syndromic aggregates compatible with ILI from the various systems currently participating in GFV in near real time, updated weekly. In 2018, the first prototype of a digital platform to combine data from several ILI PS programs was created. At that time, the priority was to have a digital environment that brought together different programs through an application program interface, providing a real time map of syndromic trends that could demonstrate where and when ILI was spreading in various regions of the globe. After 2 years running as an experimental model and incorporating feedback from partner programs, GFV was restructured to empower the community of public health practitioners, data scientists, and researchers by providing an open data channel among these contributors for sharing experiences across the network. GFV was redesigned to serve not only as a data hub but also as a dynamic knowledge network around participatory ILI surveillance by providing knowledge exchange among programs. Connectivity between existing PS systems enables a network of cooperation and collaboration with great potential for continuous public health impact. The exchange of knowledge within this network is not limited only to health professionals and researchers but also provides an opportunity for the general public to have an active voice in the collective construction of health settings. The focus on preparing the next generation of epidemiologists will be of great importance to scale innovative approaches like PS. GFV provides a useful example of the value of globally integrated PS data to help reduce the risks and damages of the next pandemic.
Wittwer S., Paolotti D., Lichand G., Leal Neto O.
2022-11-22 citations by CoLab: 0 Abstract  
BACKGROUND The ongoing COVID-19 pandemic has emphasized the necessity of a well-functioning surveillance system to detect and mitigate disease outbreaks. Traditional surveillance (TS) usually relies on health care providers and generally suffers from reporting lags that prevent immediate response plans. Participatory surveillance (PS), an innovative digital approach whereby individuals voluntarily monitor and report on their own health status via web-based surveys, has emerged in the past decade to complement traditional data collection approaches. OBJECTIVE This study compared novel PS data on COVID-19 infection rates across 9 Brazilian cities with official TS data to examine the opportunities and challenges of using PS data, and the potential advantages of combining the 2 approaches. METHODS The TS data for Brazil are publicly accessible on GitHub. The PS data were collected through the Brazil Sem Corona platform, a Colab platform. To gather information on an individual’s health status, each participant was asked to fill out a daily questionnaire on symptoms and exposure in the Colab app. RESULTS We found that high participation rates are key for PS data to adequately mirror TS infection rates. Where participation was high, we documented a significant trend correlation between lagged PS data and TS infection rates, suggesting that PS data could be used for early detection. In our data, forecasting models integrating both approaches increased accuracy up to 3% relative to a 14-day forecast model based exclusively on TS data. Furthermore, we showed that PS data captured a population that significantly differed from a traditional observation. CONCLUSIONS In the traditional system, the new recorded COVID-19 cases per day are aggregated based on positive laboratory-confirmed tests. In contrast, PS data show a significant share of reports categorized as potential COVID-19 cases that are not laboratory confirmed. Quantifying the economic value of PS system implementation remains difficult. However, scarce public funds and persisting constraints to the TS system provide motivation for a PS system, making it an important avenue for future research. The decision to set up a PS system requires careful evaluation of its expected benefits, relative to the costs of setting up platforms and incentivizing engagement to increase both coverage and consistent reporting over time. The ability to compute such economic tradeoffs might be key to have PS become a more integral part of policy toolkits moving forward. These results corroborate previous studies when it comes to the benefits of an integrated and comprehensive surveillance system, and shed light on its limitations and on the need for additional research to improve future implementations of PS platforms.
Spector E., Zhang Y., Guo Y., Bost S., Yang X., Prosperi M., Wu Y., Shao H., Bian J.
2022-04-13 citations by CoLab: 9 PDF Abstract  
Syndromic surveillance involves the near-real-time collection of data from a potential multitude of sources to detect outbreaks of disease or adverse health events earlier than traditional forms of public health surveillance. The purpose of the present study is to elucidate the role of syndromic surveillance during mass gathering scenarios. In the present review, the use of syndromic surveillance for mass gathering scenarios is described, including characteristics such as methodologies of data collection and analysis, degree of preparation and collaboration, and the degree to which prior surveillance infrastructure is utilized. Nineteen publications were included for data extraction. The most common data source for the included syndromic surveillance systems was emergency departments, with first aid stations and event-based clinics also present. Data were often collected using custom reporting forms. While syndromic surveillance can potentially serve as a method of informing public health policy regarding specific mass gatherings based on the profile of syndromes ascertained, the present review does not indicate that this form of surveillance is a reliable method of detecting potentially critical public health events during mass gathering scenarios.
Divi N., Smolinski M.
2021-11-22 citations by CoLab: 4 Abstract  
Background Technology-based innovations that are created collaboratively by local technology specialists and health experts can optimize the addressing of priority needs for disease prevention and control. An EpiHack is a distinct, collaborative approach to developing solutions that combines the science of epidemiology with the format of a hackathon. Since 2013, a total of 12 EpiHacks have collectively brought together over 500 technology and health professionals from 29 countries. Objective We aimed to define the EpiHack process and summarize the impacts of the technology-based innovations that have been created through this approach. Methods The key components and timeline of an EpiHack were described in detail. The focus areas, outputs, and impacts of the twelve EpiHacks that were conducted between 2013 and 2021 were summarized. Results EpiHack solutions have served to improve surveillance for influenza, dengue, and mass gatherings, as well as laboratory sample tracking and One Health surveillance, in rural and urban communities. Several EpiHack tools were scaled during the COVID-19 pandemic to support local governments in conducting active surveillance. All tools were designed to be open source to allow for easy replication and adaptation by other governments or parties. Conclusions EpiHacks provide an efficient, flexible, and replicable new approach to generating relevant and timely innovations that are locally developed and owned, are scalable, and are sustainable.
Divi N., Smolinski M.
2021-10-15 citations by CoLab: 0 Abstract  
BACKGROUND Technology-based innovations that are created collaboratively by local technology specialists and health experts can optimize the addressing of priority needs for disease prevention and control. An EpiHack is a distinct, collaborative approach to developing solutions that combines the science of epidemiology with the format of a hackathon. Since 2013, a total of 12 EpiHacks have collectively brought together over 500 technology and health professionals from 29 countries. OBJECTIVE We aimed to define the EpiHack process and summarize the impacts of the technology-based innovations that have been created through this approach. METHODS The key components and timeline of an EpiHack were described in detail. The focus areas, outputs, and impacts of the twelve EpiHacks that were conducted between 2013 and 2021 were summarized. RESULTS EpiHack solutions have served to improve surveillance for influenza, dengue, and mass gatherings, as well as laboratory sample tracking and One Health surveillance, in rural and urban communities. Several EpiHack tools were scaled during the COVID-19 pandemic to support local governments in conducting active surveillance. All tools were designed to be open source to allow for easy replication and adaptation by other governments or parties. CONCLUSIONS EpiHacks provide an efficient, flexible, and replicable new approach to generating relevant and timely innovations that are locally developed and owned, are scalable, and are sustainable.

Top-30

Journals

1
2
3
4
5
1
2
3
4
5

Publishers

2
4
6
8
10
12
14
16
2
4
6
8
10
12
14
16
  • We do not take into account publications without a DOI.
  • Statistics recalculated only for publications connected to researchers, organizations and labs registered on the platform.
  • Statistics recalculated weekly.

Are you a researcher?

Create a profile to get free access to personal recommendations for colleagues and new articles.
Share
Cite this
GOST | RIS | BibTex | MLA
Found error?