WOSP 2020 Keynote Presentations
Announcement
In the wake of the global outbreak of COVID-19, the workshop will be a fully online event.
Introduction
The entire body of research literature is currently estimated at 100-150 million publications with an annual increase of around 1.5 million. Research literature constitutes the most complete representation of knowledge we have assembled as human species. It enables us to develop cures to diseases, solve difficult engineering problems and answer many of the world’s challenges we are facing today. Systematically reading and analysing the full body of knowledge is now beyond the capacities of any human being. Consequently, it is important to better understand how we can leverage Natural Language Processing/Text Mining techniques to aid knowledge creation and improve the process by which research is being done.
This workshop aims to bring together people from different backgrounds who:
- have experience with analysing and mining databases of scientific publications,
- develop systems that enable such analysis and mining of scientific databases (especially those who publication databases) or
- who develop novel technologies that improve the way research is being done.
RESEARCH TRACK
The topics of the workshop will be organised around the following themes:
- The whole ecosystem of infrastructures including repositories, aggregators, text-and data-mining facilities, impact monitoring tools, datasets, services and APIs that enable analysis of large volumes of scientific publications.
- Semantic enrichment of scientific publications by means of text and data mining.
- Analysis of large databases of scientific publications to identify research trends, high impact and improve access to research content.
Topics of interest relevant to theme 1 include but are not limited to:
- Infrastructures including repositories, aggregators, text-and data-mining facilities, impact monitoring tools, datasets, services and APIs for accessing scientific publications and/or research data. The existence of datasets, services, systems and APIs (in particular those that are open) providing access to large volumes of scientific publications and research data, is an essential prerequisite for being able to research and develop new technologies that can transform the way people do research. We invite papers presenting innovative approaches to the development of these systems that enable people to access databases and carry out their analysis. Papers addressing Open Access are of special interest. We also welcome submissions discussing the technical aspects of supporting Open Science, in particular reproducibility of research, sharing of scientific workflows and linking research data with publications. Finally, we also invite papers discussing issues and current challenges in the design of these systems.
Topics of interest relevant to theme 2 include but are not limited to:
- Novel information extraction and text-mining approaches to semantic enrichment of publications. This might range from mining publication structure, such as title, abstract, authors, citation information etc. to more challenging tasks, such as extracting names of applied methods, research questions (or scientific gaps), identifying parts of the scholarly discourse structure, etc.
- Automatic categorization and clustering of scientific publications. Methods that can automatically categorize publications according to an established subject-based classification/taxonomy (such as Library of Congress classification, UNESCO thesaurus, DOAJ subject classification, Library of Congress Subject Headings) are of particular interest. Other approaches might involve automatic clustering or classification of research publications according to various criteria.
- New methods and models for connecting and interlinking scientific publications. Scientific publications in digital libraries are not isolated islands. Connecting publications using explicitly defined citations is very restrictive and has many disadvantages. We are interested in innovative technologies that can automatically connect and interlink publications or parts of publications according to various criteria, such as semantic similarity, contradiction, argument support or other relationship types.
- Models for semantically representing and annotating publications. This topic is related to the aspect of semantically modeling publications and scholarly discourse. Models that are practical with respect to the state-of-the-art in Natural Language Processing (NLP) technologies are of a special interest.
- Semantically enriching/annotating publications by crowdsourcing Crowdsourcing can be used in innovative ways to annotate publications with richer metadata or to approve/disapprove annotations created using text-mining or other approaches. We welcome papers that address the following questions: (a) what incentives should be provided to motivate users in contributing, (b) how to apply crowdsourcing in the specialized domains of scientific publications, (c) what tasks in the domain of organising scientific publications is crowdsourcing suitable for and where it might fail, other relevant crowdsourcing topics relevant to the domain of scientific publications.
Topics of interest relevant to theme 3 include but are not limited to:
- New methods, models and innovative approaches for measuring impact of publications. The most widely used metrics for measuring impact are based on citations. However, counting citations not taking into account the publication content and the qualitative nature of the citation. In addition, there is a delay between the publication and the measurable impact in citations. We in particular encourage papers addressing new ways of using textual resources for evaluating publications’ importance, such as based on the ideas of detecting (textual) novelty/contribution of works or automatic classification of citation types, sentiment or influence.
- New methods for measuring performance of researchers or research groups. Methods for assessing impact of a publication can be often extended to methods that can assess the impact of individual researchers. However, there are also other criteria for measuring impact in addition to publications, such as the development and publication of research data, economical and market impact that should also be taken into account. We welcome papers addressing these aspects.
- Methods for identifying research trends and cross-fertilization between research disciplines. Identifying research trends should allow discovering newly emerging disciplines or it should help to explain why certain fields are attracting the attention of a wider research community. Such monitoring is important for research funders and governments in order to be able to quickly respond to new developments. We invite papers discussing new methods for identifying trends and cross-fertilization between research disciplines using methods ranging from social network analysis and text- and data-mining to innovative visualization approaches.
- Applications and case studies of mining from scientific databases and publications. New methods and models developed for mining from scientific publications can be applied in many different scenarios, such as improving access to scientific publications, providing exploratory search in digital collections, identifying experts. We encourage papers describing innovative approaches that use scientific publications and data to solve real-world (discipline-specific) problems.
- Exploratory search and Recommender systems for research.This topic addresses research carried out to improve access to very large collections of research publications to improve the way research process is conducted.
SHARED TASK TRACK
This year we would like to invite the workshop participants to take part in two special Shared Tasks.
'3C' Citation Context Classification Task
We are extremely excited to introduce the new Citation Context Classification '3C' task which will require teams to build models for the classification of citations according to purpose and influence. A brand new dataset of annotated citations will be released for test / training purposes. All teams of all levels are welcome to submit their entries.
For more information, please click 3C Shared Task
Subject Classification Shared Task
We are also excited to announce a shared task on subject area classification. This task will require teams to build models that identify which subject area publications fall into. An expert curated dataset will be released for test / training purposes. All teams of all levels are welcome to submit their entries.
For more information, please click Subject Classification Task
Previous Organisation
WOSP has been the first workshop to address specifically the topic of mining scientific papers at a major conference. The 6 previous instances of WOSP were held in conjunction with the JCDL conferences.
- The 1st International Workshop on Mining Scientific Publications was collocated with JCDL 2012 in Washington, DC. The proceedings of the workshop are available here.
- The 2nd International Workshop on Mining Scientific Publications was collocated with JCDL 2013 in Indianapolis, IN. The proceedings of the workshop are available here.
- The 3rd International Workshop on Mining Scientific Publications was collocated with DL 2014 in London, UK. The proceedings of the workshop are available here.
- The 4th International Workshop on Mining Scientific Publications was collocated with JCDL 2015 in Knoxville, TN. The proceedings of the workshop are available here.
- The 5th International Workshop on Mining Scientific Publications was collocated with JCDL 2016 in Newark, NJ. The proceedings of the workshop are available here.
- The 6th International Workshop on Mining Scientific Publications was collocated with JCDL 2017 in Toronto, ON. The proceedings of the workshop are available here.
- The 7th International Workshop on Mining Scientific Publications was collocated with LREC 2018 in Miyazaki, ON. The proceedings of the workshop are available here.
We have also organised the Workshop on Scholarly Web Mining (SWM 2017), which was associated with WSDM 2017 in Cambridge, UK. The proceedings of the SWM 2017 workshop are available here.
This year, we have joined forces with the BIRNDL workshop to organize the First Workshop on Scholarly Document Processing (SDP 2020) which will be held in conjunction with EMNLP 2020. The workshop features a research track and a shared task track.
All runs of the workshop have been extremely successful in terms of attracting submissions and participants from leading institutions in the area including Cambridge University, Microsoft, British Library, Elsevier, National Library of Medicine, Library of Congress, University of Pennsylvania (CiteSeerX), Know-Center Graz, University of Athens (OpenAIRE project) and Mendeley.
Submission Format
We invite submissions related to the workshop’s topics. Long papers should not exceed 10 pages and short papers should not exceed 4 pages in the JCDL (ACM) style. Furthermore, we welcome demo presentations of systems or methods. A demonstration submission should consist of a maximum two-page description of the system, method or tool to be demonstrated.
The ACM proceedings template can be found here ACM Template. Papers should be submitted using EasyChair. Papers do not need to be anonymized for review.
All papers will be reviewed for correctness, originality, technical strength, quality of presentation, and relevance to the workshop topics of interest by three reviewers.
Important Dates
Timeline for Research Track
July 05, 2020 July 10, 2020 — Paper
submission deadline
June 22, 2020 July 26, 2020 — Paper
acceptance notification
July 13, 2020 Aug 02, 2020 —
Camera-ready
August 5, 2020 — WOSP 2020
Timeline for 3C Shared Task
May 11, 2020 — Competition Start Date
June 22, 2020 — Competition End Date
July 05, 2020 July 10, 2020 — Paper
and code submission deadline
June 22, 2020 July 26, 2020 —
Shared task acceptance notification
July 13, 2020 Aug 02, 2020 —
Camera-ready
August 5, 2020 — WOSP 2020
Keynote Speakers
The Special Case of Scientific Argumentation: Analyzing Scitorics
The exponential growth in the number of scientific publications yields the need for automatically understanding scientific text. However, the complex nature of scientific literature requires attention on the domain- and community-specific rhetorical aspects of scientific writing, which we collectively dub "scitorics". In this talk, we touch on the special case of scientific argumentation by presenting our work on analyzing scitorics in computer graphics literature. We investigate the link between the argumentative structure of publications and rhetorical layers, such as discourse categories and citation contexts. To this end, we (1) augment a corpus of scientific publications annotated with four layers of rhetoric annotations with argumentation annotations and (2) investigate neural multi-task learning architectures combining argument extraction with rhetorical classification tasks. Finally, we (3) present ArguminSci, a tool enabling for multi-layered analysis of scientific publications.
Supporting Systematic Reviews in Medicine
Systematic Reviews synthesise the results of multiple clinical trials to obtain a more significant result. While systematic reviews are essential for evidence-based medicine, they have the disadvantage of requiring a large amount of time to prepare. In this talk, I describe how computers can support the creation of Systematic Reviews in medicine, and the challenges to be solved in improving this support.
Mitigating document collection biases with citations: A case study on CORD-19
With the broad adoption of data science in decision making processes, recent years have witnessed more frequent examples where biases in the datasets or the analytical algorithms lead to unfortunate and sometimes harmful outcomes. Being mindful of potential biases and actively taking measures to mitigate them have become a necessary second nature for data scientists and decision makers alike. Citations in scholarly publications have long been known to represent the crowd-sourced collective judgments on scientific reports and can be a valuable source of information in analyzing scholarly documents. This study describes a methodology that uses citations to identify biases in the COVID-19 Open Research Dataset, or CORD-19, a document collection created to advance the development of intelligent technologies that can assist scientists in navigating through the voluminous literature of COVID-19. By expanding to articles in the citation networks seeded by CORD-19 with three distinct algorithms, it can be shown that CORD-19 has a strong tilt in favor of recent articles and uneven coverages in the topical fields and the publication venues. Using CORD-19 to identify critical knowledge and assess the journal importance, for example, will lead to different conclusions from the analyses based on the three expanded datasets, of which results largely agree with one another. CORD-19, however, does not appear to exhibit biases in describing research collaborations in terms of team sizes or geolocations. Currently, the three citation network traversal algorithms only utilize bibliographic records. How improvements can be made to them, such as through more sophisticated uses of citation contexts, will also be discussed.
LBD: Beyond the ABCs
In this workshop, Neil’s keynote speech will cover the recent research, his lab, The Smalheiser Laboratory, is involved in, some of which is aligned to the theme of the WOSP 2020. Niel would be discussing the following topics briefly: (1). Infrastructure for accessing scientific publications: The Citation Cloud surrounding a biomedical article, a visualization tool to enable citation analysis by anyone. (2). Information extraction and text mining approaches: An automated probabilistic tagger for publication types and study designs of biomedical articles. (3). Analysing large databases of scientific publications for identifying high impact research: New models of LBD in light of the scientific reproducibility crisis.
Citation Classification for Behavioral Analysis of a Scientific Field
Citations are an important indicator of the state of a scientific field, reflecting how authors frame their work, and influencing uptake by future scholars. In this talk, I'll describe the development of a new method for analyzing the purpose of citations and a large-scale behavioral study of citations on their framing and uptake. I will demonstrate how authors are sensitive to discourse structure and publication venue when citing and that how a paper cites related work is predictive of its citation count. Finally, I will use changes in citation roles to show that the field of NLP has undergone a systematic change in its citation practices to become a rapid discovery science.
Program
Please note, all sessions listed below are in UTC+1.
For times in other time zones please see the JCDL website.
|
9:00-10:30 — Session 1 |
|
9:00-9:10 |
|
| 9:10-9:40 |
Keynote Talk The Special Case of Scientific Argumentation: Analyzing Scitorics Anne Lauscher |
| 9:40-9:55 |
Short paper Representing and Reconstructing PhySH: Which Embedding Competent? Xiaoli Chen and Zhixiong Zhang |
| 9:55-10:10 |
Short paper The Normalized Impact Index for Keywords in Scholarly Papers to Detect Subtle Research Topics Daisuke Ikeda, Yuta Taniguchi and Kazunori Koga |
| 10:10-10:25 |
Short paper Term-Recency for TF-IDF, BM25 and USE Term Weighting Divyanshu Marwah and Joeran Beel |
| 10:30-11:00 |
Break |
|
11:00-12:30 — Session 2 |
|
11:00-11:30 |
Supporting Systematic Reviews in Medicine Allan Hanbury |
| 11:30-11:50 |
Long paper Synthetic vs. Real Reference Strings for Citation Parsing, and the Importance of Re-training and Out-Of-Sample Data for Meaningful Evaluations: Experiments with GROBID, GIANT and CORA Mark Grennan and Joeran Beel |
| 11:50-12:10 |
Long paper Virtual Citation Proximity (VCP): Empowering Document Recommender Systems by Learning a Hypothetical In-Text Citation-Proximity Metric For Uncited Documents Paul Molloy, Joeran Beel and Akiko Aizawa |
| 12:10-12:25 |
Short paper SmartCiteCon: Implicit Citation Context Extraction from Academic Literature Using Supervised Learning Chenrui Guo, Haoran Cui, Li Zhang, Jiamin Wang, Wei Lu and Jian Wu |
|
12:30-16:00 — JCDL Keynote + Break |
|
|
16:00-17:30 — Session 3 |
|
16:00-16:30 |
Mitigating document collection biases with citations: A case study on CORD-19 Kuansan Wang |
| 16:30-16:50 |
Shared Task overview Overview of the 2020 WOSP 3C Citation Context Classification Task Suchetha N. Kunnath, David Pride, Bikash Gyawali and Petr Knoth |
| 16:50-17:00 |
Shared Task paper Combining Representations For Effective Citation Classification Claudio Moisés Valiense de Andrade and Marcos André Gonçalves |
| 17:00-17:10 |
Shared Task paper Find influential articles in a dataset Paul Larmuseau |
| 17:10-17:20 |
Shared Task paper Scubed at 3C task A - A simple baseline for citation context purpose classification Shubhanshu Mishra and Sudhanshu Mishra |
| 17:20-17:30 |
Shared Task paper Amrita_CEN_NLP @ WOSP 3C Citation Context Classification Task B. Premjith and K. P. Soman |
| 17:30-18:00 |
Break |
|
18:00-19:30 — Session 4 |
|
18:00-18:30 |
LBD: Beyond the ABCs Neil R. Smalheiser |
| 18:30-18:50 |
Long paper Citations Beyond Self Citations: Identifying Authors, Affiliations, and Nationalities in Scientific Papers Yoshitomo Matsubara and Sameer Singh |
| 18:50-19:20 |
Keynote talk Citation Classification for Behavioral Analysis of a Scientific Field David Jurgens |
| 19:20-19:30 |
Closing |
Organising Committee
Petr Knoth, Knowledge Media institute, The Open University, UK
Christopher Stahl, Oak Ridge National Laboratory, USA
Bikash Gyawali, Knowledge Media institute, The Open University, UK
David Pride, Knowledge Media institute, The Open University, UK
Drahomira Herrmannova, Oak Ridge National Laboratory, USA
Suchetha N. Kunnath, Knowledge Media institute, The Open University, UK
Programme Committee
Sepideh Mesbah, Delft University of Technology, Netherlands
Akiko Aizawa, National Insutitute of Informatics, Japan
Marc Bertin, Université Claude Bernard Lyon 1, France
Federico Nanni, University of Mannheim, Germany
Saeed-Ul Hassan, Information Technology University, Pakistan
José Borbinha, Universidade de Lisboa, Portugal
Radim Hladik, Institute of Philosophy of the Czech Academy of Sciences, Czech Republic
Tirthankar Ghosal, Indian Institute of Technology Patna, India
Martin Klein, Los Alamos National Laboratory, USA
Wojtek Sylwestrzak, ICM Univeristy of Warsaw, Poland
Paolo Manghi, ISTI-CNR, Italy
Jian Wu, Old Dominion University, USA
Roman Kern, Graz University of Technology, Austria
Monica Ihli, University of Tennessee, USA
Antoine Isaac, Europeana, The Netherlands
Birger Larsen, Aalborg University Copenhagen, Denmark
Peter Mutschke, GESIS Leibniz Institute for the Social Sciences, Germany
Francesco Osborne, The Open University, UK
Robert M. Patton, Oak Ridge National Laboratory, USA
Eloy Rodrigues, Universidade do Minho, Portugal
Pravallika Devineni, Oak Ridge National Laboratory, USA
Vetle Torvik, University of Illinois, USA
Location
Virtual workshop collocated with Joint Conference on Digital Libraries (JCDL 2020)
Wuhan, Hubei Province, China
© 8th International Workshop on Mining Scientific Publications. Design based on CSS Templates For Free.