The fifth evaluation workshop of the DDP project held virtually over three days, took place on the 10th and 16th, and 18th of November 2021. The aim of this workshop was to have researchers evaluate the module “Data Documentation and Data Preparation” including its minimum requirements and checklists as well as the inventory list belonging to the DDP cover sheet with regard to its completeness and manageability. The first day was initially limited to the structure of the modules and the Domain Data Protocols (DDPs) themselves. At the end of the first day, the participating researchers and RDM-Experts received a version of the module tailored to qualitative data or quantitative data, depending on their expertise, to take home for evaluation until the next workshop day. On the following two days, we collected feedback on the module, with the second workshop day focusing on the quantitative perspective and the third workshop day on the qualitative perspective.
The fifth evaluation workshop was led by staff from the Leibniz Institute for Human Development and Educational Information (DIPF), the German Youth Institute (DJI), the Center for Teacher Training and Educational Research at the University of Potsdam (ZeLB), and GESIS – Leibniz Institute for the Social Sciences.
On 3 November, members of the project met virtually to discuss the structure of the Domain Data Protocols (DDPs) as well as the DDP cover sheet. For the former, it was agreed that the order of the individual modules is less important than drawing attention to the fact that all modules must be processed at a certain point in time and that this may have to be done several times (a living document). The cover sheet of the Domain Data Protocols was then addressed, with minor changes, such as the deletion of individual questions from the questionnaire.
On the 5th and 6th of October, the 22nd DINI Annual Conference took place as an online event. Simon Eckert presented the poster “Domain Data Protocols for Empirical Educational Research – The Challenge of FAIR Research Data” as part of a poster session on “Supporting the Creation of Sustainable Research Data”. Before the actual poster presentation, the author first introduced the DDP project in general in a 2-minute speed talk, before the actual poster session took place in a Gather.town room. There, he exchanged ideas with interested visitors about the conceptual origins of DDPs and their later application possibilities. Overall, this successfully raised the profile of the project and the DDPs. Furthermore, the input gained from the discussions was very valuable for the further development of the DDPs.
In order to publicize the official launch of the project website and thus the project itself to a broader public, a short article was written for the GESIS blog and published on 13 July. The blog post focuses on three main points. After a short introduction, which rudimentarily touches on research practice in the context of research data and its publication, typical problems for researchers in publishing data are addressed. This is followed by a brief introduction to the project Domain Data Protocols for Educational Research, before concluding with a discussion of one of the most important aspects of producing DDPs, the research community.
The DDPs produced in the project have been created due to the increasing relevance of data availability as well as post-data use, and are intended to provide tailored and discipline-specific assistance with the involvement of the research community. The aim is to ensure traceability and comprehensibility in the re-use and to support researchers in empirical educational research through handouts and clear guidelines, taking into account legal requirements such as data protection or copyright.
On 23 July, Anja Perry and Sebastian Netscher presented their poster Measuring the Costs of Research Data Management at the 10th ESRA Conference 2021. In this poster, the two authors explain that there has been little work to date on calculating the costs of research data management. This is mainly due to the fact that costs for research data management are generally difficult to calculate, as they can vary greatly from project to project. The authors then analysed four cost-driving variables by evaluating them empirically. Based on these analyses, modules within the DDPs (Domain Data Protocols) will then be designed to support users in calculating the costs of research data management within their own research project.
The fourth evaluation workshop of the DDP project, which was held virtually on both dates, took place on July 21st and 28th, 2021. The aim of this workshop was to evaluate the manageability and usability of the data protection module by the participating experts. The workshop was led by the Leibniz Institute for Human Development and Educational Information (DIPF), the German Youth Institute (DJI), the Center for Teacher Training and Educational Research at the University of Potsdam (ZeLB) and GESIS – Leibniz Institute for the Social Sciences.
The first of the two workshop days started with introducing the collaborative project “Domain Data Protocols for Empirical Educational Research” and the concept of Domain Data Protocols to the participants. This first introduction to the project was followed by a closer look at the module, which covers data protection aspects.
The second day of the workshop began with a round of feedback on the data protection module, which the researchers found to be very useful and helpful, but also noted that the module was experienced as very extensive and complex due to the large amount of information it contained. During the four-hour group discussion, the checklists and legal requirements related to the data protection module were further evaluated and the associated standards and use cases were discussed. These were experienced as very helpful and concrete support in the research process.
Overall, the participants were positive about the project and the implementation of the module so far and provided new ideas for the further development of the DDPs.
On April 19th, Sebastian Netscher presented the Paper Domain-specific Data Management Plans and Cross-Disciplinary Interoperability at the IDCC-2021, to promote the project DDP-Bildung. Drafted by Sebastian Netscher, Anna Schwickerath, Anja Perry and Reiner Mauer, the paper examines the challenges of processing open data, following the FAIR Data Principles. Common guidance, such as templates for data management plans, which should support researchers in doing good data management quite often fail to do so. On the one hand most of such templates are too general. On the other hand, they mostly provide little information relevant for particular research domains. In order to overcome this challenges, Science Europe suggested developing domain data protocols, as intended by our project. DDPs are not limited to support RDM in a given research domain. Transferring existing DDPs to other domains and adopting them provides an opportunity to figure out differences as well as common practises in research data management across research domains. This is not only a matter of good data management or sharing data of high quality in a particular domain. It also fosters interoperability and re-usability of data across domains, as required by the FAIR Data Principles.
On February 24th as well as on March 2nd and 4th the project has held two workshops with researchers to evaluate parts of the domain data protocols developed. Both workshops were organized by Qualiservice Bremen and the Center for Teacher Training and Education Research (ZeLB) with support from GESIS – Leibniz-Institute for the Social Sciences. On the initial day, we generally introduced the concept of DDPs and our development of data protocols for the educational research domain. Afterwards, researchers evaluated the coversheet of the DDPs, i.e. the individual information on a project and its data relevant to specify a data protocol for a particular project. Researchers’ subsequent feedback revealed, among other things, ambiguities in the processing. At the end of this first workshop day, we gave researchers our DDP model on data documentation according to the specification of their project and its data in the coversheet.
On March 2nd, researchers working with quantitative data as well as employing mixed method approaches met again to discuss their experiences on working with the DDP model on data documentation. In parallel, researchers dealing with quantitative data met again on March 4th. On both days, researchers provided their feedback in group discussions, talking, e.g., about some lack of guidance on qualitative data or terminological issues. In sum, participants highlighted in particular the utility of the model to document data for their own research. The next workshops to evaluate our developments will be organized in the second half of 2021.
On 9-10 March, 2021, members of the project DDP-Bildung were invited to participate in the Bildungsforschungstagung (BiFo) of the German Federal Ministry of Education and Research (BMBF). The project was represented by Gianpiero Favella (DIPF), Anne Gärtner (DZHW), Martin Kerwer (ZPID), Julia Künstler-Sment (IQB), Sebastian Netscher and Anna Schwickerath (GESIS) at a virtual market stand.
Visitors of our market stand had the opportunity to inform themselves about the project with a poster or through personal exchange. The project members were able to get in contact with possible future users of the domain data protocols. In particular, the topic of archiving and re-usability of research data was discussed.
On the initiative of Ivonne Anders (DKRZ) and Daniela Hausen (RWTH), Sebastian Netscher and Anna Schwickerath (GESIS) were involved in the organisation of a workshop as part of the virtual eScience Days 2021 at Heidelberg University.
The goal of the workshop was to identify needs for and further develop discipline-specific guidance for research data management, which will be developed by the Research Data Alliance’s Discipline-specific Guidance for DMPs group. Various participants reported on their institutional approaches and templates or existing projects. Although a large part of the participants came from the field of natural science research, they nevertheless showed great interest in the DDP project, which was presented during the event.
Detailed results of the workshop will be further processed within the newly founded Working Group on Discipline-specific Guidance for DMPs of the Research Data Alliance and will also find their way into the development of the Domain Data Protocols.