• DARIAH EU
• Swiss National Science Foundation close

This study discusses evaluation methods for linguists to use when employing an automatically annotated treebank as a source of linguistic evidence. While treebanks are usually evaluated with a general measure over all the data, linguistic studies often focus on a particular construction or a group of structures. To judge the quality of linguistic evidence in this case, it would be beneficial to estimate annotation quality over all instances of a particular construction. I discuss the relative advantages and disadvantages of four approaches to this type of evaluation: manual evaluation of the results, manual evaluation of the text, falling back to simpler annotation and searching for particular instances of the construction. Furthermore, I illustrate the approaches using an example from Dutch linguistics, two-verb cluster constructions, and estimate precision and recall for this construction on a large automatically annotated treebank of Dutch. From this, I conclude that a combination of approaches on samples from the treebank can be used to estimate the accuracy of the annotation for the construction of interest. This allows researchers to make more definite linguistic claims on the basis of data from automatically annotated treebanks.

Back and Forth from Boundary Objects to IIIF Resources: The Recipes of a Community-driven Initiative Specifying Standards Scientific poster presented at the DARIAH-CH Study Day in Mendrisio, Switzerland, on 20 October 2022 Abstract The exchange of digital objects and their associated metadata is simplified when these meet established standards, but the capture of all the (meta)information is still very much in tension, at the limits of resources, knowledge and indeed the underlying capabilities of given standards. These limitations can be translated into what Susan Leigh Star defines as residual categories and consequently the generation of boundary objects. The question of these non-standardised residuals within the cultural heritage and digital humanities fields is an iterative identification issue that institutions and individuals have sought to mitigate. Take for instance resources conforming to the application programming interfaces (APIs) of the International Image Interoperability Framework (IIIF). These are JSON-LD serialised objects duly specified and vetted by a community trying to break institutional silos. Of particular interest are resources compliant with the IIIF Presentation API which underpins what a Manifest is, i.e.: a description of the structure and properties of the compound object which can be interpreted by a client and displayed to end-users, typically disseminated openly on the Web. While on the surface or theoretically these IIIF Manifests, or compound objects, could be quite the antithesis of boundary objects, it remains to be seen to what extent IIIF-compatible resources revolve around residual categories and also from what point onward these Manifests have been at some point or revert to boundary objects, whether they are not well-structured or simply because the architecture and constituent software serving and interpreting them (known as viewers in the IIIF ecosystem) do not operate correctly. Additional resources: Presentation made on Exhibit: https://www.exhibit.so/exhibits/cXc5lm2e0G10tDVywh9b Verbose script as a blog post: https://julsraemy.ch/posts/2022/10/05/boundary-objects-iiif-dariah/ IIIF Manifest (JSON-LD): https://julsraemy.ch/hostiiing/manifests/backandforth.json Dataset which describes all of this in Schema.org (JSON-LD): https://julsraemy.ch/assets/metadata/backandforth.json

International audience

DARIAH-CH Study Day 2022 - The SNSF MARK16 project Mina Monier and Elisa Nury (DH+, SIB) This poster will present the virtual research environment (VRE) of the five-year SNSF project MARK16, the first VRE focused on a biblical chapter (https://mark16.sib.swiss). The last chapter of Mark is a well-known enigma of New Testament textual criticism (NTTC): at least six different endings have been listed (e.g. Focant, 2006; Clivaz 2019a). We presumed that many useful manuscripts have not yet been studied, and therefore, should be explored. This led to significant primary results that were gradually documented during our research (Monier 2019, 2021 & 2022; Clivaz 2020, 2021). To support the harvest of results, we have created a VRE in four parts (Clivaz, 2019b): the main part of the MARK16 VRE holds 55 items visualized in a Manuscript Room application (https://mr-mark16.sib.swiss), with the code on Github (https://github.com/sib-swiss/dh-mr-mark16). Prepared in collaboration with the New Testament Virtual Manuscript Room (INTF, Münster), it provides folios of Mark 16 from ancient manuscripts in ten ancient languages. More than 20 international colleagues are MARK16 partners, and data have been nominally published in Nakala, the Huma-Num open public repository (https://mark16-snsf-prima-project.nakala.fr). The second part, Interpretations, presents scholarly individual opinions on Mark’s endings from the team and some colleagues (https://mark16-etalk.sib.swiss/search.php). It uses the tool eTalk, with the API on Github (https://github.com/sib-swiss/etalk-docker). The third part, Material, presents relevant material from the printed and digital cultures, like printed editions, articles, and also multimedia publications on Mark 16 (https://material-mark16.sib.swiss). The fourth part, forthcoming, Dataviz (https:// dataviz-mark16.sib.swiss) is building a geographical map in collaboration with the network Pelagios.