{"id":1281,"date":"2021-08-15T13:41:40","date_gmt":"2021-08-15T12:41:40","guid":{"rendered":"https:\/\/comppress.org\/?page_id=1281"},"modified":"2021-08-15T14:17:14","modified_gmt":"2021-08-15T13:17:14","slug":"wiki-verlinkung-3-bewertungssystem","status":"publish","type":"page","link":"https:\/\/comppress.org\/en\/wiki-verlinkung-3-bewertungssystem\/","title":{"rendered":"Wiki Verlinkung 3 Bewertungssystem"},"content":{"rendered":"

What is evaluated and what is not (yet)?<\/strong><\/p>\n\n\n\n

Disclaimer: No claim to completeness is made for any of the statements and assumptions contained herein. This wiki, like the project as a whole, is a \"work in progress\". We warmly welcome constructive criticism and content-related information or additions in order to continuously improve our work and thus the COMPPRESS project. We are happy to receive your feedback via info@comppress.org or via Github.<\/em><\/p>\n\n\n\n

The formation of social and political opinion that is relevant for a democracy does not depend solely on media reporting. To a large extent, the media landscape also offers non-political entertainment that cannot be assessed in terms of its contribution to the formation of political opinions. Social media is an important source of information for many people \u2013 especially for political content.<\/p>\n\n\n\n

Nevertheless, the use of traditional media such as television, radio or newspapers continues to predominate in the political informational behaviour of the German population.1<\/sup> The first limitation of the assessment object of the COMPPRESS project therefore relates to the selection of traditional media output. Information products of social media, blog articles, etc. are not included in the current development stage of COMPPRESS.<\/p>\n\n\n\n

Newspapers and Magazines<\/em><\/p>\n\n\n\n

The range of newspapers and magazines in Germany is diverse \u2013 both in terms of the breadth of topics and the different demands to distribute politically and socially high-quality articles. Newspapers with high quality standards do not have the highest circulation, but still have a high political influence and are considered opinion leaders.2<\/sup> The most important are, for example, the more liberal S\u00fcddeutsche<\/em> Zeitung<\/em> with approx. 380,000 copies per day, the more conservative Frankfurter<\/em> Allgemeine Zeitung<\/em> (approx. 228,000 copies \/ day), the Berliner taz<\/em> and the Handelsblatt<\/em> as the largest newspaper with an economic focus. The weekly political magazines such as Der Spiegel<\/em>, Die Zeit<\/em> and Der Stern<\/em> are also to be classified in a similar way.2<\/sup><\/a><\/p>\n\n\n\n

The second limitation relates to the (current) sole evaluation of newspaper or magazine articles. Broadcasting output cannot be taken into account by COMPPRESS at the current stage of development.<\/p>\n\n\n\n

Online Articles<\/em><\/p>\n\n\n\n

2019, 68% of Germans used the internet as a source of political information. The most popular news sites were Spiegel online<\/em>, t-online<\/em>, Focus online<\/em>, Bild.de<\/em> and Web.de<\/em>.2<\/sup> he third limitation of the evaluation is focused on the currently available online offers of the common newspaper and magazine providers.<\/p>\n\n\n\n

Which Newspapers and Magazines Are Rated?<\/em><\/p>\n\n\n\n

The selection of the media outlets whose articles can be rated in the COMPPRESS app was made for the initial phase of the project based on a review of the German and English-speaking international media markets. The aim was to capture the breadth of the existing social and political spectrum as well as to do justice to the reality of the circulation of newspapers and magazines, while depicting the selection of media outlets as fairly as possible. In the future, with more resources available for the project, all newspapers and magazines<\/strong> whose content is within the legal framework of the basic law should be available. The aim of COMPPRESS is not to create an editorial filter when making the offer available \u2013 not even when selecting the offer of the articles to be rated.<\/strong> The technical solution is to display the articles by dragging them from the freely accessible and available \"feeds\" of the media outlets.<\/p>\n\n\n\n

The Rating System<\/strong><\/p>\n\n\n\n

With the COMPPRESS rating system, a wide variety of online articles from newspapers and magazines should be able to be rated by all users. This presents an evaluation system with conceptual and theoretical challenges.<\/p>\n\n\n\n

Principles<\/em><\/p>\n\n\n\n

t is essential that the evaluation criteria do not come from a (further) arbitrary, individual worldview and provide a subjective definition of what is \"right\", but correspond to the (self-imposed) obligations which media producers are already officially subject to. This is guaranteed by the German Press Code<\/a> (DPK), which represents the content-related basis of the COMPPRESS rating system for the German-speaking countries. COMPPRESS is not an editorial team!<\/strong><\/p>\n\n\n\n

In addition, terms have to be developed as evaluation criteria that can be meaningfully used in a scale evaluation: They must be \"capable of improvement\" or \"semantically quantifiable\" (counter example: truth \u2013 something cannot be \"a little or a lot\" true, while something can be \"a little\" or \"very\" accurate).<\/p>\n\n\n\n

Furthermore, the challenge arises to develop an evaluation system that is suitable for evaluating different types of newspaper and magazine articles, e.g. from different subject categories and articles with different analysis depths. The decisive difference for the evaluability of newspaper or magazine articles lies in their respective content-related complexity. Complex journalistic texts contain a judgmental assessment of what is being told by the author taking a position on what is being told or by conveying a high level of information and value judgments. Complex texts or articles go beyond a pure information announcement, as is the case with sub-complex articles, e.g. program announcements or simple reports. The evaluation of simpler reports can only be limited to a reduced requirement of the content. The COMPPRESS evaluation system counteracts this difficulty, in which only individual evaluation criteria can be applied \u2013 in the event that not all evaluation criteria can be sensibly applied to an article.<\/p>\n\n\n\n

Ultimately, the terms used should be as comprehensible as possible \u2013 even if subjectivity remains unavoidable in the understanding. Pure objectivity cannot be given in the use of terms, which is why the evaluation criteria derived represent an attempt to choose overly complicated or scientific terms. <\/p>\n\n\n\n

It is particularly important that the COMPPRESS evaluation system does not make any intersubjective truth claims when evaluating the quality of an article. In contrast to a research project, the COMPPRESS evaluation system collects a large number of evaluations and shows existing majority relationships. This is like a choice process in which all eligible voters allow their individual understanding or assessment to flow into a collective result. Thus, the subjectivity that goes with every evaluation and every individual understanding of the terms of the evaluation system does not contradict the aim of the evaluations.<\/p>\n\n\n\n

Derivation of The Evaluation Criteria \u2013 The Press Code<\/em><\/p>\n\n\n\n

The German Press Code (DPK) used as a basis remains general in its execution of the commandments for good journalism. It was therefore necessary to derive meaningful syntheses from its individual paragraphs for an evaluation of newspaper or magazine articles.<\/p>\n\n\n\n

Additional Sources<\/em><\/p>\n\n\n\n

In order to incorporate general principles for good journalism, the syntheses from the DPK were compared and contrasted with ideas from two other recognised press codes and the requirements immanent in the State Media Treaty (MStV) for good journalism (Table 1).<\/p>\n\n\n\n

Diligence and Truthfulness<\/em><\/p>\n\n\n\n

Within the DPK there are two commandments that can be applied to the evaluation of online articles: \"Truthfulness\" and \"Diligence\". The remaining criteria of the DPK relate more to the concrete implementation of the work of journalists. Nevertheless, ideas for products can also be derived or transferred from other criteria of the DPK (Table 1).<\/p>\n\n\n\n

Care: The term diligence is relatively easy to \"translate\" as an evaluation criterion. It is scalable (e.g. something is more or less careful) and it can be assumed that its horizon of meaning is easy to grasp \u2013 a common idea with regard to a definition can be found.<\/p>\n\n\n\n

Truthfulness: The concept of truthfulness, like that of truth, is much more complex and it is much more difficult to deal with it in the sense of an evaluation criterion. Besides which, it's not scalable, but only applicable in binary form (something is either true or not). Truthfulness is the central requirement of journalistic work, so it is essential for the evaluation at COMPPRESS. In order to \"translate\" the concept of truthfulness into an evaluation criterion, essential ideas of the term were extracted. This \"translation\" is described below. It is based on historical methodological principles.<\/p>\n\n\n\n

The Concept of Truthfulness<\/em><\/p>\n\n\n\n

Essentially, an article describes an object (story, event, etc.) by a subject. It is therefore a narrative. Accordingly, there is a \"filter\" of the narrating subject between what happened and the product of the narrative. Theoretically, it is assumed that no objective image is created, but rather that the subject makes a narrative about an object (event, fact, etc.) in which the perception is shaped by subjective aspects. These include, for example, socialisation, prior knowledge, culture, personality, etc. It follows from this that objects can be represented in different ways by different subjects. A narrative should therefore not be judged solely in terms of the categories \"true\" or \"false\", but rather the question must be asked to what extent the subject adequately takes certain aspects into account in its narrative. In J\u00f6rn R\u00fcsen's \"Basic Features of a History\", the truthfulness of a narrative can, among other things, gain validity through empirical and normative validity:<\/p>\n\n\n\n

  1. \"[\u2026] Stories justify their claim to validity by showing that the events they tell actually happened in the past as they tell it. This usually happens in that disclosure on sources are made in the stories [\u2026] Historical truth may be characterised as empirical<\/strong> validity of this reasoning regard. Stories are empirically valid if the facts asserted in them are backed up by experience. [...]\"3<\/sup><\/em><\/li>
  2. \"[...] Stories justify their claim to validity by showing that the events they tell have a meaning for the everyday life of their addressees. The narrator brings norms into play [\u2026]. In this regard, truth can be described as normative<\/strong> validity. Stories are normatively valid if the meanings claimed in them are secured by valid norms. [...]\"3<\/sup><\/a><\/em><\/li><\/ol>\n\n\n\n

    The concept of truthfulness was thus interpreted from two points of view: On the one hand, based on the claim that deliberate fraud or deliberate misrepresentation by the journalist is prohibited. On the other hand, through the claim to truthfulness as a narrative \u2013 which means that the journalists, despite their subjective view, should try to report events or facts as empirically<\/em> and normatively<\/em> as conclusively<\/em> as possible.<\/p>\n\n\n\n

    From this understanding of the requirement of truthfulness, together with the requirement of care and taking into account the ideas from other international codes, three pairs of terms were derived that make up the COMPPRESS evaluation criteria. These are:<\/p>\n\n\n\n