ⓘ SEQUAL framework. The SEQUAL framework is systems modelling reference model for evaluating the quality of models. The SEQUAL framework, which stands for semioti ..

                                     

ⓘ SEQUAL framework

The SEQUAL framework is systems modelling reference model for evaluating the quality of models. The SEQUAL framework, which stands for "semiotic quality framework" is developed by John Krogstie and others since the 1990s.

The SEQUAL framework is a so-called "top-down quality framework", which is based on semiotic theory, such as the works of Charles W. Morris. Building on these theory it "defines several quality aspects based on relationships between a model, a body of knowledge, a domain, a modeling language, and the activities of learning, taking action, and modeling". Its usefulness, according to Mendling et al. 2006, was confirmed in a 2002 experiment by Moody et al.

                                     

1. History

The basic idea behind the SEQUAL framework is, that "conceptual models can be considered as sets of statements in a language, and therefore can be evaluated in semiotic/linguistic terms". A first semiotic framework for evaluating conceptual models was originally proposed by Lindland et al. in the 1994 article "Understanding quality in conceptual modeling". In its initial version, it considered three quality levels:

  • semantic, and
  • syntactic,
  • pragmatic quality

The framework was later extended, and called the SEQUAL framework by Krogstie et al. in the 1995 article "Defining quality aspects for conceptual models". in the 2002 article "Quality of interactive models" Krogstie & Jorgensen extended the initial framework adding more levels of Stampers semiotic ladder.

                                     

2. SEQUAL framework topics

Modeling is an integral part of many technical fields, including engineering, economics, and software engineering. In this context, a model is a formal representation of an organizational system, such as a business model or a formal description of software in UML.

                                     

2.1. SEQUAL framework topics Model activation

Model activation, according to John Krogstie 2006, is the process by which a model affects reality. Model activation involves actors interpreting the model and to some extent adjusting their behaviour accordingly. This process can be:

  • manual, where the model guides the actions of human actors, or
  • automated, where a software component interprets the model,
  • interactive, where prescribed aspects of the model are automatically interpreted and ambiguous parts are left to the users to resolve.
                                     

2.2. SEQUAL framework topics Sets in the Quality Framework

The Quality Framework works with a set of eight items:

  • T: What relevant tools interpret the model to say
  • D: What can be expressed about the domain area of interest
  • K: The explicit knowledge of the participating persons
  • L: What can be expressed in the modeling language
  • M: What is expressed in the model
  • G: The goals of the modeling
  • A: Actors that develop or have to relate to parts of the model. Can be persons or tools.
  • I: What the persons in the audience interpret the model to say
                                     

2.3. SEQUAL framework topics Physical quality

The three main aspects of physical quality are:

  • Externalization or the question "Is it possible to externalize knowledge by using the model language?",
  • Basically or the question "Is the model language able to express the model domain?"
  • Internalizability about model persistence and availability, and

Externalization is presenting the modellers concept in some model form for others to make sense of it. Other people can have look on it and can discuss. How other people perceives the model is a matter of internalization. After perceiving the model in their own way they can discuss and change their mind accordingly. To make sense others, it is better to have some model language in common. Physical quality refers to the possibility of externalizing models by using model language that should be available and of course in persistence manner to be internalized by audiences.

How available is the model to audience? Availability depends on distributability, especially when members of the audience are geographically dispersed. Then, a model which is an electronically distributable format will be more easily distributed than one which must be printed on paper and sent by ordinary mail or fax. It may also matter exactly what is distributed, e.g. the model in an editable form or merely in an output format.

How persistent is the model, how protected is it against loss or damage? This also includes previous versions of the model, if these are relevant. E.g. for a model on disk, the physical quality will be higher if there is a backup copy, or even higher if this backup is on another disk whose failure is independent of the originals. Similarly, for models on paper, the amount and security of backup copies will be essential.



                                     

2.4. SEQUAL framework topics Empirical quality

To evaluate empirical quality, the model should be well externalized. Main aspects are:

  • information theory.
  • Ergonomics,
  • readability,
  • layout, and

Basically empirical quality is about the question "Is the model easily readable?". Empirical quality deals with the variety of elements distinguished, error frequencies when being written or read, coding shapes of boxes and ergonomics for Computer-Human Interaction for documentation and modeling-tools. Ergonomics is the study of workplace design and the physical and psychological impact it has on workers. This quality is related to readability and layout. There are different factors that have an important impact on visual emphasis like size, solidity, foreground/background differences, colour red attracts the eye more than other colours,changeblinking or moving symbols attract attention, position and so on.

For graph aesthetics there may be different consideration like angles between edges not be too small, minimize the number of bends along edges, minimize the number of crossings between edges, place nodes with high degree in the centre of the drawing, have symmetry of sons in hierarchies, have uniform density of nodes in the drawing, have verticality of hierarchical structures and so on.



                                     

2.5. SEQUAL framework topics Syntactical quality

Syntactic quality is the correspondence between the model M and the language extension L of the language in which the model is written. Three aspects here are:

  • Error correction: to replace a detected error with a correct statement
  • Error detection: During a modeling session, some syntactical errors--- syntactic incompleteness --- should be allowed on a temporary basis. For instance, although the DFD language requires that all processes are linked to a flow, it is difficult to draw a process and a flow simultaneously. Syntactical completeness has to be checked upon users request. So, in contrast to implicit checks where the tool is ``forcing the user to follow the language syntax, explicit check can only detect and report on existing errors. The user has to make the corrections.
                                     

2.6. SEQUAL framework topics Semantic quality

What is expressed in the model? The semantic goals of this framework are:

  • Validity; if all the statements in the model are correct and related to the problem. M\D = O
  • Completeness; if the model contains all relevant and correct statements to solve this problem. D\M = O
                                     

2.7. SEQUAL framework topics Perceived semantic quality

Perceived semantic quality is the relation between an actors interpretation of a model and his/her knowledge of the domain.

  • Perceived completeness K\I = O
  • Perceived validity I\K = O
                                     

2.8. SEQUAL framework topics Pragmatic quality

Pragmatic quality is the correspondence between the model and peoples interpretation of it. Comprehension is the only pragmatic goal in the framework. It is very important that people that read the model, understand it. No solution is good if no-one understands it. Pragmatic quality relates to the effect the model have on the participants and the world. Four aspects is treated specifically, that:

  • the tool interpretation is correct relative to what is meant to be expressed in the model.
  • the human interpretation of the model is correct relative to what is meant.
  • the participants learn based on the model.
  • the domain is changed preferably in a positive direction relative to the goal of modeling.
                                     

2.9. SEQUAL framework topics Social quality

The goal for the social quality is agreement. Agreement about knowledge, interpretation and model. Agreement is achieved if perceived semantic quality and comprehension are achieved. There is relative agreement and absolute agreement. For the three agreement parts knowledge, interpretation and model we can define:

  • Relative agreement in the three above agreement types; all Knowledge, Interpretation and Model are consistent.
  • Absolute agreement in the three above agreement types; all Knowledge, Interpretation and Model are equal.
                                     

2.10. SEQUAL framework topics Knowledge quality

Degree of internalization of existing organizational reality.

  • Knowledge in domain is "valid": K\D = O.
  • Knowledge in domain is "complete": D\K = O.

Activities for improvement:

  • Participant selection
  • Participant training
  • Research and investigation
  • Stakeholder identification
  • Knowledge source identification
  • Problem definition


                                     

2.11. SEQUAL framework topics Language quality

To receive good language quality it is important that:

  • The language is appropriate to the domain.
  • The language appropriate to express the knowledge of the participants
  • The language is appropriate to the participants knowledge of modeling languages

If the language quality is good, it will improve the participants interpretation and other technical actors interpretation. For additional detail, see the quality of modelling languages

                                     

2.12. SEQUAL framework topics Organizational quality

The organizational quality of the model relates to:

  • That all statements in the model contribute to fulfilling the goals of modeling, or Organizational goal validity.
  • That all the goals of modeling are addressed through the model, or Organizational goal completeness.
                                     

3. Alternative quality framework

An alternative quality framework is the Guidelines of Modeling GoM based on general accounting principles. The framework "include the six principles of correctness, clarity, relevance, comparability, economic efficiency, and systematic design". It was operationalized for Event-driven Process Chains and also tested in experiments

Another alternative modelling process quality framework actually based on SEQUAL is the "Quality of Modelling" framework QoMo. QoMo is still a "preliminary modelling process oriented, based on knowledge state transitions, cost of the activities bringing such transitions about, and a goal structure for activities-for-modelling. Such goals are directly linked to concepts of SEQUAL".

                                     
  • enterprise modelling. The SEQUAL framework is a reference model for evaluating the quality of models, the semiotic quality framework SEQUAL developed by John
  • participation GIS Problem structuring methods Shared vision planning SEQUAL framework Jones, Natalie A. Perez, Pascal Measham, Thomas G. Kelly, Gail J
  • of the SEQUAL framework has fixed some of the limitation of the initial framework however other limitation remain In particular, the framework is too
  • model used by image processing, video processing, and computer vision SEQUAL framework Software and Systems Modeling Solar system model  a model that illustrate