{"id":3071,"date":"2024-09-17T15:21:24","date_gmt":"2024-09-17T13:21:24","guid":{"rendered":"https:\/\/test.kint.cz\/?p=3071"},"modified":"2025-06-04T19:33:32","modified_gmt":"2025-06-04T17:33:32","slug":"4-1-expert-method-used-for-data-collection","status":"publish","type":"post","link":"https:\/\/test.kint.cz\/en\/4-1-expert-method-used-for-data-collection\/","title":{"rendered":"4.1 Expert Method Used for Data Collection"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"3071\" class=\"elementor elementor-3071\" data-elementor-post-type=\"post\">\n\t\t\t\t<div class=\"elementor-element elementor-element-523caae e-flex e-con-boxed e-con e-parent\" data-id=\"523caae\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-358a73b elementor-widget elementor-widget-heading\" data-id=\"358a73b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">4.1 Expert Method Used for Data Collection<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b60b23f elementor-widget elementor-widget-text-editor\" data-id=\"b60b23f\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\tExpert methods according to [86] utilize the knowledge and practical experience of experts in the relevant field to obtain: estimates of immeasurable quantities, estimates of data that are not available and whose acquisition would be disproportionately difficult, estimates of future developments (states), proposals for creative solutions, etc. A typical use of experts in this set of methods is for narrow, specialized problems, or especially for general, complex, and intricate problems (i.e., those that are complex, poorly structured, weakly formalized, unique and non-repeatable, with a lack or complete absence of objective qualitative information, etc.)<a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\"> [86]<\/a>. The expert survey proceeded in the following phases:\n\n<ol type=\"1\"> <li>Selection of experts.<\/li> <li>Collection of expert statements.<\/li> <li>Evaluation of expert statements.<\/li> <\/ol> The quality of expert selection directly influences the quality of the results obtained from the analysis. The decisive factors are the number of experts (i.e., for statistical significance of the results) and their relevant qualities (e.g., competence, creativity, relationship to the topic, conformity, analytical thinking and breadth of thought, constructiveness, self-criticism, tolerance)<a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\"> [86]<\/a>. The determination of the number of experts and the selection of appropriate qualities are parameters dependent on the method chosen for obtaining expert statements and, as such, also affect the costs of the analysis, both financial and time-related.\nThe collection of expert statements can occur in various ways, as described in<a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\"> [86]<\/a>, based on: the method of communication between organizers and experts, the level of communication between experts during the expert survey, the repetition of information gathering, and the degree of standardization.\n\nFor the purposes of the dissertation, a multi-stage Delphi method was chosen.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-92976a3 elementor-widget elementor-widget-heading\" data-id=\"92976a3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\n4.1.1 The multi-stage Delphi method<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7fb77fd elementor-widget elementor-widget-text-editor\" data-id=\"7fb77fd\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\tThe mentioned multi-stage Delphi method <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[23,86]<\/a> <sup class=\"modern-footnotes-footnote \" data-mfn=\"1\" data-mfn-post-scope=\"000000007b324b9600000000799bf6d9_1989\"><a role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000007b324b9600000000799bf6d9_1989-1\">1<\/a><\/sup> is a method of obtaining expert opinions with the following properties <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[86]<\/a>:\n\n<ul> <li>multiple rounds of surveys with feedback,<\/li> <li>systematic refinement of the group\u2019s opinion,<\/li> <li>anonymity of experts,<\/li> <li>feedback of information,<\/li> <li>experts have access to the group\u2019s opinion and atypical opinions before the next round,<\/li> <li>the possibility to consider circumstances the expert previously did not realize, or the possibility of reevaluating an atypical opinion,<\/li> <li>if an expert insists on an atypical opinion, they must justify it.<\/li> <\/ul> The collection of opinions occurs in multiple rounds, during which the last results are progressively refined. The method ends when \u201cagreement\u201d is reached among experts, or when the stability of individual opinions is achieved <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[86]<\/a>. The disadvantage of the Delphi method is its time-consuming nature and the higher workload involved in processing questions aimed at the desired results, processing survey questionnaires, and interpreting results to be added in the next round or response stage.\nThe evaluation of expert opinions is carried out according to <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[86]<\/a> in two phases: determining the group opinion and assessing the quality of the obtained information. The group opinion can be determined using quantitative (arithmetic mean, mode or median, distribution, statistical characteristics \u2013 variance, quartile range, interval estimates, distribution characteristics) or qualitative estimates (nominal scale, conversion to a quantitative scale, formalization and quantification of responses).\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-34010fe elementor-widget elementor-widget-image\" data-id=\"34010fe\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"398\" height=\"306\" src=\"https:\/\/test.kint.cz\/wp-content\/uploads\/2024\/09\/f4e6c829-image.png\" class=\"attachment-large size-large wp-image-1552\" alt=\"\" srcset=\"https:\/\/test.kint.cz\/wp-content\/uploads\/2024\/09\/f4e6c829-image.png 398w, https:\/\/test.kint.cz\/wp-content\/uploads\/2024\/09\/f4e6c829-image-300x231.png 300w\" sizes=\"(max-width: 398px) 100vw, 398px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\">4.1.2 Use of the Delphi method for safety research of subway operation<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8624622 elementor-widget elementor-widget-heading\" data-id=\"8624622\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">4.1.2 Use of the Delphi method for safety research of subway operation<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-94d7f96 elementor-widget elementor-widget-text-editor\" data-id=\"94d7f96\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\tHere is the translation with HTML tags preserved:\n\nThe aim of the research conducted in collaboration with the employees of the Prague Public Transport Company was to verify methods for evaluating critical infrastructure and determining the criticality of system components. The research was conducted in the form of an expert survey. Each expert was asked to fill out an electronic form <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[5,16]<\/a>, and was invited to do so via email.\n\nThe group of experts was selected based on recommendations from chosen employees of the metro operator and from selected service providers and suppliers of key equipment necessary for metro operation. Each expert approached in this way had the opportunity to recommend other suitable experts in the following areas: occupational safety and health protection for personnel, property protection, operational economy, passenger protection, and technical and functional safety of operations.\n\nA condition for recommending an expert to the expert team was their long-standing knowledge of metro operations with experience in various areas listed above and at various management levels, i.e., strategic management, tactical and project management, operational management, technical staff, and technical work.\n\nA total of 18 experts were approached, who were asked before the start of the survey to fill out a short questionnaire to determine their qualifications according to <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[86]<\/a>.\n\nThe Delphi method survey was divided into three phases:\n<ol type=\"1\">\n \t<li>Identification of assets (functions, locations, and parts of the metro system that are important for its safe operation).<\/li>\n \t<li>Determining importance and vulnerability.<\/li>\n \t<li>Impact scenarios of selected disasters.<\/li>\n<\/ol>\nAfter each round of the survey, the results were evaluated, and in case of disagreements, clarifications and justifications were made, which were also conducted in several iterations. The course of the survey and the individual questions for each round are presented in Appendix A.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-820af81 elementor-widget elementor-widget-heading\" data-id=\"820af81\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">4.1.3 Scales used<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-740d1c0 elementor-widget elementor-widget-text-editor\" data-id=\"740d1c0\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\tIn the mentioned safety research and in the presented dissertation, we work with criticality <strong><em>K<\/em><\/strong>, as a function of importance <strong><em>D<\/em><\/strong> and vulnerability <strong><em>Z<\/em><\/strong>, in accordance with the definition in section 2.1.3:\n\n<strong><em>K = D x Z<\/em><\/strong>\n\n(21)\n\nThese quantities depend on the level of the safety management system in which the quantity is assessed, i.e., according to the Defence-In-Depth approach (section 2.1.7 and 2.3.4), and based on the source <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[18]<\/a>, we follow the following levels (a more detailed description of the levels for the purposes of this research is in Appendix A):\n\n<ol type=\"1\"> <li>Safe metro operation under normal conditions (<strong>Management level L1<\/strong>).<\/li> <li>Safe metro operation under abnormal conditions (<strong>Management level L2<\/strong>).<\/li> <li>Safe metro operation with significant deviations \/ managing accidents (<strong>Management level L3<\/strong>).<\/li> <li>Managing metro operations and assets in critical conditions (<strong>Management level L4<\/strong>).<\/li> <li>Managing metro operations and assets in extreme conditions (<strong>Management level L5<\/strong>).<\/li> <\/ol> For the quantities <strong><em>D and Z<\/em><\/strong>, ordinal scales were used, i.e., a scale ranging from 1 to 3, taking into account criteria for critical infrastructure <a href=\"https:\/\/test.kint.cz\/veda-technika\/integralni-bezpecnost\/integral-safety-definice\/pouzita-literatura-pro-clanky-integralni-bezpecnost\/\">[34,35]<\/a>. A description of each numerical value is provided in section A.2.1 of Appendix A.\nThe categorization of disasters into relevant, specific, and critical categories according to the All-Hazard-Approach approach (sections 2.1.2 and 2.1.7).\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>4.1 Expert Method Used for Data Collection Expert methods according to [86] utilize the knowledge and practical experience of experts [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1552,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[197,252],"tags":[],"class_list":["post-3071","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-security-research","category-integral-security"],"_links":{"self":[{"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/posts\/3071","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/comments?post=3071"}],"version-history":[{"count":13,"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/posts\/3071\/revisions"}],"predecessor-version":[{"id":3085,"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/posts\/3071\/revisions\/3085"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/media\/1552"}],"wp:attachment":[{"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/media?parent=3071"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/categories?post=3071"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/test.kint.cz\/en\/wp-json\/wp\/v2\/tags?post=3071"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}