CTBT: Science and Technology Conference 2025 - SnT2025

A comparison of IDC Reviewed Event Bulletins with a baseline from the results of the 2024 Experiment

P4.1-856

Not scheduled

1h

Zeremoniensaal

E-poster T4.1 Performance Evaluation of the International Monitoring System P4.1 Performance Evaluation of the International Monitoring System

Speaker

Mr Christos Saragiotis (CTBTO Preparatory Commission)

Description

The 2024 Experiment, conducted from 16 to 27 September 2024, focused on the production of automatic and analysts generated products. During the experiment, the International Data Centre (IDC) generated a series of Reviewed Event Bulletins (REBs). To ensure an objective comparison, three randomly selected REBs were compared against a baseline bulletin created by an experienced team. The comparison was conducted using two validated software tools: BulCmp and BullComp, both designed for robust event matching and statistical assessment. Key metrics such as matched events, missed events, extra events and error ellipse overlap were computed, emphasizing classification accuracy through precision and recall calculations. This poster will outline the experimental design, detail the methodologies employed for quality assessment and summarize the key findings.