===================================================================================
TAC 2020 STREAMING MULTIMEDIA KNOWLEDGE BASE POPULATION EVALUATION RESULTS (TASK 1)
===================================================================================

Team ID:  BBN_TA1
Organization(s):  Raytheon BBN Technologies

********************

Run:  teambbn-ev-202010181803

English Evaluation Results:

Score   Metric
0.2866	CoreferenceMetric_ENG_Entities_F1
0.2487	TypeMetricV1_ENG_Entities_F1
0.1597	CoreferenceMetric_ENG_Events_F1
0.1441	TypeMetricV1_ENG_Events_F1
0.1123	ArgumentMetricV1_ENG_Events_F1
0.0385	FrameMetric_ENG_Events_F1
0.0738	FrameMetric_ENG_Relations_F1
0.0140	TemporalMetric_ENG_Events_S
0.0000	TemporalMetric_ENG_Relations_S
0.0506	FrameMetric_ENG_F1

Spanish Evaluation Results:

Score   Metric
0.2284	CoreferenceMetric_SPA_Entities_F1
0.2088	TypeMetricV1_SPA_Entities_F1
0.1128	CoreferenceMetric_SPA_Events_F1
0.0947	TypeMetricV1_SPA_Events_F1
0.0457	ArgumentMetricV1_SPA_Events_F1
0.0133	FrameMetric_SPA_Events_F1
0.0169	FrameMetric_SPA_Relations_F1
0.0000	TemporalMetric_SPA_Events_S
0.0000	TemporalMetric_SPA_Relations_S
0.0145	FrameMetric_SPA_F1

Russian Evaluation Results:

Score   Metric
0.2307	CoreferenceMetric_RUS_Entities_F1
0.1866	TypeMetricV1_RUS_Entities_F1
0.0454	CoreferenceMetric_RUS_Events_F1
0.0440	TypeMetricV1_RUS_Events_F1
0.0210	ArgumentMetricV1_RUS_Events_F1
0.0057	FrameMetric_RUS_Events_F1
0.0390	FrameMetric_RUS_Relations_F1
0.0000	TemporalMetric_RUS_Events_S
0.0000	TemporalMetric_RUS_Relations_S
0.0173	FrameMetric_RUS_F1

Tri-lingual (English, Spanish, Russian) Evaluation Results:

Score   Metric
0.2471	CoreferenceMetric_Entities_F1
0.2166	TypeMetricV1_Entities_F1
0.1074	CoreferenceMetric_Events_F1
0.1051	TypeMetricV1_Events_F1
0.0590	ArgumentMetricV1_Events_F1
0.0225	FrameMetric_Events_F1
0.0465	FrameMetric_Relations_F1
0.0068	TemporalMetric_Events_S
0.0000	TemporalMetric_Relations_S
0.0307	FrameMetric_F1

********************

Run:  teambbn-ta1-202101291556

English Evaluation Results:

Score   Metric
0.3458	CoreferenceMetric_ENG_Entities_F1
0.2822	TypeMetricV1_ENG_Entities_F1
0.2649	CoreferenceMetric_ENG_Events_F1
0.2100	TypeMetricV1_ENG_Events_F1
0.1561	ArgumentMetricV1_ENG_Events_F1
0.0417	FrameMetric_ENG_Events_F1
0.0872	FrameMetric_ENG_Relations_F1
0.1610	TemporalMetric_ENG_Events_S
0.0111	TemporalMetric_ENG_Relations_S
0.0566	FrameMetric_ENG_F1

Spanish Evaluation Results:

Score   Metric
0.2568	CoreferenceMetric_SPA_Entities_F1
0.2410	TypeMetricV1_SPA_Entities_F1
0.1476	CoreferenceMetric_SPA_Events_F1
0.1216	TypeMetricV1_SPA_Events_F1
0.0586	ArgumentMetricV1_SPA_Events_F1
0.0209	FrameMetric_SPA_Events_F1
0.0168	FrameMetric_SPA_Relations_F1
0.0651	TemporalMetric_SPA_Events_S
0.0000	TemporalMetric_SPA_Relations_S
0.0197	FrameMetric_SPA_F1

Russian Evaluation Results:

Score   Metric
0.2699	CoreferenceMetric_RUS_Entities_F1
0.2137	TypeMetricV1_RUS_Entities_F1
0.1042	CoreferenceMetric_RUS_Events_F1
0.0899	TypeMetricV1_RUS_Events_F1
0.0376	ArgumentMetricV1_RUS_Events_F1
0.0114	FrameMetric_RUS_Events_F1
0.0380	FrameMetric_RUS_Relations_F1
0.0505	TemporalMetric_RUS_Events_S
0.0000	TemporalMetric_RUS_Relations_S
0.0205	FrameMetric_RUS_F1

Tri-lingual (English, Spanish, Russian) Evaluation Results:

Score   Metric
0.2883	CoreferenceMetric_Entities_F1
0.2475	TypeMetricV1_Entities_F1
0.1711	CoreferenceMetric_Events_F1
0.1526	TypeMetricV1_Events_F1
0.0826	ArgumentMetricV1_Events_F1
0.0277	FrameMetric_Events_F1
0.0519	FrameMetric_Relations_F1
0.1088	TemporalMetric_Events_S
0.0066	TemporalMetric_Relations_S
0.0355	FrameMetric_F1