result-stat.md

December 27, 2023 · View on GitHub

Regression

MOSI

Model	Has0_acc_2	Has0_F1_score	Non0_acc_2	Non0_F1_score	Mult_acc_5	Mult_acc_7	MAE	Corr	Data Setting
ef_lstm	77.38	77.35	78.48	78.51	40.15	35.39	94.88	66.9	Aligned
lf_dnn	77.52	77.46	78.63	78.63	38.05	34.52	95.48	65.84	Unaligned
tfn	77.99	77.95	79.08	79.11	39.39	34.46	94.73	67.33	Unaligned
lmf	77.9	77.8	79.18	79.15	38.13	33.82	95.04	65.1	Unaligned
mfn	77.67	77.63	78.87	78.90	40.47	35.83	92.68	67.02	Aligned
graph_mfn	77.14	77.08	78.35	78.35	38.63	34.64	95.57	64.86	Aligned
mult	79.71	79.63	80.98	80.95	42.68	36.91	87.99	70.22	Unaligned
misa	81.84	81.82	83.54	83.58	47.08	41.37	77.65	77.81	Unaligned
self_mm	83.44	83.36	85.46	85.43	53.47	46.67	70.80	79.63	Unaligned
tetfn	83.24	83.13	85.37	85.33	53.64	45.77	70.84	79.84	Aligned
cenet	83.53	83.49	85.21	85.22	50.87	44.90	72.54	79.53	Unaligned

MOSEI

Model	Has0_acc_2	Has0_F1_score	Non0_acc_2	Non0_F1_score	Mult_acc_5	Mult_acc_7	MAE	Corr	Data Setting
ef_lstm	77.84	78.34	80.79	80.67	51.16	50.01	60.05	68.25	Aligned
lf_dnn	80.60	80.85	82.74	82.52	51.97	50.83	58.02	70.87	Unaligned
tfn	78.50	78.96	81.89	81.74	53.10	51.60	57.26	71.41	Unaligned
lmf	80.54	80.94	83.48	83.36	52.99	51.59	57.57	71.69	Unaligned
mfn	78.94	79.55	82.86	82.85	52.76	51.34	57.33	71.82	Aligned
graph_mfn	81.28	81.48	83.48	83.23	52.69	51.37	57.45	71.33	Aligned
mult	81.15	81.56	84.63	84.52	54.18	52.84	55.93	73.31	Unaligned
misa	80.67	81.12	84.67	84.66	53.63	52.05	55.75	75.15	Unaligned
self_mm	83.76	83.82	85.15	84.90	55.53	53.87	53.09	76.49	Unaligned
tetfn	84.12	84.35	86.21	86.11	55.78	53.90	53.73	76.96	Aligned
cenet	83.52	83.85	86.38	86.32	56.15	54.26	52.59	77.75	Unaligned

SIMS

Model	Mult_acc_2	Mult_acc_3	Mult_acc_5	F1_score	MAE	Corr	Data Setting
ef_lstm	69.37	54.27	21.23	56.82	59.07	5.45	Unaligned
lf_dnn	77.02	64.33	39.74	77.27	44.63	55.51	Unaligned
tfn	78.38	65.12	39.3	78.62	43.22	59.1	Unaligned
lmf	77.77	64.68	40.53	77.88	44.12	57.59	Unaligned
mfn	77.9	65.73	39.47	77.88	43.49	58.24	Unaligned
graph_mfn	78.77	65.65	39.82	78.21	44.5	57.84	Unaligned
mult	78.56	64.77	37.94	79.66	45.32	56.41	Unaligned
mlf_dnn	80.44	69.37	40.22	80.28	39.58	66.52	Unaligned
mtfn	81.09	68.80	40.31	81.01	39.54	66.58	Unaligned
mlmf	79.34	68.36	41.05	79.07	40.91	63.90	Unaligned
self_mm	80.04	65.47	41.53	80.44	42.50	59.52	Unaligned
tetfn	81.18	63.24	41.79	80.24	42.00	57.65	Unaligned
cenet	77.90	62.58	33.92	77.53	47.09	53.95	Unaligned

SIMSv2

Model	Mult_acc_2	Mult_acc_3	Mult_acc_5	F1_score	MAE	Corr	Data Setting
ef_lstm	78.94	72.38	49.26	79.03	33.74	65.88	Unaligned
lf_dnn	79.36	72.59	52.76	79.46	30.14	71.20	Unaligned
tfn	80.14	72.21	52.55	80.14	30.31	70.73	Unaligned
lmf	74.18	64.90	47.79	73.88	36.72	55.69	Unaligned
mfn	81.14	73.66	54.53	81.19	29.54	72.66	Unaligned
graph_mfn	73.35	67.18	45.78	72.60	37.87	57.43	Unaligned
mult	80.68	73.19	54.81	80.73	29.05	73.78	Unaligned
mlf_dnn	76.59	68.47	49.67	76.62	33.52	63.95	Unaligned
mtfn	80.43	73.71	56.05	80.50	29.26	72.03	Unaligned
mlmf	77.23	69.98	51.22	77.3	32.22	67.03	Unaligned
self_mm	79.69	72.61	52.77	79.76	31.06	69.52	Unaligned
tetfn	79.73	73.65	54.47	79.81	31.03	69.50	Unaligned
cenet	79.56	73.10	53.04	79.63	30.96	69.94	Unaligned

Classification

Data setting is the same as Regression

MOSI

Model	Has0_acc_2	Has0_F1_score	Non0_acc_2	Non0_F1_score	Acc_3	F1_score_3
ef_lstm	76.65	76.69	46.40	46.55	74.43	72.74
lf_dnn	76.73	76.82	46.13	46.62	74.64	72.99
tfn	75.33	75.24	43.78	45.55	73.44	71.86
lmf	76.01	76.11	45.76	46.34	74.11	72.50
mfn	77.23	77.17	46.68	46.78	74.99	73.22
graph_mfn	77.38	77.50	46.13	46.96	75.34	73.71
mult	77.41	77.20	48.93	47.29	74.99	73.06
misa	78.34	78.32	44.15	46.75	76.30	74.57

MOSEI

Model	Has0_acc_2	Has0_F1_score	Non0_acc_2	Non0_F1_score	Acc_3	F1_score_3
ef_lstm	70.36	69.27	26.73	28.12	66.09	63.68
lf_dnn	71.18	70.14	27.19	28.67	67.35	64.65
tfn	71.54	70.91	28.66	28.75	66.63	63.93
lmf	71.90	71.26	28.86	28.92	66.59	64.86
mfn	71.49	70.80	28.61	28.70	66.59	64.31
graph_mfn	71.25	70.51	28.47	28.77	66.39	64.00
mult	71.23	70.23	27.38	28.67	67.04	65.01
misa	71.44	70.56	28.40	29.03	67.63	65.39

SIMS

Model	Has0_acc_2	Has0_F1_score	Non0_acc_2	Non0_F1_score	Acc_3	F1_score_3
ef_lstm	69.37	56.82	63.92	49.85	54.27	38.18
lf_dnn	79.87	79.97	56.70	55.27	70.20	65.29
tfn	75.32	75.66	53.56	52.79	65.95	62.04
lmf	77.99	77.59	57.06	53.83	66.87	62.46
mfn	78.25	78.08	56.96	54.14	67.57
graph_mfn	79.21	78.92	57.99	54.66	68.44	63.44
mult	78.07	78.07	56.34	54.26	68.27	64.23
misa	78.07	77.70	57.27	53.99	67.05	60.98
mlf_dnn	80.79	80.59	58.19	55.55	70.37	65.94
mtfn	81.23	81.24	56.91	55.29	70.28	66.44
mlmf	81.45	81.62	56.60	55.66	71.60	70.45