MAF: A General Matching and Alignment Framework for Multimodal Named Entity Recognition

Pytorch Implementation of "MAF: A General Matching and Alignment Framework for Multimodal Named Entity Recognition" (WSDM 2022)

The code implementation of this paper refers to jefferyYu.

Requirements

python>=3.6

torch>=1.7.1

pytorch-crf>=0.7.2

Configuration

--negative_rate 2k in Cross-Modal Matching Module

--lamb Parameters between the main loss function and other task loss functions

--temp Temperature parameter in Cross-Modal Alignment Module

--temp_lamb 𝜆c in Cross-Modal Alignment Module

Datasets

See jefferyYu.

Usage

• Download the data from jefferyYu.

• Follow the link provided by jefferyYu to download the pre-trained ResNet-152 to the folder resnet.

sh run.sh