README.md

Numerical Folder:

Supporting Models: Transformer, Informer, Autoformer with different temporal embeddings

HuggingFace_EncDec Folder:

Supporting Models: BERT, Electra, RoBERTa

HuggingFace_Generation Folder:

Supporting Models: Bart, Blenderbot, LED, Pegasus, ProphetNet, Bigbird, T5

The Pre-trained Models for HuggingFace Language Models can be accessed as follows:

Model name	HuggingFace Model
T5	t5-base
Bart	facebook/bart-base
Blenderbot	facebook/blenderbot-small-90M
LED	allenai/led-base-16384
Pegasus	google/pegasus-xsum
ProphetNet	microsoft/prophetnet-large-uncased
Bigbird	google/bigbird-pegasus-large-arxiv
Electra	google/electra-base-generator
BERT	bert-base-uncased
RoBERTa	roberta-base

Core Packages:

transformers == 4.17.0
torch == 1.10.2