Popular Neural Network Architectures

March 15, 2023 ยท View on GitHub

  • Two stage funnel architecture

    • candidate generation + ranking

  • Two-tower architecture

  • Wide and deep learning

  • Deep cross network

  • Multi-task learning

  • Transformers

  • Encoder, Decoder, Encoder-decoder

  • Knowledge Distillation (student-teacher network)

  • Contrastive Learning

  • NLP

    • BERT, T5, GPT

  • Computer Vision

    • Object detectors (single stage, two-stage)
    • Vision Transformer

Contents

  1. 1Two stage funnel architecture
  2. 2Two-tower architecture
  3. 3Wide and deep learning
  4. 4Deep cross network
  5. 5Multi-task learning
  6. 6Transformers
  7. 7Encoder, Decoder, Encoder-decoder
  8. 8Knowledge Distillation (student-teacher network)
  9. 9Contrastive Learning
  10. 10NLP
  11. 11Computer Vision