Serving patterns

June 17, 2020 ยท View on GitHub

  • Web single pattern

  • Synchronous pattern

  • Asynchronous pattern

  • Batch pattern

  • Prep-pred pattern

  • Microservice vertical pattern

  • Microservice horizontal pattern

  • Prediction cache pattern

  • Data cache pattern

  • Prediction circuit break pattern

  • Multiple stage prediction pattern

  • Serving template pattern

  • Edge prediction pattern: To do

  • Antipatterns

    • Online bigsize pattern

    • All-in-one pattern