Pipelines

Pipelines represent our ability to scale, orchestrate and schedule our processes via underlying infrastructure. Azure offers a number of different options in this space. This Playbook will provide some basic options as there are a number of more detailed repositories available to help here, namely:

• MLOps
• MLOpsPython
• Microsoft AI Samples, Reference Architectures & Best Practices

Azure Cognitive Search

Azure Cognitive Search provides an enrichment pipeline which provides the ability to extract information, chain the invocation of custom APIs alongside Microsoft Cognitive Services and store the output to a datastore, all as a managed service.

Have a look at the sample pipeline accelerator for Azure Cognitive Search

Azure Kubernetes Service

Azure Kubernetes Service (AKS) makes it simple to deploy a managed Kubernetes cluster in Azure. AKS reduces the complexity and operational overhead of managing Kubernetes by offloading much of that responsibility to Azure. As a hosted Kubernetes service, Azure handles critical tasks like health monitoring and maintenance for you.

Have a look at the sample Helm charts for Azure Kubernetes Service

Azure Machine Learning

Azure Machine Learning service is a cloud service used to train, deploy, automate, and manage machine learning models, all at the broad scale that the cloud provides.

Have a look at the sample pipeline accelerator for Azure Machine Learning

Azure Logic Apps

Connect your business-critical apps and services with Azure Logic Apps, automating your workflows without writing a single line of code.

Have a look at the sample pipeline accelerator for Azure Logic Apps with Form Recognizer

Azure Functions

Azure Functions is an event driven, compute-on-demand experience that extends the existing Azure application platform with capabilities to implement code triggered by events occurring in Azure or third party service as well as on-premises systems.

Have a look at the sample pipeline accelerator for Azure Functions.