TRANSPARENCY_FAQ.md

Multi Agent Custom Automation Engine Solution Accelerator: Responsible AI FAQ

• What is Multi Agent Custom Automation Engine?

  This solution accelerator is designed to help businesses leverage AI agents for automating complex organizational tasks. This accelerator provides a foundation for building AI-driven orchestration systems that can coordinate multiple specialized agents to accomplish various business processes.

• What can Multi Agent Custom Automation Engine do?

  The Multi-Agent Custom Automation Engine solution accelerator allows users to specify tasks and have them automatically processed by a group of AI agents, each specialized in different aspects of the business. This automation not only saves time but also ensures accuracy and consistency in task execution.

• What is/are Multi Agent Custom Automation Engine’s intended use(s)?

  This repository is to be used only as a solution accelerator following the open-source license terms listed in the GitHub repository. The example scenario’s intended purpose is to help users understand how the multi-agent pattern can be applied to various business scenarios.

• How was Multi Agent Custom Automation Engine evaluated? What metrics are used to measure performance?

  We have used AI Foundry Prompt flow evaluation SDK to test for harmful content, groundedness, and potential security risks.

• What are the limitations of Multi Agent Custom Automation Engine? How can users minimize the impact of Multi Agent Custom Automation Engine’s limitations when using the system?

  This solution accelerator can only be used as a sample to accelerate the creation of a multi-agent solution. The repository showcases a sample scenarios using multiple agents to solve tasks. Users should review the system prompts provided and update as per their organizational guidance. Users should run their own evaluation flow either using the guidance provided in the GitHub repository or their choice of evaluation methods. AI-generated content may be inaccurate and should be manually reviewed. Currently, the sample repo is available in English only.

• What operational factors and settings allow for effective and responsible use of Multi Agent Custom Automation Engine?

  Users can try different values for some parameters like system prompt, temperature, max tokens etc. shared as configurable environment variables while running run evaluations for AI agents. Users can also provide their own agent implementation using functional tools designed for those specific agents. Please note that these parameters are only provided as guidance to start the configuration but not as a complete available list to adjust the system behavior. Please always refer to the latest product documentation for these details or reach out to your Microsoft account team if you need assistance.