Generative AI Document Summarization

Description

Tagline

Create summaries of a large corpus of documents using Generative AI.

Detailed

This solution showcases how to summarize a large corpus of documents using Generative AI. It provides an end-to-end demonstration of document summarization going all the way from raw documents, detecting text in the documents and summarizing the documents on-demand using Vertex AI LLM APIs, Document AI Optical Character Recognition (OCR), and BigQuery.

PreDeploy

To deploy this blueprint you must have an active billing account and billing permissions.

Architecture

• User uploads a new document triggering the webhook Cloud Function.
• Document AI extracts the text from the document file.
• A Vertex AI Large Language Model summarizes the document text.
• The document summaries are stored in BigQuery.

Documentation

• Generative AI Document Summary

Deployment Duration

Configuration: 1 mins Deployment: 5 mins

Cost

Cost Details

Inputs

Name	Description	Type	Default	Required
disable_services_on_destroy	Whether project services will be disabled when the resources are destroyed.	bool	false	no
documentai_location	Document AI location, see https://cloud.google.com/document-ai/docs/regions	string	"us"	no
labels	A set of key/value label pairs to assign to the resources deployed by this blueprint.	map(string)	{}	no
project_id	The Google Cloud project ID to deploy to	string	n/a	yes
region	The Google Cloud region to deploy to	string	"us-central1"	no
unique_names	Whether to use unique names for resources	bool	false	no

Outputs

Name	Description
bigquery_dataset_id	The name of the BigQuery dataset created
bucket_docs_name	The name of the docs bucket created
bucket_main_name	The name of the main bucket created
documentai_processor_id	The full Document AI processor path ID
neos_walkthrough_url	The URL to launch the in-console tutorial for the Generative AI Document Summarization solution
unique_id	The unique ID for this deployment

Requirements

These sections describe requirements for using this module.

Software

The following dependencies must be available:

• Terraform v0.13
• Terraform Provider for GCP plugin v3.0

Service Account

A service account with the following roles must be used to provision the resources of this module:

• Storage Admin: roles/storage.admin

APIs

A project with the following APIs enabled must be used to host the resources of this module:

• Google Cloud Storage JSON API: storage-api.googleapis.com

Contributing

Refer to the contribution guidelines for information on contributing to this module.

Security Disclosures

Please see our security disclosure process.