runner.PassthruDatasetProvider

December 14, 2023 · View on GitHub

Builds a tf.data.Dataset from a pass thru dataset.

Inherits From: DatasetProvider

runner.PassthruDatasetProvider(
    dataset: tf.data.Dataset,
    *,
    shuffle_datasets: bool = False,
    examples_shuffle_size: Optional[int] = None
)

Passes any dataset thru: omitting any sharding. For detailed documentation, see the filename dataset provider complement: SimpleDatasetProvider.

Methods

`get_dataset`

View source

get_dataset(
    _: tf.distribute.InputContext
) -> tf.data.Dataset

Gets a tf.data.Dataset omitting any input context.