runner.PassthruDatasetProvider
December 14, 2023 ยท View on GitHub
View source
on GitHub
Builds a tf.data.Dataset from a pass thru dataset.
Inherits From: DatasetProvider
runner.PassthruDatasetProvider(
dataset: tf.data.Dataset,
*,
shuffle_datasets: bool = False,
examples_shuffle_size: Optional[int] = None
)
Passes any dataset thru: omitting any sharding. For detailed documentation,
see the filename dataset provider complement: SimpleDatasetProvider.
Methods
get_dataset
get_dataset(
_: tf.distribute.InputContext
) -> tf.data.Dataset
Gets a tf.data.Dataset omitting any input context.