quanda.utils.datasets package

Datasets.

class quanda.utils.datasets.OnDeviceDataset(dataset: Dataset, device: str | device)

Bases: Dataset

Wrapper that moves a dataset’s tensors to a target device.

Handles arbitrary sample structures returned by dataset[i] — single tensor, tuple/list of any length, dict — by recursively moving every tensor leaf while leaving non-tensor values untouched.

__init__(dataset: Dataset, device: str | device)

Construct the OnDeviceDataset class.

Parameters:

• dataset (torch.utils.data.Dataset) – The dataset to move to the device.

• device (Union[str, torch.device]) – The device to move the dataset to.

Subpackages

• quanda.utils.datasets.transformed package
  • Submodules
    • quanda.utils.datasets.transformed.base module
    • quanda.utils.datasets.transformed.label_flipping module
    • quanda.utils.datasets.transformed.label_grouping module
    • quanda.utils.datasets.transformed.metadata module
    • quanda.utils.datasets.transformed.sample module

Submodules

• quanda.utils.datasets.dataset_handlers module
  • DatasetHandler
    • DatasetHandler.create_dataloader()
    • DatasetHandler.get_label()
    • DatasetHandler.get_model_inputs()
    • DatasetHandler.get_predictions()
    • DatasetHandler.process_batch()
    • DatasetHandler.with_label()
  • HuggingFaceDatasetHandler
    • HuggingFaceDatasetHandler.create_dataloader()
    • HuggingFaceDatasetHandler.get_label()
    • HuggingFaceDatasetHandler.get_model_inputs()
    • HuggingFaceDatasetHandler.get_predictions()
    • HuggingFaceDatasetHandler.process_batch()
    • HuggingFaceDatasetHandler.with_label()
  • HuggingFaceSequenceDatasetHandler
    • HuggingFaceSequenceDatasetHandler.__init__()
    • HuggingFaceSequenceDatasetHandler.build_positional_batch()
    • HuggingFaceSequenceDatasetHandler.collate()
    • HuggingFaceSequenceDatasetHandler.create_dataloader()
    • HuggingFaceSequenceDatasetHandler.process_batch()
  • TorchDatasetHandler
    • TorchDatasetHandler.build_positional_batch()
    • TorchDatasetHandler.create_dataloader()
    • TorchDatasetHandler.get_label()
    • TorchDatasetHandler.get_model_inputs()
    • TorchDatasetHandler.get_predictions()
    • TorchDatasetHandler.process_batch()
    • TorchDatasetHandler.with_label()
  • get_dataset_handler()
• quanda.utils.datasets.image_datasets module
  • HFtoTV
    • HFtoTV.__init__()
    • HFtoTV.get_label()
• quanda.utils.datasets.on_device_dataset module
  • OnDeviceDataset
    • OnDeviceDataset.__init__()