Hi everyone, I don’t understand how to download only the requested split. See the following for this [EDIT: current version uses .zip] dataset: >>> ds = load_dataset("ego-thales/cifar10", name="no_airplane", split="left_out_calibration") train/automobile/25706.png: 100%|███████████████████████████…

I know I can use the streaming=True option if I want this mode, but I’d hope that without it, HF would simply eagerly download the whole split, but only the requested split!

I know I can use the streaming=True option if I want this mode, but I’d hope that without it, HF would simply eagerly download the whole split, but only the requested split! I realize now that even this does not work. Indeed, my current version uses .zip archives since it’s impossible to load th…

Me too so far… :confused: I won’t resort to it though since my goal is to have clean few-liner downloads for tutorials. But for the life of me I really feel like I’m missing something. I’ve heard so much talk about HuggingFace and it’s sooo popular. Yet, somehow, requesting a split fetches the enti…

Just so you can see what I came down to x) [image]

Download only requested split?

Beginners

John6666 August 8, 2025, 10:16am 4

I can only think of sharding with WebDataset…

Edit:
I found this.

Topic		Replies	Views
Download only a subset of a split 🤗Datasets	10	19352	February 25, 2025
Download a fraction of data from HuggingFace Datasets 🤗Datasets	5	710	October 3, 2026
How can I download a specific split of a dataset? 🤗Datasets	1	1899	April 3, 2024
Download only 1 of many parquet file 🤗Datasets	2	507	March 19, 2025
Is there any ways to download only a subset of dataset using huggingface-cli? 🤗Hub	0	395	July 17, 2024

Download only requested split?

Related topics