Bump datasets from 3.1.0 to 3.5.0

[dependabot]

Bumps datasets from 3.1.0 to 3.5.0.

Release notes

Sourced from datasets's releases.

3.5.0

Datasets Features

• Introduce PDF support (#7318) by @​yabramuvdi in huggingface/datasets#7325

>>> from datasets import load_dataset, Pdf
>>> repo = "path/to/pdf/folder"  # or username/dataset_name on Hugging Face
>>> dataset = load_dataset(repo, split="train")
>>> dataset[0]["pdf"]
<pdfplumber.pdf.PDF at 0x1075bc320>
>>> dataset[0]["pdf"].pages[0].extract_text()
...

What's Changed

• Fix local pdf loading by @​lhoestq in huggingface/datasets#7466
• Minor fix for metadata files in extension counter by @​lhoestq in huggingface/datasets#7464
• Priotitize json by @​lhoestq in huggingface/datasets#7476

New Contributors

• @​yabramuvdi made their first contribution in huggingface/datasets#7325

Full Changelog: huggingface/datasets@3.4.1...3.5.0

3.4.1

Bug Fixes

• Fix data_files filtering by @​lhoestq in huggingface/datasets#7459

Full Changelog: huggingface/datasets@3.4.0...3.4.1

3.4.0

Dataset Features

• Faster folder based builder + parquet support + allow repeated media + use torchvideo by @​lhoestq in huggingface/datasets#7424

  • /!\ Breaking change: we replaced decord with torchvision to read videos, since decord is not maintained anymore and isn't available for recent python versions, see the video dataset loading documentation here for more details. The Video type is still marked as experimental is this version

  from datasets import load_dataset, Video
  dataset = load_dataset("path/to/video/folder", split="train")
  dataset[0]["video"]  # <torchvision.io.video_reader.VideoReader at 0x1652284c0>

  • faster streaming for image/audio/video folder from Hugging Face
  • support for metadata.parquet in addition to metadata.csv or metadata.jsonl for the metadata of the image/audio/video files

• Add IterableDataset.decode with multithreading by @​lhoestq in huggingface/datasets#7450

  • even faster streaming for image/audio/video folder from Hugging Face if you enable multithreading to decode image/audio/video data:

  dataset = dataset.decode(num_threads=num_threads)

... (truncated)

Commits

• 0b5998a release: 3.5.0 (#7484)
• 5f8d2ad Priotitize json (#7476)
• a256b85 Minor fix for metadata files in extension counter (#7464)
• 781ce85 Fix local pdf loading (#7466)
• d6d0281 Introduce pdf support (#7318) (#7325)
• 0f6e35f set dev version (#7462)
• f742152 release: 3.4.1 (#7460)
• e7f1def Fix data_files filtering (#7459)
• 6f7cd01 set dev version (#7454)
• 14fb15a release: 3.4.0 (#7453)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[mariusarvinte]

@dependabot ignore this major version

[dependabot]

OK, I won't notify you about version 3.x.x again, unless you re-open this PR.