Issues

• Concurrency Budget is Static & Estimated From Hardcoded Magic Constants

  bughelp wanted
  Lightning-AI/litData#870 · Filter by author hillhack opened on Aug 10, 2026

• parquet tests fails inconsistently in CI

  bughelp wanted
  Lightning-AI/litData#813 · Filter by author deependujha opened on Apr 29, 2026
  1

• Shuffle buffer for controlling sample correlation

  enhancement
  Lightning-AI/litData#797 · Filter by author Aceticia opened on Mar 11, 2026
  2

• Add Global max_cache_size to CombinedStreamingDataset to Enforce a Total Cache Budget Across Child Datasets

  enhancement
  Lightning-AI/litData#790 · Filter by author hvkoops opened on Feb 17, 2026
  1

  

• Interrupt and resume merge_datasets

  enhancement
  Lightning-AI/litData#784 · Filter by author aRI0U opened on Jan 14, 2026
  2

• StreamingDataLoader state is not loaded from checkpoint when resuming training

  bughelp wanted
  Lightning-AI/litData#775 · Filter by author philgzl opened on Dec 19, 2025
  1

• TokensLoader segmentation fault

  bughelp wantedwaiting on author
  Lightning-AI/litData#756 · Filter by author Aceticia opened on Nov 20, 2025
  1

• TokensLoader with parallel meta field

  enhancement
  Lightning-AI/litData#753 · Filter by author Aceticia opened on Nov 15, 2025

• Supporting samplers for creating balanced batches

  questionwaiting on author
  Lightning-AI/litData#717 · Filter by author karinazad opened on Sep 22, 2025
  1

• Add support for Teamspaces EFS and Filestore folders in resolver

  enhancement
  Feature

  Lightning-AI/litData#698 · Filter by author bhimrazy opened on Aug 23, 2025

• Add support for raw Video types for sliced video loading

  enhancement
  Lightning-AI/litData#688 · Filter by author bhimrazy opened on Aug 10, 2025

• Add support for TiffStreamingRawDataset

  enhancementhelp wanted
  Lightning-AI/litData#687 · Filter by author bhimrazy opened on Aug 10, 2025
  1

  

• Switch raw dataset indexing from fsspec to obstore

  enhancementhelp wanted
  Lightning-AI/litData#686 · Filter by author bhimrazy opened on Aug 10, 2025
  1

• Add support for easy logging setup with sensible defaults

  enhancementgood first issuehelp wanted
  Lightning-AI/litData#685 · Filter by author bhimrazy opened on Aug 10, 2025
  2

  

• Try obstore for LitData Chunks

  enhancement
  Lightning-AI/litData#663 · Filter by author bhimrazy opened on Jul 27, 2025
  2

• Support Cycling a CombinedStreamingDataset

  enhancement
  Lightning-AI/litData#658 · Filter by author shaoyuancc opened on Jul 22, 2025
  3

• Support for subclasses of StreamingDataset with different length

  enhancement
  Feature

  Lightning-AI/litData#642 · Filter by author philgzl opened on Jun 30, 2025
  1

• Explore Optimizing and Running Tests in Parallel for Faster CI in litdata

  ci / testshelp wanted
  Lightning-AI/litData#612 · Filter by author bhimrazy opened on Jun 4, 2025
  3

• Add example for hugging face dataset optimization and benchmarks reports

  documentation
  Lightning-AI/litData#558 · Filter by author bhimrazy opened on Apr 17, 2025
  

• Cycle option for StreamingDataLoader

  enhancementwaiting on author
  Feature

  Lightning-AI/litData#524 · Filter by author Aceticia opened on Mar 24, 2025
  8

• Local cache dir not fully clearing in DDP multi-node training.

  bughelp wanted
  Lightning-AI/litData#512 · Filter by author JackUrb opened on Mar 12, 2025
  12

• Add batch sampler for StreamDataloader to enable flexiable training strategy.

  enhancement
  Lightning-AI/litData#509 · Filter by author xinsir6 opened on Mar 11, 2025
  2

• CI error: All chunks should've been deleted keeps coming back

  bughelp wanted
  Lightning-AI/litData#437 · Filter by author deependujha opened on Dec 20, 2024
  2

• Restart training with new data, mid-epoch

  enhancement
  Lightning-AI/litData#436 · Filter by author schopra8 opened on Dec 17, 2024
  1

• Clear Examples of use with different dataset types and code changes.

  documentationenhancement
  Lightning-AI/litData#409 · Filter by author Woodr7 opened on Nov 4, 2024
  3