Skip to content

Issues: Lightning-AI/litdata

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

30 Open 49 Closed
30 Open 49 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Inject custom s3 connection configs (credentials) enhancement New feature or request help wanted Extra attention is needed
#236 opened Jul 16, 2024 by csy1204
2
Uneven number of batches returned across ranks in StreamingDataset/DataLoader bug Something isn't working help wanted Extra attention is needed
#233 opened Jul 15, 2024 by awaelchli
1
3
Integration with DAG framework Prefect enhancement New feature or request help wanted Extra attention is needed
#226 opened Jul 12, 2024 by tchaton
@deependujha
Add support for the reduce operator enhancement New feature or request help wanted Extra attention is needed
#225 opened Jul 12, 2024 by tchaton
1
GitHub actions triggering twice ci / tests help wanted Extra attention is needed
#220 opened Jul 11, 2024 by awaelchli
4
Is the multinode data processing only available in lightning studio? enhancement New feature or request help wanted Extra attention is needed
#218 opened Jul 10, 2024 by rishabhm12
3
Using a streaming dataloader with an unbalanced dataset yields unexpected batch sizes. bug Something isn't working help wanted Extra attention is needed
#199 opened Jun 29, 2024 by esivonxay-cognitiv
7
Add support for encrypting / decrypting the chunks + API Keys enhancement New feature or request help wanted Extra attention is needed
#197 opened Jun 29, 2024 by tchaton
1
4
Add support for parquet files for storing the chunks bug Something isn't working help wanted Extra attention is needed
#191 opened Jun 27, 2024 by tchaton
LitData doesn't support s3 bucket connection outside server enhancement New feature or request help wanted Extra attention is needed
#183 opened Jun 25, 2024 by sanyalsunny111
11
Using fsspec to download files enhancement New feature or request help wanted Extra attention is needed
#181 opened Jun 23, 2024 by samsja
3
Batch size beginning to vary half way through epoch bug Something isn't working help wanted Extra attention is needed
#179 opened Jun 21, 2024 by MarcoForte
7
Warning Message When Using StreamingDataset with DDP bug Something isn't working help wanted Extra attention is needed
#172 opened Jun 14, 2024 by taemincho
2
Data shard delation with multi GPU does not work bug Something isn't working help wanted Extra attention is needed
#140 opened May 24, 2024 by rakro101
4
Adding breakpoint in random_images function crashes pdb bug Something isn't working help wanted Extra attention is needed
#134 opened May 21, 2024 by cgebbe
4
DataChunkRecipe is not working when used in litgpt's TinyLlama pretraining example bug Something isn't working help wanted Extra attention is needed
#130 opened May 15, 2024 by wen020
5
Pytorch lighting Fabric + lit data + DDP hangs when finishing epoch bug Something isn't working help wanted Extra attention is needed
#129 opened May 13, 2024 by miguelalba96
3
Stream selected channels enhancement New feature or request help wanted Extra attention is needed
#128 opened May 13, 2024 by robmarkcole
Slow Dataset Preprocessing due to CPU affinity (?) issues bug Something isn't working help wanted Extra attention is needed
#118 opened May 2, 2024 by mgolub2
5
Dataloading is not working when used in litgpt's debug pretraining example bug Something isn't working help wanted Extra attention is needed
#103 opened Apr 18, 2024 by iloshchilov
4
ValueError: buffer size must be a multiple of element size bug Something isn't working help wanted Extra attention is needed
#102 opened Apr 18, 2024 by awaelchli
Assert when deserializing no_header_numpy or no_header_tensor. bug Something isn't working help wanted Extra attention is needed
#92 opened Apr 4, 2024 by ouj
4
TPU support enhancement New feature or request
#79 opened Mar 26, 2024 by miguelalba96
5
Prints inside the worker processes mess up the progress bar bug Something isn't working help wanted Extra attention is needed
#76 opened Mar 24, 2024 by carmocca
1
Allow a StreamingDataset to wrap around when running in a CombinedStreamingDataset enhancement New feature or request
#74 opened Mar 14, 2024 by lantiga
1
ProTip! Find all open issues with in progress development work with linked:pr.