error.md
January 2, 2025 ยท View on GitHub
Misc errors
Data processing error
Comment out Line 299-306 in .venv/lib/python3.10/site-packages/tensorflow_datasets/core/dataset_builder.py to avoid the AttributeError: 'MultiplexedPath' object has no attribute 'parts' error (seems an issue with running python3.10; using tensorflow_datasets==4.9.2 fixes this issue but disabling gcs does not work any more somehow)
Quantization error in training
If using quantization in training, might need to modify Line 474 in .venv/lib64/python3.10/site-packages/bitsandbytes/autograd/_functions.py to return output.clone from return output (related issue).
torch.compile + quantization
Quantization does not work well with torch.compile currently when running eval.