Convert and PR models to Safetensors
Organize and process datasets for AI models
Curate and manage datasets for AI and machine learning
Search for Hugging Face Hub models
Create a domain-specific dataset seed
Create a large, deduplicated dataset for LLM pre-training
Display html
Create and validate structured metadata for datasets
Create a report in BoAmps format
Browse TheBloke models' history
Find and view synthetic data pipelines on Hugging Face
Label data for machine learning models
Organize and invoke AI models with Flow visualization
Convert to Safetensors is a tool designed to convert AI models to the Safetensors format. Safetensors is a secure alternative to PyTorch's .pt files, offering enhanced security by only allowing the storage of floats and integers. This format is particularly useful for model sharing and collaboration, as it prevents potential attacks through malicious file content.
convert_to_safetensors --input /path/to/model.pt --output /path/to/model.safetensors
convert_to_safetensors --input /path/to/model.pt --output /path/to/model.safetensors --compress
Why should I use Safetensors over PyTorch's .pt files?
Safetensors provides enhanced security by restricting data types, reducing the risk of malicious content in shared models.
What formats are supported for conversion?
The tool supports conversion between PyTorch (.pt) and Safetensors (.safetensors) formats.
Can I convert a Safetensors model back to PyTorch?
Yes, the tool allows bidirectional conversion, enabling you to switch between formats as needed.