Convert and PR models to Safetensors
Browse a list of machine learning datasets
Manage and label data for machine learning projects
Label data efficiently with ease
Display translation benchmark results from NTREX dataset
Train a model using custom data
ReWrite datasets with a text instruction
Explore datasets on a Nomic Atlas map
Create datasets with FAQs and SFT prompts
Speech Corpus Creation Tool
Explore recent datasets from Hugging Face Hub
Browse and extract data from Hugging Face datasets
Search and find similar datasets
Convert to Safetensors is a tool designed to convert AI models to the Safetensors format. Safetensors is a secure alternative to PyTorch's .pt files, offering enhanced security by only allowing the storage of floats and integers. This format is particularly useful for model sharing and collaboration, as it prevents potential attacks through malicious file content.
convert_to_safetensors --input /path/to/model.pt --output /path/to/model.safetensors
convert_to_safetensors --input /path/to/model.pt --output /path/to/model.safetensors --compress
Why should I use Safetensors over PyTorch's .pt files?
Safetensors provides enhanced security by restricting data types, reducing the risk of malicious content in shared models.
What formats are supported for conversion?
The tool supports conversion between PyTorch (.pt) and Safetensors (.safetensors) formats.
Can I convert a Safetensors model back to PyTorch?
Yes, the tool allows bidirectional conversion, enabling you to switch between formats as needed.