Optimum CLI Commands. Compress, Quantize and Convert!
Generate text with input prompts
Generate SQL queries from natural language input
Generate and filter text instructions using OpenAI models
A powerful AI chatbot that runs locally in your browser
Combine text and images to generate responses
Answer questions about videos using text
Generate text based on input prompts
Generate a styled PowerPoint from text input
Submit Hugging Face model links for quantization requests
Submit URLs for cognitive behavior resources
Generate subtitles from video or audio files
Generate creative text with prompts
The Optimum-CLI-Tool is a command-line interface designed to optimize machine learning models through compression, quantization, and conversion. It streamlines the process of preparing models for deployment, focusing on efficiency and performance. This tool is particularly useful for users working with Text Generation tasks and aims to simplify model optimization workflows.
optimum-cli convert --input-model your_model.pb --output-model optimized_model.xml
What is model quantization?
Quantization reduces the numerical precision of model weights, decreasing model size and improving inference speed without significant loss in accuracy.
Which frameworks does Optimum-CLI-Tool support?
The tool supports TensorFlow, PyTorch, and OpenVINO, allowing seamless conversion between these formats.
How do I convert a model to OpenVINO format?
Run the tool with the conversion option, specifying the input model and desired output format. For example:
optimum-cli convert --input-model your_model.pb --output-model optimized_model.xml --target-framework openvino