Get up and running with Mellea
conda install 'torchvision>=0.22.0'
(this should also install pytorch and torchvision-extra). Then, you should be able to run uv pip install mellea
. To run the examples, you will need to use python <filename>
inside the conda environment instead of uv run --with mellea <filename>
.error: can't find Rust compiler
). You can either downgrade to python 3.12 or install the rust compiler to build the wheel for outlines locally.mellea.start_session(backend_name="ollama", model_id=mellea.model_ids.IBM_GRANITE_3_3_8B)
.user_variables
. These are filled by treating the instruction description as a jinja template.
The m.instruct()
function returns a ModelOutputThunk
per default, which has the model output string bound to the field .value
.