Skip to content

python-ml-layer

Recipe card from the charly-languages plugin (Images — the deployable catalog).

python-ml – Core ML Python environment (Tier 2 meta-layer)

Section titled “python-ml – Core ML Python environment (Tier 2 meta-layer)”
Property Value
Dependencies cuda
Sub-candies llama-cpp
Install files charly.yml, pixi.toml, plan:

Architecture: Tier 2 Environment-Owner Meta-Layer

Section titled “Architecture: Tier 2 Environment-Owner Meta-Layer”

This candy owns the pixi.toml for the core ML Python environment and composes the llama-cpp Tier 1 candy via candy: [llama-cpp]. Build order: pixi environment → llama-cpp (binaries) → python-ml user-phase tasks (vLLM wheel).

Variable Value
NVIDIA_PYTHON_PROJECT ~/.pixi
LD_LIBRARY_PATH /usr/lib64:$HOME/llama.cpp

Plus from llama-cpp sub-candy:

Variable Value
LLAMA_CPP_PATH ~/llama.cpp
PATH (appended) ~/llama.cpp

PyPI: PyTorch >= 2.10.0 (CUDA 13.0), xformers, transformers, accelerate, safetensors, numpy, scipy, einops, pillow, kornia, spandrel, torchsde, vLLM runtime deps (blake3, flashinfer, numba, ray, xgrammar, etc.), gguf, pydantic, aiohttp

  • vLLM 0.19 cu130 nightly wheel (pip install --no-deps)

Use when the user asks about:

  • Machine learning Python environment
  • PyTorch, transformers, or vLLM setup
  • CUDA Python integration
  • The python-ml candy, its packages, or its meta-layer composition
  • The two-tier candy architecture for ML candies
  • /charly-image:layer — candy authoring reference (charly.yml schema, plan steps, service declarations)
  • /charly-check:check — declarative testing (check: block, charly check box, charly check live)