GetCacheMemory

Get the cache size in bytes.

PyTorch

API: torch.cuda.memory_reserved
Strategy: Direct Mapping
Official Docs ↗

Apple MLX

API: mlx.core.get_cache_memory
Strategy: Direct Mapping
Official Docs ↗