OpenRadar

Tag

#pytorch

2 open-source projects filed under this tag.

01 Python

apple-coreai-models

Apple's first open-source on-device AI models repo — Python export recipes, Swift runtime, and agent skills for deploying PyTorch models on Apple silicon.

#ai#on-device#apple#pytorch
762 50 Read
02 Python

lmcache

LMCache is a KV cache management layer that slashes LLM inference latency by reusing computed attention states across requests, sessions, and GPU clusters.

#llm#inference#kv-cache#vllm
8.7k 1.3k Read