heterogeneous LLM inference optimization

A promising but complex framework for heterogeneous LLM inference, best suited as a research tool rather than a direct product opportunity for a solo developer.