This all sounds great. Would love to also see more support for non-NVIDIA GPUs. I’m particularly excited about using int8 with AMD, and would be nice to not need workarounds such as plaid-ml.