llm

Kimi K3 runs on 8GB CPU, No GPU Mehul Gupta - Medium This is exactly why the Kimi K3 in C repository has attracted so much attention. Instead of requiring GPU clusters, it demonstrates that Kimi K3, a 2.78 trillion parameter Mixture-of-Experts (MoE) model, can perform inference on a single CPU...

Goodness I wasn't fully aware all the major LLMs and generative AI models were so open to jailbreaking by reframing prompts to augment the output. https://www.microsoft.com/en-us/security/blog/2024/06/26/mitigating-skeleton-key-a-new-type-of-generative-ai-jailbreak-technique/...