XDA Developers on MSN

I quantized a local LLM on my home server and ditched cloud AI for smart home control entirely

My Proxmox node now powers my entire smart home without touching a single cloud service ...
XDA Developers on MSN

I tried PewDiePie's open-source AI workspace, and it's weirdly great

Impressive, but weird ...
GitHub

llama.cpp-mtp — Fused TBQ4 Flash Attention + MTP + Shared Tensors

Fork of llama.cpp with fused TurboQuant flash attention — the FA kernel reads raw TBQ4_0 K/V blocks directly from global memory and dequants via centroid lookup in the FWHT-rotated domain. No separate ...
IEEE

LLaMA-Unidetector: An LLaMA-Based Universal Framework for Open-Vocabulary Object Detection in Remote Sensing Imagery

Abstract: The object detection is a crucial task in the computer vision for remote sensing applications. However, the reliance of traditional methods on predefined and trained object categories limits ...
GitHub

ruribe17/cuyex-ik-llama-cpp

Deploy powerful LLMs locally, on your own hardware — no cloud, no latency, no data leaving your infrastructure.