
vLLM ignores LoRA rank_pattern and alpha_pattern and serves the adapter at the wrong scale
TL;DR: A PEFT LoRA adapter can give individual modules their own rank and alpha through rank_pattern...
Tag archive

TL;DR: A PEFT LoRA adapter can give individual modules their own rank and alpha through rank_pattern...
Modern LLMs have billions of parameters. Fine-tuning all of them for a new task means: Storing full...
IronEar's ESP32-S3 Sensor Hears: An open-source ESP32-S3 sensor node classifies 500+ household sounds on-device and reports to Home Assistant over MQTT or a private LoRa mesh.
Off-Grid LoRa Message Board: A battery-powered desk display that receives text messages over a LoRa mesh network with no WiFi needed, plus a built-in CO2 and humidity sensor.
For years, the charm of LoRa mesh networking has been its stubborn refusal to behave like ordinary...
When it helps, when RAG beats it, and why most teams never need it.
A new EMNLP demonstration system uses teacher-generated examples to train a compact task-specific adapter from a natural-language specification, reporting 83.6% semantic accuracy on a difficult subset where a fast compiler achieved 22.4% mean LEM.
When an AI model fails to understand a company's specialized requirements, the instinct is often to...
WeatherXM D2 Mesh Solar: A solar weather station that reports over a LoRa mesh instead of Wi-Fi or cellular, plus how to build a cheap ESP32 version of the same idea.
ExpressLRS Squeezes Kilometers Out: Four open-source ELRS receivers, an SX1280 LoRa radio, and one 50-ohm trace: the RF design tricks that keep a 1-watt link locked kilometers out.
restmesh is a Meshtastic-related REST API app I’m developing. Its purpose is to have a simple...
ESP32 Bit Pirate v1.7 turns cheap Espressif boards into a Bus Pirate-style debug tool, now with in-browser WebUSB access and SX1262 LoRa packet sniffing.