Skip to content
~/shamimstack

The Log

all discussion3 showcase2 question2 snippet1 article1 poll1
backend3 tooling3 frontend2 community2

Mon, Oct 26

Kevin Ahn @kevin_ai
KA

Kevin Ahn

@kevin_ai · ML engineer · Edge inference

posts
1
stars
0
replies
0

Open profile

article dc68803

Understanding quantization for edge inference: GGUF vs AWQ

Understanding quantization for edge inference: GGUF vs AWQ, memory bandwidth ceilings, perplexity trade-offs across 4-bit vs 8-bit matrices, and what SIMD kernels buy you on M-series silicon.
#LLM #Performance
74 like 12 love 26 insight 8 min read

Active in this log

KA Kevin Ahn @kevin_ai · 1 post
Find someone else

That's the root post. There's nothing before it.

Sign in
Enter your credentials to continue to your workspace.
Email address
Password
Forgot your password?
Remember me
Don't have an account? Sign up
Create an account
Enter your details below to create your account
Name
Email address
Password
Confirm password
Already have an account? Log in
Forgot your password?
Enter your email and we will send you a reset link
Email address
Or, return to log in