Running edge LLMs in postmarketOS using llama.cpp
with optimization. This can be used as a feasibility study to study how many tokens can be generated per second.
No Issues, PRs or Discussions added.
Suraj Kumar Mahto
suraj_kumar_mahto