jeffw@lemmy.world to Technology@lemmy.worldEnglish · 5 months agoEverything Apple iOS 18 Will Do, Android Already Doesgizmodo.comexternal-linkmessage-square249fedilinkarrow-up1377arrow-down190cross-posted to: android@lemdro.id
arrow-up1287arrow-down1external-linkEverything Apple iOS 18 Will Do, Android Already Doesgizmodo.comjeffw@lemmy.world to Technology@lemmy.worldEnglish · 5 months agomessage-square249fedilinkcross-posted to: android@lemdro.id
minus-squarekill_dash_nine@lemm.eelinkfedilinkEnglisharrow-up8·5 months agoYou would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size.
You would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size.