If so-called AI is basically just Large Language Models, how come predictive text on my phone is bollock-useless?
Like if I type "I have two appl.." for example, often it will suggest "apple" singular instead of plural. Just a small example, but it is really bad at predicting which variant of a word should come after the previous
You are viewing a single comment
LLMs are orders of magnitude more sophisticated and expensive to run. But don't worry, I'm sure not so far in the future we will see smaller LLMs being run on device to be used as autocorrect.
It would have to be pretty specific and small to work on a phone and I think a side effect would be everyone's conversations start to sound a lot more homogeneous.
you're not wrong. Google just announced Gemini Nano that will run directly on the Pixel 8. Of course, it's the first of it's kind and will probably be slow and it's not used as autocorrect yet. But just give it one year or two and it will probably be more common.
Even give years ago, Google had a keyboard that skimmed your emails and texts to start a bank of words you use to supplement it's dictionary for autocorrect. Like if you are a chemist and send an email that includes the word "tetrahydrafuran" every couple month, it would be nice for your phone keyboard to just have it in the dictionary.
SwiftKey does that if you give it access to your emails.
Can we have Scottish ones that know what a bawbag is, and when to put an "e" on the end of "shit"?
Thanks!
Think of it from the LLM's perspective - in the general pool you have common English, you have less common variations such as this, and then you have whatever the heck people like Kid Rock are doing...