Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.
So it connects to Google Cloud for this? What does that mean "locally", if its a Cloud Platform? And what does that mean "Mozilla's", if its Google? I'm a bit confused with this sentence.
Does it download and execute it locally offline or does it send the data to Google Cloud Platform?? The page is not clear about this and I searched for an answer. I have the same Mistral 7B model that I downloaded from HuggingFace website and can use offline with a specific GUI application. It would be nice if I could Firefox point to that file instead.
Otherwise, this does not look very promising and I wouldn't trust it at the moment.
So it connects to Google Cloud for this? What does that mean "locally", if its a Cloud Platform? And what does that mean "Mozilla's", if its Google? I'm a bit confused with this sentence.
Does it download and execute it locally offline or does it send the data to Google Cloud Platform?? The page is not clear about this and I searched for an answer. I have the same Mistral 7B model that I downloaded from HuggingFace website and can use offline with a specific GUI application. It would be nice if I could Firefox point to that file instead.
Otherwise, this does not look very promising and I wouldn't trust it at the moment.