A smaller model running entirely on-device can now summarize long documents and threads offline, trading some nuance for speed and privacy.
Sending every document to a server for summarization is a non-starter for sensitive material, and it fails outright without a connection. An on-device option gives people a genuine offline, private fallback for the common case of 'just tell me the gist.'