• Amelia42@piefed.blahaj.zone
    link
    fedilink
    English
    arrow-up
    27
    arrow-down
    1
    ·
    11 hours ago

    From the article:

    GETTING AROUND PROTECTIONS Agents that can take actions on behalf of users are billed as the next big wave of AI technology, capable of surfacing relevant information from across different apps ‌and executing time-saving ⁠tasks like answering emails, booking appointments and making online purchases autonomously, without direct instructions. However, that reach can get around the protections that apps like Signal build for themselves. Reuters reported earlier this week that Meta’s (META.O), opens new tab Muse agent was able to bypass its own official “Connector” tool to access Signal messages on both an Apple computer and a phone using Google’s Android system. In both cases, Muse used broad operating system-level permissions granted during the app’s initial setup to pull in the messages, using those authorizations in ways a user might not ​anticipate. On Apple’s macOS, for instance, it used ​a combination of the computer’s accessibility ⁠and screenshot tools, repurposing settings Apple offers for people with disabilities to navigate over to Signal, take screenshots of chats there, extract text from those pictures and reproduce the messages inside the Muse app. An operating system update from Apple this week effectively closed that ​specific pathway, but also introduced a new set of permissions aimed at agents that offers similar capabilities paired with additional ​user warnings. Meta said in response ⁠to Reuters’ reporting that agents need to see and interact with people’s computers in order to work on their behalf, and that Muse can access other apps only via permissions users explicitly grant. Signal said that developers should have straightforward ways of opting their apps out of such data processing by AI assistants entirely, specifically mentioning screen reading, notifications and other file ⁠system access. The service, ​owned by a non-profit foundation, promises its users a secure messaging experience by limiting the data it ​stores on its own servers, eschewing ads and offering end-to-end encryption, meaning it cannot access and read the conversations conducted on its app. AI systems that scan people’s screens can undermine those protections by pulling the ​messages out of Signal’s secure environment and into whatever other servers the agent is using, it said in the post.

    • ctrl_alt_esc@lemmy.ml
      link
      fedilink
      English
      arrow-up
      36
      arrow-down
      1
      ·
      11 hours ago

      Insane that there are people out there that woulg give an LLM unrestricted access to their devices…

      • rbb36@lemmy.world
        link
        fedilink
        English
        arrow-up
        13
        ·
        9 hours ago

        More insane: They make up the majority of the market. Therefore, expect most products and services to be increasingly agentic-drooler-centric.

        • Zarobi@aussie.zone
          link
          fedilink
          English
          arrow-up
          0
          ·
          2 hours ago

          To be fair, it is like 4 paragraphs as a single wall of text. It made me feel kind of tired looking at it