In 2023 and 2024, Flock sent 1,427 alerts to the Roseville [CA] Police Department.

Roseville police found that Flock misread license plates in 71% of those alerts.

Max Isaacs, director of technology law and policy with the Policing Project at New York University’s School of Law, described Roseville’s misread data as “stunning.”

“A 71% misread rate is really beyond the pale,” he told Business Insider, referring to Roseville’s reported error rate for stolen and felony vehicle alerts. He added that “in the absence of concrete rules that directly address the problem of misreads, this technology is not safe to be deployed in communities.”

  • JohnEdwa@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    13
    ·
    1 day ago

    If you have a pi reading license plates, you are probably scanning a few dozen different plates a day, looking if they match a handful of possibilities. If the only plate that opens the gate is ABC123, nothing happens if it accidentally reads anything else, and I’ll probably get it right a second later.

    When Flock scans plates, it reads thousand of them every second looking to read and match every possible plate variation from every state (which there are over 8000 of) to every reported stolen plate, in all weather and lighting conditions. It’s really no wonder if 71% of the times it reports it found a stolen plate it had got it wrong.

    • Wildmimic@anarchist.nexus
      link
      fedilink
      English
      arrow-up
      4
      ·
      11 hours ago

      This has nothing to do with weather conditions or lighting. It has to do with basic statistics: if you are looking for a very small subset of identifiers in a very large pool, and you have a system that has a (pretty good btw) 96% chance to read an identifier correctly, you will get more and more false positives the more identifiers you scan.

      That means expanding the Flock network also expands the amount of false positives.

      This cannot be avoided, except if you are able to make the 96% rate better; but be reminded if this system would get upgraded from 96% to 99.6%, total precision would only increase about 1% (from 29.1% to 30.1%). reducing the number of false positives in this example by only 15 licence plates.

      To actually reduce the amount of false positives, you would have to make the system less sensitive - which isn’t possible in this context.

    • 0x0@infosec.pub
      link
      fedilink
      English
      arrow-up
      19
      ·
      1 day ago

      I highly doubt a single flock camera would scan thousands of plates per second lol

      There is no good reason for sending images of plates to the cloud for alpr when the camera can do it locally

      • JohnEdwa@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        15
        ·
        1 day ago

        I did not know there was only one single Flock camera in the city of 150 000 people, or in California, or the USA in general. lol.

        it has cameras in more than 6,000 communities across the country, and it touts more than 20 billion vehicle reads each month.

        Oh, kinda looks like they have more. 20 billion reads a month, huh. That’s 7610 scan a second. Fancy that.

        • NOT_RICK@lemmy.world
          link
          fedilink
          English
          arrow-up
          13
          arrow-down
          1
          ·
          1 day ago

          Flock cameras process the images locally for plate recognition. It’s only after the image of the plate has been converted into text that the plate number (or in this instance the number it has misinterpreted) is sent to AWS for matches and alerts. The issue sounds like it’s at the individual camera level.

          • JohnEdwa@sopuli.xyz
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            8
            ·
            1 day ago

            …yes?

            The cameras around the US scan 7000 plates per second, trying to figure out what they say with 8000 different possible plate designs around the country, and those results are then matched to a database of stolen vehicles and other plates , which there’s roughly 600k reported stolen in the US each year so. That database is going to be massive.

            That means every second, 7000 strings of letters and numbers OCR’d at unknown conditions and accuracy are being compared to hundreds of thousands of stolen plates. They are guaranteed to get a number of “matches” constantly, most of them from reads that were not accurate.

            And specifically because they aren’t sent anywhere, nobody can double check the picture to see if the camera got it anywhere right at all.

            • halcyoncmdr@piefed.social
              link
              fedilink
              English
              arrow-up
              6
              arrow-down
              2
              ·
              22 hours ago

              The cameras around the US scan 7000 plates per second

              Yes the entire system saving that text, and maybe a still image handles that many… But the single camera taking each photo where the actual OCR processing is done ON THE CAMERA HARDWARE ITSELF only needs to handle maybe one or two each second… And only if it is looking at a busy road. At the distances these cameras can process, most are not handling a lot simultaneously. And very busy roads will have different hardware than the lower end camera systems used in most places.

              You HAVE to purposely be trying NOT to understand any of the responses to you here. No one could possibly be that stupid unintentionally.

            • Alexstarfire@lemmy.world
              link
              fedilink
              English
              arrow-up
              6
              ·
              1 day ago

              What does any of this have to do with the cameras from one specific town being wrong a majority of the time? Not that it would be better if it wad the average across the nation. It would be much, much worse actually.

        • XLE@piefed.social
          link
          fedilink
          English
          arrow-up
          4
          ·
          22 hours ago

          I don’t think you understand their point. The point is that the OCR can be done on a distributed system, because a distributed system is what the cameras already are.

          My biggest contention with this claim is whether the computers onboard the license plate readers are actually capable of doing this with solar power and battery capacity, but considering I’d rather they didn’t exist anyway…