GPS comparison tests

For an introduction, on how imprecise GPS detection can be on smartphones and how that can easily be demonstrated, see also GPS.

Below are screenshots taken on September 29, 2024, during a walk in the park, under a clear sky. In one hand, I held an iPhone 14 (with dual-band GPS), and in the other, an iPhone 12 (without dual-band GPS).

For testing purposes, the OpenBomenKaart application uses diagnostic tweaks, as shown in the screenshots. I used this test version (only fully functional on a mobile phone). (on a desktop browser it simulates a random walk)

The exact path I walked is marked in cyan. I traced this route on the desktop using Esri imagery via tool keene.edu/campus/maps/tool/. I consider this my reference track. Note that Esri and OSM may not always align perfectly, especially for paths in the park.

Every second, GPS coordinates are recorded along with an accuracy value. The accuracy is then translated into a rating scale from 1 to 5 ('weak' to 'spot on'). See the code sample below.

code example (pls ignore the syntax warnings)

Every second, I display the measured position as a magenta circle. Every time the signal strength changes by a full level, I plot a yellow circle and indicate the strength. I connect the dots with a red line. I count how often each accuracy level is found. Which is shown (cryptically short) in the heading, together with the date, for easily comparing screenshots between walks.

In the live app, the circles work best at zoom level 19 or higher. The red line works best at zoom level 18 or lower.

iPhone 12, note how by far the most measurements were at accuracy 2

iPhone 14, note how by far the most measurements were at accuracy 3

Closer view, zoomed in: I started and ended here, then walked in a straight line, hard to tell

test

iPhone 12

iPhone 14, note how this trace goes awry at Constantijn Huygenslaan 7-19, both iphones were at the same position, I never made this detour

iPhone 12 only the numbers	iPhone 14 only the numbers
test	test

Evaluation: Both iPhones are able to render the route followed with reasonable accuracy when zoomed out. However, upon closer inspection (when zoomed in), the discrepancy can be confusing. The exact position can be off by 10 meters or more from what is reported. During normal use, this can be mitigated by waiting for the blue dot to stabilize, similar to Google Maps. However, in an unstructured area, like a park, it may not be as easy to detect discrepancies using visual cues. We actually need higher precision than Google Maps (since in Google Maps, if the blue dot is a few meters outside a bicycle lane, no one will be confused).