Mozilla will be retiring the Mozilla Location Service
203 points by foresterre 1 year ago | 132 comments- NelsonMinar 1 year agoKey part of the article: a patent claim from Skyhook forced Mozilla to alter the service in a way they couldn't keep it working.
- ikekkdcjkfke 1 year agoSo skyhook lays claim to an aggregate of wifi and gps, both technologies of which they have no chance developing.. Patents involving other advanced technologies should have much stricter requitements
- 0xFF0123 1 year agoHow does Google get around this? Or do they license?
- deely3 1 year agoHow you differentiate between advanced technologies and not?
- crankycoder1975 1 year agoYou can't.
Skyhook basically owns triangulation of rf. It's absurd.
- crankycoder1975 1 year ago
- 0xFF0123 1 year ago
- ikekkdcjkfke 1 year ago
- michaelt 1 year agoI'm not surprised this drifted into disuse.
Both Apple and Android smartphones come with a built in location service, which also has GPS. Firefox OS, which might have needed this service, is no longer around.
Desktops and laptops are rarely used for navigation - the only uses of the geolocation api for desktop web browsers I've encountered are when you go to a retailer's store finder page, and they have a button to use your current location. And even then, the geolocation api is competing with IP geolocation (which doesn't show the user an ominous consent popup)
And I don't imagine it was easy for Mozilla to get quality data - if their service is mostly used by the most privacy-focussed users, I don't imagine those users were lining up to submit their geolocation and wifi data to a public database.
- seba_dos1 1 year agoGeoclue uses MLS and provides location not just on desktops and laptops, but also on phones; and uploading data is (well, was now) one toggle away from being enabled in its config.
MLS is also used by microG, also on phones.
- botanical 1 year agoIt had 2.4 billion unique WiFi networks, and 64 million unique cell networks:
- eek2121 1 year agoLocation is used for far more than simple Navigation.
- edude03 1 year agoCan you provide some examples then?
- Sayrus 1 year agoSome laptops use-cases I've seen:
- red shift at night: if you move around countries, you don't want to reconfigure or use IP location. Having location from WiFi allows this.
- Weather application without picking a city or using GPS
- Night/Day wallpapers
- thayne 1 year agoFinding the nearest location of a store or restaurant.
- bongobingo1 1 year agoBroadly auto-picking the correct language and currency? Populating from a regional feed for news or alerts?
- Sayrus 1 year ago
- edude03 1 year ago
- seba_dos1 1 year ago
- demurgos 1 year agoReally sad to see it go. It powers KDE Plasma's geolocation for its Night Colors feature among other FOSS projects.
- 1oooqooq 1 year agoThose features requiring geolocation to give tune 2min away from the system time is ridiculous and overkill
- 1oooqooq 1 year ago
- KoftaBob 1 year agoFor those wondering, Skyhook is a "location technology company" that was acquired by Qualcomm
- lioeters 1 year agoSome context: https://en.wikipedia.org/wiki/Skyhook_Wireless
- jijijijij 1 year agoWow. I don't know what's exactly protected in their patent, but I have a suspicion they shouldn't have gotten it in the first place. Looks like their business model is mostly trolling, or rather keeping everyone else hostage by their overreaching IP.
Also:
> In 2016, Skyhook introduced a range of innovative [sic] products tailored for the advertising technology sector: Retailer Personas, Power Personas, and On-Demand Personas. Leveraging Skyhook's vast processing capabilities handling billions of location data points, these solutions empower marketers to finely tune consumer targeting by analyzing past locations, enabling personalized mobile marketing campaigns.
Lovely.
- sapiosenses 1 year agoI struggle to understand how a company whose IP essentially amounts to using RF emitters as geolocation sources based on simultaneous correlation with GPS data and other known geolocated RF sources can amass apparently between 600 and 700 patents on this "innovation".
I know that they sued Google over their Android NLP implementation and Google lost on almost all of the enumerated complaints, Apple started using Skyhook beginning with early versions of iOS, and Microsoft apparently also uses them.
What they have seemingly done with the assistance of an absurd number of patents that they apparently keep getting granted by the USPTO (which is known for issuing boatloads of junk patents), is take a fairly obvious tactic which amounts to one of the earliest examples of crowdsourcing - the WiFi "wardriving" practice - and find ways to patent-encumber that technique that they did not invent until they have engineered what appears to be a complete monopoly on it.
I'm also curious how the legal landscape of that business may have changed after the Qualcomm acquisition. IIRC at one point in time Qualcomm was licensing Skyhook data.
- sapiosenses 1 year ago
- jijijijij 1 year ago
- lioeters 1 year ago
- rcMgD2BwE72F 1 year agoWhat service can replace this in microG? Most Android ROM relies on it for location services :(
- wkat4242 1 year agoThere's a plugin for apple's but I think it's unmaintained :(
- RealStickman_ 1 year agoNewer versions of microg (I think from 0.28 onwards) are rewriting the location stack and remove the UnifiedNLP interface. Currently only Mozilla Location Services is built into the new stack.
- rcMgD2BwE72F 1 year agoAlso proprietary.
- wkat4242 1 year agoWell yes but better than Google.
The plugin is open source though
- wkat4242 1 year ago
- RealStickman_ 1 year ago
- wkat4242 1 year ago
- raybb 1 year agoReminds me of a problem I had in NYC back in 2019. There was one station in Manhattan and when I went in there my phone always though I was somewhere out in Brooklyn. Even with WiFi off. It only happened on Android no IOS. It was like this for a long time and I tried many times reporting it as an issue on Google maps. Confirmed the issue with many friends who used Android.
I don't know exactly how these things work but I always suspected that some WiFi AP got repaired and moved to a new location and was broadcasting an SSID that used to be somewhere else for a long time.
Or could it be caused by something else?
- jeroenhd 1 year agoThere's a separate "WiFi scanning" setting that's enabled even when WiFi is switched off. Same with Bluetooth. This passive scanning is quite power efficient, so in practice you probably wouldn't notice that the WiFi is still powered.
I've experience this when a company I worked for switched offices. As soon as I got into range of the WiFi access points, my phone got confused. I'm pretty sure it was the WiFi access points + the IP address of the work WiFi's IP address.
It takes a while for location services to heal themselves. I run a VPN server at home, so ever since I took my phone and tablet to Amsterdam for a day, Google associated my IP address with that city, probably because my phone and tablet got so many data points there. I've seen it happen before, but that'll switch back eventually too.
- thisislife2 1 year ago> There's a separate "WiFi scanning" setting that's enabled even when WiFi is switched off.
Really? What is it called and can it be disabled? That kind of data collection seems like a gross violation of user privacy, and should be illegal.
- mananaysiempre 1 year agoMy old phone asked me for consent during an update, my new one during first boot. It can also be toggled afterwards[1]. Sadly, I suspect this means it’s legal even though most people don’t realize it’s on.
[1] https://support.google.com/android/answer/3467281#scanning
- jeroenhd 1 year agoOn my phone it's under settings > location > location services > wifi/bluetooth scanning.
- mananaysiempre 1 year ago
- thisislife2 1 year ago
- lxgr 1 year agoIt was probably using mobile network base stations. These can sometimes span quite large physical areas underground.
Additionally I'd assume they're quite hard to automatically update: The crowdsourced updates these databases depend on only work when at least one device has both a GPS signal and can see a cell or Wi-Fi base station, which is obviously quite hard underground.
- dfc 1 year agoTurning wi-fi off on android devices does not stop it from being used for location services.
- jeroenhd 1 year ago
- miduil 1 year agoThank you Skyhook Holdings, Inc.
- cebert 1 year agoIt looks like Skyhook Holdings was recently acquired by Qualcomm according to their website. I wonder if this was more for their IP and patents rather than product(s).
- sapiosenses 1 year agoI think it was for products too (eg Qualcomm is currently doing a heavy push of their IoT products where Skyhook is a central piece) but I'd also like to know if the legal landscape changed after the acquisition.
Especially considering Qualcomm's relationship with many device makers and the OS platforms.
- sapiosenses 1 year ago
- cebert 1 year ago
- nanis 1 year agoThe rather troubling part of this announcement in a GitHub issue is that this nugget comes out in a seemingly innocuous comment[1]:
>> Firefox still uses MLS for `browser.region.network.url`; will that also move to Google Location Services?
> This endpoint will be migrated to another service (classify-client) that will return the expected response. We'll adjust DNS entries when it's time to make that move so firefox won't see any difference.
What exactly is this "classify-client" service?
Note also this led me to discover for the first time that this is a thing[2]:
> Geolocation for default search engine
> In order to set the right default search engine for your location, Firefox will perform a geolocation lookup once by contacting Mozilla's servers and store the country-level result locally. This connection happens on the first start of Firefox – in case you want to prohibit that, you will have to preconfigure the browser and set the browser.search.geoip.url preference to a blank string.
Also related is [3].
[1]: https://github.com/mozilla/ichnaea/issues/2065#issuecomment-...
[2]: https://support.mozilla.org/en-US/kb/how-stop-firefox-making...
[3]: https://old.reddit.com/r/firefox/comments/iq27wa/disabling_l...
- codethief 1 year agoclassify-client is probably this project: https://github.com/mozilla/classify-client
Looks like it depends on a GeoIP database.
- joveian 1 year agoSearching for the file name the default database seems to be MaxMind's free database:
https://dev.maxmind.com/geoip/geolite2-free-geolocation-data
They are the comany that infamously set the default US location to a farm in Kansas, causing all sorts of trouble for the people who live there. From the file name it sounds like classify-client is by default only trying to identify the country you are in.
I'm not seeing a browser.search.geoip.url setting, however I have geo.enabled set to false and various other setting that might cause that to not be present.
- pests 1 year agoDefault, or center?
- pests 1 year ago
- joveian 1 year ago
- kps 1 year ago>> Firefox still uses MLS for `browser.region.network.url`; will that also move to Google Location Services?
Is that the latest rename of `geo.provider.network.url`? And if so, have they changed the json format again too? I set that manually on my desktop because Mozilla's regularly put me far away (and in a different legal jurisdiction).
- 1 year ago
- codethief 1 year ago
- vrinsd 1 year agoI think this is a good thing in the long-run.
Relying on WiFi access points to geolocation was always a bit of a hack and in my experience it's allowed phone manufacturers to roll back on the quality of their satellite-based GPS implementations and worsened phone battery life ; now the phone is constantly scanning for WiFi access points and Bluetooth and shuffling that data back to the mothership(s) on the user's data plan.
My old Samsung S4 could get a GPS lock (sans Internet, WiFI, in airplane mode) in doors usually in < 30s. I had a few different iPhones, 6, 6S, 7 and XS where GPS wouldn't reliably work unless it had "network" (Internet) connectivity due to the reliance on WiFi-geolocation. Similar experience with Pixel 3's, with noticable improvements on Pixel 4s satellite GPS acquisition time.
For Android phone users, if you can use a slightly older version of microG (due to some recent unfortunate change microG made making the use of other backends more difficult), I found this backend to consistently be the best:
https://f-droid.org/en/packages/org.fitchfamily.android.gsml...
The above backend lets you use a database of CELL TOWER IDs to speed up location acquisition. As you might expect, cell phone towers rarely (ever?) move and even without a SIM card or celluar connectivity, a phone can scan for CELL IDs.
The other cool thing about this backend is it can create the database from the phone, or you can do it offline on a PC and push a sqlite.db file to phone. I suggest the PC route, the script is pretty simple to understand and you can filter out countries that might not be relevant to you.
And f** Skyhook.
- daedalus_j 1 year agoThe service has indeed been getting worse and worse over the last few years. In the tools I've got that use it the number of inaccurate hits I've gotten has been increasing. People who move and keep their same wifi gear seem to be the cause of it. Then it happened to me when I moved, and I tried to find a way to update MLS and couldn't, so my Linux laptops can no longer be set to automatic time zone mode, or they revert back to my old time zone whenever I'm at home...
I very much hope they release the information about which patents are a problem so that future attempts at a service like it can hopefully avoid that problem, but considering the state it's been in I'm not terribly upset that it'll be shutting down.
- seba_dos1 1 year ago> and I tried to find a way to update MLS and couldn't
Up until a few days ago when the submission service was turned off on MLS side, it was just a matter of setting `submit-data=true` in geoclue.conf and going for a walk.
- daedalus_j 1 year agoTrue, I do recall that! But you'd have a buy a usb/Bluetooth GPS to plug in to your laptop I think, there was no android option. In the end I just decided it wasn't worth it, my laptops can just be manually placed in my home timezone.
- seba_dos1 1 year agoGeoclue works on phones too (which is how I contributed data about my neighborhood, which resulted in instant massive improvement for all my devices), and for Android there are apps like Tower Collector that let you do it as well [edit: though on second look, it seems like it only collects cellular stations and not WiFi APs]
- seba_dos1 1 year ago
- daedalus_j 1 year ago
- seba_dos1 1 year ago
- cpeterso 1 year agoI helped stand up MLS and worked on the Android "stumbler" submission app. The original motivation for MLS was to provide a free location service for carriers that would potentially ship Firefox OS devices but not want to pay for Google's or Qualcomm's location services.
We always wished we could release the Wi-Fi location data, but there were privacy and safety concerns. Google was sued in Germany for recording Wi-Fi access points' locations and some data packets. And we were considering publishing similar location data, which would be an even bigger liability. The Google lawsuit lead to a lame opt-out system: to opt out of Google's Wi-Fi mapping, you're supposed to append "_nomap" to your SSID. To opt out of Microsoft's Wi-Fi mapping, you're supposed to append "_optout" to your SSID. I'm not sure how you're supposed to do both. MLS honored both "_nomap" and "_outopt" anywhere in the SSID string, filtering out those access points from submissions and lookup requests on both Mozilla's clients and server side.
A potential safety concern for releasing the MLS location data was the "stalker scenario": if you knew someone's access point MAC address and they moved, you might be able to find their new location by looking up their MAC address in the location database. This scenario was less of concern for lookup requests to the MLS server server because lookups include a list of MAC addresses that the client sees. The server returns an average of those neighboring MAC addresses' locations, but shouldn't return the location of an individual MAC address. (I don't know if MLS currently implements this restriction.)
Another protection (not implemented, AFAIK) could be to require lookups to include the SSID that matches a known MAC address and SSID pair. This would allow an access point's owner to change their SSID so lookups using the old SSID don't return the new location.
I thought we might be able to release the location database leveraging that restriction of requiring multiple MAC addresses. Instead of releasing a database mapping raw MAC addresses to locations, the database would map hashes of MAC1 + SSID1 + MAC2 + SSID2 to locations. Offline database lookups would need to know the MAC addresses and current SSIDs of two access points that had previously been seen together. I'm not a cryptographer, so there's probably some hole in this idea. :) It would also significantly increase the size of the database.
Requiring lookups to include multiple MAC addresses and matching SSIDs could also reduce the impact of poisoned location submissions because lookups (online or offline) would only see poisoned data if they included multiple poisoned MAC addresses and valid matching SSIDs pairs that can previously been submitted as neighbors. Poisoned data in the database doesn't affect clients that don't fetch it. :)
Another way to reduce the impact of poisoned location submissions could be to filter out submitting clients' new access point locations outside the submitting client's GeoIP region.
A neat trick from lookups including multiple access points is that the service can learn about new access points and their locations. If the service has seen MAC1 and MAC2 before and a client's lookup says they see MAC1, MAC2, and MAC3, the service can return the location average of MAC1 and MAC2 and tentatively record that new MAC3 exists at that average location and is a neighbor of MAC1 and MAC2.
- 1oooqooq 1 year agowe all know that feature only existed because it was the bundle of things google feared getting in trouble for.
mozilla was google henchman for over a decade. and nobody here will even grasp the size of the impact.
- andybak 1 year agoAnyone know where on the spectrum of "Fair enough. That's clever" to "Oh come on! FFS..." these patents fall?
- Angostura 1 year agoPretty sure Apple use Skyhook - or at least they used to for geolocation
- BuckGup 1 year agoSo how does Skyhook still work for iPhones? Apple made the mac addresses private on IOS14 and they rotate every 24hrs to prevent wifi tracking. So did Apple make the data private to then be able to sell themselves to Skyhook? Seems like it
- Angostura 1 year agoApple uses/used Skyhook to geolocate where a Wifi network was- that's it.
- Angostura 1 year ago
- lxgr 1 year agoI suspect it's by now a crowdsourced database as well: Updates seem to happen way too frequently to make manual car-based tracking plausible.
Skyhook might still be running the actual database and augmenting it with their own manual scans, though, but I strongly suspect that any Apple device with GPS is contributing its location data back to it.
- kevin_b_er 1 year agoSkyhook apparently threatens companies that try to crowdsource such things, case in point Mozilla. So, you're either paying off the patent troll or using their services.
- lxgr 1 year agoWhat I mean by crowdsourcing here isn't Apple bootstrapping a parallel database, either using Skyhook or their own GPS-only data, but rather them feeding into Skyhook. I'd be very surprised if Skyhook was opposed to that.
Given the ubiquity of Apple devices, I wouldn't even be surprised if Skyhook paid Apple at this point.
- lxgr 1 year ago
- kevin_b_er 1 year ago
- BuckGup 1 year ago
- Animats 1 year agoWill that break Mozilla UnifiedNip Backend on Android?
- sapiosenses 1 year agoYep.
But it's academic at this point. The MLS data had been going stale for 2-3 years now, I stopped using it ~2 years ago because of how inaccurate it had become.
If you're using microG GMSCore prior to 0.2.28.xxxx, you can use various other UNLP backends that can still give good results.
But for 0.3.0.xxxx and newer, it relies solely on the MLS db as well as some more obscure methods that don't help most people. Many in the microG community are hoping that gets greatly improved going forward.
- sapiosenses 1 year ago
- wkat4242 1 year agoCrap. This was so great with microG :(
- onli 1 year agoFuck. I just last year integrated this in a project of mine. Thinking: "Yeah, Google fucked me over here before when I used their, but it's Mozilla, it will be fine."
It is not okay to stop providing a service like this. Not if you are Mozilla, with that mission and money, not something that is so deeply entrenched. Though, reading it more calmly, I can see how them being hit by a patent troll can make their investment in this project untenable.
There is a comment about the Graphene Foundation maybe providing an alternative. That would be great - but having https://www.youtube.com/watch?v=4To-F6W1NT0 in mind, with that maintainer still active the project and foundation is a complete no-go. The organic maps comment is the one to follow instead.
- deprecative 1 year agoMozilla is funded by Google. Mozilla doesn't seem to have much of a clue what it ought to be doing, either. I use Firefox, but I wouldn't trust anything else to last unfortunately.
- Devasta 1 year ago> Mozilla doesn't seem to have much of a clue what it ought to be doing, either.
They know exactly what their purpose is: to provide a figleaf that Google can point when facing allegations that they control the browser market.
- echelon 1 year agoThis is the only purpose for Mozilla: a convenient ruse for distracting regulators.
If Google thought they didn't need this ploy, Mozilla would be snuffed out.
- echelon 1 year ago
- berkes 1 year ago> Mozilla is funded by Google
You aren't saying it, but it is implied or can easily misread as such. But Google is not directly funding Mozilla.
Mozilla gets its funds from many places, and one of them is Google; paying for being the default search engine. It's by far the largest amount. But not the only, nor a direct funding.
- eganist 1 year ago> But not the only, nor a direct funding.
Being paid directly for a service by a company (Google paying for the privilege of being the default) is to be directly funded by that company. You're right that it's not the only source of revenue, but it's absolutely a direct source of funding.
- rglullis 1 year ago> It's by far the largest amount.
Without Google funding, Mozilla wouldn't be able to maintain its operations. That is more than enough to treat the "Mozilla is funded by Google" statement as objectively true.
- eganist 1 year ago
- Devasta 1 year ago
- lxgr 1 year agoCan you summarize the concerns addressed in that video, or is there a text source?
- onli 1 year agoEasy to write a summary that would risk being banned for ;) But that basically says it all, the user hostile and insulting behavior and his vendetta against projects he hallucinates at somehow being hostile to him - completely delusional - makes the project something that never should be on anyone's hardware, especially not something security relevant. That guy would have root.
But best to watch the video, there are a plethora of sources.
Last time I wrote something like that here someone else from GrapheneOS accused me of being unfair, since he is out by now - now I see the old maintainer writing in the name of the foundation and that he still commits to the project.
- codethief 1 year ago> since he is out by now - now I see the old maintainer writing in the name of the foundation and that he still commits to the project.
What do you mean? At least to me knowledge, Daniel Micay has been the maintainer of GrapheneOS throughout (from day 1 until now).
- codethief 1 year ago
- onli 1 year ago
- wkat4242 1 year agoGrapheneOS doesn't use this though on Android. microG does but they hate microG with a passion, for some reason. They have their sandboxed Google play as an alternative.
- 1 year ago
- Yoric 1 year agoWell, money can be used to power a service that (almost) nobody uses, or to power services that Mozilla hopes will be more useful.
I, for one, had assumed that this service had been retired ages ago.
- dingensundso 1 year agoA lot of people running degoogled androids depend on the location service: https://github.com/microg/GmsCore/issues/2237
- onli 1 year agoImho that location service is an important piece of infrastructure for web apps that need IP geolocation, especially for FOSS software given that there is no alternative, and useful for Android without Google services. Both things Mozilla should support.
- bananapub 1 year ago> an important piece of infrastructure for web apps that need IP geolocation
er, isn't it entirely for physical location based on wifi and mobile network towers?
- bananapub 1 year ago
- tehbeard 1 year ago> ...power services that Mozilla hopes will be more useful.
Hmm, more likely to end up as another C-level bonus/salary bump.
- thayne 1 year agoOr another project that nobody wants that gets shut down after a couple years.
- thayne 1 year ago
- pona-a 1 year ago"Nobody uses"...
Do you understand what you just said? Raw GPS is universally unusable, requiring up to half an hour of waving your phone under clear sky, hoping it a) will actually work; b) will not loose signal; c) will not drain the battery before you reach your destination.
The only way to get reasonable estimation of location? Location services. Guess who are the only providers? About 5 or something companies, all with expensive licenses and weird terms of use.
And here comes Mozilla, providing this same expensive exclusive service for free as a convenient API. Just send some WiFi SSIDs and signal strength, cell towers, and Bluetooth devices, and without even having to turn on the actual GPS, you get a faster, more accurate estimate of geolocation, down to a few meters.
This service is vital to mobile Linux or even deGoogled Android or non-Chrome browsers. In its time Canonical had to plead with Here maps for years to give their devices proper GPS. To say a project unique in its entire domain on which hinges the existence of entire ecosystems is less important than a yet VPN or email alias service seems downright silly.
Besides, it's not like Mozilla did it on their own volition. A patent troll had come to destroy their competitor on shaky legal footing, knowing they won't fight back...
- overstay8930 1 year agoWhat year did you last use GPS, it’s even usable deep within cities now. Modern devices use GPS, GLONASS, GALILEO, and various regional ones too. Locking on is super fast and it’s hard to lose unless you walk inside of a big building. I can even get a good GPS lock inside my house, it’s really good these days.
You’re right that it can use more power, but it’s really not that bad with modern hardware.
- traceroute66 1 year ago> Raw GPS is universally unusable, requiring up to half an hour of waving your phone under clear sky,
Sigh. The increasing amount of unsubstantiated FUD finding its way on to HN recently is depressing.
Two glaringly obvious points to make at your nonsense:
1. What you describe is ancient history. It applied to old previous-generation devices with single-frequency chipsets (L1 GPS signals). However, effectively 100% of devices released within the last 3–5 years (and more in the case of certain manufacturers !) (a) have L1,L2,L5 GPS chipsets and (b) have multi-frequency GPS chipsets whch work not only with the "original" GPS but also Galileo, QZSS and others.
2. Even if we accept your argument, which we should not, then the rapid adoption of Apple's FindMy network (and the equivalent for Google) surely cannot have escaped your attention ? These serve to increase accuracy.
The reality is there is fast becoming no need for a third-party service such as the one Mozilla provided, because there is now first-class support for sufficiently robust high-accuracy positioning.
- ianburrell 1 year agoAGPS provided by the mobile carriers is sufficient. It is downloading the ephemeris that is slow, not getting the fix. That isn't considered Location Services.
You could test this by disabling WiFi, downloading AGPS from mobile, and then driving to place without service or putting in airplane mode. GPS fix will be fast cause ephemeris is good for days and corrections are small.
- 1 year ago
- overstay8930 1 year ago
- dingensundso 1 year ago
- 1 year ago
- deprecative 1 year ago
- ktosobcy 1 year agoWho the F is Skyhook) Holdings? :-\