What you need to keep in mind is that if you have more than a handful of locations that you need to get rid of, scrolling through a never-ending list of locations that you need to get rid of is not the option that might be one of your choices. To get a glimpse at the location history of all the devices that are connected to your Google Account, you can take a look at your Google Maps history dashboard. This will be available to you on the browser in your computer. You can take a look at your Google Maps history and then adjust the location settings on your phone accordingly.