OSM, Open Data and Geeks required

For all high tech electronic equipment including GPS, PLB, chargers, phones, computers, software. Discussion of simple electrical devices such as torches, belongs in the main 'Equipment' forum.

OSM, Open Data and Geeks required

Postby tastrax » Mon 23 Mar, 2015 11:19 am

Hi Folks,

Seems to me that the Australian Government and most states are now starting to release much of their spatial data in "Open Data" sites on the web. Most seem to have suitable licencing for use in Open Street Mapping. Now we all love free maps, but how on earth do we get this stuff into OSM mapping for all to see. I am a bit of a geek and would love to work with other geeks to get suitable material into the system for the benefit of bushwalkers as well as other users (like Red Cross ... whilst wearing my other volunteer hat).

Has anyone done any bulk imports?

Open data I have found so far.

http://listdata.dpiwe.tas.gov.au/opendata/
https://data.sa.gov.au/dataset
http://data.nsw.gov.au/data/dataset
https://data.qld.gov.au/dataset
Cheers - Phil

OSM Mapper
User avatar
tastrax
Lagarostrobos franklinii
Lagarostrobos franklinii
 
Posts: 2048
Joined: Fri 28 Mar, 2008 6:25 pm
Location: What3words - epic.constable.downplayed
ASSOCIATED ORGANISATIONS: RETIRED! - Parks and Wildlife Service
Region: Tasmania

Re: OSM, Open Data and Geeks required

Postby GPSGuided » Mon 23 Mar, 2015 5:13 pm

Good on you! I have only participated in dumb dumb entries into OSM and that's the limit of my technical know-how to date.
Just move it!
User avatar
GPSGuided
Lagarostrobos franklinii
Lagarostrobos franklinii
 
Posts: 6968
Joined: Mon 13 May, 2013 2:37 pm
Location: Sydney
Region: New South Wales

Re: OSM, Open Data and Geeks required

Postby michael_p » Mon 23 Mar, 2015 6:40 pm

I've done over 1000 manual edits but have never done a bulk import. Can't say I know anything about doing a bulk import. It's worth having a read through the wiki on bulk imports: http://wiki.openstreetmap.org/wiki/Import. Reading the wiki it seems to be a bit of a convoluted process.

Cheers,
Michael.
One foot in front of the other.
User avatar
michael_p
Athrotaxis selaginoides
Athrotaxis selaginoides
 
Posts: 1379
Joined: Sun 15 Nov, 2009 6:58 pm
Location: Macarthur Region of Sydney.
Region: New South Wales
Gender: Male

Re: OSM, Open Data and Geeks required

Postby Bubbalouie » Mon 23 Mar, 2015 7:36 pm

tastrax wrote:Hi Folks,

Seems to me that the Australian Government and most states are now starting to release much of their spatial data in "Open Data" sites on the web. Most seem to have suitable licencing for use in Open Street Mapping. Now we all love free maps, but how on earth do we get this stuff into OSM mapping for all to see. I am a bit of a geek and would love to work with other geeks to get suitable material into the system for the benefit of bushwalkers as well as other users (like Red Cross ... whilst wearing my other volunteer hat).

Has anyone done any bulk imports?

Open data I have found so far.

http://listdata.dpiwe.tas.gov.au/opendata/
https://data.sa.gov.au/dataset
http://data.nsw.gov.au/data/dataset
https://data.qld.gov.au/dataset


Looks pretty workable (looking at it on my phone mind you). They have an API & some established exchange formats.

I've got no experience with OSM and editing or uploading. However, I've got plenty of experience writing software to do things like format shifting and interfacing to web sites.

Do you have experience with the OSM API or any of the bulk uploader scripts they've got? How about just editing and their review process?
Bubbalouie
Athrotaxis cupressoides
Athrotaxis cupressoides
 
Posts: 420
Joined: Tue 03 Sep, 2013 11:22 pm
Region: South Australia
Gender: Male

Re: OSM, Open Data and Geeks required

Postby icefest » Mon 23 Mar, 2015 9:50 pm

Look at that cc 1 arc second srtm hydrologically enforced dem data :) http://data.gov.au/dataset/d3687cf1-b4b ... 5179e3c879
Men wanted for hazardous journey. Low wages, bitter cold, long hours of complete darkness. Safe return doubtful.
User avatar
icefest
Lagarostrobos franklinii
Lagarostrobos franklinii
 
Posts: 4479
Joined: Fri 27 May, 2011 11:19 pm
Location: www.canyoninginvictoria.org
Region: Victoria

Re: OSM, Open Data and Geeks required

Postby Bubbalouie » Mon 23 Mar, 2015 10:54 pm

Creative commons license :)

Can't view it though, getting 500 error :(

I assume this is every river/creek/lake in the country as a vector map with an accuracy of 30m? (sorry, I personally know very little about these things)
Bubbalouie
Athrotaxis cupressoides
Athrotaxis cupressoides
 
Posts: 420
Joined: Tue 03 Sep, 2013 11:22 pm
Region: South Australia
Gender: Male

Re: OSM, Open Data and Geeks required

Postby tastrax » Tue 24 Mar, 2015 2:12 pm

OK so it looks like most of us are just casual editors. I will also ask the question on a couple of other forums and try and round up some other geeks.

Bubbalouie - I am just a casual editor with no idea on API's etc. I do have GIS experience and can do plenty of manipulation of the open data to get it into a form that could be ready for importing
Cheers - Phil

OSM Mapper
User avatar
tastrax
Lagarostrobos franklinii
Lagarostrobos franklinii
 
Posts: 2048
Joined: Fri 28 Mar, 2008 6:25 pm
Location: What3words - epic.constable.downplayed
ASSOCIATED ORGANISATIONS: RETIRED! - Parks and Wildlife Service
Region: Tasmania

Re: OSM, Open Data and Geeks required

Postby Son of a Beach » Wed 25 Mar, 2015 8:15 am

After having complained about Tas gov making it impossible for Tasmanians to get good access to our own spatial/geographic data for so many years, I'm very impressed with the way they've opened up over the last year or so. It's such a breakthrough to be able to make good use of our own data.

Sorry, I too know very little about OSM. I'm just an occasional casual user.

But I've been having some fun over the last few weeks playing with the LIST opendata: http://map.nixanz.com/
Of course, the new LISTmap is also excellent. You can add your own points/lines/etc to it, and print off your own maps from there.

Currently their open data doesn't include mountains/peaks and is missing some other nice-to-have datasets. I queried them about this just last Monday, and received a reply from them yesterday:
DPIPWE wrote:The good news is more of our datasets will be available for download mid to late April which will include the Nomenclature (Placenames) dataset that includes Mountain names. The bad news is we are not the custodians of the Forestry Groups data so that one will not be there

(I had queried the availability of mountains, and vegetation groups.)
Son of a Beach
Lagarostrobos franklinii
Lagarostrobos franklinii
 
Posts: 7024
Joined: Thu 01 Mar, 2007 7:55 am
ASSOCIATED ORGANISATIONS: Bit Map (NIXANZ)
Region: Tasmania
Gender: Male

Re: OSM, Open Data and Geeks required

Postby andrewp » Wed 25 Mar, 2015 8:19 am

Some of this look quite interesting, especially the hydro data which is currently very lacking in OSM. However IMO a bulk upload would not be a good idea. It would create duplicate and unwanted data.

Most of it seems to be in shapefile format. JOSM reads shapefiles.
User avatar
andrewp
Athrotaxis cupressoides
Athrotaxis cupressoides
 
Posts: 274
Joined: Mon 29 Aug, 2011 10:34 am
Region: Victoria
Gender: Male

Re: OSM, Open Data and Geeks required

Postby andrewp » Wed 25 Mar, 2015 8:29 am

Can't view it though, getting 500 error :(

I assume this is every river/creek/lake in the country as a vector map with an accuracy of 30m? (sorry, I personally know very little about these things)


I don't think this is a map of creeks. I think it is DEM data that has been modified to ensure that the elevations are correct for water flow. If you look at the raw SRTM DEM you will find that creeks flow uphill in places.

IMO this is not useful for OSM.
User avatar
andrewp
Athrotaxis cupressoides
Athrotaxis cupressoides
 
Posts: 274
Joined: Mon 29 Aug, 2011 10:34 am
Region: Victoria
Gender: Male

Re: OSM, Open Data and Geeks required

Postby Son of a Beach » Wed 25 Mar, 2015 9:08 am

Not sure about the other sources but the Tasmanian (LIST) data is available in a variety of formats, including ESRI shapefiles, ESRI file GDB, MapInfo.

Any decent spatial software can read any of these formats. You can download free tools for a variety of platforms to query them and convert them too (see http://trac.osgeo.org/gdal/wiki/DownloadingGdalBinaries ).
Son of a Beach
Lagarostrobos franklinii
Lagarostrobos franklinii
 
Posts: 7024
Joined: Thu 01 Mar, 2007 7:55 am
ASSOCIATED ORGANISATIONS: Bit Map (NIXANZ)
Region: Tasmania
Gender: Male


Return to Techno-Babble

Who is online

Users browsing this forum: No registered users and 23 guests