Australian Geoscience Data Cube

Presenter: Alexis McIntyre, Geoscience Australia

Wednesday, 16 November 2016

The Australian Geoscience Data Cube provides an integrated gridded data analysis environment for decades of analysis ready earth observation satellite, and related data from multiple satellite and other acquisition systems. It hosts the Australian Landsat Archive and other national Earth Observation collections, alongside access to gridded datasets such as rainfall and elevation.

This webinar demonstrates how to access the Australian Geoscience Data Cube using the Virtual Desktop Infrastructure (VDI) at the National Computational Infrastructure (NCI). By the end of the webinar you will be able to access national collections of Earth Observation data on the NCI, and use the Australian Geoscience Data Cube in a virtual desktop environment on the NCI.

To follow the presentation examples you will need to set up an account on the NCI, and set up access to the Virtual Desktop Infrastructure (VDI). Use project wd8 to sign up via https://nci.org.au/access/user-registration/register-new-user. Instructions on how to set up access to the VDI are available at http://vdi.nci.org.au/help. The Jupyter notebook used in the webinar can also be viewed here.

Joining project wd8 allows visualisation of all AGDC data on the NCI via the VDI, but restricts storage and computing abilities. If extra storage and computing resources are required in the future, this should be discussed with the AGDC or NCI teams. The AGDC can also be accessed within the High Performance Computing (HPC) environment (i.e. Raijin), and all users with computing quotas on Raijin are able to access the AGDC through the HPC system.

(Recording contains audio and visual [.flv file 106MB])

More resources:

• What is the Australian Geoscience Data Cube?

• Code Documentation

• Loading the AGDC module on the NCI

• How-to Guide

• Jupyter notebook examples

• Source code

• join the AGDC mailing list

• Slack channel. (There is a link to sign-up, however if you are not part of an approved domain you will need an invitation. Please send a request to earth.observation@ga.gov.au.)

• NCI data catalogue (which provides links to the metadata in the NCI GeoNetwork, and the data in THREDDS.) 

Accessing AusCover Data Webinar

Presented by Peter Scarth
Joint Remote Sensing Research Program

Thursday, 21 July 2016

Abstract

This webinar will give several examples using direct access using opendap on thredds and gdal/rasterio on thredds and http where you'll be able to query and directly interact with Landsat, MODIS and Himawari datasets in both iPython notebooks and in GIS packages. By the end of the webinar, you’ll be able to discover some of the many data sets openly available on the NCI and query them using web services.

For these examples I'll be using a Jupyter Notebook with code in Python.

• The Jupyter Notebook is a web application that allows you to create and share documents that contain live code, equations, visualizations and explanatory text and has support for over 40 programming languages, including Python, R, Julia and Scala.
• If you've never used Jupyter Notebooks before, I highly recommend installing Anaconda.
• As an aside, many of the packages used by JRSRP and partners, such as RIOS, RSGISLIB and PyLidar can be installed into this environment from the OSGEO Conda index.

This notebook will outline some simple online interaction with some of the JRSRP Landsat seasonal mosaics. We'll treat the data hosted on qld.auscover.org.au as files and use the RasterIO package to interact with the data and undertake some typical remote sensing tasks. Finally we'll build a simple example to extract and analyse a time series of imagery across an agricultural research property in the Burdekin (from ~5 TB of raster data hosted online).

Then we'll look at how you'd access some of the GA Landsat data produced out of the AGDC and hosted on the NCI using the OPeNDAP protocol via THREDDS. Link to Hosted Notebook.

Finally we'll check out a pretty cool notebook that uses the NCI THREDDS Data Server and queries the CSIRO Auscover MODIS data sets to extract a time series of imagery. Link to hosted Notebook.

You will find all instructions and code at github.com/AusCover/aeoccg-examples.

Recording contains audio and visual [.flv file 70 MB]