USGS 3DEP LiDAR Point Clouds

January 24, 2019 ยท View on GitHub

================================================================================ USGS 3DEP LiDAR Point Clouds

.. contents:: Contents :depth: 2

Project Description

This AWS Public Dataset project is about processing the USGS 3DEP LiDAR point cloud data into a form that is cloud-friendly, streamable, lossless, and convenient.

The main landing page on AWS for the project is at https://registry.opendata.aws/usgs-lidar/

Public 3DEP LiDAR data is available in two forms on AWS:

  1. A Requester Pays <https://docs.aws.amazon.com/AmazonS3/latest/dev/RequesterPaysBuckets.html>__ bucket at s3://usgs-lidar containing many of the USGS resources available as full-density LASzip_ tiles

  2. A public access bucket at s3://usgs-lidar-public containing EPT resources mirroring many (but not all) of the resources in #1.

Entwine ................................................................................

A description of the EPT_ format, which is a hierarchical format arranged by progressive level-of-detail, is contained at https://entwine.io/entwine-point-tile.html. EPT was chosen as the service mechanism for this data due to its scalability potential to trillions of points, flexibility, and its ease of use via open source infrastructure like PDAL, LASzip, Potree, and Plasio.js.

To generate EPT datasets for your own data with Entwine, visit the quickstart <https://entwine.io/quickstart.html>__ and browse the configuration documentation <https://entwine.io/configuration.html>__ for more advanced usage.

Processing ................................................................................

Data processing with Entwine_ was performed on AWS EC2 c5d.9xlarge instances using S3 <https://aws.amazon.com/s3/>__ for output storage. Currently, there are more than 10 trillion LiDAR points available in over 950 distinct resources.

Visualization ................................................................................

The point cloud data may be visualized with Potree_ or Plasio.js_ via the index at http://usgs.entwine.io.

Coordinate System ................................................................................

The EPT data is accessible via EPSG:3857 <https://epsg.io/3857>__ for ease of web usage - with PDAL the data can be reprojected on the fly with the reprojection filter <https://pdal.io/stages/filters.reprojection.html>__ which can be used in combination with other processing pipeline stages.

The EPT reader <https://pdal.io/stages/readers.ept.html>__ within PDAL_ may also be used to select areas of data for use locally.

  • Entwine_
  • PDAL_ readers.ept_
  • Potree_
  • Plasio.js_

.. _readers.ept: https://pdal.io/stages/readers.ept.html .. _Potree: http://potree .. _Plasio.js: https://github.com/hobu/plasio.js

Support

Thank you to the multiple organizations that have supported the development of the USGS 3DEP LiDAR dataset.

USACE CRREL ................................................................................

.. image:: ./images/rsgis_logo.png :target: http://www.erdc.usace.army.mil/Locations/CRREL.aspx :scale: 30%

The US Army Corps of Engineers Remote Sensing / GIS Center of Expertise at CRREL_ sponsored the processing and development of the AWS 3DEP Public Dataset_ in multiple ways. First, it sponsored the development and continuing support of PDAL_ and Entwine_ open source software libraries, which were used to process and manage the data. Second, it supported the processing and management of the 3DEP data to an Entwine Point Tiles_ public dataset.

Amazon Web Services Public Datasets Team ................................................................................

.. image:: https://d0.awsstatic.com/logos/powered-by-aws.png :target: https://registry.opendata.aws :scale: 30%

The AWS Public Datasets Team supported the effort by providing processing and storage grants for the development of the EPT_ data and ongoing support by making access to that data publicly available.

Hobu, Inc. ................................................................................

.. image:: ./images/hobu-logo-2C-white.png :target: https://hobu.co :scale: 30%

Connor Manning_ from Hobu, Inc._ constructed the 3DEP EPT resources with cloud processing and management tools from Hobu, Inc._.

.. _Connor Manning: http://github.com/connormanning/ .. _Hobu, Inc.: https://hobu.co .. _Entwine: https://entwine.io .. _PDAL: https://pdal.io .. _CRREL: https://www.erdc.usace.army.mil/Locations/CRREL.aspx

.. _Entwine Point Tiles: https://entwine.io/entwine-point-tile.html .. _EPT: https://entwine.io/entwine-point-tile.html .. _LASzip: https://laszip.org

.. _AWS 3DEP Public Dataset: https://registry.opendata.aws/usgs-lidar/