Peter Berger, Paul Meysembourg, Jim Sales, and Carol Johnston

TOWARDS A VIRTUAL REALITY INTERFACE FOR LANDSCAPE VISUALIZATION


ABSTRACT

A prototype virtual reality interface which combines the visualization capabilities of virtual reality with the spatial display capabilities of GIS is described. Satellite-derived landcover databases are draped over a DEM-derived topographic frame for EPA's Mid-Atlantic Integrated Assessment (MAIA) area. Trees are depicted as three-dimensional objects, corresponding with forested covertypes, and other land covers are represented by different colors and textures. The user can specify a vehicle (e.g. airplane, all-terrain machine) and a path for travel, viewing landscape features from different perspectives.

INTRODUCTION

Geographic Information Systems depict spatially-distributed data as they would be shown on a map: two-dimensional surfaces viewed from nadir via a high platform, with spatial objects represented by different patterns and colors. However, humans located in an actual landscape view features much differently: the land surface is undulating, vegetation is three-dimensional and has characteristic structures, objects appear smaller in the distance, and features are located above, below, and around the observer. Consequently, many people find it difficult to visualize the data represented by a GIS.

We are developing a software interface which combines the visualization capabilities of virtual reality with the spatial display capabilities of GIS. Landscapes are rendered as perspective views using actual elevation and land cover data, such that they depict realistic scenery. The user can specify a vehicle (e.g. airplane, all-terrain machine) and a path for travel, viewing landscape features from different perspectives. We use the term "virtual reality" to denote a system which provides the tools for users to interact with a simulated environment, but not necessarily in real time.

The ultimate goal of the research is to develop a prototype virtual reality interface with data from the Mid-Atlantic Integrated Assessment (MAIA) region, in support of the U.S. EPA's Environmental Monitoring and Assessment Program EMAP). The MAIA region falls in the states of PA, VA, WV, DE, NJ, and MD, and the District of Columbia, and includes the entire Chesapeake Bay watershed. Virtual rendering is being accomplished with two basic datasets: (1) digital elevation models (DEMs), and (2) land cover data derived from classified satellite imagery. Specific technical objectives are:

1. Interface DEM with virtual reality software.
2. Drape classified land cover over DEM.
3. Set camera location, elevation, and view angle.
4. Render image, enabling 3-D structures.

METHODS

Software

In order to provide results quickly, we used an existing, inexpensive (~$100 US) virtual reality program, Vistapro 3.13 for DOS (Virtual Reality Laboratories, Inc., 2341 Ganador Ct., San Luis Obispo, CA 93401), which we ran on a Pentium P5-133 Intel based PC running DOS 6.2, with 16 mbytes of ram and 2 gigabytes of hard disk storage. Versions of Vistapro are also available for PC Windows and Macintosh platforms. Vistapro is a software package for three- dimensional landscape simulation that can use U.S. Geological Survey Digital Elevation Model (DEM) files to accurately recreate real world landscapes. It is a single frame generator, meaning that it acts like a camera; at intervals along a user-specified flight path, Vistapro points and clicks the camera, rendering a new view of the landscape. The individual frames are displayed in rapid succession to make "fly-bys" appear animated. The Vistapro package also comes with a freely distributable "player" program which allows a virtual world developer to make copies available to users who do not own Vistapro. The player provides capabilities for exploring the virtual world but not modifying it.

Vistapro renders realistic scenary by level slicing the landscape color palette to realistically shade cliffs and hills. It does this through user definable variables, a rules system, fractals, and chaotic math to add non-uniform textures to the rendering (Virtual Reality Laboratories, 1993). Lifelife landscapes are depicted despite a limited number of possible terrain types: water, beach, vegetation, bare, snow, cliff, and buildings.

Input data for defining landscapes can be DEMs and/or PCX files. PCX is a standard graphic file format commonly used by Paint programs in Windows applications. Landscapes can be built using only DEMs, only PCX files, or a combination of both. When only DEMs are used, terrain types are defined based on elevation (Fig. 1). For example, low, intermediate, and high elevations could be defined as water, vegetation, and snowfields, respectively. Alternatively, the white and tan colors of snowfields and bedrock on a PCX- format aerial photo of a mountaintop could be used to define those areas as user-defined elevation ranges, as well as terrain types. When both DEM and PCX files are used, the DEM is used to generate topography, and the PCX file is used to generate land cover.

Although Vistapro generally worked well for our purposes, importing GIS data into Vistapro was not straightforward, requiring the development of special protocols and the use of other software packages to pre-process the data (see Results).

Datasets

Initial testing and rendering was done with a DEM supplied by Vistapro of Crater Lake, Oregon, which allowed us to quickly generate realistic pictures and fly-bys of the region. After perfecting procedures for importing and exporting the supplied DEM, we learned how to import and export eight 7.5 minute USGS DEM's of Voyageurs National Park, which were not native Vistapro files and therefore posed additional challenges. Use of these data allowed us to develop procedures for joining adjacent DEMs to render larger and larger regions, a capability required to display scenes from throughout the multi- state MAIA region. Ultimately, we used four 1:250,000 USGS DEMs centered over the MAIA region (Williamsport East, Harrisburg East, Scranton West, Newark West), which were obtained via ftp from the U.S. Geological Survey Home Page (http://www.usgs.gov/). Each 1:250,000 file covers a 1 x 1 degree block at a data resolution of approximately 90 x 90 meters at this latitude.

Two types of land cover data, both derived from satellite imagery, were draped over the DEM-generated landscape: (1) the Conterminous U.S. AVHRR Global Data Set, and (2) the Chesapeake Drainage Basin Land Cover Grid. The first data set was produced by the U.S. Geological Survey, and consists of 1-km resolution data derived from AVHRR satellite imagery, classified into vegetation types based upon spectral reflectance values and seasonal onset of greenness (Eidenshink 1992). The second data set was produced at the EPA EMSL-Las Vegas Laboratory from Landsat TM data (30 x 30 m pixels) of the Chesapeake Bay region, and consisted of six land cover classes: high-density developed, low- density developed, woody, herbaceous, exposed land, and water.

RESULTS

Vistapro's strength was that it could render beautiful images quickly, but its weaknesses were that: (1) adjacent DEMs joined with the MCNV program in Vistapro were slightly misaligned, and (2) Vistapro doesn't use true geo-referencing, which would prevent combining land use patterns with the DEMs (Objective 2). Therefore, we developed procedures using auxiliary software programs to overcome these deficiencies (Table 1, Fig. 2).

Table 1. Software packages used.

Software Ver. Platform Function
ARC/INFO 7.0.3 Sun Sparcstation Merge multiple DEMs
ARC/INFO Grid 7.0.3 Sun Sparcstation Georeference, resample, clip
ERDAS Imagine 8.2 Sun Sparcstation (same functions as ARC/INFO GRID)
XV 2.21 Sun Sparcstation Manipulate file colors
Graphics Workshop 1.1 PC Windows 3.1 Convert TIFF to PCX format
SAGE Capture 2.13 PC DOS Convert ARC/INFO DEM to Vistapro format
Makepath 3.10 PC DOS Generate paths & camera angle
Vistapro 3.13 PC DOS Render landscapes, generate fly-bys
Excel 5.0 PC Windows 3.1 Edit scripts

Objective 1: Interface DEM with VR Software

The Vistapro MCNV program aligns adjacent files using a row and column match, which caused seams to be visible in joined DEMs. Because of this misalignment problem, we used the LATTICEMERGE procedure in ARC/INFO (Environmental Systems Research Institute, Inc., Redlands, CA) to join adjacent DEMs. Although this worked well for splicing and aligning the DEMs, there were problems importing ARC/INFO-generated DEMs into Vistapro, because ARC/INFO's DEM output differs from the format used by USGS. Vistapro will read an ARC/INFO DEM, but the "nodata" values trick the program into interpolating between -9999 and the highest value in the file. This distorts features such as sea level and snowline, and corrupts Vistapro's use of level slicing. Level slicing is used in the rendering phase to give computer images a photorealistic quality. Therefore, a third software program, "SAGE Capture" (Digital Land Systems Research, P.O. Box 4191, Parkville, Victoria 3052 Australia) was used to convert the ARC/INFO-spliced DEMs into the correct format. The SAGE Capture program reads the ASCII file exported by ARC/INFO and can export either a Vistapro binary file or a Vistapro version of a DEM.

Objective 2: Drape classified land cover over DEM

Although Vistapro renders lifelike landscapes using elevation alone by assigning different vegetation types to user-specified elevation ranges (Fig. 1), we sought to vegetate the MAIA landscapes based on actual land cover distribution, which is often independent of elevation. We are developing procedures for interfacing land cover and DEM data in Vistapro, work that is still in progress.

Files in PCX format with up to 8 colors can be used to define terrain types in Vistapro, each color representing a different terrain class. Vistapro uses these classes to generate shading patterns and 3-D objects associated with particular vegetation types. To ensure that the colors in the land cover files corresponded with the desired terrain type, we converted them to a TIFF format and imported them into XV, a UNIX graphics utility, for color manipulation. After color editing, we ported the files to a PC and converted them from TIFF to PCX using Graphics Workshop, a shareware graphics conversion utility that runs under Windows 3.1.

Files to be overlaid had to be aligned before importing them into Vistapro. Vistapro uses row and column addresses rather than true geo-referencing, so it was necessary to create DEMs and land cover files covering exactly the same area and with exactly the same number of rows and columns. There were several steps involved in this procedure.

The first step was to georeference the DEMs and land cover datasets. We used ARC/INFO GRID to perform this georeferencing, but also had excellent results with ERDAS IMAGINE (ERDAS, Inc., 2801 Buford Highway, NE, Suite 300, Atlanta, Georgia 30329-2137), particularly for scanned aerial photographs or USGS 7.5' topographic maps.

The second step was to resample the files so that the cells in each dataset were of the same size and aligned exactly. The cells in the 1:250,000 DEMs were approximately 90 x 90 m, whereas the cells in the Landsat TM-derived land cover layer were 30 x 30 m. This was also done using ARC/INFO GRID.

The third step was to change the nodata values (-9999) of the DEM file to a value equal to one less than the lowest elevation in the DEM. If this is not done, Vistapro uses the -9999 value as elevation, thus severely distorting the landscape.

The fourth step was to clip both datasets to one of four standard sizes used for display by Vistapro. This step was essential because Vistapro displays DEMs and PCX files differently: DEMs are centered within the display screen, whereas PCX files are justified with the lower left corner of the display window. Vistapro pads the edges of files with 0 values if the rows and columns don't match one of its four standard sizes, which also causes misalignment of overlaid datasets. The clipping was done with the row and column references used by Vistapro, rather than actual locational information. After these procedures were done in ARC/INFO GRID, we exported the DEM into an ASCII format, and passed it through the import/export process in SAGE Capture (see Objective 1).

Objective 3: Set camera location, elevation, and view angle

The Makepath Flight Director (Virtual Reality Laboratories, Inc., 2341 Ganador Ct., San Luis Obispo, CA 93401) was used to generate the paths used to "fly" though the rendered landscape. Paths can be generated interactively or by use of scripting controls, which allow creation of multiple unattended views of a landscape. A DEM was loaded, and a flight path set by placing nodes along the desired route.

The script file generated by Makepath is a comma delimited ASCII file with one record per frame defining camera x, y, and z coordinates, heading, pitch, and angle of view. Vistapro uses the scripts to generate individual frames which can then be played back as an animation. Makepath permits only a limited range of motion consistent with the vehicle type chosen, and uses the elevation of the DEM to determine the elevation of the path for every frame.

The ASCII script file that Makepath generates can be edited to vary elevation along the chosen route or to simulate other types of motion. We used the Microsoft Excel 5.0 spreadsheet program to edit the script file, simulating a parachute jump into Crater Lake and a space capsule zooming into an entire 1:250,000 DEM quad. Neither of these vertical drops are inherent to Makepath. Several iterations were usually needed to fine tune the desired path. At this trial and error stage, low detail and course resolution were used to get a feel for the visual results of the fly-by because of the long amount of time required for final rendering (see Objective 4). Script editing can also be used to reduce rendering time by decreasing the detail and quality of files produced.

Objective 4: Render image, enabling 3-D structures

Scenes can be rendered in Vistapro at different levels of resolution. High resolution images are more aesthetic but require longer rendering times than low resolution images (Fig. 3).

Computer performance was an important determinant of rendering speed. Although the minimal hardware requirements for the DOS version are a 386 with a VGA display, 4 Megabytes of RAM and 3 Megabytes of hard disk space, more powerful equipment provided much faster results. Rendering speed benchmark tests were performed using the Vistapro supplied DEM of Crater Lake (258 x 258 cells) on three different computer configurations (Table 2). Display modes were all set at 8 bit VGA 320 X 200 resolution. Results of the rendering speed benchmark tests are shown in Table 3.

Table 2. Computers used in benchmark tests. Speed tests were done with the Norton Integrator Software Advanced Edition, Version 4.50.

Machine System Info. IndexDisk Speed Disk Transfer Rate
386 20MHz 4MegRAM 13.2 22.4ms 494 K/S
486 66MHz 8Meg RAM 144 11.5ms 1.4MB/S
P5 133MHz 16Meg RAM 420 8ms 3.6MB/S

Table 3. Results of rendering speed benchmark tests. Times shown are in the following machine order: 386/486/P5. All times are rounded to the nearest second.

Texture Settings
# of Polygons Off Low Medium High
2048 0:03/0:01/0:00 0:12/0:01/0:00 0:39/0:06/0:01 1:45/0:18/0:05
8192 0:08/0:01/0:00 0:22/0:02/0:00 0:45/0:07/0:01 1:52/0:20/0:05
32,768 0:24/0:03/0:00 1:02/0:09/0:02 1:17/0:12/0:03 2:13/0:23/0:06
131,072 1:48/0:14/0:03 2:50/0:22/0:06 2:53/0:25/0:06 3:21/0:30/0:08

Vistapro is more computationally intensive with large files than with the small file used in the benchmark tests. Rendering of large files (2050 x 2050 cells) ranged from three seconds to 13.4 minutes per frame on the Pentium P5 computer. A number of variables manipulated within the program itself also influenced rendering speed and quality: size of polygons, texture quality, tree visibility, blending, dithering, pixel dithering, and gouraud shading. Final processing of all frames took as long as eight hours for a 200 frame animation lasting 19 seconds.

The ability to render very accurate 3-D structures was important in our decision to use this software package. Fractal generated trees were used with various controllable settings such as: light source and direction, density, size, detail, and colors. These also affected the time required to produce the final output. Generating many fractal trees was extremely time consuming, but the visual results were well worth it (Fig. 3).

Enhancements

In addition to making progress on our basic objectives, we also developed the ability to edit individual frames of an animation to add interesting visual enhancements. For a test, we used a scanned image of a pair of boots to add realism to a simulated parachute jump over the Crater Lake Area. The frames were individually edited using a basic paint program. These individual frames were then re-processed into animation form for viewing. The result appears remarkably real, as if the parachute jumper is looking down at his/her feet! This process more appropriately could be used to add an inset locational map or data tables about the scenes currently being viewed during a fly-by. It should be noted that only 12 frames were edited for this test; editing all or many frames from a 200 frame animation could be very tedious, so an automatic file editor would need to be written.

CONCLUSIONS

Despite its fairly limited feature set, Vistapro allowed us to get a working prototype up and running quickly. We used the prototype both to visualize the land cover data and to benchmark performance requirements and discuss enhancements for future implementation.

Virtual reality renderings are computationally intensive, so it was not possible to make our applications interactive in real time with devices such as a headset or data glove. As the power available on consumer-grade desktop computers increases, however, progressively more realistic presentations become possible using ubiquitous hardware. These hardware advances have enabled a generation of low cost visualization and virtual reality software packages for the experimenter. Although the results of these low cost solutions only approximate the realism (measured in rendering detail and speed) available on high-end platforms, some are now good enough to enable serious work, and the results obtained can be improved markedly simply by moving the software to faster hardware as it becomes available.

At the extreme, virtual reality promises a fully immersive environment which fully engages all the user's senses and provides full interactivity in real time. At the minimum it provides a visualization environment that encourages a user to imagine being within the virtual world -- to suspend disbelief in the simulation. At this stage in our project, user interaction is limited to importing digital elevation and land use data and navigating within the resulting environment. Once we complete experiments with our prototype, we plan in later stages to port our model from Vistapro to a more open-ended virtual reality software package, which will allow us to effect changes to the model from within the virtual environment.

ACKNOWLEDGEMENTS

Support from Minnesota Technology, Inc., the U.S. Environmental Protection Agency EMAP Program, and the U.S. Department of the Interior, National Biological Service is gratefully acknowledged. No formal endorsement of the commercial software products mentioned should be inferred.

REFERENCES

Eidenshink, J.C. 1992. The 1990 conterminous U.S. AVHRR data set. Photogrammetric Engineering and Remote Sensing 58:809-813.

Virtual Reality Laboratories, Inc. 1993. Vistapro User Guide, IBM DOS Version.


AUTHOR INFORMATION

Peter Berger
Proprietor
Brimson Laboratories
1549 Hiironen Road
Brimson MN 55602
Phone: 218-848-2885
FAX: 218-848-2433
Email: pberger@brimson.com

Paul Meysembourg
Principal Laboratory Technician
Natural Resources Research Institute
University of Minnesota
5013 Miller Trunk Highway
Duluth MN 55811
Phone: 218-720-4275
FAX: 218-720-4219
Email: paul@sparkie.nrri.umn.edu

James Sales
Principal Laboratory Technician
Natural Resources Research Institute
University of Minnesota
5013 Miller Trunk Highway
Duluth MN 55811
Phone: 218-720-4275
FAX: 218-720-4219
Email: jsales@sparkie.nrri.umn.edu

Carol Johnston
GIS Administrator
Natural Resources Research Institute
University of Minnesota
5013 Miller Trunk Highway
Duluth MN 55811
Phone: 218-720-4269
FAX: 218-720-4219
Email: cjohnsto@sparkie.nrri.umn.edu