Immersive, Realistic 3D Virtual Streetscape Infrastructure Modeling across Multiple Software Platforms

By Dana Smith
Slide 1: Title slide for Immersive, Realistic 3D Virtual Streetscape Infrastructure Modeling presentation by Dana Smith

Slide-1

REU Scholar: Dana Smith

Research Mentor: Jinwoo Jang, Ph.D.

REU Project: Infrastructure Systems: Human-in-the-loop Digital Twins for Smart Cities

Florida Atlantic University, Department of Civil, Environmental and Geomatics Engineering

Slide 2: Introduction section with information about photorealistic 3D map tiles and digital twins, includes red video placeholder

Slide-2

Introduction

Photorealistic 3D Maps Tiles

• Encrypted with 3D geodata and images, visualize entire streetscapes: buildings, terrain, roads, forestry, etc. [1-3]

• Urban planning, game development, and transportation through visualizing potential city plans, tourism, and predicting the future housing market. [4-5]

3D immersive digital twin

• Digital replication of an actual structure or object to conduct simulations with real-time data and visualize the impacts of future city plans. [6]

Figure 1. Video of Photorealistic 3D Tiles made by the Google Maps Platform [8]

Slide 3: Objectives section describing project goals for creating 3D digital twin of CS3 testbed in West Palm Beach

Slide-3

Objectives

Project Goal: to create a high-quality 3D immersive digital twin of a National Science Foundation's (NSF) Center for Smart Streetscapes (CS3) research testbed using Google Maps Application Programming Interface (API), Photorealistic 3D Map Tiles, and Unity.

This testbed is located in downtown West Palm Beach, Florida, focusing on Clematis Street. [7]

Figure 2. Image of the CS3 testbed in West Palm Beach visualized using Google Photorealistic 3D Map Tiles. [8]

The figure displays a 3D rendered view of Clematis Street in downtown West Palm Beach, showing buildings, street layout, palm trees, and urban infrastructure in photorealistic detail using Google's 3D mapping technology.

Slide 4: Overview section with workflow diagram showing the process from Google Maps API to final Unity implementation

Slide-4

Overview

The slide displays a workflow diagram showing the process flow from Google Maps API through various software platforms to create the 3D digital twin. The diagram shows interconnected boxes representing different stages of the modeling process, including data acquisition, processing through Blender, and final implementation in Unity for the immersive digital twin creation.

Slide 5: Issues section describing challenges encountered during the project implementation

Slide-5

Issues

This slide outlines various technical challenges and limitations encountered during the project implementation, though specific details of the issues are presented in bullet point format on the visual slide.

Slide 6: Methods - Blender section showing 3D modeling process and interface screenshots

Slide-6

Methods – Blender

This slide shows screenshots of the Blender software interface being used for 3D modeling of the streetscape. The images demonstrate the 3D modeling environment with various tools, viewports, and the process of creating and refining the digital twin models within Blender's interface.

Slide 7: Methods - Blender continued, showing additional 3D modeling work and interface views

Slide-7

Methods – Blender

This slide continues to show the Blender modeling process with additional screenshots of the software interface. The images display various stages of 3D model development, including different viewport perspectives and modeling tools being utilized to create accurate representations of the streetscape infrastructure.

Slide 8: Methods - Blender showing detailed 3D models and texturing work

Slide-8

Methods – Blender

This slide presents more advanced stages of the Blender modeling process, showing detailed 3D models with texturing and material applications. The screenshots demonstrate the progression from basic geometric models to more refined, textured representations of buildings and streetscape elements.

Slide 9: Methods - Blender conclusion stating Blender's capability for accurate digital replications

Slide-9

Methods – Blender

As we can see, Blender is capable of producing accurate, high-quality digital replications of the streetscape.

Slide 10: Methods - Blender showing final rendered models and comparison views

Slide-10

Methods – Blender

This slide displays the final rendered 3D models created in Blender, showing high-quality visual outputs and comparison views that demonstrate the accuracy and detail achieved in the digital replication of the streetscape infrastructure.

Slide 11: Methods - Unity section showing the Unity game engine interface and implementation

Slide-11

Methods – Unity

This slide shows screenshots of the Unity game engine interface being used to implement the 3D digital twin. The images demonstrate the Unity development environment with scene views, asset management, and the integration of the 3D models created in Blender into an interactive, immersive environment.

Slide 12: Methods - Unity continued, showing additional Unity development work and scene setup

Slide-12

Methods – Unity

This slide continues to demonstrate the Unity implementation process, showing additional development work including scene setup, lighting configuration, and the arrangement of 3D assets within the Unity environment to create the immersive digital twin experience.

Slide 13: Results section showing the final implemented 3D digital twin

Slide-13

Results

This slide presents the final results of the project, displaying the completed 3D immersive digital twin implementation. The images show the successful integration of all components to create a high-quality, interactive representation of the CS3 testbed streetscape.

Slide 14: Ongoing & Future Research section outlining next steps and planned improvements

Slide-14

Ongoing & Future Research

More fine-tuning of the buildings will be done

The portion of the CS3 testbed will be expanded to replicate the entire CS3 testbed located on Clematis St.

Traffic and Pedestrian simulation information will be incorporated into this digital twin via Unity collaboration

Slide 15: Conclusion summarizing the successful creation of the 3D digital twin

Slide-15

Conclusion

An accurate immersive 3D high-quality digital twin was created for a portion of the CS3 testbed located in downtown West Palm Beach

I am excited for Google Maps to update their Photorealistic 3D Tiles to minimize building distortion.

Slide 16: Acknowledgment section crediting NSF funding support

Slide-16

Acknowledgment

This work was fully supported by the U.S. National Science Foundation (EEC- 2133516).

Slide 17: References section listing all cited sources and documentation

Slide-17

References

  1. Photorealistic 3D tiles. (n.d.-b). Google for Developers. https://developers.google.com/maps/documentation/tile/3d-tiles
  2. Photorealistic 3D Tiles overview. (n.d.). Google for Developers. https://developers.google.com/maps/documentation/tile/3d-tiles-overview
  3. Photorealistic 3D tiles. (n.d.-c). https://3d-tiles.web.app/#flight
  4. Photorealistic 3D tiles. (n.d.-d). https://3d-tiles.web.app/#data-viz
  5. Build immersive maps at scale with photorealistic 3D, 2D, and street view tiles, now in GA – Google Maps platform. (n.d.). Google Maps Platform. https://mapsplatform.google.com/resources/blog/build-immersive-maps-at-scale-with-photorealistic-3d-2d-and-street-view-tiles-now-in-ga/#:~:text=Photorealistic%203D%20Tiles%20The%20visualization%20shows%203D,based%20on%20transportation%2C%20building%2C%20and%20market%20forecasts.
  6. Hansen, M. (2023, September 26). The future of innovation: immersive digital twins. Kinetic Vision. https://kinetic-vision.com/the-future-of-innovation-immersive-digital-twins/
  7. Center for Smart Streetscapes. (n.d.). https://cs3-erc.org/research/
  8. Photorealistic 3D tiles. (n.d.-a). https://3d-tiles.web.app/#orbit
  9. Blosm for Blender: Google 3D cities, OpenStreetMap, terrain. (n.d.). Gumroad. https://prochitecture.gumroad.com/l/blender-osm
  10. Bos, L. (2023, October 26). Photorealistic 3D Tiles from Google Maps Platform Now Included in Cesium ion. Cesium. https://cesium.com/blog/2023/10/26/photorealistic-3d-tiles-in-cesium-ion/
  11. Photorealistic 3D tiles. (n.d.-e). https://3d-tiles.web.app/#globe-view
Slide 18: Questions & Feedback final slide inviting audience interaction

Slide-18

Questions & Feedback

Last slide: Contains plain text stating 'End of presentation. Click the right arrow to return to beginning of slide show.'

End of Presentation

Click the right arrow to return to the beginning of the slide show.

For a downloadable version of this presentation, email: I-SENSE@FAU.

Additional Information
The Institute for Sensing and Embedded Network Systems Engineering (I-SENSE) was established in early 2015 to coordinate university-wide activities in the Sensing and Smart Systems pillar of FAU’s Strategic Plan for the Race to Excellence.
Address
Florida Atlantic University
777 Glades Road
Boca Raton, FL 33431
i-sense@fau.edu