Skip to content

Home

Multifaceted Policy Evaluation and Design Support in 3D Space
Reproducing the movements of people and vehicles in real-time 3D space from camera footage:
A groundbreaking technology that transforms the real world into a miniature garden, enabling a variety of simulations.

Challenges in Utilizing Camera Footage

Challenges in Utilizing Camera Footage
In fields such as urban development, construction, transportation, and security, it is a pressing challenge to evaluate measures in advance and ensure safety and efficiency. However, reproducing the movements of people and vehicles in real-time 3D space is difficult, requiring massive data processing and specialized equipment, which pose significant barriers.

Solution Through This Technology

Solution Through This Technology
Fujitsu has developed a technology that reproduces moving objects, such as vehicles and people, in real-time 3D space using standard monocular cameras. This technology estimates the position and 3D shape of objects from video footage and maps them with high precision onto a 3D space. This enables the evaluation of measures from various perspectives and facilitates new PoC (Proof of Concept) implementations aimed at solving societal issues.

The benefits of Multifaceted Policy Evaluation and Design Support in 3D Space

  1. High-Precision Simulations
    • By simulating environments close to the real world, potential risks can be identified in advance, enabling safer designs.
  2. Effectiveness Verification from Multiple Perspectives
    • Evaluating measures from various viewpoints allows for more comprehensive assessments and optimization.
  3. Cost Reduction and Efficiency Improvement
    • Reducing trial-and-error through simulations and enabling quick decision-making significantly shortens development time and reduces costs.
  4. Data-Driven Decision-Making
    • Evaluations based on concrete data support objective and reliable decision-making.
  5. Low Implementation Costs
    • Since the technology can utilize existing infrastructure such as surveillance cameras, implementation costs can be kept low.

This technology is expected to be utilized in various fields, such as urban planning, traffic management, and disaster prevention measures. We have prepared a demo application, API, demo video, and guidance for implementing a PoC. Please feel free to contact us.

Technical overview

Target Industry/Users

  • (Smart City Development)
    • Target Users: Municipal governments, local authorities, urban planners
    • Applications: Urban design and infrastructure improvement; enhancing traffic flow, alleviating congestion, and assessing public space safety.
  • (Construction and Civil Engineering Industry)
    • Target Users: Construction companies, architectural designers, site managers
    • Applications: Monitoring construction progress and ensuring safety on-site; risk management and efficiency improvements through simulations.
  • (Transportation and Mobility)
    • Target Users: Traffic management agencies, automotive manufacturers, logistics companies
    • Applications: Development and testing of autonomous driving technologies; analyzing traffic accident risks and mapping pedestrian and vehicle movement.
  • (Security and Surveillance)
    • Target Users: Security companies, security system developers, commercial facility operators
    • Applications: Real-time crime prevention using surveillance camera data; early detection of potential criminal activity and emergency response planning.
  • (Environment and Energy)
    • Target Users: Environmental consultants, energy companies, policymakers
    • Applications: Evaluating and simulating measures to reduce CO2 emissions; designing cities to minimize environmental impact.
  • (Entertainment and VR/AR)
    • Target Users: Game developers, movie production companies, theme park operators
    • Applications: Delivering realistic experiences using 3D digital spaces; recreating dynamic objects in virtual environments.
  • (Healthcare and Elder Care)
    • Target Users: Healthcare facilities, eldercare facility operators, insurance companies
    • Applications: Enhancing safety through movement analysis of elderly individuals and patients within facilities; preventing accidents and optimizing spatial layout.
  • (Manufacturing and Logistics)
    • Target Users: Factory operators, logistics center managers
    • Applications: Optimizing the movement of workers and automated guided robots within factories and warehouses; simulating efficient use of space.

Challenges in Target Industry and Operations

  • To address social issues, it is essential to evaluate the effectiveness of policies in advance and ensure safety and efficiency.

Technical Challenges

  • With conventional technology, reproducing the movement of people and vehicles in a three-dimensional space in real-time faces numerous technical limitations, making it challenging to conduct evaluations that account for individual perspectives.

Solutions

  • We have developed the technology that can reproduce moving objects, such as vehicles and people, in a three-dimensional digital space in real-time using only a standard monocular camera.
  • The system estimates the position and 3D shape of objects from 2D video and accurately maps them onto a 3D spatial model that replicates static objects.
  • This enables the evaluation of policies that consider individual perspectives, making it possible to create a more realistic digital twin.

Fujitsu's Technological Advantage

  • By preparing a 3D model in advance, it is possible to accurately recreate a three-dimensional space using only a single monocular camera.
  • Since it does not require processing large amounts of data, the system operates at high speed.

The benefits of Multifaceted Policy Evaluation and Design Support in 3D Space

  • Cost Reduction:

    • By utilizing existing data, such as footage from already-installed surveillance cameras, high-precision 3D digital twins can be generated at a low implementation cost.

  • Improved Safety:

    • The ability to observe environments from various perspectives, such as pedestrians, drivers, and security personnel, allows for a multifaceted evaluation of specific policy effects.

  • Comprehensive Operational Efficiency:

    • In addition to macro-level metrics like CO2 emissions, considering micro-level indicators such as safety from individual perspectives enables more holistic policy design.

Case studies

  • We are considering utilizing this technology for post-traffic accident simulations and pre-simulations for traffic sign installations in collaboration with the police.

Technical Trial

  • Demo Video

Documents

Document Title Explanation
Technical manual Supplementary Materials for Press Release