Distributed Video Sensor Networks

Preface

Contents

Introduction

Distributed Video Sensor Networks and Research Challenges

Report on NSF/ARO/ONR Workshop on Distributed Camera Networks: Research Challenges and Future Directions

1 Introduction

2 Workshop Recommendations

3 Suggested Major Research Topics

Appendix 1: List of Attendees in Alphabetical Order

Appendix 2: Groups and Group Leaders

Appendix 3: Talks with Titles and Presenters

Video Processing and Understanding

Motion Analysis: Past, Present and Future

1 Introduction to Motion: An Early History

2 Motion: Highlights from Philosophy, Psychology and Neurobiology

3 Motion in Computer Vision: The Beginnings

4 Optical Flow-Based Motion Detection

5 Human Actions and Activities

6 Motion: Future

References

Projective Joint Invariants for Matching Curves in Camera Networks

1 Introduction

2 Problem Formulation and Preliminaries

3 Joint-Invariant Signatures

4 Toward Local Signatures

5 Matching Performance

6 Discussion

References

Multiple-View Object Recognition in Smart Camera Networks

1 Introduction

2 Encoding Multiple-View Features via Sparse Representation

3 System Implementation

4 Experiment

5 Conclusion and Discussion

References

A Comparison of Techniques for Camera Selection and Hand- Off in a Video Network

1 Introduction

2 RelatedWork and Contributions

3 Theoretical Comparison

4 Experimental Results

5 Conclusions and Future Work

References

Distributed Sensing and Processing for Multi- Camera Networks

1 Introduction

2 Statistical Inference for Tracking

3 Efficient Particle Filtering

4 Compressive Sensing

5 Conclusions and Future Directions

References

Tracking of Multiple Objects over Camera Networks with Overlapping and Non- overlapping Views

1 Introduction

2 RelatedWork

3 Tracking within a Single Camera

4 Tracking Across Multiple Cameras

5 Experimental Results

6 Conclusion

References

Toward Robust Online Visual Tracking

1 Introduction

2 Appearance Modeling for Visual Tracking

3 Learning Detectors Online for Visual Tracking

4 Conclusions

References

Modeling Patterns of Activity and Detecting Abnormal Events with Low- Level Co- occurrences

1 Introduction

2 Context, Overview and Notations

3 OurMethod

4 Experimental Results

5 Conclusion

References

Use of Context in Video Processing

1 Introduction

2 Case Study: Environment Discovery

3 Conclusion

References

Simulation, Graphics, Cognition and Video Networks

Virtual Vision

1 Introduction

2 The Case for Virtual Vision

3 RelatedWork

4 Smart Camera Nodes

5 Surveillance Systems

6 Conclusions

References

Virtualization and Programming Support for Video Sensor Networks with Application toWireless and Physical Security

1 Motivation

2 RelatedWork

3 SNBench Overview

4 EnablingWireless Monitoring

5 Deployment Environment

6 Service Programming Primer

7 Wireless Security Services

8 Future Work and Conclusions

References

Simulating Human Activities for Synthetic Inputs to Sensor Systems

1 Overview

2 The CAROSA System

3 RelatedWork

4 Parameterized Representations

5 Resource Management

6 Roles and Groups

7 Scenario Authoring

8 Example Simulation

9 CAROSA Summary

10 Input to Distributed Sensor Networks

11 Summary

References

Cognitive Sensor Networks

1 Introduction

2 Cognition

3 Symmetry Theory in Signal Processing

4 Conclusion

References

Ubiquitous Displays: A Distributed Network of Active Displays

1 Introduction

2 Initial Progress

3 Conclusion

References

Wireless Video Sensor Networks, Communications and Control

Research Challenges forWireless Multimedia Sensor Networks

1 Introduction

2 Applications of Wireless Multimedia Sensor Networks

3 Network Architecture

4 Factors Influencing the Design of Multimedia Sensor Networks

5 Application Layer

6 Transport Layer Protocols

7 Network Layer

8 MAC Layer

9 Physical Layer

10 Conclusions

References

Camera Control and Geo-Registration for Video Sensor Networks

1 Introduction

2 RelatedWork

3 PTZ Camera Viewspace Control Model

4 Scene-Based Camera Geo-Registration and Mapping

5 Operational Interface

6 Summary

References

Persistent Observation of Dynamic Scenes in an Active Camera Network

1 Introduction

2 Technical Rationale

3 Cooperative Target Acquisition Using Game Theory

4 Experimental Results

5 Conclusion

References

Proactive PTZ Camera Control

1 Introduction

2 Proactive Camera Control

3 Results

4 Conclusions and Future Work

References

Distributed Consensus Algorithms for Image- Based Localization in Camera Sensor Networks

1 Introduction

2 Review of Average-Consensus Algorithms

3 Distributed Object Localization

4 Distributed CSN Localization

5 Conclusion

References

Conditional Posterior Cramér–Rao Lower Bound and its Applications in Adaptive Sensor Management

1 Introduction

2 Conditional PCRLB for Recursive Nonlinear Filtering

3 C-PCRLB-Based Sensor Management

4 Applications in Camera Network Management

References

Distributed Embedded Cameras and Real- Time Video Analysis

VideoWeb: Optimizing aWireless Camera Network for Real- time Surveillance

1 Introduction

2 RelatedWork and Contributions

3 Building the Camera Network

4 The VideoWebWireless Camera Network

5 Experiments for Performance Characterization and Optimization of the Video Network

6 Conclusions

References

VideoWeb Dataset for Multi-camera Activities and Non- verbal Communication

1 Introduction

2 Data Collection

3 Conclusions

References

Wide-Area Persistent Airborne Video: Architecture and Challenges

1 Introduction

2 Spatio-temporal Reflectance Variations

3 Wide Aperture Imaging Model of Camera Arrays

4 Accommodating Dynamic Variations in Operational Camera Arrays Using Pose Information

5 Summary and Conclusions

References

Collaborative Face Recognition Using a Network of Embedded Cameras

1 Introduction

2 RelatedWork

3 Experimental Setup

4 System Performance

5 Conclusions and Future Work

References

SATware: A Semantic Approach for Building Sentient Spaces

1 Introduction

2 SATware: An Middleware Framework for Sentient Spaces

3 A Programming Model for Pervasive Applications

4 Supporting Scalability through Semantic Scheduling

5 Supporting Robustness through Sensor Recalibration

6 Conclusions

References

Applications of Distributed Video Networks

Video Analytics for Force Protection

1 Aerial Video Analysis

2 Tracking from Fixed Ground Based Cameras

3 Person Detection from Moving Platforms

4 Biometrics at a Distance

5 Facial Analysis

6 Summary

References

Recognizing Activity Structures in Massive Numbers of Simple Events Over Large Areas

1 Introduction

2 Spatial Structure

3 Temporal Structure

4 Event-Linkage Structure

5 Short Event-Sequence Structure

6 Network Structure

7 Summary

References

Distributed Sensor Networks for Visual Surveillance

1 Introduction

2 Technical Challenges in Large Sensor Networks

3 System Design and Components

4 Results

References

Ascertaining Human Identity in Night Environments

1 Introduction

2 Color-NIR Cross-Spectral Iris Matching

3 Short Wave Infrared Face Verification

4 Gait Curves for Human Recognition in a Night-Time Environment

5 Soft Biometrics—Body Measurement

6 Summary

References

Educational Opportunities and Curriculum Development

Educational Opportunities in Video Sensor Networks

1 Introduction

2 Computational Sensor Networks

3 Engineering Background for Video Sensor Networks

4 Course Organization

5 Support Technology for Instruction

6 Conclusion

Appendix 1: Recommended Courses and Topics

References

Index