resources-researchers

Wiley, ISBN: 978-0-470-03560-3, 2009

UbiCom Book Resources Mainly for Researchers

Each of the 13 chapters includes a list of references for researchers totaling over 630 references. The work of over 1000 different researchers is referred to. Here is the list of researchers whose work is referred to in this book. See also the general reader resources. The book proposes the following innovations in its treatment of Ubiquitous computing:

A novel holistic framework for UbiCom (Chapter 1).
Three basic design patterns for UbiCom called Smart Devices, Smart Environments and Smart Interaction (Chapter 1).
A critical analysis of the five core UbiCom properties: distributed computing (Chapters 3 and 4), iHCI (Chapter 5), context-awareness (Chapter 7), artificial intelligence (Chapters 8 and 9) and autonomy (Chapter 10).
No single definition for UbiCom but a framework based upon a core set of 5 properties which can be combined as needed. The next level of detail for the model includes over 70 defined properties. (Chapter 1).
Extension of Weiser's 3 basic form factors for UbiCom devices to include 3 additional forms based upon skins, dust and clay (Chapters 1, 5).
A classification of UbiCom system environment interaction into 3 main types: CCI, HCI and CPI (Chapter 1).
A classification of how smart devices and smart environments model each other (Chapter 1).
Analysis about the common myths of Ubiquitous Computing (Chapter 1).
Survey of the key UbiCom projects and a discussion of these in the light of the types of UbiCom readily available today (Chapter 2).
Detailed discussion of design for UbiCom service interaction in volatile resource and communication infrastructures. (Chapter 3).
Constrained model for service access based upon embodied virtuality to complement the seamless virtuality of Web-based Service-Oriented Computing (Chapters 1, 3).
Comprehensive treatment of operating systems for UbiCom including MTOS, ASOS, RTOS, Mobile and resource-constrained OS and Virtual Machines (Chapters 3,4, 6).
Novel treatment and taxonomy of mobility that extends far beyond the current generation of smart mobile communication devices (Chapter 4).
Applied HCI starting with four common device models, a focus on iHCI, a review of different types of hidden computer interfaces and the use of implicit versus explicit models of human interaction (Chapter 5).
Applied AI extended that covers multiple representations, hybrid models, multiple and autonomous intelligent systems (Chapters 8,9,10).
Novel treatment and taxonomy for physical world and virtual world tagging (Chapter 6).
Novel treatment of context-awareness based upon a goal-based context-aware model and a classification of three main types of context (Chapter 7).
Interlinking of different communication models for interaction such as event-driven, sensor-based, context-awareness, AI and HCI.(Chapters 3,8).
Analysis of how intelligent systems or agent-based models can be used as designs for sensor-based systems, context-awareness, autonomous systems, robots, autonomic interaction and human computer interaction,
Comprehensive study of autonomous systems that encompasses automatic systems, self-star systems, autonomic computing, multi-agent systems, reflective systems, complex systems and artificial life (Chapter 10).
Detailed analysis of self-star systems including autonomic computing and a taxonomy of over 20 different self-star properties and management techniques. (Chapter 10).
Treatment of ubiquitous communication and networks (chapter 11).
Comprehensive and holistic treatment of UbiCom management techniques including six different models for user-centered system management. (Chapter 12).
Cross disciplinary-treatment view of computing and one that also spans and embraces engineering, physics, biology, ecology, economics, geography, law and sociology. (Chapters 9, 13).
Multi-lateral model of support for UbiCom to enable different applications to support different degrees and mixes of autonomy, context-awareness, intelligence, iHCI etc (Chapter 13).
Analysis of the key issues for future computing (Chapter 13).

Holistic Framework for UbiCom

A novel holistic framework is proposed for UbiCom called the Smart DEI (Devices, Environments and Interaction) model. It is based upon three interlinked system viewpoints in terms of:

Internal UbiCom system properties: distributed, iHCI (implicit HCI), context-aware, intelligent, autonomous.
System interaction in three distinct external environments: ICT or virtual computing, physical world and human world.
Distinct design architectures: smart devices, smart environments and smart interaction.

Form Factors for UbiCom

Mark Weiser who first coined the term Ubiquitous Computing, originally proposed three main forms for ubiquitous computing:

Tabs: hand-held, centimeter sized device which be surface-mounted (wearable) or accompanied, e.g., mobile phones
Pads: lap-sized, decimeter-sized devices which can accompany users, accompanied in luggable cases, e.g., laptop computers
Boards: Wall displays are useful for viewing by multiple people, for collaborative working and for viewing large complex structures such as maps. Board may be used horizontally as surface computers as well used in a vertical position

This set of forms is extended to include three additional forms:

Dust: micro and nano sized devices, e.g., micro sensors and MEMS
Skins: non-planar surfaces which can be used to cover natural and artificial physical world objects, e.g.,organic user interfaces
Clay: programmable synthetic matter, e.g., clusters of MEMS

Basics Designs for UbiCom

Three basic designs for UbiCom based upon smart devices, smart environments and smart interaction:

Smart devices which are characterised by being mobile, personalised, planar, macro sized MTOS devices which can be used as multi-application platforms, Web portals and combined multimedia players, recorders and communicators. These tend to be designed to access remote rather than local services.
Smart environments are environments in which static macro devices are embedded into it, or untethered micro and nano-sized devices are scattered into social and public spaces Local interaction dominates the use of smart environments.
Smart interaction is concerned with combining multiple individual smart devices and environments in order to interact in a richer, flexible ways, such as supporting orchestrated, choreographed, competitive and cooperative interaction to support dynamic virtual systems.
Hybrid designs are typically used in practice where systems combine smart devices, smart environments and smart interaction.

Classification of System-Environment Interaction: CCI, HCI and CPI

UbiCom system use covers a range of interactions (Chapter 1):

Computer-Computer Interaction, C2C or CCI. Interaction between UbiCom systems or devices, or between one UbiCom system and its virtual computer infrastructure that can use SOA (Chapter 3), distributed AI (Chapters 8,9) and biological mechanisms (Chapter 10).
Human Computer Interaction, HCI, between devices and people (Chapter 5)
Computer device - Physical world Interaction ,CPI, e.g., robotics, embedded controllers, sensor nets, (Chapter 6).

Some CPI involves sensing the physical environment, performing tasks which are situated in it, affect it and may control it. Physical environments which are smart environments act in part as collections of smart devices so CPI involving smart environments approximates towards CCI. Interactions between humans (H2H or HHI) and between humans and the physical environment (HPI) are often mediated using computer devices. If humans interact with the physical world and the latter is designed as a smart environment then human smart environment interaction approximates to HCI and HPI.

Unilateral Models of Environment by System or Vice Versa or Mutual Modeling

Each of these three types of system environment interaction can also be subdivided (Chapter 1) in terms of whether or not:

Unilateral model of environment is used by a smart system. The system is intelligent a system deploys a model of its environment to control its interaction, e.g., iHCI or implicit HCI
Unilateral model of a system are used by a smart environment. The environment is intelligent and deploys a model of the system to control the environment interaction, e.g., eHCI or explicit HCI
Mutual modeling. both systems and environments are intelligent and mutually model each other.

Common Myths of Ubiquitous Computing

Ubiquitous computing is quite a broad vision. There is a danger that it becomes too encompassing. Here a few unrealistic expectations about ubiquitous computing which are discussed in detail in chapter 1:

There is a single definition which will accurately characterises Ubiquitous Computing
The ideal type of Ubiquitous computing is where all the properties of ubiquitous must be fully supported
Ubiquitous computing means making computing services accessible everywhere
Ubiquitous computing is boundless computing
Ubiquitous computing is just about HCI
Calm Computing should be used as a model for all HCI
Ubiquitous computing is just distributed or virtual computing
Ubiquitous computing is just mobile wireless computing
Ubiquitous computing is just about smart environments
Ubiquitous computing need to be highly autonomous systems
Ubiquitous computing is just about physical world context-awareness
Ubiquitous computing is just distributed intelligence
Ubiquitous computing systems can operate effectively in all kinds of environments.

Applied HCI

Chapter 5 includes:

An analysis of four common device models: computers, phones, games consoles and local wireless controlled devices
An analysis of how to design usable user interfaces for input and output resource constrained devices such as mobile devices
A comprehensive treatment of hidden user interfaces and associated devices.
A description of iHCI (intrinsic HCI) design, contrasted with conventional HCI design (called explicit HCI design.
Design patterns for pervasive device user interfaces.
An overview of a user-centered design method for (user) interactive devices.
An introduction to user modeling for use in personalised services and devices.

Applied AI or Intelligent Systems (IS)

This is covered in 3 specific chapters (chapters 8,9,10) but interlinked with other chapters. This treatment highlights the following main points:

An introduction and overview of AI in one chapter (8).
Use of (distributed) AI models in UbiCom.
Compare and contrast of IS (agent-based) models with sensor-based systems and context-aware systems.
Basic models for intelligent systems based upon those proposed by Russell and Norvig (in their AI: a modern approach textbook) but extending the way they way that they talk about model-based systems, e.g., in terms of combining (internal) self-models and (external) environment models.
A holistic approach for different AI model representations including Semantic KB, Classical Logic and Soft-computing.
A comprehensive look at interaction multiplicity models in distributed computing, compared and contrasted with distributed AI interaction.
Coverage of models from automatic, autonomous to autonomic behaviours.
Coverage of models concerning reflective systems and self-aware systems.
Coverage of complex systems and artificial life.

Ubiquitous Networks and Communication

Chapter 11 includes:

A holistic treatment of convergence in multimedia communication including audio radio, phone, Internet and video networks.
A detailed look at a range of wireless and mobile user network models for UbiCom.
A comprehensive discussion of service oriented networks.

Chapter 9 includes:

Compares and contrasts conventional distributed and network communication with richer distributed AI interaction.

Stefan Poslad

Ubiquitous Computing: Smart

Devices, Environments and Interactions