Skip to content

Visual Studio

Virtual Reality and IoT – 2018

I have updated and recreated the Virtual Reality and IoT presentation for 2018. The GitHub I hosted it on has the same information as below.

Resources

IoT Dashboard (to create Windows IoT images)

Visual Studio

Unity 3d

Guides

Getting started with Windows IoT

UWP Hello world for Win IoT

IoT Projects

Azure IoT getting started guide

Azure Service Bus Topics

Unity Documentation

Equipment

Special Thanks

A special thanks to the SignalR Client for .NET 2.0 for makin a SignalR solution that works for Unity3d

Abstract

Whether it’s called mixed reality, augmented reality, or virtual reality; changing the perceived reality of the user is here. This presentation will look at how to create IoT devices, pipe the data created by them through the cloud, and use that data to drive a virtual or mixed reality experience. Creating applications that interact with the data created by the user’s environment should become straightforward after this introduction.

Description

Using IoT Devices, powered by Windows 10 IoT and Raspian, we can collect data from the world surrounding us. That data can be used to create interactive environments for mixed reality, augmented reality, or virtual reality. To move the captured data from the devices to the interactive environment, the data will travel through Microsoft’s Azure.

First it will be ingested through the Azure IoT Hub. The IoT Hub provides the security, bi-directional communication, and input rates needed for the solution. We will move the data directly from the IoT Hub to an Azure Service Bus Topic. The Topic allows for data to be sent to every Subscription listening for the data that was input. Azure Web Apps subscribe to the Topics and forward the data through a SignalR Hub that forwards the data to a client. For this demo, the client is a Unity Application that creates a Virtual Reality simulation showcasing that data.

Once finished with this introduction to these technologies, utilizing each component of this technology stack should be approachable. Before seeing the pieces come together, the technologies used in this demonstration may not seem useful to a developer. When combined, they create a powerful tool to share nearly unlimited amounts of incoming data across multiple channels.

New set of presentations

So it is finally time to retire my previous set of presentations and put some new ones together. There are some major categories I need to cover:

  • IoT with Mobile
  • Azure IoT Gateway modules
  • Stream Analytics edge
  • Azure ML edge
  • Alternative application interfaces
  • FuseThru advantage
  • Azure IoT architecture

This post is a way for me to put out some ideas on what to speak on and edit them as time passes and I get feedback. So here are my initial attempts:

IoT and Mobile

So in this talk I want to show some command control scenarios and some data ingestion. To do this I will show a scenario where a mobile device running a Xamarin application will control an LED or a servo or a relay or some other visible actionable device. Then on the data ingestion side, a set of devices consuming physical data and broadcasting them over the air via Bluetooth. The mobile app will consume that data and showcase it in the application.

Azure IoT Edge

This talk can reuse the Bluetooth devices from the IoT and mobile talks. Using those, a gateway can have a module configured  to consume the device data. With that I can show how to make a module and deploy that module to the gateway. Then I will add a stream analytics module from the edge to consume the data internally to the application.

Stream Analytics Edge

This is a talk very similar to the Azure IoT Edge talk except instead of focusing on creating the module in code, I focus on the architecture of the gateway and show how to create an edge module in stream analytics. The data consumed will most likely be the same Bluetooth devices as above.

Azure ML Edge

This talk will take a little different set of hardware. Video is such a game changer when it comes to machine learning. It really shows how powerful machine learning is. To accomplish that demonstration will require a video input. I would love to be able to use the HoloLens but I think I will settle for an easy to use camera. Once the camera is streaming data to a gateway, I will try to push a ML algorithm for computer vision down to the gateway to consume the data and output any detection events.

Alternative application interfaces

I would like to continue to be able to show the different ways an application can consume data and interact with the user and the environment without a screen. To do this, the following interfaces should be shown:

  • Audio input
  • Audio output
  • Video input
  • Control output
  • Control input

This is one I really need to think on. I would like to get a combination of each input to each output.

FuseThru advantage

One presentation should be on how Fusethru’s Fuseworks technology can greatly reduce the computing cost of distributed IoT data. In the demo, I will showcase a large amount of data moving through the Fuseworks application on a Multitech box using different incoming sensors to showcase how easy to use and how the application uses its existing power to accomplish big data queries.

Azure IoT architecture

The simplest demo. Go thorough the different styles of Azure IoT architecture and showcase a use case for each.

 

Twitter Auto Publish Powered By : XYZScripts.com