Summary This week the majority of our time was spent exploring the Magic Leap Unity tutorials and learning the Magic Leap deployment procedure. We followed Magic Leap’s documentation on how to run Unity applications via Magic Leap Remote (to accomplish zero-iteration and simulation). We investigated how event handling for the Magic Leap controller works in C# scripts. Because augmented workspaces will involve interacting with many rectangular objects in 3D space, we realized we’ll need design some kind of abstraction to handle them. As such, we started designing and implementing a system of interactive UI windows (that react to click, drag, touchpad movement, etc.). We also started working on applying images to those windows. Paul and Alan received eye prescriptions for the Magic Leap prescription lens. Progress One of our main goals this week was to set up the developer environment on Unity and deploy a Unity project onto the Magic Leap One. We followed instructions on downloading the Magic Leap Package Manager, the Magic Leap version of Unity, the Lumin SDK (which includes Magic Leap Remote, which allows you to run simulations of Magic Leap apps on the desktop), and the Magic Leap Unity package. Once everything was installed, we followed tutorials that introduced the various parts of the library Magic Leap provides for interacting with the headset and its controller. The following are some of the tutorials we went through:
We also explored zero-iteration and deployment. Eventually we got it working, but it was somewhat more involved than we originally anticipated. Some of the issues we dealt with include...
Plan for next week Paul: I will continue working on the C# script to take input from the controller (e.g., pointer coordinate position and button events). In Unity, I will be creating game objects that can be used as a texture for the basic drawing brush. Afterwards, I will put together the controller motion and click events to project game objects into Magic Leap’s augmented space. I will also research Unity’s Texture2D object that for storing pixel data of the drawings.
Peyton: I will keep working on the networking side of things. I expect to demonstrate communication between Magic Leap headset and a lab computer over WiFi by the end of the week. If time permits, I’ll start focusing on how networking will apply specifically to our project (i.e., file transfer). Alan: I will keep working on developing the features of the windows UI next week. I will also explore how to handle the real world environment as a set of planes. Tianqi: I will investigate using the Magic Leap controller to manipulate objects, since it is critical for user interactions. Specifically, I’ll focus on using the controller to move, place, and resize objects. By the end of the week, I expect to have a small demo on these functionalities.
0 Comments
|
Blog
|