Experiential Design Final Project: Completed Experience

 

 

Experiential Design

2/12/2022 - 7/12/2022 (Week 14 - 16)

Teng Kwok Sang / 0343089 / Bachelor of Computer Science (Hons)

Experiential Design

Final Project: Completed Experience

------------------------------------------------------------------------------------------------------------------------------

The full Experiential Design Blogs

Task assigned / Instruction

Based on our previous tasks, we were asked to utilize our visual asset and refine the prototype into a complete working and functional product experience.

Week 14 (2/12/2022)

3D model bug

After going through the whole day searching for the solution for the old issue on my 3D models, I still couldn't solve the problem.

Week 14 (3/12/2022)

3D model

After going through the whole day searching for 3D models, I couldn't find any of the free 3D models with the animation of exercise that I want. So I'm considering to replace the 3D models with half transparent videos. But Mr Razif recommended me to try to animate the 3D using motion capture via video, I can act out the motion and capture the keys. However my only concern is I'm afraid that I dont have enough time for that. Mr Razif then recommended me to try the AI app call Plask. I tried it, it works, but not good enough, but I guess it works for my project.

Week 15 (4/12/2022)

Completing the UI

Today I will try to complete the UI, the first problem I faced is I couldn't store the variable across Scenes. After doing hours of research, I realized I just need to simply change the String that store the variables into Static.

Meanwhile, I recorded quite some video recording to keep track of my own progress throughout the process of completing the experience.

Week 15 (5/12/2022)

Completing the UI

For today, I will complete the entire UI for the AR app, so now the only thing awaiting me to solve it the issue with 3D models.

Week 14 (6/12/2022)

Completing the 3D

I captured the motion for all 6 of my exercises, then I successfully implemented them into 3D and bring them into Unity. However there's one issue remains, which is the 3D model isnt acting out what animation it suppose to execute if i implement them on ground. Hence, I tried my first solution, which is implementing image target instead of groundplane target, so image target wont need to regenerate a new model. But then, I realized when I slanted the image target until near 60-70 degree to mimic the ground, then it will fail to capture the image target. Now I know that its not suitable for my case, because i cannot just take the camera and point at ground, then it will lost the purpose. 

So in the end what I do is I stick the 3D model on UI level, so the user can still continue to follow whatever exercises and move the 3D model do. Then the users wouldn't need to worry about finding the ground and stuff, its easier to navigate for them.

Week 15 (7/12/2022)

Finally, I finished implemented everything into the app I wanted to create, with similar output as initial e-portfolio. The video will be showcasing how it looks in Unity.

Week 15 (9/12/2022)

Finally, I added a Main Menu for the app.

Now, this is the Main Menu, users will need to press START in order to prompt to the scene where they are able to choose what exercise to do. Other than that, the user can press QUIT to completely close the application. The initial End Scene that displays all the stats, its Exit button no longer directs back to the exercise selection page, but instead it is directed to this Main Menu page.

Week 16 (14/12/2022)

After reviewing back to how I was taught by Mr Razif to build a Unity to apk file on week 6, I successfully build and installed the apk on my phone. However, I noticed a problem, which is I forgot to change the orientation of the app, in default the app's orientation is portrait. 

Main Menu

Option Page

So, I changed the default orientation to landscape, then build and run the software on phone. 

Then I noticed some issue, which is the UI is a lot smaller than how it should be scaling, so I adjusted the scaling and position of every single element on Unity.

The differences between the proposed app in e-portfolio stage and the final outcome: 

• Orientation mode
  In contrast to the final product, the proposed orientation mode is portrait mode, but I changed to landscape mode as what Mr Razif recommended me earlier.
  

• 3D Model
  Initially, the 3D Model was planned to stick on the floor. However due to vulforia feature compatibility issue, I had the 3D model on the UI layer. But the end result somehow attached to the ground without applying vulforia, which is a good thing.
  

• Main Menu Feature
  In the proposed e-portfolio, I didn't plan to add a Main Menu. However, I decided to implement Main Menu to create a more complete experience.
  
• Camera
  
  In the proposed e-portfolio, I wanted to allow the app to use front camera. But due to technical issue, I couldn't find a way to make it work on front camera on Unity, that's the only limitation i face.
  

Final Submission 

Here is a video capturing all my app features and the final outcome.

------------------------------------------------------------------------------------------------------------------------------

REFLECTION

In the first week, when I saw the previous semester's work, I was amazed by how good their work is, now looking at what I had achieved in this Project, I feel so happy. I was worried that I would run out of time to complete my other module's tasks. Fortunately, this project was done on time. Thanks to this project, I have become more comfortable with Unity, and more familiar with the techniques.

 

In fact, I have learned a lot about creating AR stuff this semester while studying this module, especially the knowledge about UI and how to properly implement and use it however I can imagine. Notably I'm taking the module Game Development on the same semester as well, so I'm able to implement some of the knowledge of Unity and C# codes onto my Game Development too.

I enjoy doing this project and also solving all the problems that I faced. I believe that there is a lot more for me to improve. However, I was happy with the outcome as this semester is my first exposure to AR, Unity, and also coding with C#. I definitely appreciate all the knowledge I learned from this module. It was a very enjoyable process because I managed to combine my favourite hobby, sports onto creating my first ever AR app.

 

Lastly, I couldn't express my gratitude enough to Mr. Razif for his heart and effort to explain things to us and giving us honest and constructive feedback in order to help us improve our skills and works throughout the entire semester. I appreciate his warmth and willingness to facilitate the class and clarify information. All in all, I am grateful for taking this module this semester with Mr Razif. Even though it's extremely tiring to take all 3 module of Mr Razif (Sonic Design, Experiential Design, Game Development) at the same time, but it's a fun journey, and I learnt a lot of knowledge through the process.