Overiew work about the this week

• More literature review was conducted about the concept last week, because in the miro that have some comment that does more research on how 3D music is different from traditional music, which I did not explain clearly in the last report.
• Review zombie game to refer to the game room to see how the sound effects give users more feedback to close connect my prototype with the team concept.

World War Z - Part 1 - AN INTENSE NEW ZOMBIE GAME!

---

Top 10 New ZOMBIE Games of 2020 | PS4, PC, XBOX ONE (4K 60FPS)

---

Even if the music target is to normal people, there could also afford me lessons that merit attention.Those music give me more inspiration with the game, especially with the video of "Top 10 New ZOMBIE Games of 2020".I will use some novel music from the video in the next prototype.

• Thinking more motivate users to use this prototype, for example, the music of different levels about the game and development storyline and then develop it with the unity scene.

Prototype

This week,i finished design process separate to three parts and I finished it with three weeks.

1.Design game flow with music and Finding music resource and recording audio narration

• Lightning sound outside the window

• The sound of opening the door

• The sound of the house leaking after entering the door

• The sound of the sword slashing towards the enemy

• The sound of the enemy being knocked down

• The sound of game victory

2.Design game scenes with unity

3.Creating 3D surround background music with previous music resource and then combine the music with game scenes

I use the software of Adobe Audition and the plugin Panorama to develop the music. I main chose two methods to create the six 3d surround sound background music.

Prototype

In this week,i finish the prototype.The concept is a game that help the visually impaired man who would like to exercise their hearing sensitivity. This project focus on how use the 3D surrounds music that improve the immersion and narrative of the game which is am responsible for designing the music used in the game. The technology will include using Adobe audition software to make the 3D game surrounds. And then I will using Unity to design the sounds as that put sounds in a 3d space and virtually move the player in the 3d space to change the sound levels from 4 speakers.

First, there are not many games on the market for training blind people's hearing. There are some cases on YouTube: Blind Men (Xbox One) Achievement Walkthrough and Inside the Deku Tree, etc. But these cases mostly focus on gamepads and simple storyline plots. Secondly, in the few game cases, games with physical interactions have not been discovered, and the settings of this game will fill this gap. At the same time, it can help visually impaired man to do some sports when training listening.

Critiques

After finished the presentation about the prototype, I finished the Team-based critiques for allocated teams on the Miro board about three people with 3 hours team online meeting.

Report feedback

• What is the one BIG question you have about the Prototype deliverable?

The big question about the prototype is about the technology about the unity.how to show the user of the gameplay flow with 3D surround music.

• What is your key aim for your prototype (or part of the prototype)? It is the main thing that you want to have worked or completed or figured out for your prototype.

the key aim for the prototype is linking the game with 3D surround music which will help how the music presentation of the game

• What concerns or needs do you have for getting it done?

I am working with creat unity scenes of the game and study tutorials with adobe to make 3D surround music.

About work

This week, I create some unity scenes which simulate a scene that the user plays the game. The scene next week will be improved, which makes the scene more realistic. At the same time, I find some music that will be used in the game, and I tried to use the audition to make the music to 3D surround background music.

Tuesday Studio

In studio, I reported the question as following:

• What did you achieve over the break?

• I did interview with the project including interview questions and tasks. We would like to get some feedback about the project function or game flow is reasonable or where we need to rethink.
• Working with an online tutorial with this project.

• What is your main task for the next week?

• Main task for the next week is Still working with Ardunio and finished about 40% of all work.

• What concerns do you have about completing？

About the time of online shopping with Arduino sensors and kits.If the sensors not on time, we will use plan B with other sensors.

Thursday Workshop

In the workshop, I reported to tutor what technology was applied to this project.

Firstly, i introduced the project.This work is a game that provides visually impaired people who would exercise hearing sensitivity.

Because the target user is unique, they can not see the world, so the game sound is useful to user. The game will play sound effects through four speakers for the audience to listen to. I am responsible for designing the music used in the game. The technology will include using Adobe audition software to make the 3D game surrounds.

And then. I will using Unity to design the sounds as that put sounds in a 3d space and virtually move the player in the 3d space to change the sound levels from 4 speakers.

Precautions when design and play the game and interview

This week, I made the interview plan for our project, and I have summarised the precautions of design and play the game

3D suround background music

After this week's group meeting, the team members agreed that the sound effects of the game are a more critical part of our game design, so my group task has changed. In the future prototype, I will design the 3D surround background music in the game, and use unity to show how to use the sound effects of this part of the game.

Tuesday Studio

In-studio, I reported the question as following:

• What did you achieve over the break?

• I interviewed with the project, including interview questions and tasks. We want to get some feedback about the project function or game flow is reasonable or where we need to rethink.
• Working with an online tutorial with this project.

• What is your main task for the next week?

• The main task for the next week is Still working with Ardunio and finished about 40% of all work.

• What concerns do you have about completing？

About the time of online shopping with Arduino sensors and kits. If the sensors not on time, we will use plan B with other sensors.

Thursday Workshop

In the workshop, I reported to tutor what technology was applied to this project.

Firstly, I introduced the project. This work is a game that provides visually impaired people who would exercise hearing sensitivity.

Because the target user is unique, they can not see the world, so the game sound is useful to the user. The game will play sound effects through four speakers for the audience to listen. I am responsible for designing the music used in the game. The technology will include using Adobe audition software to make the 3D game surrounds.

And then. I will be using Unity to design the sounds as that put sounds in a 3d space and virtually move the player in the 3d space to change the sound levels from 4 speakers.

Precautions when design and play the game and interview

This week, I made the interview plan for our project, and I have summarised the precautions of design and play the game

3D surround background music

After this week's group meeting, the team members agreed that the sound effects of the game are a more critical part of our game design, so my group task has changed. In the future prototype, I will design the 3D surround background music in the game, and use Unity to show how to use the sound effects of this part of the game.

Proposal

This week,i finished the writing work with proposal.I responses about introduce about the project part and relevance to theme part with team proposal and individual proposal.

Arduino

I found some tutorial video in Youtube,which were introduced about the TTS(Text to Speech TTS Converter).This video introduces playing the voice part of the game by controlling the TTS voice synthesis module.This may require the following accessories:

• Arduino development board
• Speaker
• Amplifier circuit
• Regulated power supply
• Connection cable

About Miro

About online coures

During the meeting on Tuesday and Thursday, the team and I organized a team report and individual report to tutor. We also discussed the content of the project proposal.

Team meeting

This week, our team finished the group meeting. We separated each team member's task and discussed the response to feedback.

The response to feedback gave us more inspiration for the project. For example, using 3D- headphones in this game, the target audience expanded to ordinary people. It will be useful in the next process that we transform ours' project.

Individual works

I finished about the team work's project proposal part about relevance to theme and i will finished the individual proposal as soon as possible in the next Monday and Tuesday

About proposal

This week, we finished the first proposal of the physical device, which including the video and pitch. The name of our system is Hasaki, which is a hearing-centric swordman somatic game.

Individual task-Scenario

I created the scenario of the proposal. The storyline is as follows:

• Jim lost his eyesight because of an accident. The sudden change made him very uncomfortable. The color world now has only empty darkness, and he feels as if he has lost all contact with this world.
• The world has changed since he knew Hasaki from a friend.
• When he first played the game, he was very unskilled. He is insensitive to sound. He often lost the game because he couldn't feel the sound.
• With practice, he gradually became more comfortable, and he could adapt to more challenging games.
• The monotonous life before was fun because of a game designed for him. He was braver to re-perceive the world with his voice.

Individual task -Target users

I created two target users with this work. One personal is for common people, and another is for blindmen.

Comments of presentation

Bata skwad

The problem of the trust of the phone is always dull people. The theme forced on Personality is a great way to reconsider the issue. How its work process is clear to show in the presentation. Trying to rethink about the machine exterior which suitable to ergonomics.

Fitlody

The overall work is pretty good. The combination of fitness and music to design somatosensory games is an exciting starting point. The sketch can let users know this device more clearly. Persona is designed to be very concise so that the audience can clearly understand the target user. Perhaps the scenario could be further improved, but the current is not very detailed. Body storming is very interesting, and from the video, we will know how this device works.

Negative Nancies

This idea is fascinating, the introduction and storyboard of this device are very detailed. However, The sketch maybe needs to improve. Tring to make the sketch more detailed. Target users possibly need to add motivation and user detail.

EMS - Housework

The design of the personas is excellent. I could easily find the characteristics of the user. Consider the detailed storyboard.

Zoomista

The project has a useful review of the literature. In the presentation, each part has a bright showing. Using emotional color is an enchanting design idea.

Botherhood

Brotherhood could solve the problem when people are waiting for a long time—considering make the video voice louder because sometimes the dubbing of the video is not particularly precise. In addition, Showing technique solutions are significant parts because it will be showing how it works.

Lome

Using flower is interesting in the design idea. The scenarios are clear. On the other hand, Trying to find a way to encourage users to keep a good mood.

Innovation Lab

In the innovation lab I learned the skills of sawing wood, drilling, painting, and laser cutting. The inspiration for me is about that i know a lot manufacturing knowledge which i could use the skill in future design projects.

World cafe

The world cafe has three rounds, and the poster is separated with a different theme. Each round, we need to discuss with the various content.I will record some interesting table discuss as following:

• Process: 8 different ideas with different table and discussion in this time.
• Goal:Projects identified

Round 1: Context(30min)

Round2:(45min)

We design for the music lover. Some of these projects will be applied to public space, and the other will be applied to personal creation. What was interesting in the discussion was that we proposed how to transform one of these ideas. The final exam results will be applied to individual syllables, through which we can record the results of this semester and even the entire school year.

Round: (45min)

Guests Sharing Meeting

We have a remote meeting with UQ previous students who live in UK now.

I got some work experience from the sharing guests.The interesting meeting session is that we need to write the detail information about:

• My name is ...
• I am a ...
• I am unique because ...

The process will help us to know our advantage and it will give us clear career positioning.

About my presentation

In my presentation, I made a big mistake. I feel too much tension, and the performance was not plain sailing. It needs me to rethink profoundly because when you feel nervous, it is difficult to convey my thoughts to the audience accurately. In the next presentation, I need to avoid nervousness, which will make the presentation more attractive.

Presentation Reflection

In this week's presentation, everyone shared their inspiration. We then categorized these inspirations, which will be helpful for subsequent group work.

Below I will record a few memorable cases in meeting. These inspirations are all worth learning for me.

Speaking shooting game

As far as the design concept is concerned, the users of this device can use the device to make the words they say turn into bullets to fight against the enemy. I think this idea is very novel.

The interaction of this design is also novel. Because of the different ways of interaction, the entertainment of the entire device has increased.

From a design perspective, this device also achieves the purpose of decompressing for users.

Smart bedroom

The concept made only home, which is rarely mentioned in the presentation. At the same time, this design is combined with human emotion.

The way of interaction is novel. This smart bed analyzes the user's emotions by identifying data on human features and body.

Interestingly, this design is combined with the concept of emotional triggers of colors. Some other design inspiration can add a similar theoretical basis.

About future work

Due to the travel ban, I missed some activities in the Innovation Lab, which has left me behind other classmates. I hope I can attend these events on time next week. In addition, for the concept of design pitch, after the presentation, Lorna put forward some suggestions for modification, and I need to refine the design concept next week.

TASK BOX

Background and social problem:

In contemporary society, parents always encounter many problems when educating the next generation. For example, students have poor self-learning ability, poor learning habits, and low efficiency in doing homework。Therefore, there is a need to understand the influences of human factors to design digital learning environments that best suit every learner (Chen & Wang, 2019). Enhancing the fun and self-learning is the consideration of cultivating good habits for the next generation.

Research areas:

New learning styles of young learners

Idea detail:

It is a task box, which consists of six electronic screens.

Users can record tasks at each time of day through voice interaction. Tasks are arranged in the text on the electronic screen in the previous section. When the user completes the task within the prescribed period, the corresponding task on the screen will disappear.

The upper part of the box is an electronic calendar, and the color of the corresponding date part on the screen will turn green. When all tasks for the month are completed on time, the box will open from the top, and users can take out the reward gifts that parents put into the box early.

Target user:

The younger learners 6 to 12 who have poor self-control in learning.

Design aim： Provide a playful new type of auxiliary learning method for younger learners who have poor self-control in learning and finished school task and life task

Interactions method: Voice interactions

Automatic Speech Recognition（ASR）：The machine converts the user's voice signal into corresponding text through recognition.

Natural Language Processing（NLP）：It focuses on communication between computers and humans using natural language.

IInspiration

About the Idea, my inspiration comes from the seven HCI grand challenges. From the sixth part, the book describes the challenges for learning and creativity in technologically advanced and intelligent environments. There reference one main issue about the new generation of learners.

#Voice interactions# #young learners #

Reference

Chen, S., . Y., & Wang, J., . H. (2019). Human factors and personalized digital learning: An editorial. International Journal of Human–Computer Interaction, 35(4–5), 297–298. doi:10.1080/10447318.2018.1542891

TASK BOX

Background and social problem:

In contemporary society, parents always encounter many problems when educating the next generation. For example, students have poor self-learning ability, poor learning habits, and low efficiency in doing homework。Therefore, there is a need to understand the influences of human factors to design digital learning environments that best suit every learner (Chen & Wang, 2019). Enhancing the fun and self-learning is the consideration of cultivating good habits for the next generation.

Research areas:

New learning styles of young learners

Idea detail:

It is a task box, which consists of six electronic screens.

Users can record tasks at each time of day through voice interaction. Tasks are arranged in the text on the electronic screen in the previous section. When the user completes the task within the prescribed period, the corresponding task on the screen will disappear.

The upper part of the box is an electronic calendar, and the color of the corresponding date part on the screen will turn green. When all tasks for the month are completed on time, the box will open from the top, and users can take out the reward gifts that parents put into the box early.

Target user:

The younger learners 6 to 12 who have poor self-control in learning.

Design aim： Provide a playful new type of auxiliary learning method for younger learners who have poor self-control in learning and finished school task and life task

Interactions method: Voice interactions

Automatic Speech Recognition（ASR）：The machine converts the user's voice signal into corresponding text through recognition.

Natural Language Processing（NLP）：It focuses on communication between computers and humans using natural language.

IInspiration

About the Idea, my inspiration comes from the seven HCI grand challenges. From the sixth part, the book describes the challenges for learning and creativity in technologically advanced and intelligent environments. There reference one main issue about the new generation of learners.

#Voice interactions# #young learners #

Reference

Chen, S., . Y., & Wang, J., . H. (2019). Human factors and personalized digital learning: An editorial. International Journal of Human–Computer Interaction, 35(4–5), 297–298. doi:10.1080/10447318.2018.1542891

About the course

In week one,before the class i read the social organisation & democracy part. In the class, I studied online and firstly we discuses 10 mins about what we what our fears, hopes, questions and expectations .We learned the HCI 7 Grand Challenges.After the class i have fresh understudying about HCI grand challenges.

Working process

After class i finished the task on the blackboard which is important when we go to lab.The content is complex and some information i reviewed about two times. In the beginning when i received the pitch task, i am not really sure what to do next project because i have no inspiration. After review the resource of class and check some design cases in website, I have new idea.

Source of inspiration:

Many contemporary people have the habit of doing daily planning. This is a very good habit, which can help one to complete the task efficiently every day. Children rarely have good self-control. They need to complete homework and tasks every day. But some children have bad habits of delay, which is a problem that many parents are boring.

Concept of design:

I will design a new type of physical interaction aid to motivate children to complete the tasks they need to complete every day. This device consists of 30 boxes. The screens of these boxes can be recorded by the user to record daily tasks and displayed on the electronic screen. Parents can put small gifts in each box. When the child completes the task, the box will pop open and the child can get a reward.

Aim of design:

This device can interact both visually and through audio. It is a novel interactive device that helps children efficiently complete daily learning tasks and life plans, and helps children develop good habits.

About future work

In this Saturday and Sunday, i will finished the posters design and on Monday i will prepare my presentation.Beside,for a long time, research deep in the project is needed.For example, i think the device is too big and it is not flexible for users.

Reference

7 HCI GRAND CHALLENGES9:10 - 9:30 Stephanidis, C., Salvendy, G., Antona, M., Chen, J. Y., Dong, J., Duffy, V. G., ... & Guo, Y. (2019). Seven HCI grand

challenges. International Journal of Human–Computer Interaction, 35(14), 1229-1269.