Interactive Intelligent Product

Sign

The course Interactive Intelligent Product aims to help students understand the main paradigms in sensing, data collection, signal processing and machine learning and to apply them in meaningful design solutions of intelligent interactive products by empowering design problems that involve prediction, decision and adaptation.

In my work for this course, the primary goal was to enlighten and facilitate the life of the user, by addressing a broad societal problem. The source code that was used within this project was provided by the University. This code has been altered and complemented where needed, in order to realize the product as designed.

Studies show that being speech impaired or both hearing and speech impaired results in a decrease of the overall quality of life, since this target group is dependent on sign-language and someone to translate their sign-language in order to communicate to his or her surroundings and interact with other people. SIGN is an interactive intelligent product that is designed to give a ‘voice to the voiceless’ and restore a crucial part of the user’s feeling of independence. Machine learning and gesture recognition were used to realize a working prototype of this product.

AFFILIATION
Master Industrial Design (TU/e)


ACTIVITY

Premaster course


COURSE NAME
Interactive Intelligent Product


COURSE COORDINATOR
dr. J. Liang


PERIOD
S1 Q2 (2018/2019)


TEAM
Maud Oomen, Emo Nuijens,
Lina Simme


KEYWORDS
Math, Data & Computing, Technology & Realization, Machine Learning, Artificial Intelligence, Mutism, Wearable, Data Collection, Model, Gesture Recognition, Sign Language


GRADE
9/10

Development

The course Creative Programming provided me with the experience that if I have an idea for a design or an interaction in mind and I want to make it experienceable through code, I can. As a result, I was less insecure and scared for the next technical course in line: Interactive Intelligent Product. When it was pronounced in the first lecture that this course was going to be a combination of the courses From Idea to Design and Creative Programming, my expectations of this course evolved from slightly insecure and scared to enthusiastic and interested. Where Creative Programming focussed more on the skill of writing code instead of creating something within an actual context and problem statement, it felt like the perfect next step to combine these two aspects of design and learn how to really implement coding into an actual realizable product.

At first, I was a bit confused to receive all the example codes instead of writing code myself, but now I understand that it would not have been achievable to learn to write this code myself within the scope of this course. However, this course has thought me that I am capable of understanding the pure basics of machine learning and artificial intelligence, which feels unreal to me. I can honestly say that I have never envisioned myself capable of working on projects and codes like these and even succeeding in doing those activities.

I remember dr. J. (Rong-Hao) Liang - the lecturer of this course - saying in his final speech at the end of the last lecture that we can consider ourself magicians from this point on: I know now that there is no longer a barrier when designing products for a specific user and context. Every product can be an interactive and intelligent one, accomplished by the use of machine learning.

Learning about the basic knowledge of machine learning and being invited to understand, work with and alter complicated but intriguing example codes will help me to be able to think further out of the box and make my future designs more limit-testing, which is the primary insight that I’ve gained through this course.

Furthermore, I am proud of myself concerning my effort and my motivation for this course by attending every lecture and workshop, paying attention, making notes, participating in the examples shown during the workshops, and succeeding while performing these activities. Unfortunately I do feel like I could (and should) have done more. This course has been groundbreaking for me in general, but I haven’t taken all the opportunities that I should have taken. I should have taken the accelerometer home more often and invest more time in trying to understand, work with and alter the example codes to fit with the goal of our project. I did do this one time during the course and I did succeed in solving an issue within the code, but I took this experience too easily as a confirmation and as a reason to go back to my conventional skills again for the rest of the project. Of course, other aspects should also be taken into account concerning this statement. There was only one accelerometer available for the whole group, and one member of the project group was a bit more assertive than I was in asking to take the accelerometer home and working with the code. But, I should not have used these aspects as an excuse to avoid working with the provided codes and making the knowledge my own. Being aware of this, I am planning to be more assertive, not only towards others but more primarily towards myself for future design challenges. If I want to become more aware and more capable within this field of design, I need to step up my game and no longer make excuses to go back to my conventional skills within group projects.