Team AI-LUL (Artificial Intelligence-LUL)

Photo: Top-left (Khee Ri Han), Bottom-left (Ivan Ling Ting Yang), Top-right (Chia Tze Hank), Middle-RIght (Delveer Singh), Bottom Right (Frederick Wong Kui Siung)

This project was initiated to participate in Aickathon 2018 (16th-18th Nov). Its primary goal was to enable advertisers to receive real-time customer feedback with an automated system using Artificial Intelligence & Computer Vision in public areas.

The problem:

Advertisements that are hosted on billboards/public areas often do not have a systematic way of indicating whether customers are/aren’t attracted to the advertised product. Investors/Advertisers do not receive solid feedback on their advertisement’s performances, unlike Youtube/Facebook Ads.

Mall
An advertisement board in a shopping mall

Solution:

Using computer vision and Artificial Intelligence, we are able to determine the ratings of a customer’s emotion towards the advertisement and their class judged based on their clothing attire.

Picture1
Adnalytics User Interface

Workflow of the system:

  1. The camera is initialized and begins tracking faces that are looking at the camera.
  2. The advertisements shown at the left side are switching in random order, attempting to attract the customer’s attention.
  3. A shot of the person’s face and upper body is taken and sent to Coqnitic’s face and fashion API to distinguish the emotion, attire type of the character, finally classifying the data into classes such as blue-collar worker, hipster, child etc.
  4. The response of the character’s emotion is then recorded according to the ad displayed at that time as a dataset for future reference.

Demo Video:

The Hackathon:

Aickathon 2018 is hosted by the UM App Club, there were many participants coming around from different parts of Malaysia, making it one of the toughest competitive scenes I have ever entered. The main theme of the hackathon is Smart City and Fashion, participants are required to use at least 2 Coqnitics API to develop a solution which involves fashion or city-related problems.

48394381_291974104788296_5621971749328388096_o.jpg
Crazy students hungry for innovation!
48368760_291982171454156_1147372982386032640_o.jpg
Mr Ivan posing at the camera, smile! 😀
48369342_291975654788141_5503013236972191744_o.jpg
Bargaining ideas

Appreciations

48374763_291980491454324_8769490828000231424_n.jpg
Kokokrunch, our spirit animal/food of LUL Enterprise.

Despite our loss in the qualifying rounds, it has been a fruitful event for us as we made a few more friends from UM ( great people I tell you), understood the latest trends on Artificial Intelligence, and amazing ideas from different people around Malaysia!

Its quite an eye-opener to me as there are so many young passionate people out there as I used to think Malaysia is quite dead when it comes to innovation ( apparently I am so wrong). Kudos to all the innovators out there trying to fulfill their dreams! 😀

We hope to bring this message out to everyone who is interested in Artificial Intelligence or any other modern technologies: Don’t be afraid to try! There are always plenty of heart-warming people out there to help you achieve your dreams!