As I am visiting my family and do not have a lot of time to work on my prototype, while some progress is being made slowly I thought I would take this time to work on my Formative assignment

Similar Project – Research

AI Virtual Painter – Hassan Murtaza

This project is the original idea I came across when exploring my switch from eye tracking based accessibility in videogames. It lays the groundwork for my idea exploring the use of OpenCV combined with the MediaPipe library to create a painting tool.

This Virtual Painter project works by using MediaPipe combined with OpenCV to locate and record the position of an individuals finger tips. With that information the x and y coordinates of a persons fingers on the screen are used as the center of spheres drawn by OpenCV, effectively creating a virtual canvas on which an individual can draw upon.

He further explores the capabilities of the two libraries by using the number of fingers as an input source to allow for more functionality, dedicating specific regions at the top of the screen that when 2 fingers are lifted inside of them different effects occur. As seen in the screenshot he allows users to select from a variety of different colors as well as allowing for them to erase what they have already drawn.