Smartglasses Use ChatGPT To Help The Blind And Visually Impaired

Klah Sur

Transcript

00:00These are AI-powered smart glasses that help people who are blind or have low vision.

00:09Chicken and pumpkin soup.

00:11They're called InVision glasses, and they use ChatGPT, Google Glass hardware, and 5G connectivity

00:18to quickly and accurately process the visual information around the user and convert that into speech.

00:25Handcrafted, bruised, family-friendly, public house, local bold, flavors.

00:30The visually impaired community, we want to be independent as much as possible.

00:36And things, devices like the InVision glasses allow us to do that.

00:42We take a look at how the InVision glasses work and how they assist the blind and visually impaired.

00:49This is 5G Playbook.

00:52My name is Sam Seavey, and I am an assistive technology specialist.

00:57And I am the owner and the creator of the YouTube channel, The Blind Life.

01:01When I first got my hands on the InVision glasses, I was really impressed by the hardware.

01:07And then when I turned it on and started to use it, I was equally impressed with the features, even in the early days.

01:15Private, parking lot, farmer's jewelry, and corner...

01:19The glasses have an offline mode, but you're not going to get the best performance through that.

01:25It gets the job done, but if you want the best results, then you should be connected to some type of mobile hotspot.

01:32The performance through that hotspot now versus my previous review is much better.

01:39In the scene, there is a sidewalk in front of a store. The sidewalk is lined with pumpkins.

01:43And I'm sure that's because the adoption of 5G and faster networks and all of that.

01:49But it's truly fantastic for us.

01:53Not only is it a convenience thing, but it's very possibly a safety thing.

01:57If there's an obstacle in my way, if there's a sign that is warning me of something,

02:02the faster I can get the information about that, the better.

02:05Indicating the presence of a busy street nearby.

02:08So there are many features within the glasses which wouldn't have been possible without 5G.

02:13One such feature that I can think of is the scan text feature.

02:16Now, this is a feature that users use to scan all types of documents.

02:20And that kind of AI is actually quite complex and big, and can't be actually put onto the glasses themselves.

02:27So using 5G, we're able to keep the AI in the cloud.

02:30And we're able to send data from the glasses to the cloud.

02:33And the cloud is able to go ahead and understand the images and extract the text

02:37and help the users go ahead and read those documents more easily.

02:41Scan text.

02:42Reader. Chapter 8. Sending email.

02:45Translate text into Spanish.

02:48Envision is answering your question.

02:55Some other things that Envision does, it helps a visually impaired person to read text

02:59in over 100 different languages from pretty much any surface.

03:02Recognize faces of friends and family.

03:04Help them get descriptions of scenes around them.

03:06And even make video calls directly from the Envision glasses to a friend or a family member if they need any help.

03:12Call an ally.

03:14Opening call an ally.

03:17Ray Haddad.

03:19Connecting with Ray Haddad.

03:22So Envision started off when me and my co-founder went to a blind school in India.

03:27And we asked those kids there what kind of problems would they like to solve when they grew up.

03:31And the answers that they gave us was quite impactful.

03:34They said they'd like to go out more independently.

03:36They'd like to read books more independently.

03:38And that was a big inspiration.

03:40I like to get out and explore the world.

03:42I travel a ton.

03:44And one of the problems that I run into the most when I'm doing that, though,

03:47is accessing printed material like signs or menus or price tags.

03:53And that is probably one of the best ways that the Envision glasses help me, specifically,

03:59is to read those things when I'm out and about.

04:03I can simply just walk down the street and enjoy downtown, enjoy being out in nature,

04:10and still be able to access all the signs and business names and all of that around me, just like anybody else.

04:18So it really has changed my life tremendously.

04:23In the scene, there are three men standing together in a room.

04:26One of the men is holding a camera, possibly capturing footage for a video or recording.

Category

Transcript

Recommended