These smartglasses use ChatGPT to help the blind and visually impaired

Business Insider

Envision Glasses use Chat-GPT and Google Glass hardware to process the visual information around the user and convert that into speech.

Transcript

00:00 (upbeat music)

00:02 These are AI-powered smart glasses

00:05 that help people who are blind or have low vision.

00:08 - Chicken and pumpkin soup.

00:10 - They're called Envision glasses,

00:13 and they use ChatGPT, Google Glass hardware,

00:16 and 5G connectivity to quickly and accurately process

00:20 the visual information around the user

00:22 and convert that into speech.

00:24 - Handcrafted, bruised, family-friendly,

00:27 public house, local bold, flavors.

00:30 - The visually impaired community,

00:32 we want to be independent as much as possible.

00:36 And things, devices like the Envision glasses

00:40 allow us to do that.

00:42 - We take a look at how the Envision glasses work

00:44 and how they assist the blind and visually impaired.

00:48 This is 5G Playbook.

00:50 - My name is Sam Seavey,

00:53 and I am an assistive technology specialist,

00:56 and I am the owner and the creator

00:58 of the YouTube channel, The Blind Life.

01:01 When I first got my hands on the Envision glasses,

01:03 I was really impressed by the hardware.

01:06 And then when I turned it on and started to use it,

01:10 I was equally impressed with the features,

01:13 even in the early days.

01:15 - Private, parking lot, farmer's jewelry, and corner-

01:18 - The glasses have an offline mode,

01:21 but you're not gonna get the best performance through that.

01:24 It gets the job done, but if you want the best results,

01:28 then you should be connected to some type

01:31 of mobile hotspot.

01:32 The performance through that hotspot now

01:35 versus my previous review is much better.

01:38 - In the scene, there is a sidewalk in front of a store.

01:41 The sidewalk is lined with pumpkins.

01:43 - And I'm sure that's because the adoption of 5G

01:46 and faster networks and all of that,

01:49 but it's truly fantastic for us.

01:52 Not only is it a convenience thing,

01:54 but it's very possibly a safety thing.

01:56 If there's an obstacle in my way,

01:59 if there's a sign that is warning me of something,

02:02 the faster I can get the information about that, the better.

02:05 - Indicating the presence of a busy street nearby.

02:08 - So there are many features within the glasses

02:10 which wouldn't have been possible without 5G.

02:13 One such feature that I can think of

02:14 is the scan text feature.

02:16 Now, this is a feature that users use

02:18 to scan all types of documents.

02:20 And that kind of AI is actually quite complex and big

02:23 and can't be actually put onto the glasses themselves.

02:26 So using 5G, we're able to keep the AI in the cloud

02:30 and we're able to send data from the glasses to the cloud

02:32 and the cloud is able to go ahead and understand the images

02:35 and extract the text and help the users

02:38 go ahead and read those documents more easily.

02:40 - Scan text.

02:42 - Reader, chapter eight, sending email.

02:45 - Translate text into Spanish.

02:48 - Envision is answering your question.

02:51 - (speaks in foreign language)

02:55 - Some other things that Envision does,

02:56 it helps a visually impaired person to read text

02:59 in over a hundred different languages

03:00 from pretty much any surface,

03:01 recognize faces of friends and family,

03:04 help them get descriptions of scenes around them

03:06 and even make video calls directly from the Envision glasses

03:09 to a friend or a family member if they need any help.

03:12 - Call an ally.

03:13 - Opening call an ally.

03:16 Ray Haddad.

03:18 - Giving a call. - Connecting with Ray Haddad.

03:22 - So Envision started off when me and my co-founder

03:25 went to a blind school in India

03:26 and we asked those kids there what kind of problems

03:28 would they like to solve when they grew up

03:30 and the answers that they gave us was quite impactful.

03:33 They said they'd like to go out more independently,

03:35 they'd like to read books more independently

03:37 and that was a big inspiration.

03:39 - I like to get out and explore the world.

03:41 I travel a ton and one of the problems

03:44 that I run into the most when I'm doing that though

03:47 is accessing printed material like signs or menus

03:51 or price tags and that is probably one of the best ways

03:55 that the Envision glasses help me specifically

03:59 is to read those things when I'm out and about.

04:02 I can simply just walk down the street

04:05 and enjoy downtown, enjoy being out in nature

04:09 and still be able to access all the signs

04:13 and business names and all of that around me

04:16 just like anybody else.

04:17 So it really has changed my life tremendously.

04:20 - In the scene, there are three men

04:24 standing together in a room.

04:26 One of the men is holding a camera

04:27 possibly capturing footage for a video or recording.

04:31 (upbeat music)

04:33 (gentle music)

04:36 (gentle music)

04:38 (gentle music)

Category

Transcript

Recommended