- il y a 5 semaines
Founder’s Story AI to See the World
Catégorie
🤖
TechnologieTranscription
00:04Ok, merci beaucoup pour venir, et je suis ici pour parler de Be My Eyes.
00:10Je m'appelle Hans-Jergen Weiberg, je suis le founder de Be My Eyes, je suis aussi blind, je viens
00:19de Danemark.
00:21Et la histoire de Be My Eyes est que j'ai travaillé pour le Danemark pour un nombre d'années
00:31et dans cette période de temps, j'ai rencontré beaucoup de personnes comme moi et j'ai aussi rencontré un
00:42jeune homme et il me dit qu'il était utilisé FaceTime quand il était alone.
00:49Il a fait un téléphone et il a besoin de quelqu'un pour voir quelque chose.
00:52Et il a fait un appel à ses amis et sa famille.
00:56Et il a dit qu'il a toujours besoin de quelqu'un.
01:00Et je me suis dit, peut-être qu'on peut faire une groupe que vous pouvez vous dire, donc vous
01:04ne devriez pas à savoir qui vous pouvez vous dire.
01:07Je ne suis pas un technic personnel, donc je n'avais pas de soucire commenter ou pas à faire un
01:12app ou autre.
01:13Je n'avais pas de soucire, mais je n'avais pas de soucire, mais je n'avais pas de soucire.
01:17Et je n'avais pas de soucire, mais j'avais pas de soucire à trouver ce Be My Eyes app.
01:27Et on a fait, et on a fait un peu comme ça.
01:33Un peu comme ça, c'est...
01:37J'ai pensé que je suis en ma kitchen et je ne sais pas.
01:40Et je n'avais pas de soucire, mais je n'avais pas de soucire.
01:50Et je n'avais pas de soucire à la Marseille.
01:55Je n'avais pas de soucire à la Marseille.
01:59And then the Be My Eyes server will notify 20 of our volunteers about, hey, there's a blind guy who
02:08needs your assistance.
02:10And the first one of those 20 people to swipe yes will be connected with me in a live video
02:18call.
02:19And I will point my phone at something in front of me and ask, is this yogurt and what's the
02:26expiry date?
02:27Or this piece of letter, can you tell me more about that?
02:31Or I have dropped something on the floor, can you help me find it?
02:34And the volunteer will say, okay, please move a little to the right and a little to the left and
02:38so on.
02:40And that is the very short version of what we do.
02:48As I mentioned, I'm blind, so I'm going to really see the slides here.
02:58We have over 7 million volunteers globally, and we are now providing assistance to 600 and something thousand blind and
03:14low vision people across the globe.
03:16We can connect people in 185 different languages.
03:21This is super important because many people only speak their own language.
03:27So it is important that we can provide assistance in your native language.
03:35And with 7.3 million volunteers, we can easily provide assistance in your own language.
03:46And anywhere in the world where you have access to the internet, you can use Be My Eyes.
03:55And even now, I'm from Denmark and I'm in France, I can easily get assistance in Danish even though I
04:02am in the middle of Paris.
04:04Because I have chosen Danish as my language.
04:07If I make a call at 3 o'clock in the morning, we do not send notifications to anyone at
04:143 o'clock in the morning.
04:15But then we can always find someone in another time zone.
04:19And that is how we can assist 24-7 without disturbing our volunteers 24-7.
04:27Be My Eyes is a free service.
04:31And we decided it should be free because when we looked at the numbers in the beginning, we can see
04:38that 90% of the blind people in this world, they live in the so-called global south.
04:46We also know that many of them do have smartphones and somewhat cheap access to the internet.
04:57But we cannot charge them $10 a month or something.
05:00So we decided, also because it is really the volunteers who are doing the work.
05:05So we decided that Be My Eyes should be a free service.
05:10We still need to make some money though.
05:14Does this say business?
05:16Yeah, business plan.
05:17Yeah.
05:21So our business plan is that you can call a volunteer, but you can also call a company.
05:28So we have made partnerships with companies like Google, Microsoft, LinkedIn, Spotify, Trucks and Gamble, Lego from Denmark, which is
05:41super important.
05:42And the point is that when you, as a blind person, you need assistance, it's difficult to find the phone
05:55number for a company.
05:57So we have made a service directory where you can go in and find the relevant numbers and contact information
06:05on companies.
06:07And let's take Microsoft as an example.
06:11I have an issue with some Microsoft products.
06:15And then I will make a call to Microsoft.
06:18And if I use the Microsoft phone number, I will get a random agent at Microsoft.
06:25They have thousands of agents handling these calls.
06:28Most of them don't know anything about being blind.
06:32But they do have, like, 10 or 15 agents who get all the calls from Be My Eyes.
06:40So, and they very fast grow in to be experts about being blind and what issues they will have with
06:49Microsoft products.
06:50So, the benefit for Microsoft is that they can handle these calls a lot faster because the agent actually knows
07:03about what a screen reader is and all that.
07:05So, it's not only Microsoft being a good company, it's also Microsoft being a real business company and doing this
07:17from a business perspective, actually saving money because the agents can handle these calls a lot faster.
07:26Some of the agents have had more than 10,000 calls from the Be My Eyes users.
07:33So, these agents are real experts and can give a fantastic service.
07:41And the later thing is that we have introduced AI into the Microsoft support as well.
07:48So, now you can choose if you want to use the AI to handle your request.
07:56And maybe a lot of people hate when they get an AI bot.
08:01But for a blind person, it can be a real benefit because the AI will provide you with a five
08:09-step list of things to do to solve your issue.
08:14And as a blind person, it can be difficult to take notes and what was the step four and all
08:20that.
08:20But because we are using it within the app, you get a written answer back and you can take your
08:27time and you can go back and say, okay, what was step four actually?
08:31And if it doesn't work, you can call again and get a real person at Microsoft and help you through.
08:38But our users are super happy about the AI part of this as well.
08:48I'm also here to talk about AI just like everybody else.
08:53And I think it is pretty obvious that AI can really make a difference for blind people.
09:00So, last year, in February, we got a phone call from OpenAI.
09:06We were kind of surprised.
09:09But what they wanted was to make a partnership with Be My Eyes about their new model that nobody knew
09:19about called Image to Text.
09:22So, you can take a photo, we upload that photo to OpenAI, and then you get a detailed description back.
09:33It's pretty amazing.
09:35We call it Be My AI.
09:39And we had four weeks to build this into the Be My Eyes app.
09:45So, I can tell you that my developers were super busy in that time.
09:51But I think it's also pretty obvious that such a technology is exactly what you want as a blind person.
10:01And then you can say, why not just call the volunteers and ask them?
10:05But we realized that many of our users, they use Be My Eyes, but they are not super comfortable talking
10:15to a stranger about something rather private and in their home and so on.
10:21And maybe it's just too early Monday morning and you have not had your coffee, so you're not ready to
10:25other human beings.
10:27And then you can use the Be My AI function.
10:31I'm going to show you a little video.
10:34And this is a painting in my kitchen.
10:38And please, if you can, take a look at the painting and then hear the description coming back from AI.
10:54Be My Eyes, Beta.
10:57Trick to Gange.
10:58Be My Eyes.
11:04Trick to Gange.
11:05So now I'm taking the picture and waiting for the reply.
11:10Take picture, button.
11:12Take picture, you titill it.
11:22The picture shows a painting hung on a vertical wooden surface with light wood planks.
11:27The painting appears to be an abstract landscape, possibly depicting a sunset or sunrise.
11:33The top half of the canvas is filled with soft, horizontal strokes of pale blue and white, suggesting a sky
11:40with gentle clouds.
11:41Below this, a band of warm orange and red hues stretches across, possibly representing the glow of the sun on
11:48the horizon.
11:49Underneath the warm band, there are dark green and brownish strokes that give the impression of a distant line of
11:54trees or foliage.
11:56The bottom section of the painting features more green tones with hints of blue, which could be interpreted as a
12:02body of water or a grassy field.
12:03The painting has a textured appearance with visible brush strokes and layers of paint.
12:11It is one thing to describe a sunset from a photo, but to have an AI describe a sunset from
12:20a painting and even telling me the structure of the painting, I think, is kind of next level.
12:29And, of course, this is maybe not the most used case, but you can imagine how easy it is for
12:38AI to tell me what kind of wine it is or the expiry date or something like that.
12:45It is a really amazing tool that OpenAI has provided.
12:51OpenAI has agreed to do this for free for the users of Be My Eye because we are not going
13:00to charge our users anything, and they agreed to go along with that.
13:05So we are super happy about our partnership with OpenAI.
13:12And how do I see the future of AI?
13:16Well, I could talk a long time about that, but I think I'd rather show you the future because that's
13:24what we can do.
13:25And the next short video is one of my colleagues working for Be My Eyes, Andy.
13:30He is blind, and he lives in London, and he is the first blind person in this world who got
13:37access to the newest version of OpenAI where you can have a live conversation when you are filming around, and
13:48then you can have a live conversation with the AI about what's going on, and you can ask questions.
13:56Let's see.
14:01Is the king in residence at the moment?
14:04Yes. It looks like the king is in residence right now.
14:07The royal standard flag is flying above Buckingham Palace, which is the signal that the monarch is present.
14:14How exciting to be there while the king is home.
14:17Try and tell me exactly what they are doing right now, please.
14:20Um, right now the ducks are gently gliding across the water. They're moving in a fairly relaxed manner, not in
14:28a hurry. Occasionally, one of them will dip its head under the water, probably looking for food, and then pop
14:34back up.
14:37I even know when a taxi is coming with its orange light on. I think I'll hail it to get
14:41home.
14:43Yes, I spotted one just now. It's heading your way on the left side of the road. Get ready to
14:50wave it down.
14:55Great job hailing that taxi. It looks like you're all set to go. That's a good dog right there.
15:00Leading the way into the taxi.
15:02Safe travels.
15:05I think it's easy to understand, if you are a blind person, how much of a difference this makes.
15:12And this is, some blind people have told me, this is really what we always wanted.
15:17A pair of eyes in our pocket we can pull out and use at any time.
15:23And we have so high expectation about this. And as you could hear, it is like a real conversation.
15:35I'm not sure when millions of people start using this, if we can keep the latency down.
15:42But at least now we know it is possible, and that's basically what we expect AI to do.
15:49I know there is a lot of discussions about the dangers of AI.
15:56But I just want to show you that it can actually be used for something good.
16:02And also something that is really, really important for a very large group of people.
16:09And I am immensely proud that Be My Eyes is in the forefront of this new technology.
16:18I can tell you that the blind community is not used to be one of the first people to use
16:25new technology.
16:27Most likely it is something that we get access to later on when it is made accessible.
16:33But for once, Be My Eyes and the whole blind community is in the forefront of this.
16:40And thank you for this opportunity to talk at the biggest conference I have ever been to.
16:46So thank you so much.
16:47Thank you.
Commentaires