An Interview with Dr. Yonatan Wexler, Head of Research and Development at OrCam
by Maureen Duffy
VisionAware is pleased to speak with Dr. Yonatan Wexler, the head of Research and Development at OrCam, an Israeli start-up company founded in 2010 by Amnon Shashua, Sachs Professor of Computer Science at The Hebrew University of Jerusalem.
The mission of OrCam is to develop a "portable, wearable visual system with 'human-like' capabilities" for blind and visually impaired persons, via the use of artificial computer intelligence and augmented reality. The OrCam is based on a computer algorithm that Professor Shashua has pioneered with Dr. Wexler and Shai Shalev-Shwartz, a Hebrew University colleague. You can learn more at The OrCam: A Portable, Wearable Visual System for Blind and Visually Impaired Persons on the VisionAware blog.
Please note: This interview does not imply endorsement of the OrCam by VisionAware. It is intended only to provide information for our readers.
Maureen Duffy: Hello, Dr. Wexler. I appreciate your taking the time to talk with our readers. First, the basics: How did you become interested in and/or involved with the OrCam project?
Yonatan Wexler: Visual arts always fascinated me. When computers came along, I found it surprisingly hard to explain precisely how we perceive the world in visual terms. We do it so innately that we can't explain how we do it. This question led me to a career of researching in the field called "Computer Vision." Three years ago, Amnon Shashua, my Ph.D. advisor, contacted me about creating a device for blind people. For this we had to develop the most sophisticated artificial visual system.
MD: Had you had experience with blind people prior to this?
YW: Not very much. This was interesting, since it took a while to learn what blind and visually impaired people actually need. It is different from what we expected at the beginning. For example, recognizing obstacles is not a key difficulty. This is because a simple [white] cane gives all the needed information. The ability to read, on the other hand, has a far greater added value to a person who is blind.
MD: I'm interested in the computer algorithm your team developed. Can you explain it to a non-technical audience?
YW: The biggest challenge any visual system faces is the sheer amount of data. Every image has millions of measurements (called pixels). Any attempt to make sense of these has to be very lean, so it isn't bogged down with the sheer volume of the input. For this we have published a new algorithm [i.e., a step-by-step problem-solving procedure] called ShareBoost. It finds the most informative parts of the image that can be combined into a realization of what is in the image.
MD: How long did it take to develop the algorithm?
YW: We spent about a year devising the core algorithm and then two more years to apply it to the various aspects of the device. Creating something of value, from a scientific perspective and by solving a fundamental human need, is very rewarding. When we started working on this, it was an open problem from a scientific perspective. Such cases, when it is not clear that there is a solution, require real determination. We have a fantastic team that is dedicated and focused; otherwise we would have not succeeded – and definitely not in such a short time.
What types of information are pre-stored in the OrCam system at the time of purchase?
YW: The system comes programmed to recognize bank notes. We know that this is something of value for all of our users. It is very easy to teach the system more products in a very simple manner that takes only a few seconds. Each user, therefore, can teach the system the products they care about.
MD: Can you explain the gestures that are required to add an item and add a face or place?
YW: Adding an item is very simple. It starts by pressing a button. The system will prompt the user to wave the product so the camera can see it from various angles. The user then records the name of the product and concludes by pressing the button again. All this takes up to twenty seconds.
MD: You say that the OrCam is intuitive, but is there a learning curve?
YW: My experience is that a five-minute demonstration suffices to teach most people how to use the device. The interaction is gesture-based, and therefore intuitive. You point at what you are interested in, and the device talks back to you in plain English. It is part of our natural body language that the device responds to. That is why it is so intuitive.
MD: I'm also following the OpenGlass Project with great interest. Can you explain the difference between Google Glass and the OrCam? I find that readers find it difficult to differentiate the two systems.
YW: Google Glass is essentially a wearable screen. OrCam (pictured at left) is a smart camera that speaks. It has no screen, since this has no value for most visually impaired persons. As such, they are very different. OrCam is also designed to be a robust device that is dependable and can sustain daily use.
MD: How much does the OrCam cost and is there insurance coverage on the horizon?
YW: The device is priced at $2,500 for our first users, which corresponds to the price of a hearing aid. The demand has been overwhelming. We started working towards getting insurance coverage in order to help our customers and will update the information on our website once progress has been made.
MD: Is there anything else you'd like to add?
YW: It is a great privilege being able to apply this technology to something that will improve the lives of so many people.
We thank Dr. Wexler for his support of VisionAware and for his research on behalf of blind and visually persons worldwide. You can read about additional OrCam-related projects in development at the German Research Center for Artificial Intelligence website.
Where you can find Dr. Yonatan Wexler and OrCam online:
Re: An Interview with Dr. Yonatan Wexler, Head of Research and Development at OrCamPosted by susan olivo on 11/5/2013 at 10:35 AM
Great interview, Maureen.
I really enjoyed reading about the genesis of this project. I am hoping to see an Orcam demonstration one of these days. It sounds like an awesome device.
Good for you, Dr. Wexler!
Re: An Interview with Dr. Yonatan Wexler, Head of Research and Development at OrCamPosted by sharon stone on 11/29/2013 at 9:43 AM
We ordered the ORCAM for my husband and expect to receive it by the end of the year or the first of next year.
We can't wait!!!
Re: An Interview with Dr. Yonatan Wexler, Head of Research and Development at OrCamPosted by 593613 on 9/15/2014 at 10:38 PM
Well right now, the Orcam is missing in action; I don't see it. No updates for over a couple of years. September 2014 and not any movement toward reality. No replies from my e-mails... No U.S. dealers, no VA commitments, nothing.
Is this another investor scam ?... Preying on the disabled...
Beginning to look like it !... See this not in faith, but for what it is not... So far I see nothing by sight - BWR
Re: An Interview with Dr. Yonatan Wexler, Head of Research and Development at OrCamPosted by 593613 on 9/15/2014 at 10:47 PM
Yea, Thinking the same thing, could not have said it better.
Hanging on to my cane, too good to be true :(
Re: An Interview with Dr. Yonatan Wexler, Head of Research and Development at OrCamPosted by MaureenD on 9/20/2014 at 12:47 PM
Hello BWR: I sent your comments to Dr. Wexler at OrCam and he asked me to provide the following response to you. I hope it's helpful:
Dear BWR: I am very sorry to hear about the experience you had with OrCam. We usually reply to all questions and inquiries, usually through email at firstname.lastname@example.org or via Facebook at https://www.facebook.com/orcamtech. Please email us again and we will provide you with all the necessary information.
We are now finishing the second beta testing of a few hundred devices. We used this feedback to identify and fix the last remaining issues with the software and hardware. Our plan is to start general sales before the end of the year.
Log in to Post a Comment
- Macular Degeneration (120 posts)
- In the News (100 posts)
- Glaucoma (71 posts)
- Diabetes and diabetic retinopathy (58 posts)
- Health (53 posts)
- Cataracts (33 posts)
- Public Policy (33 posts)
- Cultural Diversity (31 posts)
- Planning for the Future (24 posts)
- Low Vision (251 posts)
- Personal Reflections (97 posts)
- Technology (77 posts)
- Assistive Technology (67 posts)
- Reading (41 posts)
- Online Tools (32 posts)
- A Powerful New Report from the National Academies of Sciences, Engineering, and Medicine: Making Eye and Vision Health an Imperative for All Americans
- What's New in iOS 10 Accessibility for Blind, Low Vision, and Deaf-Blind Users Part 1: Scott Davert, AppleVis Editorial Team
- What's New in iOS 10 Accessibility for Blind, Low Vision, and Deaf-Blind Users Part 2: Scott Davert, AppleVis Editorial Team