Seeing AI and Be my AI: Harnessing the Power of AI to Transform Accessibility for People with Visual Challenges
In recent years, the advent of Artificial Intelligence (AI) has sparked a revolution in accessibility for individuals with disabilities. AI is changing how we interact with the world, providing innovative solutions to enhance accessibility for people with disabilities. Two standout AI tools making significant strides in this area are Seeing AI and Be My AI. These tools are particularly beneficial for individuals with blindness and low vision. Let's delve into how these technologies are changing lives and compare their functionalities.
Seeing AI is an AI-powered app developed by Microsoft. It serves as a virtual assistant for individuals with visual impairments, offering multiple features tailored to enhance independence and accessibility by describing the world around the user through the camera of their smartphone. Some key functionalities of Seeing AI include:
Scene Descriptions: The app can describe scenes, objects, and people in real-time.
World Descriptions: Turns the visual world into an audible experience.
Text Recognition: Instantly reads printed text, handwritten notes, and documents.
Currency Identification: Identifies different currencies, aiding in financial transactions.
Product Identification: Scans barcodes to provide information about products.
Facial Recognition: Recognizes faces and even describes emotions.
Colors: Identifies colors of objects or clothing.
Be My AI is a visual assistant powered by OpenAI's new GPT-4 language model. It is currently being beta-tested nationwide. This AI technology is integrated with the Be My Eyes app, which connects visually impaired individuals with sighted volunteers via a live video, allowing the user to ask questions in real time to obtain needed information about their environment. For individuals who utilize screen reading software, the Be My AI app describes photos, reads documents and anything you can access on your Windows device. The app enables users to ask questions about the materials shown via chat, not a live volunteer like Be My Eyes. A user can access Be My AI by opening the Be My Eyes app and clicking on the Be My AI tab.
How Generative AI Can Improve Accessibility for Students with Visual Impairments
Seeing AI and/or Be My AI have the capability to foster academic participation and success by assisting students with the following tasks:
Reading and accessing text including, but not limited to, the following formats:
Textbooks, handouts, notes, and other classroom materials.
Handwritten and typed notes.
Assignment instructions and examination papers.
Books, journals, comics, and magazines available in the school library.
Posters, visuals, product labels, whiteboards/chalkboards, instruction manuals, etc.
Scoreboards at sporting events.
Screenshots and text posts.
Navigating the environment:
AI can assist users with wayfinding by describing users’ surroundings, helping locate classrooms, restrooms, and other facilities.
AI can also help users identify items in vending machines.
Identifying people:
Seeing AI can describe the physical appearance of people and even predicting their mood, which can improve recognizing familiar faces and the understanding of emotions.
Providing Real-Time Classroom Assistance:
Lab Work: During science labs, students can identify necessary tools for assistance with experiments, ensuring they follow safety protocols and accurately complete tasks.
Art and Design: AI can help students with visual impairments engage in art and design projects by describing visual elements, identifying colors and providing guidance.
Supporting Remote Learning:
Virtual Classes: In remote or hybrid learning environments, AI can assist students with fully participating in their academic program by reading screenshots, photos, graphs, and some webpages due to their design.
AI can also help users prepare for virtual calls by describing the set up to ensure they are centered and that the lighting is sufficient.
Homework Support: AI can assist with homework by reading instructions, explaining diagrams, and answering questions on assignments.
Extracurricular Activities:
Sports and Physical Education: AI can provide real-time guidance during sports activities, helping students with visual impairments participate in physical education. Examples include location of balls, equipment, or other people in their vicinity.
Clubs and Events: AI can assist students in participating in school clubs, events, and extracurricular activities by providing visual support to recognize faces, objects, read signs and assist with navigation.
Conclusion
Implementing AI-powered tools such as Seeing AI and Be My AI in education can greatly enhance the learning experience for students with visual disabilities. These tools offer vital support for accessing educational content and foster independence, inclusivity, and active engagement within the school environment and community. By utilizing these technologies, educators can cultivate a more equitable and supportive learning environment for all students.
While the potential benefits of AI in education are extensive, it is crucial for district leaders and educators to establish policies and procedures that ensure the responsible use of generative AI to safeguard student well-being. It is important to prioritize professional development opportunities for AI literacy as the integration of AI in educational settings continues to grow. Administrators should also assess and communicate any potential risks associated with generative AI in education to staff, families, and students.