Welcome to Newton Eyes

🔍 What Is Newton Eyes?

"Newton Eyes" is a cutting-edge app that transforms your smartphone into a powerful visual interpreter. By simply taking a picture, users receive a detailed description of their surroundings, enabling them to perceive the world in ways previously unimaginable. From identifying objects and text to understanding complex environments, "Newton Eyes" acts as a virtual guide, providing voice feedback for every interaction to ensure a seamless and enriching experience.

🗣 Voice-Powered Interactivity

We believe in the power of voice to simplify interactions. With "Newton Eyes," users can ask questions about their environment using voice input, eliminating the need for typing. Whether it’s inquiring about the color of a shirt or asking for a description of a scene, our app listens and responds with accurate, helpful information. Voice feedback accompanies every action within the app, making it more accessible and convenient for everyone.

🌐 Features at a Glance

• AI-Driven Descriptions: Get detailed, accurate descriptions of photos captured with your camera, helping you understand your surroundings better.
• Voice Input and Feedback: Interact with the app through voice commands and receive audio feedback, making it fully accessible for visually impaired users.
• Intuitive Interface: Designed with accessibility in mind, ensuring ease of use for all users.

🙏 Credits

Thanks to Hiralal Hadrean, Hansda Haradan of Jyothi Seva Home for Blind Children (Venkateshpura, Bangalore, India ). They have been instrumental in providing feedback and helping us improve the app to make it more accessible and useful for the visually challenged community. I am grateful for their support and look forward to continuing our collaboration to create a more inclusive world for all.

Thanks to Sister Clare for the opportunity to work with them on this app.

Thanks to Viswanatha Reddy in helping with ideation, picking the required Generative AI Models, and helping build the app overall.

Credit to Thanks to Manish Prasad (Delhi Technical Campus, Greater Noida) for volunteering to help the testing efforts.

FAQ

How to use the app?

On the home screen, click the camera icon in the first half of the page to click a pic. Click the mic icon in the second half of the page to start recording a question. Click the mic icon again to stop recording.

In the settings page, you can change the verbosity of the app and enable or disable the "describe pic" feature. You can also toggle if you want to use the camera or the gallery to select an image.

What happens when "Describe Pic" is enabled?

When "Describe Pic" is enabled, the app will describe the image as soon as you select it. You can further then ask follow up questions by clicking and holding the image.

How to change the speaker voice?

The speaker voice can be changed from the settings of your device. Here is how you can do it on Android.

What is Verbosity?

Verbosity is the amount of words the app speaks. You can change it using the slider. This applies only to the initial description of the image. Does not apply to follow up questions.

I get a message that the app is unable to reach the servers. What should I do?

Either the app servers are down, or you have been rate limited as you have used the app beyond its fair use limits. Please check back later. If you think you have been rate limited unfairly, please email me here.

Is this app free?

Yes, this app is free to use. However, it costs money to run the servers and to use the AI services of cloud providers. I am yet to figure out a way to procure some cloud sponsorship for this app to allow it to be sustainable. I don't intend to monetize the app in any way.

If you would like to sponsor the app, please email me here.

Who is Newton?

Newton is the name of my Betta fish. He is a great listener and a great friend.

How to request deletion of your account and info?

Click here to request deletion of your account and info

What languages does the app support?

The app currently supports English, Telugu, Hindi, Tamil, Malayalam, Kannada languages.

Important Notice:

The app is provided as is without any warranty. The developer is not responsible for any damages caused by the app. Do not use the app for taking important decisions. Please rely on your own judgement and usual methods for important decisions.