Artificial intelligence has made a serious impact on our world within a short period. We can see the presence of advanced AI features and services across all the fields. Anthropic, one of the prominent figures in the AI software developer community has introduced a novel feature called ‘Computer use’ which is capable of controlling the user’s mouse cursor and performing some specific tasks on the computer. The Claude 3.5 Sonnet upgraded version was released on Tuesday which has become the first frontier artificial intelligence model to offer ‘computer use’ in a public beta version.
The latest version of the Claude 3.5 Sonnet model can indulge in activities like understanding and interacting with desktop applications. The advanced AI can perform actions like button clicks, mouse gestures, and keystrokes. According to Anthropic, Computer use along with Claude 3.5 Sonet can perform ten to hundreds of steps to accomplish a specific task.
The company claims that it is still in the experimental phase and error-prone and releasing this beta version is to analyze the program and to make further improvements required to make it a fully-fledged AI tool to enhance the automated service experience. As part of the early access period, companies like Canva, DoorDash, Asana, Replit, and Cognition have started to capitalize on the opportunity and opened the door for exploration. We can see a fully developed ‘computer use ’ that can perform numerous automated tasks in the future.
Future possibilities of ‘Computer use’
The Artificial Intelligence-driven feature of Computer use will become one of the most promising features in the future once it reaches its true potential. This feature will enable the users to direct their personal computers by just looking at the screen. It can help the individual to complete certain tasks with the help of AI and predictive analysis. Claude 3.5 Sonnet can interact with the active pages you are on, provide assistance for typing and clicks, and even suggest next steps to enhance the user experience. This feature can only be used with the permission of the respective individual. We have to permit the AI tool to initiate and move along with the service.
Also Read: Major Benefits Of Artificial Intelligence You Need To Know
What Computer use is capable of?
Computer use can make Claude perform tasks like navigating the websites and web applications based on the permission we are giving to it. Interacting with the user interface is another task that can be done with the help of Computer use. Moving the mouse, clicking, and typing all these have come under the segment of interacting with the user interface. Interpretation of visual information from screenshots is another task that Computer use is capable of. It can derive in-depth pieces of information from the screenshots and act according to the decoded details.
To simplify the understanding of what ‘Computer use’ is capable of in the future, Anthropic researcher Pujja Rajan has come up with an example. She tells Claude, she would like to enjoy the sunrise hike at the Golden Gate Bridge and she asks the model, whether it can sort out the logistics and organize a calendar entry, that indicates her departure time. After the command, it opened the browser and found the most suitable locations for the hike and the perfect sunrise times.
Along with that, it calculated the travel distance and time based on her area opened up the calendar then marked the entry in it. This explanation itself defines the futuristic possibilities of ‘Computer use’ and how it will be going to make an impact on human life as well as technology uses.
