Microsoft has found out a lot – both good and bad – in just a week since it launched the new Bing AI search and chat features.
The company has shared some of the positives and negatives of this new search experience.
The good. Overall, most searchers seem happy with the results, Microsoft said. In fact, 71% of searches graded the results a “thumbs up” in the search interface.
“Increased engagement across traditional search results and with the new features like summarized answers, the new chat experience, and the content creation tools,” Microsoft added.
The not-so-good. Microsoft added it has been a learning experience that “can’t be done solely in the lab,” but needs to be done in the real world. Some the challenges and surprises:
Timely information can be a challenge for the new Bing search. Microsoft wrote, “we are finding our share of challenges with answers that need very timely data like live sports scores.” Even though the Bing ChatGPT integration is much faster and more timely, as Brodie Clark found, Microsoft said it is not always fast enough. As a result, Microsoft is “planning to 4x increase the grounding data we send to the model,” they wrote. Also, Microsoft might add a “toggle that gives you more control on the precision vs. creativity of the answer to tailor to your query.” Our early test drives showed some early issues as well. Chatting for fun has been an area that Bing did not necessarily anticipate