Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

Can ChatGPT help me at the office? We put the AI chatbot to the test.

Washington Post: “If ChatGPT, the buzzy new chatbot from Open AI, wrote this story, it would say: “As companies look to streamline their operations and increase productivity, many are turning to artificial intelligence tools like ChatGPT to assist their employees in completing tasks. But can workers truly rely on these AI programs to take on more and more responsibilities, or will they ultimately fall short of expectations? Not great, but not bad, right? Workers are experimenting with ChatGPT for tasks like writing emails, producing code or even completing a year-end review. The bot uses data from the internet, books and Wikipedia to produce conversational responses. But the technology isn’t perfect. Our tests found that it sometimes offers responses that potentially include plagiarism, contradict itself, are factually incorrect or have grammatical errors, to name a few — all of which could be problematic at work. ChatGPT is basically a predictive-text system, similar but better than those built into text-messaging apps on your phone, says Jacob Andreas, assistant professor at MIT’s Computer Science and Artificial Intelligence Laboratory who studies natural language processing. While that often produces responses that sound good, the content may have some problems, he said. “If you look at some of these really long ChatGPT-generated essays, it’s very easy to see places where it contradicts itself,” he said. “When you ask it to generate code, it’s mostly correct, but often there are bugs.” We wanted to know how well ChatGPT could handle everyday office tasks. Here’s what we found after tests in five categories…”

Sorry, comments are closed for this post.