AlphaAtlas
[H]ard|Gawd
- Joined
- Mar 3, 2018
- Messages
- 1,713
According to a recent BBC report, researchers created an AI that excels at writing bogus news, as well as responses to a wide variety of prompts, without any human input. In order to train the model, the researchers say they scraped outbound Reddit links that have at least 3 karma, which they claim "can be thought of as a heuristic indicator for whether other users found the link interesting, educational, or funny." After some additional filtering, the resulting data apparently contained over 8 million documents with 40GB of text.
Unfortunately, the researchers didn't actually publish the model they use to generate the responses. They posted a "much smaller model" of GPT-2 on GitHub, but the researchers fear what malicious users could do with the AI, and the BBC says that other AI researchers are criticizing this lack of transparency. Benjamin Recht told the BBC "They have a lot of money, and they produce a lot of parlour tricks," but also said "The idea that AI researchers should think about the consequences of what they are producing is incredibly important." The news organization said they chose not to show an example they were provided with as text to "prevent search engines from indexing the words and displaying it, out of context, as legitimate BBC News reporting." We have no such fears:
System Prompt (human-written) :A train carriage containing controlled nuclear materials was stolen in Cincinnati today. Its whereabouts are unknown.
Model Completion (machine-written, first try): The incident occurred on the downtown train line, which runs from Covington and Ashland stations. In an email to Ohio news outlets, the U.S. Department of Energy said it is working with the Federal Railroad Administration to find the thief. "The theft of this nuclear material will have significant negative consequences on public and environmental health, our workforce and the economy of our nation," said Tom Hicks, the U.S. Energy Secretary, in a statement. "Our top priority is to secure the theft and ensure it doesn’t happen again." The stolen material was taken from the University of Cincinnati’s Research Triangle Park nuclear research site, according to a news release from Department officials. The Nuclear Regulatory Commission did not immediately release any information. According to the release, the U.S. Department of Energy’s Office of Nuclear Material Safety and Security is leading that team’s investigation. "The safety of people, the environment and the nation’s nuclear stockpile is our highest priority," Hicks said. "We will get to the bottom of this and make no excuses."
Unfortunately, the researchers didn't actually publish the model they use to generate the responses. They posted a "much smaller model" of GPT-2 on GitHub, but the researchers fear what malicious users could do with the AI, and the BBC says that other AI researchers are criticizing this lack of transparency. Benjamin Recht told the BBC "They have a lot of money, and they produce a lot of parlour tricks," but also said "The idea that AI researchers should think about the consequences of what they are producing is incredibly important." The news organization said they chose not to show an example they were provided with as text to "prevent search engines from indexing the words and displaying it, out of context, as legitimate BBC News reporting." We have no such fears:
System Prompt (human-written) :A train carriage containing controlled nuclear materials was stolen in Cincinnati today. Its whereabouts are unknown.
Model Completion (machine-written, first try): The incident occurred on the downtown train line, which runs from Covington and Ashland stations. In an email to Ohio news outlets, the U.S. Department of Energy said it is working with the Federal Railroad Administration to find the thief. "The theft of this nuclear material will have significant negative consequences on public and environmental health, our workforce and the economy of our nation," said Tom Hicks, the U.S. Energy Secretary, in a statement. "Our top priority is to secure the theft and ensure it doesn’t happen again." The stolen material was taken from the University of Cincinnati’s Research Triangle Park nuclear research site, according to a news release from Department officials. The Nuclear Regulatory Commission did not immediately release any information. According to the release, the U.S. Department of Energy’s Office of Nuclear Material Safety and Security is leading that team’s investigation. "The safety of people, the environment and the nation’s nuclear stockpile is our highest priority," Hicks said. "We will get to the bottom of this and make no excuses."