Moving Beyond the Turing Test with the Allen AI Science Challenge
2016-04-14Code Available0· sign in to hype
Carissa Schoenick, Peter Clark, Oyvind Tafjord, Peter Turney, Oren Etzioni
Code Available — Be the first to reproduce this paper.
ReproduceCode
Abstract
Given recent successes in AI (e.g., AlphaGo's victory against Lee Sedol in the game of GO), it's become increasingly important to assess: how close are AI systems to human-level intelligence? This paper describes the Allen AI Science Challenge---an approach towards that goal which led to a unique Kaggle Competition, its results, the lessons learned, and our next steps.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Aristo Kaggle Allen AI 8th grade questions | Cardal | 1:1 Accuracy | 59.31 | — | Unverified |
| Aristo Kaggle Allen AI 8th grade questions | Alejandro Mosquera | 1:1 Accuracy | 58.26 | — | Unverified |