2019
5414994
2019
1
apa
50
default
349
https://www.nlplab.psu.edu/wp-content/plugins/zotpress/
%7B%22status%22%3A%22success%22%2C%22updateneeded%22%3Afalse%2C%22instance%22%3Afalse%2C%22meta%22%3A%7B%22request_last%22%3A0%2C%22request_next%22%3A0%2C%22used_cache%22%3Atrue%7D%2C%22data%22%3A%5B%7B%22key%22%3A%22U8IR3F7B%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Qiao%20and%20Valiant%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EQiao%2C%20M.%2C%20%26amp%3B%20Valiant%2C%20G.%20%282019%29.%20A%20Theory%20of%20Selective%20Prediction.%20%3Ci%3EProceedings%20of%20the%2032nd%20Conference%20on%20Learning%20Theory%20%28PMLR%29%3C%5C%2Fi%3E%2C%20%3Ci%3E99%3C%5C%2Fi%3E%2C%202580%26%23x2013%3B2594.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fproceedings.mlr.press%5C%2Fv99%5C%2Fqiao19a.html%27%3Ehttps%3A%5C%2F%5C%2Fproceedings.mlr.press%5C%2Fv99%5C%2Fqiao19a.html%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22A%20Theory%20of%20Selective%20Prediction%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mingda%22%2C%22lastName%22%3A%22Qiao%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Gregory%22%2C%22lastName%22%3A%22Valiant%22%7D%5D%2C%22abstractNote%22%3A%22We%20consider%20a%20model%20of%20selective%20prediction%2C%20where%20the%20prediction%20algorithm%20is%20given%20a%20data%20sequence%20in%20an%20online%20fashion%20and%20asked%20to%20predict%20a%20pre-specified%20statistic%20of%20the%20upcoming%20data%20points.%20The%20algorithm%20is%20allowed%20to%20choose%20when%20to%20make%20the%20prediction%20as%20well%20as%20the%20length%20of%20the%20prediction%20window%2C%20possibly%20depending%20on%20the%20observations%20so%20far.%20We%20prove%20that%2C%20even%20without%20any%20distributional%20assumption%20on%20the%20input%20data%20stream%2C%20a%20large%20family%20of%20statistics%20can%20be%20estimated%20to%20non-trivial%20accuracy.%20To%20give%20one%20concrete%20example%2C%20suppose%20that%20we%20are%20given%20access%20to%20an%20arbitrary%20binary%20sequence%20%24x_1%2C%20%5C%5Cldots%2C%20x_n%24%20of%20length%20%24n%24.%20%20Our%20goal%20is%20to%20accurately%20predict%20the%20average%20observation%2C%20and%20we%20are%20allowed%20to%20choose%20the%20window%20over%20which%20the%20prediction%20is%20made%3A%20for%20some%20%24t%20%26lt%3B%20n%24%20and%20%24m%20%5C%5Cle%20n%20-%20t%24%2C%20after%20seeing%20%24t%24%20observations%20we%20predict%20the%20average%20of%20%24x_%7Bt%2B1%7D%2C%20%5C%5Cldots%2C%20x_%7Bt%2Bm%7D%24.%20This%20particular%20problem%20was%20first%20studied%20in%20Drucker%20%282013%29%20and%20referred%20to%20as%20the%20%5Cu201cdensity%20prediction%20game%5Cu201d.%20We%20show%20that%20the%20expected%20squared%20error%20of%20our%20prediction%20can%20be%20bounded%20by%20%24O%28%5C%5Cfrac%7B1%7D%7B%5C%5Clog%20n%7D%29%24%20and%20prove%20a%20matching%20lower%20bound%2C%20which%20resolves%20an%20open%20question%20raised%20in%20Drucker%20%282013%29.%20This%20result%20holds%20for%20any%20sequence%20%28that%20is%20not%20adaptive%20to%20when%20the%20prediction%20is%20made%2C%20or%20the%20predicted%20value%29%2C%20and%20the%20expectation%20of%20the%20error%20is%20with%20respect%20to%20the%20randomness%20of%20the%20prediction%20algorithm.%20Our%20results%20apply%20to%20more%20general%20statistics%20of%20a%20sequence%20of%20observations%2C%20and%20we%20highlight%20several%20open%20directions%20for%20future%20work.%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%2032nd%20Conference%20on%20Learning%20Theory%20%28PMLR%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fproceedings.mlr.press%5C%2Fv99%5C%2Fqiao19a.html%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222023-01-06T23%3A36%3A46Z%22%7D%7D%2C%7B%22key%22%3A%226SU43T3I%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Liu%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ELiu%2C%20T.%2C%20Ding%2C%20W.%2C%20Wang%2C%20Z.%2C%20Tang%2C%20J.%2C%20Huang%2C%20G.%20Y.%2C%20%26amp%3B%20Liu%2C%20Z.%20%282019%29.%20Automatic%20Short%20Answer%20Grading%20via%20Multiway%20Attention%20Networks.%20In%20S.%20Isotani%2C%20E.%20Mill%26%23xE1%3Bn%2C%20A.%20Ogan%2C%20P.%20Hastings%2C%20B.%20McLaren%2C%20%26amp%3B%20R.%20Luckin%20%28Eds.%29%2C%20%3Ci%3EArtificial%20Intelligence%20in%20Education%3C%5C%2Fi%3E%20%28Vol.%2011626%2C%20pp.%20169%26%23x2013%3B173%29.%20Springer%20International%20Publishing.%20https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-030-23207-8_32%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22bookSection%22%2C%22title%22%3A%22Automatic%20Short%20Answer%20Grading%20via%20Multiway%20Attention%20Networks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Seiji%22%2C%22lastName%22%3A%22Isotani%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Eva%22%2C%22lastName%22%3A%22Mill%5Cu00e1n%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Amy%22%2C%22lastName%22%3A%22Ogan%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Peter%22%2C%22lastName%22%3A%22Hastings%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Bruce%22%2C%22lastName%22%3A%22McLaren%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Rose%22%2C%22lastName%22%3A%22Luckin%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tiaoqiao%22%2C%22lastName%22%3A%22Liu%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Wenbiao%22%2C%22lastName%22%3A%22Ding%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Zhiwei%22%2C%22lastName%22%3A%22Wang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Jiliang%22%2C%22lastName%22%3A%22Tang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Gale%20Yan%22%2C%22lastName%22%3A%22Huang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Zitao%22%2C%22lastName%22%3A%22Liu%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22bookTitle%22%3A%22Artificial%20Intelligence%20in%20Education%22%2C%22date%22%3A%222019%22%2C%22language%22%3A%22en%22%2C%22ISBN%22%3A%22978-3-030-23206-1%20978-3-030-23207-8%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Flink.springer.com%5C%2F10.1007%5C%2F978-3-030-23207-8_32%22%2C%22collections%22%3A%5B%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-10-19T22%3A32%3A07Z%22%7D%7D%2C%7B%22key%22%3A%22DR8HR9MT%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Strobl%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EStrobl%2C%20Ailhaud%2C%20Benetos%2C%20Devitt%2C%20Kruse%2C%20%26amp%3B%20Proske.%20%282019%29.%20Digital%20support%20for%20academic%20writing%3A%20A%20review%20of%20technologies%20and%20pedagogies.%20%3Ci%3EComputers%20%26amp%3B%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E131%3C%5C%2Fi%3E%2C%2033%26%23x2013%3B48.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.compedu.2018.12.00%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.compedu.2018.12.00%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Digital%20support%20for%20academic%20writing%3A%20A%20review%20of%20technologies%20and%20pedagogies%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Strobl%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Ailhaud%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Benetos%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Devitt%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Kruse%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Proske%22%7D%5D%2C%22abstractNote%22%3A%22This%20paper%20presents%20a%20review%20of%20the%20technologies%20designed%20to%20support%20writing%20instruction%20in%20secondary%20and%20higher%20education.%20The%20review%20covers%20tools%20to%20support%20first%20and%20second%20language%20writers%20and%20focuses%20on%20instructional%20affordances%20based%20on%20their%20technological%20specifications.%20Previous%20studies%20in%20this%20field%20centred%20on%20Automated%20Writing%20Evaluation%2C%20Automated%20Essay%20Scoring%20and%20the%20rarer%20Intelligent%20Tutoring%20Systems%2C%20addressing%20mainly%20essay%20writing%20needs%20in%20US%20secondary%20school%20instruction.%20With%20technology-enhanced%20learning%20becoming%20more%20ubiquitous%20and%20widespread%2C%20new%20technologies%20and%20tools%20catering%20to%20a%20broader%20range%20of%20genres%2C%20pedagogical%20settings%2C%20and%20approaches%20are%20emerging.%20We%20present%20a%20systematic%20analysis%20of%2044%20tools%20across%2026%20quantitative%20and%20qualitative%20features%20related%20to%20writing%20processes%2C%20pedagogical%20approaches%2C%20feedback%20modalities%20and%20technological%20specifications.%20The%20results%20uncover%20an%20imbalance%20of%20available%20tools%20with%20regard%20to%20supported%20languages%2C%20genres%2C%20and%20pedagogical%20focus.%20While%20a%20considerable%20number%20of%20tools%20support%20argumentative%20essay%20writing%20in%20English%2C%20other%20academic%20writing%20genres%20%28e.g.%2C%20research%20articles%29%20and%20other%20languages%20are%20under-represented.%20With%20regard%20to%20the%20pedagogical%20focus%2C%20automated%20support%20for%20revising%20on%20the%20micro-level%20targeting%20factual%20knowledge%20%28e.g.%2C%20grammar%2C%20spelling%2C%20word%20frequencies%29%20is%20well%20represented%2C%20whereas%20tools%20that%20support%20the%20development%20of%20writing%20strategies%20and%20encourage%20self-monitoring%20to%20improve%20macro-level%20text%20quality%20%28e.g.%2C%20argumentative%20structure%2C%20rhetorical%20moves%29%20are%20infrequent.%20By%20mapping%20the%20state%20of%20the%20art%20and%20specifying%20direction%20for%20further%20research%20and%20development%2C%20this%20review%20is%20of%20interest%20to%20researchers%2C%20policymakers%2C%20tool%20developers%2C%20and%20practitioners%20of%20writing%20instruction%20in%20higher%20and%20secondary%20education%20institutions.%22%2C%22date%22%3A%222019%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.1016%5C%2Fj.compedu.2018.12.00%22%2C%22ISSN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.sciencedirect.com%5C%2Fscience%5C%2Farticle%5C%2Fabs%5C%2Fpii%5C%2FS036013151830318X%22%2C%22collections%22%3A%5B%22XSGKE5BJ%22%5D%2C%22dateModified%22%3A%222022-08-04T14%3A52%3A24Z%22%7D%7D%2C%7B%22key%22%3A%22LWR4DMG7%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Gere%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGere%2C%20A.%20R.%2C%20Limlamai%2C%20N.%2C%20Wilson%2C%20E.%2C%20MacDougall%20Saylor%2C%20K.%2C%20%26amp%3B%20Pugh%2C%20R.%20%282019%29.%20Writing%20and%20Conceptual%20Learning%20in%20Science%3A%20An%20Analysis%20of%20Assignments.%20%3Ci%3EWritten%20Communication%3C%5C%2Fi%3E%2C%20%3Ci%3E36%3C%5C%2Fi%3E%281%29%2C%2099%26%23x2013%3B135.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1177%5C%2F0741088318804820%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1177%5C%2F0741088318804820%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Writing%20and%20Conceptual%20Learning%20in%20Science%3A%20An%20Analysis%20of%20Assignments%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Anne%20Ruggles%22%2C%22lastName%22%3A%22Gere%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Naitnaphit%22%2C%22lastName%22%3A%22Limlamai%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Emily%22%2C%22lastName%22%3A%22Wilson%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kate%22%2C%22lastName%22%3A%22MacDougall%20Saylor%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Raymond%22%2C%22lastName%22%3A%22Pugh%22%7D%5D%2C%22abstractNote%22%3A%22This%20systematic%20review%20of%2046%20published%20articles%20investigates%20the%20constructs%20employed%20and%20the%20meanings%20assigned%20to%20writing%20in%20writing-to-learn%20assignments%20given%20to%20students%20in%20science%20courses.%20Using%20components%20of%20assignments%20associated%20with%20the%20greatest%20learning%20gains%5Cu2014meaning%20making%2C%20clear%20expectations%2C%20interactive%20writing%20processes%2C%20and%20metacognition%5Cu2014this%20review%20illuminates%20the%20constructs%20of%20writing%20that%20yield%20conceptual%20learning%20in%20science.%20In%20so%20doing%2C%20this%20article%20also%20provides%20a%20framework%20that%20can%20be%20used%20to%20evaluate%20writing-to-learn%20assignments%20in%20science%2C%20and%20it%20documents%20a%20new%20era%20in%20research%20on%20writing%20to%20learn%20in%20science%20by%20showing%20the%20increased%20rigor%20that%20has%20characterized%20studies%20in%20this%20field%20during%20the%20past%20decade.%22%2C%22date%22%3A%2201%5C%2F2019%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1177%5C%2F0741088318804820%22%2C%22ISSN%22%3A%220741-0883%2C%201552-8472%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fjournals.sagepub.com%5C%2Fdoi%5C%2F10.1177%5C%2F0741088318804820%22%2C%22collections%22%3A%5B%22XSGKE5BJ%22%2C%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-08-03T18%3A31%3A35Z%22%7D%7D%2C%7B%22key%22%3A%22CFKMDIK8%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Liu%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ELiu%2C%20T.%2C%20Ding%2C%20W.%2C%20Wang%2C%20Z.%2C%20Tang%2C%20J.%2C%20Huang%2C%20G.%20Y.%2C%20%26amp%3B%20Liu%2C%20Z.%20%282019%29.%20Automatic%20Short%20Answer%20Grading%20via%20Multiway%20Attention%20Networks.%20In%20S.%20Isotani%2C%20E.%20Mill%26%23xE1%3Bn%2C%20A.%20Ogan%2C%20P.%20Hastings%2C%20B.%20McLaren%2C%20%26amp%3B%20R.%20Luckin%20%28Eds.%29%2C%20%3Ci%3EArtificial%20Intelligence%20in%20Education%3C%5C%2Fi%3E%20%28Vol.%2011626%2C%20pp.%20169%26%23x2013%3B173%29.%20Springer%20International%20Publishing.%20https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-030-23207-8_32%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22bookSection%22%2C%22title%22%3A%22Automatic%20Short%20Answer%20Grading%20via%20Multiway%20Attention%20Networks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Seiji%22%2C%22lastName%22%3A%22Isotani%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Eva%22%2C%22lastName%22%3A%22Mill%5Cu00e1n%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Amy%22%2C%22lastName%22%3A%22Ogan%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Peter%22%2C%22lastName%22%3A%22Hastings%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Bruce%22%2C%22lastName%22%3A%22McLaren%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Rose%22%2C%22lastName%22%3A%22Luckin%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tiaoqiao%22%2C%22lastName%22%3A%22Liu%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Wenbiao%22%2C%22lastName%22%3A%22Ding%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Zhiwei%22%2C%22lastName%22%3A%22Wang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Jiliang%22%2C%22lastName%22%3A%22Tang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Gale%20Yan%22%2C%22lastName%22%3A%22Huang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Zitao%22%2C%22lastName%22%3A%22Liu%22%7D%5D%2C%22abstractNote%22%3A%22Automatic%20short%20answer%20grading%20%28ASAG%29%2C%20which%20autonomously%20score%20student%20answers%20according%20to%20reference%20answers%2C%20provides%20a%20costeffective%20and%20consistent%20approach%20to%20teaching%20professionals%20and%20can%20reduce%20their%20monotonous%20and%20tedious%20grading%20workloads.%20However%2C%20ASAG%20is%20a%20very%20challenging%20task%20due%20to%20two%20reasons%3A%20%281%29%20student%20answers%20are%20made%20up%20of%20free%20text%20which%20requires%20a%20deep%20semantic%20understanding%3B%20and%20%282%29%20the%20questions%20are%20usually%20open-ended%20and%20across%20many%20domains%20in%20K12%20scenarios.%20In%20this%20paper%2C%20we%20propose%20a%20generalized%20end-to-end%20ASAG%20learning%20framework%20which%20aims%20to%20%281%29%20autonomously%20extract%20linguistic%20information%20from%20both%20student%20and%20reference%20answers%3B%20and%20%282%29%20accurately%20model%20the%20semantic%20relations%20between%20free-text%20student%20and%20reference%20answers%20in%20open-ended%20domain.%20The%20proposed%20ASAG%20model%20is%20evaluated%20on%20a%20large%20real-world%20K-12%20dataset%20and%20can%20outperform%20the%20state-of-the-art%20baselines%20in%20terms%20of%20various%20evaluation%20metrics.%22%2C%22bookTitle%22%3A%22Artificial%20Intelligence%20in%20Education%22%2C%22date%22%3A%222019%22%2C%22language%22%3A%22en%22%2C%22ISBN%22%3A%22978-3-030-23206-1%20978-3-030-23207-8%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Flink.springer.com%5C%2F10.1007%5C%2F978-3-030-23207-8_32%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-30T20%3A30%3A31Z%22%7D%7D%2C%7B%22key%22%3A%22VGXN4A6A%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Sung%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ESung%2C%20C.%2C%20Dhamecha%2C%20T.%2C%20Saha%2C%20S.%2C%20Ma%2C%20T.%2C%20Reddy%2C%20V.%2C%20%26amp%3B%20Arora%2C%20R.%20%282019%29.%20Pre-Training%20BERT%20on%20Domain%20Resources%20for%20Short%20Answer%20Grading.%20%3Ci%3EProceedings%20of%20the%202019%20Conference%20on%20Empirical%20Methods%20in%20Natural%20Language%20Processing%20and%20the%209th%20International%20Joint%20Conference%20on%20Natural%20Language%20Processing%20%28EMNLP-IJCNLP%29%3C%5C%2Fi%3E%2C%206070%26%23x2013%3B6074.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FD19-1628%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FD19-1628%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Pre-Training%20BERT%20on%20Domain%20Resources%20for%20Short%20Answer%20Grading%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Chul%22%2C%22lastName%22%3A%22Sung%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tejas%22%2C%22lastName%22%3A%22Dhamecha%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Swarnadeep%22%2C%22lastName%22%3A%22Saha%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tengfei%22%2C%22lastName%22%3A%22Ma%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Vinay%22%2C%22lastName%22%3A%22Reddy%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rishi%22%2C%22lastName%22%3A%22Arora%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%202019%20Conference%20on%20Empirical%20Methods%20in%20Natural%20Language%20Processing%20and%20the%209th%20International%20Joint%20Conference%20on%20Natural%20Language%20Processing%20%28EMNLP-IJCNLP%29%22%2C%22conferenceName%22%3A%22Proceedings%20of%20the%202019%20Conference%20on%20Empirical%20Methods%20in%20Natural%20Language%20Processing%20and%20the%209th%20International%20Joint%20Conference%20on%20Natural%20Language%20Processing%20%28EMNLP-IJCNLP%29%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.18653%5C%2Fv1%5C%2FD19-1628%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FD19-1628%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-30T19%3A36%3A30Z%22%7D%7D%2C%7B%22key%22%3A%22JM966SR2%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Wang%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EWang%2C%20T.%2C%20Inoue%2C%20N.%2C%20Ouchi%2C%20H.%2C%20Mizumoto%2C%20T.%2C%20%26amp%3B%20Inui%2C%20K.%20%282019%29.%20Inject%20Rubrics%20into%20Short%20Answer%20Grading%20System.%20%3Ci%3EProceedings%20of%20the%202nd%20Workshop%20on%20Deep%20Learning%20Approaches%20for%20Low-Resource%20NLP%20%28DeepLo%202019%29%3C%5C%2Fi%3E%2C%20175%26%23x2013%3B182.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FD19-6119%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FD19-6119%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Inject%20Rubrics%20into%20Short%20Answer%20Grading%20System%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tianqi%22%2C%22lastName%22%3A%22Wang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Naoya%22%2C%22lastName%22%3A%22Inoue%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Hiroki%22%2C%22lastName%22%3A%22Ouchi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tomoya%22%2C%22lastName%22%3A%22Mizumoto%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kentaro%22%2C%22lastName%22%3A%22Inui%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%202nd%20Workshop%20on%20Deep%20Learning%20Approaches%20for%20Low-Resource%20NLP%20%28DeepLo%202019%29%22%2C%22conferenceName%22%3A%22Proceedings%20of%20the%202nd%20Workshop%20on%20Deep%20Learning%20Approaches%20for%20Low-Resource%20NLP%20%28DeepLo%202019%29%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.18653%5C%2Fv1%5C%2FD19-6119%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FD19-6119%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-30T19%3A35%3A20Z%22%7D%7D%2C%7B%22key%22%3A%22EMVUKP2X%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Green%20and%20Chen%22%2C%22parsedDate%22%3A%222019-11-07%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGreen%2C%20B.%2C%20%26amp%3B%20Chen%2C%20Y.%20%282019%29.%20The%20Principles%20and%20Limits%20of%20Algorithm-in-the-Loop%20Decision%20Making.%20%3Ci%3EProceedings%20of%20the%20ACM%20on%20Human-Computer%20Interaction%3C%5C%2Fi%3E%2C%20%3Ci%3E3%3C%5C%2Fi%3E%28CSCW%29%2C%201%26%23x2013%3B24.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3359152%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3359152%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22The%20Principles%20and%20Limits%20of%20Algorithm-in-the-Loop%20Decision%20Making%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ben%22%2C%22lastName%22%3A%22Green%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yiling%22%2C%22lastName%22%3A%22Chen%22%7D%5D%2C%22abstractNote%22%3A%22The%20rise%20of%20machine%20learning%20has%20fundamentally%20altered%20decision%20making%3A%20rather%20than%20being%20made%20solely%20by%20people%2C%20many%20important%20decisions%20are%20now%20made%20through%20an%20%5C%22algorithm-in-the-loop%27%27%20process%20where%20machine%20learning%20models%20inform%20people.%20Yet%20insufficient%20research%20has%20considered%20how%20the%20interactions%20between%20people%20and%20models%20actually%20influence%20human%20decisions.%20Society%20lacks%20both%20clear%20normative%20principles%20regarding%20how%20people%20should%20collaborate%20with%20algorithms%20as%20well%20as%20robust%20empirical%20evidence%20about%20how%20people%20do%20collaborate%20with%20algorithms.%20Given%20research%20suggesting%20that%20people%20struggle%20to%20interpret%20machine%20learning%20models%20and%20to%20incorporate%20them%20into%20their%20decisions---sometimes%20leading%20these%20models%20to%20produce%20unexpected%20outcomes---it%20is%20essential%20to%20consider%20how%20different%20ways%20of%20presenting%20models%20and%20structuring%20human-algorithm%20interactions%20affect%20the%20quality%20and%20type%20of%20decisions%20made.%20This%20paper%20contributes%20to%20such%20research%20in%20two%20ways.%20First%2C%20we%20posited%20three%20principles%20as%20essential%20to%20ethical%20and%20responsible%20algorithm-in-the-loop%20decision%20making.%20Second%2C%20through%20a%20controlled%20experimental%20study%20on%20Amazon%20Mechanical%20Turk%2C%20we%20evaluated%20whether%20people%20satisfy%20these%20principles%20when%20making%20predictions%20with%20the%20aid%20of%20a%20risk%20assessment.%20We%20studied%20human%20predictions%20in%20two%20contexts%20%28pretrial%20release%20and%20financial%20lending%29%20and%20under%20several%20conditions%20for%20risk%20assessment%20presentation%20and%20structure.%20Although%20these%20conditions%20did%20influence%20participant%20behaviors%20and%20in%20some%20cases%20improved%20performance%2C%20only%20one%20desideratum%20was%20consistently%20satisfied.%20Under%20all%20conditions%2C%20our%20study%20participants%201%29%20were%20unable%20to%20effectively%20evaluate%20the%20accuracy%20of%20their%20own%20or%20the%20risk%20assessment%27s%20predictions%2C%202%29%20did%20not%20calibrate%20their%20reliance%20on%20the%20risk%20assessment%20based%20on%20the%20risk%20assessment%27s%20performance%2C%20and%203%29%20exhibited%20bias%20in%20their%20interactions%20with%20the%20risk%20assessment.%20These%20results%20highlight%20the%20urgent%20need%20to%20expand%20our%20analyses%20of%20algorithmic%20decision%20making%20aids%20beyond%20evaluating%20the%20models%20themselves%20to%20investigating%20the%20full%20sociotechnical%20contexts%20in%20which%20people%20and%20algorithms%20interact.%22%2C%22date%22%3A%222019-11-07%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1145%5C%2F3359152%22%2C%22ISSN%22%3A%222573-0142%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fdoi%5C%2F10.1145%5C%2F3359152%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-29T18%3A59%3A06Z%22%7D%7D%2C%7B%22key%22%3A%226ATIKKYT%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Hellman%20et%20al.%22%2C%22parsedDate%22%3A%222019-06-24%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EHellman%2C%20S.%2C%20Rosenstein%2C%20M.%2C%20Gorman%2C%20A.%2C%20Murray%2C%20W.%2C%20Becker%2C%20L.%2C%20Baikadi%2C%20A.%2C%20Budden%2C%20J.%2C%20%26amp%3B%20Foltz%2C%20P.%20W.%20%282019%29.%20Scaling%20Up%20Writing%20in%20the%20Curriculum%3A%20Batch%20Mode%20Active%20Learning%20for%20Automated%20Essay%20Scoring.%20%3Ci%3EProceedings%20of%20the%20Sixth%20%282019%29%20ACM%20Conference%20on%20Learning%20%40%20Scale%3C%5C%2Fi%3E%2C%201%26%23x2013%3B10.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3330430.3333629%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3330430.3333629%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Scaling%20Up%20Writing%20in%20the%20Curriculum%3A%20Batch%20Mode%20Active%20Learning%20for%20Automated%20Essay%20Scoring%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Scott%22%2C%22lastName%22%3A%22Hellman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mark%22%2C%22lastName%22%3A%22Rosenstein%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Andrew%22%2C%22lastName%22%3A%22Gorman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22William%22%2C%22lastName%22%3A%22Murray%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lee%22%2C%22lastName%22%3A%22Becker%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alok%22%2C%22lastName%22%3A%22Baikadi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Jill%22%2C%22lastName%22%3A%22Budden%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Peter%20W.%22%2C%22lastName%22%3A%22Foltz%22%7D%5D%2C%22abstractNote%22%3A%22We%20introduce%20a%20new%20approach%20to%20the%20ma-%20chine-assisted%20grading%20of%20short%20answer%20ques-%20tions.%20We%20follow%20past%20work%20in%20automated%20grading%20by%20first%20training%20a%20similarity%20metric%20between%20student%20responses%2C%20but%20then%20go%20on%20to%20use%20this%20metric%20to%20group%20responses%20into%20clus-%20ters%20and%20subclusters.%20The%20resulting%20group-%20ings%20allow%20teachers%20to%20grade%20multiple%20re-%20sponses%20with%20a%20single%20action%2C%20provide%20rich%20feedback%20to%20groups%20of%20similar%20answers%2C%20and%20discover%20modalities%20of%20misunderstanding%20among%20students%3B%20we%20refer%20to%20this%20amplifica-%20tion%20of%20grader%20effort%20as%20%5Cu201cpowergrading.%5Cu201d%20We%20develop%20the%20means%20to%20further%20reduce%20teacher%20effort%20by%20automatically%20performing%20actions%20when%20an%20answer%20key%20is%20available.%20We%20show%20results%20in%20terms%20of%20grading%20progress%20with%20a%20small%20%5Cu201cbudget%5Cu201d%20of%20human%20actions%2C%20both%20from%20our%20method%20and%20an%20LDA-based%20approach%2C%20on%20a%20test%20corpus%20of%2010%20questions%20answered%20by%20698%20respondents.%22%2C%22date%22%3A%222019-06-24%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20Sixth%20%282019%29%20ACM%20Conference%20on%20Learning%20%40%20Scale%22%2C%22conferenceName%22%3A%22L%40S%20%2719%3A%20Sixth%20%282019%29%20ACM%20Conference%20on%20Learning%20%40%20Scale%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1145%5C%2F3330430.3333629%22%2C%22ISBN%22%3A%22978-1-4503-6804-9%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fdoi%5C%2F10.1145%5C%2F3330430.3333629%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-29T18%3A35%3A39Z%22%7D%7D%2C%7B%22key%22%3A%22I4AVDI6G%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Pandya%20et%20al.%22%2C%22parsedDate%22%3A%222019-01-27%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EPandya%2C%20R.%2C%20Huang%2C%20S.%20H.%2C%20Hadfield-Menell%2C%20D.%2C%20%26amp%3B%20Dragan%2C%20A.%20D.%20%282019%29.%20Human-AI%20Learning%20Performance%20in%20Multi-Armed%20Bandits.%20%3Ci%3EProceedings%20of%20the%202019%20AAAI%5C%2FACM%20Conference%20on%20AI%2C%20Ethics%2C%20and%20Society%3C%5C%2Fi%3E%2C%20369%26%23x2013%3B375.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3306618.3314245%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3306618.3314245%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Human-AI%20Learning%20Performance%20in%20Multi-Armed%20Bandits%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ravi%22%2C%22lastName%22%3A%22Pandya%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Sandy%20H.%22%2C%22lastName%22%3A%22Huang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Dylan%22%2C%22lastName%22%3A%22Hadfield-Menell%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Anca%20D.%22%2C%22lastName%22%3A%22Dragan%22%7D%5D%2C%22abstractNote%22%3A%22People%20frequently%20face%20challenging%20decision-making%20problems%20in%20which%20outcomes%20are%20uncertain%20or%20unknown.%20Artificial%20intelligence%20%28AI%29%20algorithms%20exist%20that%20can%20outperform%20humans%20at%20learning%20such%20tasks.%20Thus%2C%20there%20is%20an%20opportunity%20for%20AI%20agents%20to%20assist%20peo-%20ple%20in%20learning%20these%20tasks%20more%20effectively.%20In%20this%20work%2C%20we%20use%20a%20multi-armed%20bandit%20as%20a%20controlled%20setting%20in%20which%20to%20explore%20this%20direction.%20We%20pair%20humans%20with%20a%20selection%20of%20agents%20and%20ob-%20serve%20how%20well%20each%20human-agent%20team%20performs.%20We%20find%20that%20team%20performance%20can%20beat%20both%20human%20and%20agent%20performance%20in%20isolation.%20Interestingly%2C%20we%20also%20find%20that%20an%20agent%5Cu2019s%20performance%20in%20isolation%20does%20not%20necessarily%20correlate%20with%20the%20human-agent%20team%5Cu2019s%20performance.%20A%20drop%20in%20agent%20performance%20can%20lead%20to%20a%20disproportionately%20large%20drop%20in%20team%20performance%2C%20or%20in%20some%20set-%20tings%20can%20even%20improve%20team%20performance.%20Pairing%20a%20human%20with%20an%20agent%20that%20performs%20slightly%20better%20than%20them%20can%20make%20them%20perform%20much%20better%2C%20while%20pairing%20them%20with%20an%20agent%20that%20per-%20forms%20the%20same%20can%20make%20them%20them%20perform%20much%20worse.%20Further%2C%20our%20results%20suggest%20that%20people%20have%20different%20exploration%20strategies%20and%20might%20perform%20better%20with%20agents%20that%20match%20their%20strategy.%20Overall%2C%20optimizing%20human-agent%20team%20performance%20requires%20going%20beyond%20optimizing%20agent%20performance%2C%20to%20understanding%20how%20the%20agent%5Cu2019s%20suggestions%20will%20influence%20human%20decision-making.%22%2C%22date%22%3A%222019-01-27%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%202019%20AAAI%5C%2FACM%20Conference%20on%20AI%2C%20Ethics%2C%20and%20Society%22%2C%22conferenceName%22%3A%22AIES%20%2719%3A%20AAAI%5C%2FACM%20Conference%20on%20AI%2C%20Ethics%2C%20and%20Society%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1145%5C%2F3306618.3314245%22%2C%22ISBN%22%3A%22978-1-4503-6324-2%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fdoi%5C%2F10.1145%5C%2F3306618.3314245%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-29T18%3A34%3A52Z%22%7D%7D%2C%7B%22key%22%3A%22784ADXVL%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Gao%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGao%2C%20Y.%2C%20Sun%2C%20C.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282019%29.%20Automated%20Pyramid%20Summarization%20Evaluation.%20%3Ci%3EProceedings%20of%20the%2023rd%20Conference%20on%20Computational%20Natural%20Language%20Learning%20%28CoNLL%29%3C%5C%2Fi%3E%2C%20404%26%23x2013%3B418.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FK19-1038%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FK19-1038%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Automated%20Pyramid%20Summarization%20Evaluation%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yanjun%22%2C%22lastName%22%3A%22Gao%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Chen%22%2C%22lastName%22%3A%22Sun%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%2023rd%20Conference%20on%20Computational%20Natural%20Language%20Learning%20%28CoNLL%29%22%2C%22conferenceName%22%3A%22Proceedings%20of%20the%2023rd%20Conference%20on%20Computational%20Natural%20Language%20Learning%20%28CoNLL%29%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.18653%5C%2Fv1%5C%2FK19-1038%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FK19-1038%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222022-04-21T15%3A28%3A58Z%22%7D%7D%2C%7B%22key%22%3A%22TV2KS3CY%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Gao%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGao%2C%20Y.%2C%20Driban%2C%20A.%2C%20Xavier%20McManus%2C%20B.%2C%20Musi%2C%20E.%2C%20Davies%2C%20P.%2C%20Muresan%2C%20S.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282019%29.%20Rubric%20Reliability%20and%20Annotation%20of%20Content%20and%20Argument%20in%20Source-Based%20Argument%20Essays.%20%3Ci%3EProceedings%20of%20the%20Fourteenth%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20Building%20Educational%20Applications%3C%5C%2Fi%3E%2C%20507%26%23x2013%3B518.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FW19-4452%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FW19-4452%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Rubric%20Reliability%20and%20Annotation%20of%20Content%20and%20Argument%20in%20Source-Based%20Argument%20Essays%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yanjun%22%2C%22lastName%22%3A%22Gao%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alex%22%2C%22lastName%22%3A%22Driban%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Brennan%22%2C%22lastName%22%3A%22Xavier%20McManus%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Elena%22%2C%22lastName%22%3A%22Musi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Patricia%22%2C%22lastName%22%3A%22Davies%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Smaranda%22%2C%22lastName%22%3A%22Muresan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20Fourteenth%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20Building%20Educational%20Applications%22%2C%22conferenceName%22%3A%22Proceedings%20of%20the%20Fourteenth%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20Building%20Educational%20Applications%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.18653%5C%2Fv1%5C%2FW19-4452%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FW19-4452%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222022-04-19T15%3A14%3A48Z%22%7D%7D%2C%7B%22key%22%3A%2292J4NYLH%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Taniguchi%20et%20al.%22%2C%22parsedDate%22%3A%222019-08-18%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ETaniguchi%2C%20T.%2C%20Mochihashi%2C%20D.%2C%20Nagai%2C%20T.%2C%20Uchida%2C%20S.%2C%20Inoue%2C%20N.%2C%20Kobayashi%2C%20I.%2C%20Nakamura%2C%20T.%2C%20Hagiwara%2C%20Y.%2C%20Iwahashi%2C%20N.%2C%20%26amp%3B%20Inamura%2C%20T.%20%282019%29.%20Survey%20on%20frontiers%20of%20language%20and%20robotics.%20%3Ci%3EAdvanced%20Robotics%3C%5C%2Fi%3E%2C%20%3Ci%3E33%3C%5C%2Fi%3E%2815%26%23x2013%3B16%29%2C%20700%26%23x2013%3B730.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1080%5C%2F01691864.2019.1632223%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1080%5C%2F01691864.2019.1632223%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Survey%20on%20frontiers%20of%20language%20and%20robotics%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22T.%22%2C%22lastName%22%3A%22Taniguchi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22D.%22%2C%22lastName%22%3A%22Mochihashi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22T.%22%2C%22lastName%22%3A%22Nagai%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22S.%22%2C%22lastName%22%3A%22Uchida%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22N.%22%2C%22lastName%22%3A%22Inoue%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22I.%22%2C%22lastName%22%3A%22Kobayashi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22T.%22%2C%22lastName%22%3A%22Nakamura%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Y.%22%2C%22lastName%22%3A%22Hagiwara%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22N.%22%2C%22lastName%22%3A%22Iwahashi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22T.%22%2C%22lastName%22%3A%22Inamura%22%7D%5D%2C%22abstractNote%22%3A%22The%20understanding%20and%20acquisition%20of%20a%20language%20in%20a%20real-world%20environment%20is%20an%20important%20task%20for%20future%20robotics%20services.%20Natural%20language%20processing%20and%20cognitive%20robotics%20have%20both%20been%20focusing%20on%20the%20problem%20for%20decades%20using%20machine%20learning.%20However%2C%20many%20problems%20remain%20unsolved%20despite%20significant%20progress%20in%20machine%20learning%20%28such%20as%20deep%20learning%20and%20probabilistic%20generative%20models%29%20during%20the%20past%20decade.%20The%20remaining%20problems%20have%20not%20been%20systematically%20surveyed%20and%20organized%2C%20as%20most%20of%20them%20are%20highly%20interdisciplinary%20challenges%20for%20language%20and%20robotics.%20This%20study%20conducts%20a%20survey%20on%20the%20frontier%20of%20the%20intersection%20of%20the%20research%20fields%20of%20language%20and%20robotics%2C%20ranging%20from%20logic%20probabilistic%20programming%20to%20designing%20a%20competition%20to%20evaluate%20language%20understanding%20systems.%20We%20focus%20on%20cognitive%20developmental%20robots%20that%20can%20learn%20a%20language%20from%20interaction%20with%20their%20environment%20and%20unsupervised%20learning%20methods%20that%20enable%20robots%20to%20learn%20a%20language%20without%20hand-crafted%20training%20data.%22%2C%22date%22%3A%222019-08-18%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1080%5C%2F01691864.2019.1632223%22%2C%22ISSN%22%3A%220169-1864%2C%201568-5535%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.tandfonline.com%5C%2Fdoi%5C%2Ffull%5C%2F10.1080%5C%2F01691864.2019.1632223%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T19%3A04%3A15Z%22%7D%7D%2C%7B%22key%22%3A%22PHMS6HHJ%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Magyar%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EMagyar%2C%20J.%2C%20Kobayashi%2C%20M.%2C%20Nishio%2C%20S.%2C%20Sincak%2C%20P.%2C%20%26amp%3B%20Ishiguro%2C%20H.%20%282019%29.%20Autonomous%20Robotic%20Dialogue%20System%20with%20Reinforcement%20Learning%20for%20Elderlies%20with%20Dementia.%20%3Ci%3E2019%20IEEE%20International%20Conference%20on%20Systems%2C%20Man%20and%20Cybernetics%20%28SMC%29%3C%5C%2Fi%3E%2C%203416%26%23x2013%3B3421.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1109%5C%2FSMC.2019.8914248%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1109%5C%2FSMC.2019.8914248%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Autonomous%20Robotic%20Dialogue%20System%20with%20Reinforcement%20Learning%20for%20Elderlies%20with%20Dementia%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Jan%22%2C%22lastName%22%3A%22Magyar%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Masahiko%22%2C%22lastName%22%3A%22Kobayashi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Shuichi%22%2C%22lastName%22%3A%22Nishio%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Peter%22%2C%22lastName%22%3A%22Sincak%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Hiroshi%22%2C%22lastName%22%3A%22Ishiguro%22%7D%5D%2C%22abstractNote%22%3A%22The%20growing%20number%20of%20people%20living%20with%20dementia%20puts%20a%20heavy%20load%20on%20elderly%20care%20nurses.%20The%20use%20of%20humanoid%20robots%20as%20communication%20partners%20can%20help%20alleviate%20this%20load%20with%20the%20goal%20to%20assist%20seniors%20in%20maintaining%20their%20cognitive%20skills%20through%20conversation.%20In%20this%20paper%20we%20present%20an%20autonomous%20robotic%20dialogue%20system%20with%20the%20humanoid%20robot%20Bonoid%20that%20is%20capable%20of%20learning%20a%20conversation%20strategy%20from%20interactions%20with%20humans.%20The%20system%20was%20tested%20and%20evaluated%20with%20first%20results%20showing%20natural%20and%20engaging%20interactions%20with%20seniors%2C%20and%20the%20robotic%20system%20acquiring%20a%20conversation%20strategy%20through%20the%20use%20of%20reinforcement%20learning.%22%2C%22date%22%3A%2210%5C%2F2019%22%2C%22proceedingsTitle%22%3A%222019%20IEEE%20International%20Conference%20on%20Systems%2C%20Man%20and%20Cybernetics%20%28SMC%29%22%2C%22conferenceName%22%3A%222019%20IEEE%20International%20Conference%20on%20Systems%2C%20Man%20and%20Cybernetics%20%28SMC%29%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.1109%5C%2FSMC.2019.8914248%22%2C%22ISBN%22%3A%22978-1-72814-569-3%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fieeexplore.ieee.org%5C%2Fdocument%5C%2F8914248%5C%2F%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T16%3A33%3A01Z%22%7D%7D%2C%7B%22key%22%3A%22SMYKSBZN%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Sierra%20and%20International%20Joint%20Conferences%20on%20Artificial%20Intelligence%2C%20Inc%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ESierra%2C%20C.%2C%20%26amp%3B%20International%20Joint%20Conferences%20on%20Artificial%20Intelligence%2C%20Inc%20%28Eds.%29.%20%282019%29.%20%3Ci%3EInternational%20Joint%20Conferences%20on%20Artificial%20Intelligence%20%28IJCAI%202017%29%3A%20Melbourne%2C%20Australia%2C%2019-25%20August%202017%3C%5C%2Fi%3E.%20Curran%20Associates%2C%20Inc.%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22book%22%2C%22title%22%3A%22International%20Joint%20Conferences%20on%20Artificial%20Intelligence%20%28IJCAI%202017%29%3A%20Melbourne%2C%20Australia%2C%2019-25%20August%202017%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Carles%22%2C%22lastName%22%3A%22Sierra%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22International%20Joint%20Conferences%20on%20Artificial%20Intelligence%2C%20Inc%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222019%22%2C%22language%22%3A%22eng%22%2C%22ISBN%22%3A%22978-0-9992411-0-3%20978-1-5108-7679-8%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T16%3A17%3A12Z%22%7D%7D%2C%7B%22key%22%3A%22BW7RJT7I%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Addlesee%20et%20al.%22%2C%22parsedDate%22%3A%222019-09-14%22%2C%22numChildren%22%3A2%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EAddlesee%2C%20A.%2C%20Eshghi%2C%20A.%2C%20%26amp%3B%20Konstas%2C%20I.%20%282019%2C%20September%2014%29.%20Current%20Challenges%20in%20Spoken%20Dialogue%20Systems%20and%20Why%20They%20Are%20Critical%20for%20Those%20Living%20with%20Dementia.%20%3Ci%3EArXiv%3A1909.06644%20%5BCs%5D%3C%5C%2Fi%3E.%20Dialog%20for%20Good%20%28DiGo%29%202019%2C%20Workshop%20on%20Speech%20and%20Language%20Technology%20Serving%20Society%2C%20Stockholm%2C%20Sweden.%20%3Ca%20href%3D%27http%3A%5C%2F%5C%2Farxiv.org%5C%2Fabs%5C%2F1909.06644%27%3Ehttp%3A%5C%2F%5C%2Farxiv.org%5C%2Fabs%5C%2F1909.06644%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Current%20Challenges%20in%20Spoken%20Dialogue%20Systems%20and%20Why%20They%20Are%20Critical%20for%20Those%20Living%20with%20Dementia%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Angus%22%2C%22lastName%22%3A%22Addlesee%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Arash%22%2C%22lastName%22%3A%22Eshghi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ioannis%22%2C%22lastName%22%3A%22Konstas%22%7D%5D%2C%22abstractNote%22%3A%22Dialogue%20technologies%20such%20as%20Amazon%27s%20Alexa%20have%20the%20potential%20to%20transform%20the%20healthcare%20industry.%20However%2C%20current%20systems%20are%20not%20yet%20naturally%20interactive%3A%20they%20are%20often%20turn-based%2C%20have%20naive%20end-of-turn%20detection%20and%20completely%20ignore%20many%20types%20of%20verbal%20and%20visual%20feedback%20-%20such%20as%20backchannels%2C%20hesitation%20markers%2C%20filled%20pauses%2C%20gaze%2C%20brow%20furrows%20and%20disfluencies%20-%20that%20are%20crucial%20in%20guiding%20and%20managing%20the%20conversational%20process.%20This%20is%20especially%20important%20in%20the%20healthcare%20industry%20as%20target%20users%20of%20Spoken%20Dialogue%20Systems%20%28SDSs%29%20are%20likely%20to%20be%20frail%2C%20older%2C%20distracted%20or%20suffer%20from%20cognitive%20decline%20which%20impacts%20their%20ability%20to%20make%20effective%20use%20of%20current%20systems.%20In%20this%20paper%2C%20we%20outline%20some%20of%20the%20challenges%20that%20are%20in%20urgent%20need%20of%20further%20research%2C%20including%20Incremental%20Speech%20Recognition%20and%20a%20systematic%20study%20of%20the%20interactional%20patterns%20in%20conversation%20that%20are%20potentially%20diagnostic%20of%20dementia%2C%20and%20how%20these%20might%20inform%20research%20on%20and%20the%20design%20of%20the%20next%20generation%20of%20SDSs.%22%2C%22date%22%3A%222019-09-14%22%2C%22proceedingsTitle%22%3A%22arXiv%3A1909.06644%20%5Bcs%5D%22%2C%22conferenceName%22%3A%22Dialog%20for%20Good%20%28DiGo%29%202019%2C%20Workshop%20on%20Speech%20and%20Language%20Technology%20Serving%20Society%2C%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Farxiv.org%5C%2Fabs%5C%2F1909.06644%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T16%3A04%3A17Z%22%7D%7D%2C%7B%22key%22%3A%22P78VWN9G%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Addlesee%20et%20al.%22%2C%22parsedDate%22%3A%222019-09-14%22%2C%22numChildren%22%3A2%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EAddlesee%2C%20A.%2C%20Eshghi%2C%20A.%2C%20%26amp%3B%20Konstas%2C%20I.%20%282019%29.%20Current%20Challenges%20in%20Spoken%20Dialogue%20Systems%20and%20Why%20They%20Are%20Critical%20for%20Those%20Living%20with%20Dementia.%20%3Ci%3EArXiv%3A1909.06644%20%5BCs%5D%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27http%3A%5C%2F%5C%2Farxiv.org%5C%2Fabs%5C%2F1909.06644%27%3Ehttp%3A%5C%2F%5C%2Farxiv.org%5C%2Fabs%5C%2F1909.06644%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Current%20Challenges%20in%20Spoken%20Dialogue%20Systems%20and%20Why%20They%20Are%20Critical%20for%20Those%20Living%20with%20Dementia%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Angus%22%2C%22lastName%22%3A%22Addlesee%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Arash%22%2C%22lastName%22%3A%22Eshghi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ioannis%22%2C%22lastName%22%3A%22Konstas%22%7D%5D%2C%22abstractNote%22%3A%22Dialogue%20technologies%20such%20as%20Amazon%27s%20Alexa%20have%20the%20potential%20to%20transform%20the%20healthcare%20industry.%20However%2C%20current%20systems%20are%20not%20yet%20naturally%20interactive%3A%20they%20are%20often%20turn-based%2C%20have%20naive%20end-of-turn%20detection%20and%20completely%20ignore%20many%20types%20of%20verbal%20and%20visual%20feedback%20-%20such%20as%20backchannels%2C%20hesitation%20markers%2C%20filled%20pauses%2C%20gaze%2C%20brow%20furrows%20and%20disfluencies%20-%20that%20are%20crucial%20in%20guiding%20and%20managing%20the%20conversational%20process.%20This%20is%20especially%20important%20in%20the%20healthcare%20industry%20as%20target%20users%20of%20Spoken%20Dialogue%20Systems%20%28SDSs%29%20are%20likely%20to%20be%20frail%2C%20older%2C%20distracted%20or%20suffer%20from%20cognitive%20decline%20which%20impacts%20their%20ability%20to%20make%20effective%20use%20of%20current%20systems.%20In%20this%20paper%2C%20we%20outline%20some%20of%20the%20challenges%20that%20are%20in%20urgent%20need%20of%20further%20research%2C%20including%20Incremental%20Speech%20Recognition%20and%20a%20systematic%20study%20of%20the%20interactional%20patterns%20in%20conversation%20that%20are%20potentially%20diagnostic%20of%20dementia%2C%20and%20how%20these%20might%20inform%20research%20on%20and%20the%20design%20of%20the%20next%20generation%20of%20SDSs.%22%2C%22date%22%3A%222019-09-14%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISSN%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Farxiv.org%5C%2Fabs%5C%2F1909.06644%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T16%3A01%3A30Z%22%7D%7D%2C%7B%22key%22%3A%22QXE9GLX3%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Ritter%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ERitter%2C%20F.%20E.%2C%20Tehranchi%2C%20F.%2C%20%26amp%3B%20Oury%2C%20J.%20D.%20%282019%29.%20ACT-R%3A%20A%20cognitive%20architecture%20for%20modeling%20cognition.%20%3Ci%3EWIREs%20Cognitive%20Science%3C%5C%2Fi%3E%2C%20%3Ci%3E10%3C%5C%2Fi%3E%283%29%2C%20e1488.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fwcs.1488%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fwcs.1488%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22ACT-R%3A%20A%20cognitive%20architecture%20for%20modeling%20cognition%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Frank%20E.%22%2C%22lastName%22%3A%22Ritter%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Farnaz%22%2C%22lastName%22%3A%22Tehranchi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Jacob%20D.%22%2C%22lastName%22%3A%22Oury%22%7D%5D%2C%22abstractNote%22%3A%22ACT-R%20is%20a%20hybrid%20cognitive%20architecture.%20It%20is%20comprised%20of%20a%20set%20of%20programmable%20information%20processing%20mechanisms%20that%20can%20be%20used%20to%20predict%20and%20explain%20human%20behavior%20including%20cognition%20and%20interaction%20with%20the%20environment.%20We%20start%20by%20reviewing%20its%20history%2C%20which%20shapes%20its%20current%20form%2C%20contrasts%20and%20relates%20it%20to%20other%20architectures%2C%20and%20helps%20readers%20to%20anticipate%20where%20it%20is%20going.%20Based%20on%20this%20history%2C%20we%20then%20describe%20it%20as%20a%20theory%20of%20cognition%20that%20is%20realized%20as%20a%20computer%20program.%20After%20this%2C%20we%20briefly%20discuss%20tools%20for%20working%20with%20ACT-R%2C%20and%20also%20note%20several%20major%20accomplishments%20that%20have%20been%20gained%20by%20working%20with%20ACT-R%20in%20both%20basic%20and%20applied%20science%2C%20including%20summarizing%20some%20of%20the%20insights%20about%20human%20behavior.%20We%20conclude%20by%20discussing%20its%20future%2C%20which%20we%20believe%20will%20include%20adding%20emotions%20and%20physiology%2C%20increasing%20usability%2C%20and%20the%20use%20of%20nongenerative%20models.%20This%20article%20is%20categorized%20under%3A%20Computer%20Science%20%3E%20Artificial%20Intelligence%20Psychology%20%3E%20Reasoning%20and%20Decision%20Making%20Psychology%20%3E%20Theory%20and%20Methods%22%2C%22date%22%3A%222019%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fwcs.1488%22%2C%22ISSN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fonlinelibrary.wiley.com%5C%2Fdoi%5C%2Fabs%5C%2F10.1002%5C%2Fwcs.1488%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222021-03-17T15%3A49%3A16Z%22%7D%7D%2C%7B%22key%22%3A%22YF7594EM%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Miyazawa%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EMiyazawa%2C%20K.%2C%20Horii%2C%20T.%2C%20Aoki%2C%20T.%2C%20%26amp%3B%20Nagai%2C%20T.%20%282019%29.%20Integrated%20Cognitive%20Architecture%20for%20Robot%20Learning%20of%20Action%20and%20Language.%20%3Ci%3EFrontiers%20in%20Robotics%20and%20AI%3C%5C%2Fi%3E%2C%20%3Ci%3E6%3C%5C%2Fi%3E%2C%20131.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.3389%5C%2Ffrobt.2019.00131%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.3389%5C%2Ffrobt.2019.00131%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Integrated%20Cognitive%20Architecture%20for%20Robot%20Learning%20of%20Action%20and%20Language%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kazuki%22%2C%22lastName%22%3A%22Miyazawa%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Takato%22%2C%22lastName%22%3A%22Horii%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tatsuya%22%2C%22lastName%22%3A%22Aoki%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Takayuki%22%2C%22lastName%22%3A%22Nagai%22%7D%5D%2C%22abstractNote%22%3A%22The%20manner%20in%20which%20humans%20learn%2C%20plan%2C%20and%20decide%20actions%20is%20a%20very%20compelling%20subject.%20Moreover%2C%20the%20mechanism%20behind%20high-level%20cognitive%20functions%2C%20such%20as%20action%20planning%2C%20language%20understanding%2C%20and%20logical%20thinking%2C%20has%20not%20yet%20been%20fully%20implemented%20in%20robotics.%20In%20this%20paper%2C%20we%20propose%20a%20framework%20for%20the%20simultaneously%20comprehension%20of%20concepts%2C%20actions%2C%20and%20language%20as%20a%20first%20step%20toward%20this%20goal.%20This%20can%20be%20achieved%20by%20integrating%20various%20cognitive%20modules%20and%20leveraging%20mainly%20multimodal%20categorization%20by%20using%20multilayered%20multimodal%20latent%20Dirichlet%20allocation%20%28mMLDA%29.%20The%20integration%20of%20reinforcement%20learning%20and%20mMLDA%20enables%20actions%20based%20on%20understanding.%20Furthermore%2C%20the%20mMLDA%2C%20in%20conjunction%20with%20grammar%20learning%20and%20based%20on%20the%20Bayesian%20hidden%20Markov%20model%20%28BHMM%29%2C%20allows%20the%20robot%20to%20verbalize%20its%20own%20actions%20and%20understand%20user%20utterances.%20We%20verify%20the%20potential%20of%20the%20proposed%20architecture%20through%20experiments%20using%20a%20real%20robot.%22%2C%22date%22%3A%222019%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.3389%5C%2Ffrobt.2019.00131%22%2C%22ISSN%22%3A%222296-9144%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.frontiersin.org%5C%2Farticle%5C%2F10.3389%5C%2Ffrobt.2019.00131%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222021-03-17T00%3A34%3A13Z%22%7D%7D%2C%7B%22key%22%3A%222675FXJB%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Kulkarni%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EKulkarni%2C%20A.%2C%20Zha%2C%20Y.%2C%20Chakkraborti%2C%20T.%2C%20Vadlamudi%2C%20S.%20G.%2C%20Zhang%2C%20Y.%2C%20%26amp%3B%20Kambhampati%2C%20S.%20%282019%29.%20Explicable%20Planning%20as%20Minimizing%20Distance%20from%20Expected%20Behavior.%20%3Ci%3EProceedings%20of%20the%2018th%20International%20Conference%20on%20Autonomous%20Agents%20and%20MultiAgent%20Systems%20%28AAMAS%20%26%23x2019%3B19%29%3C%5C%2Fi%3E%2C%20%3Ci%3ERichland%2C%20CS%3C%5C%2Fi%3E%2C%202075%26%23x2013%3B2077.%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Explicable%20Planning%20as%20Minimizing%20Distance%20from%20Expected%20Behavior%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Anagha%22%2C%22lastName%22%3A%22Kulkarni%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yantian%22%2C%22lastName%22%3A%22Zha%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tathagata%22%2C%22lastName%22%3A%22Chakkraborti%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Satya%20Gautam%22%2C%22lastName%22%3A%22Vadlamudi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yu%22%2C%22lastName%22%3A%22Zhang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Subbarao%22%2C%22lastName%22%3A%22Kambhampati%22%7D%5D%2C%22abstractNote%22%3A%22In%20order%20to%20have%20effective%20human-AI%20collaboration%2C%20it%20is%20necessary%20to%20address%20how%20the%20AI%20agent%5Cu2019s%20behavior%20is%20being%20perceived%20by%20the%20humans-in-the-loop.%20When%20the%20agent%5Cu2019s%20task%20plans%20are%20generated%20without%20such%20considerations%2C%20they%20may%20often%20demonstrate%20inexplicable%20behavior%20from%20the%20human%20observer%5Cu2019s%20point%20of%20view.%20This%20problem%20may%20arise%20due%20to%20the%20observer%5Cu2019s%20partial%20or%20inaccurate%20understanding%20of%20the%20agent%5Cu2019s%20planning%20model.%20This%20may%20have%20serious%20implications%2C%20from%20increased%20cognitive%20load%20to%20more%20serious%20concerns%20of%20safety%20around%20the%20physical%20agent.%20In%20this%20paper%2C%20we%20address%20this%20issue%20by%20modeling%20the%20notion%20of%20plan%20explicability%20as%20a%20function%20of%20the%20distance%20between%20a%20plan%20that%20the%20agent%20makes%20and%20the%20plan%20that%20the%20observer%20expects%20it%20to%20make.%20We%20achieve%20this%2C%20by%20learning%20a%20regression%20model%20over%20the%20plan%20distances%20and%20map%20them%20to%20the%20labeling%20scheme%20used%20by%20the%20human%20observers.%20We%20develop%20an%20any-%20time%20search%20algorithm%20that%20is%20guided%20by%20a%20heuristic%20derived%20from%20the%20learned%20model%20to%20come%20up%20with%20progressively%20explicable%20plans.%20We%20evaluate%20the%20effectiveness%20of%20our%20approach%20in%20a%20simulated%20autonomous%20car%20domain%20and%20a%20physical%20robot%20domain%20and%20also%20report%20results%20of%20the%20user%20studies%20performed%20in%20both%20the%20domains.%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%2018th%20International%20Conference%20on%20Autonomous%20Agents%20and%20MultiAgent%20Systems%20%28AAMAS%20%2719%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222021-03-15T18%3A40%3A30Z%22%7D%7D%2C%7B%22key%22%3A%22UVQR467V%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Chakraborti%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EChakraborti%2C%20T.%2C%20Sreedharan%2C%20S.%2C%20%26amp%3B%20Kambhampati%2C%20S.%20%282019%29.%20Balancing%20Explicability%20and%20Explanations%20for%20Human-Aware%20Planning.%20%3Ci%3EProceedings%20of%20the%20Twenty-Eighth%20International%20Joint%20Conference%20on%20Artificial%20Intelligence%20%28IJCAI-19%29%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fwww.ijcai.org%5C%2FProceedings%5C%2F2019%5C%2F185%27%3Ehttps%3A%5C%2F%5C%2Fwww.ijcai.org%5C%2FProceedings%5C%2F2019%5C%2F185%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Balancing%20Explicability%20and%20Explanations%20for%20Human-Aware%20Planning%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tathagata%22%2C%22lastName%22%3A%22Chakraborti%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Sarath%22%2C%22lastName%22%3A%22Sreedharan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Subbarao%22%2C%22lastName%22%3A%22Kambhampati%22%7D%5D%2C%22abstractNote%22%3A%22Human-aware%20planning%20involves%20generating%20plans%20that%20are%20explicable%20as%20well%20as%20providing%20explanations%20when%20such%20plans%20cannot%20be%20found.%20In%20this%20paper%2C%20we%20bring%20these%20two%20concepts%20together%20and%20show%20how%20an%20agent%20can%20achieve%20a%20trade-off%20between%20these%20two%20competing%20characteristics%20of%20a%20plan.%20In%20order%20to%20achieve%20this%2C%20we%20conceive%20a%20first%20of%20its%20kind%20planner%20MEGA%20that%20can%20augment%20the%20possibility%20of%20ex-%20plaining%20a%20plan%20in%20the%20plan%20generation%20process%20itself.%20We%20situate%20our%20discussion%20in%20the%20context%20of%20recent%20work%20on%20explicable%20planning%20and%20explanation%20generation%2C%20and%20illustrate%20these%20concepts%20in%20two%20well-known%20planning%20domains%2C%20as%20well%20as%20in%20a%20demonstration%20of%20a%20robot%20in%20a%20typical%20search%20and%20reconnaissance%20task.%20Human%20factor%20studies%20in%20the%20latter%20highlight%20the%20usefulness%20of%20the%20proposed%20approach.%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20Twenty-Eighth%20International%20Joint%20Conference%20on%20Artificial%20Intelligence%20%28IJCAI-19%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.ijcai.org%5C%2FProceedings%5C%2F2019%5C%2F185%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222021-03-15T18%3A18%3A52Z%22%7D%7D%2C%7B%22key%22%3A%22EI6E6HRV%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Huerta%20and%20Garza%22%2C%22parsedDate%22%3A%222019-09-01%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EHuerta%2C%20M.%2C%20%26amp%3B%20Garza%2C%20T.%20%282019%29.%20Writing%20in%20Science%3A%20Why%2C%20How%2C%20and%20for%20Whom%3F%20A%20Systematic%20Literature%20Review%20of%2020%26%23xA0%3BYears%20of%20Intervention%20Research%20%281996%26%23x2013%3B2016%29.%20%3Ci%3EEducational%20Psychology%20Review%3C%5C%2Fi%3E%2C%20%3Ci%3E31%3C%5C%2Fi%3E%283%29%2C%20533%26%23x2013%3B570.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs10648-019-09477-1%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs10648-019-09477-1%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Writing%20in%20Science%3A%20Why%2C%20How%2C%20and%20for%20Whom%3F%20A%20Systematic%20Literature%20Review%20of%2020%5Cu00a0Years%20of%20Intervention%20Research%20%281996%5Cu20132016%29%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Margarita%22%2C%22lastName%22%3A%22Huerta%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tiberio%22%2C%22lastName%22%3A%22Garza%22%7D%5D%2C%22abstractNote%22%3A%22The%20role%20writing%20plays%20in%20learning%20science%20has%20evolved%20over%20time%2C%20as%20have%20the%20settings%20and%20contexts%20in%20which%20writing%20in%20science%20research%20has%20taken%20place.%20This%20systematic%20review%20examines%2020%5Cu00a0years%20%281996%5Cu20132016%29%20of%20writing%20in%20science%20intervention%20studies%20in%20K-12%20settings%20with%20a%20specific%20focus%20on%20comparing%20contexts%20that%20do%20and%20do%20not%20include%20English%20language%20learners%20%28ELLs%29%2C%20who%20are%20at%20risk%20academically.%20Findings%20include%20an%20overall%20validation%20of%20writing-to-learn%20theories%20in%20science%20learning%20contexts.%20Findings%20also%20include%20notable%20differences%20between%20articles%20containing%20studies%20that%20include%20ELLs%20and%20those%20that%20do%20not%20such%20as%20a%20general%20lack%20of%20depth%20in%20terms%20of%20description%2C%20analysis%2C%20and%20rigor%20on%20writing%20with%20ELLs%20in%20the%20science%20classroom.%20In%20addition%2C%20trends%20over%20the%20last%20two%20decades%20are%20noted.%20Implications%20for%20research%20and%20practice%20based%20on%20the%20findings%20are%20discussed.%22%2C%22date%22%3A%22September%201%2C%202019%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.1007%5C%2Fs10648-019-09477-1%22%2C%22ISSN%22%3A%221573-336X%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs10648-019-09477-1%22%2C%22collections%22%3A%5B%22QLXZHG9M%22%2C%22XSGKE5BJ%22%2C%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222020-11-20T16%3A55%3A24Z%22%7D%7D%2C%7B%22key%22%3A%22DRQD4TZS%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Zare%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EZare%2C%20M.%2C%20Ayub%2C%20A.%2C%20Wagner%2C%20A.%20R.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282019%29.%20Show%20Me%20How%20to%20Win%3A%20A%20Robot%20that%20Uses%20Dialog%20Management%20to%20Learn%20from%20Demonstrations.%20%3Ci%3EFourth%20Games%20and%20Natural%20Language%20Processing%20Workshop%20%28GAMNLP-19%29%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fdoi%5C%2F10.1145%5C%2F3337722.3341866%27%3Ehttps%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fdoi%5C%2F10.1145%5C%2F3337722.3341866%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Show%20Me%20How%20to%20Win%3A%20A%20Robot%20that%20Uses%20Dialog%20Management%20to%20Learn%20from%20Demonstrations.%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Maryam%22%2C%22lastName%22%3A%22Zare%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ali%22%2C%22lastName%22%3A%22Ayub%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alan%20R.%22%2C%22lastName%22%3A%22Wagner%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Fourth%20Games%20and%20Natural%20Language%20Processing%20Workshop%20%28GAMNLP-19%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fdoi%5C%2F10.1145%5C%2F3337722.3341866%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222020-04-27T16%3A22%3A15Z%22%7D%7D%2C%7B%22key%22%3A%2278S2APDU%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Gao%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGao%2C%20Y.%2C%20Driban%2C%20A.%2C%20McManus%2C%20B.%2C%20Musi%2C%20E.%2C%20Davies%2C%20P.%2C%20%26amp%3B%20Passonneau.%20%282019%29.%20Rubric%20Reliability%20and%20Annotation%20of%20Content%20and%20Argument%20in%20Source-Based%20Argument%20Essays.%20%3Ci%3EProceedings%20of%20the%20Fourteenth%20on%20Innovative%20Use%20of%20NLP%20for%20Building%20Educational%20Applications%20%28BEA%29%3C%5C%2Fi%3E%2C%20507%26%23x2013%3B518.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FW19-4452%5C%2F%27%3Ehttps%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FW19-4452%5C%2F%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Rubric%20Reliability%20and%20Annotation%20of%20Content%20and%20Argument%20in%20Source-Based%20Argument%20Essays%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yanjun%22%2C%22lastName%22%3A%22Gao%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alex%22%2C%22lastName%22%3A%22Driban%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Brennan%22%2C%22lastName%22%3A%22McManus%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Elena%22%2C%22lastName%22%3A%22Musi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Patricia%22%2C%22lastName%22%3A%22Davies%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222019%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20Fourteenth%5CnWorkshop%20on%20Innovative%20Use%20of%20NLP%20for%20Building%20Educational%20Applications%20%28BEA%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FW19-4452%5C%2F%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222020-04-27T16%3A19%3A35Z%22%7D%7D%5D%7D
Qiao, M., & Valiant, G. (2019). A Theory of Selective Prediction. Proceedings of the 32nd Conference on Learning Theory (PMLR), 99, 2580–2594. https://proceedings.mlr.press/v99/qiao19a.html
Liu, T., Ding, W., Wang, Z., Tang, J., Huang, G. Y., & Liu, Z. (2019). Automatic Short Answer Grading via Multiway Attention Networks. In S. Isotani, E. Millán, A. Ogan, P. Hastings, B. McLaren, & R. Luckin (Eds.), Artificial Intelligence in Education (Vol. 11626, pp. 169–173). Springer International Publishing. https://doi.org/10.1007/978-3-030-23207-8_32
Strobl, Ailhaud, Benetos, Devitt, Kruse, & Proske. (2019). Digital support for academic writing: A review of technologies and pedagogies. Computers & Education, 131, 33–48. https://doi.org/10.1016/j.compedu.2018.12.00
Gere, A. R., Limlamai, N., Wilson, E., MacDougall Saylor, K., & Pugh, R. (2019). Writing and Conceptual Learning in Science: An Analysis of Assignments. Written Communication, 36(1), 99–135. https://doi.org/10.1177/0741088318804820
Liu, T., Ding, W., Wang, Z., Tang, J., Huang, G. Y., & Liu, Z. (2019). Automatic Short Answer Grading via Multiway Attention Networks. In S. Isotani, E. Millán, A. Ogan, P. Hastings, B. McLaren, & R. Luckin (Eds.), Artificial Intelligence in Education (Vol. 11626, pp. 169–173). Springer International Publishing. https://doi.org/10.1007/978-3-030-23207-8_32
Sung, C., Dhamecha, T., Saha, S., Ma, T., Reddy, V., & Arora, R. (2019). Pre-Training BERT on Domain Resources for Short Answer Grading. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 6070–6074. https://doi.org/10.18653/v1/D19-1628
Wang, T., Inoue, N., Ouchi, H., Mizumoto, T., & Inui, K. (2019). Inject Rubrics into Short Answer Grading System. Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019), 175–182. https://doi.org/10.18653/v1/D19-6119
Green, B., & Chen, Y. (2019). The Principles and Limits of Algorithm-in-the-Loop Decision Making. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–24. https://doi.org/10.1145/3359152
Hellman, S., Rosenstein, M., Gorman, A., Murray, W., Becker, L., Baikadi, A., Budden, J., & Foltz, P. W. (2019). Scaling Up Writing in the Curriculum: Batch Mode Active Learning for Automated Essay Scoring. Proceedings of the Sixth (2019) ACM Conference on Learning @ Scale, 1–10. https://doi.org/10.1145/3330430.3333629
Pandya, R., Huang, S. H., Hadfield-Menell, D., & Dragan, A. D. (2019). Human-AI Learning Performance in Multi-Armed Bandits. Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, 369–375. https://doi.org/10.1145/3306618.3314245
Gao, Y., Sun, C., & Passonneau, R. J. (2019). Automated Pyramid Summarization Evaluation. Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), 404–418. https://doi.org/10.18653/v1/K19-1038
Gao, Y., Driban, A., Xavier McManus, B., Musi, E., Davies, P., Muresan, S., & Passonneau, R. J. (2019). Rubric Reliability and Annotation of Content and Argument in Source-Based Argument Essays. Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications, 507–518. https://doi.org/10.18653/v1/W19-4452
Taniguchi, T., Mochihashi, D., Nagai, T., Uchida, S., Inoue, N., Kobayashi, I., Nakamura, T., Hagiwara, Y., Iwahashi, N., & Inamura, T. (2019). Survey on frontiers of language and robotics. Advanced Robotics, 33(15–16), 700–730. https://doi.org/10.1080/01691864.2019.1632223
Magyar, J., Kobayashi, M., Nishio, S., Sincak, P., & Ishiguro, H. (2019). Autonomous Robotic Dialogue System with Reinforcement Learning for Elderlies with Dementia. 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), 3416–3421. https://doi.org/10.1109/SMC.2019.8914248
Sierra, C., & International Joint Conferences on Artificial Intelligence, Inc (Eds.). (2019). International Joint Conferences on Artificial Intelligence (IJCAI 2017): Melbourne, Australia, 19-25 August 2017. Curran Associates, Inc.
Addlesee, A., Eshghi, A., & Konstas, I. (2019, September 14). Current Challenges in Spoken Dialogue Systems and Why They Are Critical for Those Living with Dementia. ArXiv:1909.06644 [Cs]. Dialog for Good (DiGo) 2019, Workshop on Speech and Language Technology Serving Society, Stockholm, Sweden. http://arxiv.org/abs/1909.06644
Addlesee, A., Eshghi, A., & Konstas, I. (2019). Current Challenges in Spoken Dialogue Systems and Why They Are Critical for Those Living with Dementia. ArXiv:1909.06644 [Cs]. http://arxiv.org/abs/1909.06644
Ritter, F. E., Tehranchi, F., & Oury, J. D. (2019). ACT-R: A cognitive architecture for modeling cognition. WIREs Cognitive Science, 10(3), e1488. https://doi.org/https://doi.org/10.1002/wcs.1488
Miyazawa, K., Horii, T., Aoki, T., & Nagai, T. (2019). Integrated Cognitive Architecture for Robot Learning of Action and Language. Frontiers in Robotics and AI, 6, 131. https://doi.org/10.3389/frobt.2019.00131
Kulkarni, A., Zha, Y., Chakkraborti, T., Vadlamudi, S. G., Zhang, Y., & Kambhampati, S. (2019). Explicable Planning as Minimizing Distance from Expected Behavior. Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS ’19), Richland, CS, 2075–2077.
Chakraborti, T., Sreedharan, S., & Kambhampati, S. (2019). Balancing Explicability and Explanations for Human-Aware Planning. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19). https://www.ijcai.org/Proceedings/2019/185
Huerta, M., & Garza, T. (2019). Writing in Science: Why, How, and for Whom? A Systematic Literature Review of 20 Years of Intervention Research (1996–2016). Educational Psychology Review, 31(3), 533–570. https://doi.org/10.1007/s10648-019-09477-1
Zare, M., Ayub, A., Wagner, A. R., & Passonneau, R. J. (2019). Show Me How to Win: A Robot that Uses Dialog Management to Learn from Demonstrations. Fourth Games and Natural Language Processing Workshop (GAMNLP-19). https://dl.acm.org/doi/10.1145/3337722.3341866
Gao, Y., Driban, A., McManus, B., Musi, E., Davies, P., & Passonneau. (2019). Rubric Reliability and Annotation of Content and Argument in Source-Based Argument Essays. Proceedings of the Fourteenth on Innovative Use of NLP for Building Educational Applications (BEA), 507–518. https://www.aclweb.org/anthology/W19-4452/
2018
5414994
2018
1
apa
50
default
349
https://www.nlplab.psu.edu/wp-content/plugins/zotpress/
%7B%22status%22%3A%22success%22%2C%22updateneeded%22%3Afalse%2C%22instance%22%3Afalse%2C%22meta%22%3A%7B%22request_last%22%3A0%2C%22request_next%22%3A0%2C%22used_cache%22%3Atrue%7D%2C%22data%22%3A%5B%7B%22key%22%3A%224XL6PSFW%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Kalman%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EKalman%2C%20C.%20S.%20%282018%29.%20%3Ci%3ESuccessful%20Science%20and%20Engineering%20Teaching%3A%20Theoretical%20and%20Learning%20Perspectives%3C%5C%2Fi%3E.%20Springer%2C%20Cham.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-319-66140-7%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-319-66140-7%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22book%22%2C%22title%22%3A%22Successful%20Science%20and%20Engineering%20Teaching%3A%20Theoretical%20and%20Learning%20Perspectives%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Calvin%20S.%22%2C%22lastName%22%3A%22Kalman%22%7D%5D%2C%22abstractNote%22%3A%22Science%20educational%20research%20began%20with%20the%20realization%20that%20many%20students%20were%20failing%20science%20courses%20not%20because%20they%20lacked%20the%20ability%20to%20understand%20the%20courses%20but%20because%20the%20courses%20were%20not%20meeting%20their%20needs.%20After%20discussing%20the%20beginnings%20of%20science%20educational%20research%2C%20we%20look%20at%20research%20questions.%20No%20book%20can%20hope%20to%20cover%20all%20of%20science%20educational%20research.%20This%20book%20attempts%20to%20explore%20some%20major%20questions%20relating%20to%20basic%20issues%20that%20impede%20student%20learning.%22%2C%22date%22%3A%222018%22%2C%22language%22%3A%22%22%2C%22ISBN%22%3A%22978-3-319-66140-7%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-319-66140-7%22%2C%22collections%22%3A%5B%22L43JYTHB%22%5D%2C%22dateModified%22%3A%222023-02-03T15%3A12%3A11Z%22%7D%7D%2C%7B%22key%22%3A%22FNGWSFM7%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Gao%20et%20al.%22%2C%22parsedDate%22%3A%222018-05-07%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGao%2C%20Y.%2C%20Warner%2C%20A.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282018%2C%20May%207%29.%20PyrEval%3A%20An%20Automated%20Method%20for%20Summary%20Content%20Analysis.%20%3Ci%3EProceedings%20of%20the%20Eleventh%20International%20Conference%20on%20Language%20Resources%20and%20Evaluation%20%28LREC%202018%29%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27http%3A%5C%2F%5C%2Fwww.lrec-conf.org%5C%2Fproceedings%5C%2Flrec2018%5C%2Fpdf%5C%2F1096.pdf%27%3Ehttp%3A%5C%2F%5C%2Fwww.lrec-conf.org%5C%2Fproceedings%5C%2Flrec2018%5C%2Fpdf%5C%2F1096.pdf%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22PyrEval%3A%20An%20Automated%20Method%20for%20Summary%20Content%20Analysis%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yanjun%22%2C%22lastName%22%3A%22Gao%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Andrew%22%2C%22lastName%22%3A%22Warner%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22The%20pyramid%20method%20is%20a%20content%20analysis%20approach%20in%20automatic%20summarization%20evaluation%20for%20manual%20construction%20of%20a%20content%20model%20from%20reference%20summaries%2C%20and%20manual%20scoring%20of%20unseen%20summaries%20with%20the%20pyramid%20model.%20PyrEval%20automates%20the%20manual%20pyramid%20method.%20PyrEval%20uses%20low-dimension%20distributional%20semantics%20to%20represent%20phrase%20meanings%2C%20and%20a%20new%20algorithm%2C%20EDUA%20%28Emergent%20Discovery%20of%20Units%20of%20Attraction%29%2C%20to%20solve%20a%20set%20cover%20problem%20to%20construct%20the%20content%20model%20from%20vectorized%20phrases.%20Because%20the%20vectors%20are%20pretrained%2C%20and%20EDUA%20is%20an%20efficient%20greedy%20algorithm%2C%20PyrEval%20can%20apply%20pyramid%20content%20evaluation%20with%20no%20retraining%2C%20and%20in%20excellent%20time.%20Moreover%2C%20PyrEval%20has%20been%20tested%20on%20many%20datasets%20derived%20from%20humans%20and%20machine%20generated%20summaries%2C%20and%20shown%20good%20performance%20on%20both.%22%2C%22date%22%3A%22May%207-12%2C%202018%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20Eleventh%20International%20Conference%20on%20Language%20Resources%20and%20Evaluation%20%28LREC%202018%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fwww.lrec-conf.org%5C%2Fproceedings%5C%2Flrec2018%5C%2Fpdf%5C%2F1096.pdf%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222023-01-18T20%3A43%3A11Z%22%7D%7D%2C%7B%22key%22%3A%22IF7MKZNY%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Krippendorff%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EKrippendorff%2C%20K.%20%282018%29.%20%3Ci%3EContent%20analysis%3A%20an%20introduction%20to%20its%20methodology%3C%5C%2Fi%3E%20%28Fourth%20Edition%29.%20SAGE.%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22book%22%2C%22title%22%3A%22Content%20analysis%3A%20an%20introduction%20to%20its%20methodology%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Klaus%22%2C%22lastName%22%3A%22Krippendorff%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222018%22%2C%22language%22%3A%22%22%2C%22ISBN%22%3A%22978-1-5063-9566-1%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222022-10-19T00%3A25%3A28Z%22%7D%7D%2C%7B%22key%22%3A%22UXFHSANU%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22National%20Science%20%26%20Technology%20Council%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ENational%20Science%20%26amp%3B%20Technology%20Council.%20%282018%29.%20%3Ci%3ECharting%20a%20course%20for%20success%3A%20America%26%23x2019%3Bs%20strategy%20for%20STEM%20education%3C%5C%2Fi%3E.%20Office%20of%20Science%20and%20Technology%20Policy.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fwww.energy.gov%5C%2Fsites%5C%2Fdefault%5C%2Ffiles%5C%2F2019%5C%2F05%5C%2Ff62%5C%2FSTEM-Education-Strategic-Plan-2018.pdf%27%3Ehttps%3A%5C%2F%5C%2Fwww.energy.gov%5C%2Fsites%5C%2Fdefault%5C%2Ffiles%5C%2F2019%5C%2F05%5C%2Ff62%5C%2FSTEM-Education-Strategic-Plan-2018.pdf%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22report%22%2C%22title%22%3A%22Charting%20a%20course%20for%20success%3A%20America%5Cu2019s%20strategy%20for%20STEM%20education%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22National%20Science%20%26%20Technology%20Council%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22reportNumber%22%3A%22%22%2C%22reportType%22%3A%22%22%2C%22institution%22%3A%22Office%20of%20Science%20and%20Technology%20Policy%22%2C%22date%22%3A%222018%22%2C%22language%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.energy.gov%5C%2Fsites%5C%2Fdefault%5C%2Ffiles%5C%2F2019%5C%2F05%5C%2Ff62%5C%2FSTEM-Education-Strategic-Plan-2018.pdf%22%2C%22collections%22%3A%5B%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-10-18T21%3A10%3A22Z%22%7D%7D%2C%7B%22key%22%3A%22Z6J9H8V7%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Balgopal%20et%20al.%22%2C%22parsedDate%22%3A%222018-06-01%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EBalgopal%2C%20M.%20M.%2C%20Casper%2C%20A.%20M.%20A.%2C%20Wallace%2C%20A.%20M.%2C%20Laybourn%2C%20P.%20J.%2C%20%26amp%3B%20Brisch%2C%20E.%20%282018%29.%20Writing%20Matters%3A%20Writing-to-Learn%20Activities%20Increase%20Undergraduate%20Performance%20in%20Cell%20Biology.%20%3Ci%3EBioScience%3C%5C%2Fi%3E%2C%20%3Ci%3E68%3C%5C%2Fi%3E%286%29%2C%20445%26%23x2013%3B454.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1093%5C%2Fbiosci%5C%2Fbiy042%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1093%5C%2Fbiosci%5C%2Fbiy042%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Writing%20Matters%3A%20Writing-to-Learn%20Activities%20Increase%20Undergraduate%20Performance%20in%20Cell%20Biology%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Meena%20M%22%2C%22lastName%22%3A%22Balgopal%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Anne%20Marie%20A%22%2C%22lastName%22%3A%22Casper%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alison%20M%22%2C%22lastName%22%3A%22Wallace%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Paul%20J%22%2C%22lastName%22%3A%22Laybourn%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ellen%22%2C%22lastName%22%3A%22Brisch%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222018-06-01%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1093%5C%2Fbiosci%5C%2Fbiy042%22%2C%22ISSN%22%3A%220006-3568%2C%201525-3244%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Facademic.oup.com%5C%2Fbioscience%5C%2Farticle%5C%2F68%5C%2F6%5C%2F445%5C%2F4990682%22%2C%22collections%22%3A%5B%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-10-18T01%3A16%3A20Z%22%7D%7D%2C%7B%22key%22%3A%222BTI56E3%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Hand%20et%20al.%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EHand%2C%20B.%2C%20Shelley%2C%20M.%20C.%2C%20Laugerman%2C%20M.%2C%20Fostvedt%2C%20L.%2C%20%26amp%3B%20Therrien%2C%20W.%20%282018%29.%20Improving%20critical%20thinking%20growth%20for%20disadvantaged%20groups%20within%20elementary%20school%20science%3A%20A%20randomized%20controlled%20trial%20using%20the%20Science%20Writing%20Heuristic%20approach.%20%3Ci%3EScience%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E102%3C%5C%2Fi%3E%284%29%2C%20693%26%23x2013%3B710.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fsce.21341%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fsce.21341%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Improving%20critical%20thinking%20growth%20for%20disadvantaged%20groups%20within%20elementary%20school%20science%3A%20A%20randomized%20controlled%20trial%20using%20the%20Science%20Writing%20Heuristic%20approach%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Brian%22%2C%22lastName%22%3A%22Hand%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mack%20C.%22%2C%22lastName%22%3A%22Shelley%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Marcia%22%2C%22lastName%22%3A%22Laugerman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Luke%22%2C%22lastName%22%3A%22Fostvedt%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22William%22%2C%22lastName%22%3A%22Therrien%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%2207%5C%2F2018%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1002%5C%2Fsce.21341%22%2C%22ISSN%22%3A%2200368326%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fonlinelibrary.wiley.com%5C%2Fdoi%5C%2F10.1002%5C%2Fsce.21341%22%2C%22collections%22%3A%5B%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-10-18T01%3A09%3A51Z%22%7D%7D%2C%7B%22key%22%3A%22E7S4EPQE%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Cohen%20et%20al.%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ECohen%2C%20Y.%2C%20Levi%2C%20E.%2C%20%26amp%3B%20Ben-Simon%2C%20A.%20%282018%29.%20Validating%20human%20and%20automated%20scoring%20of%20essays%20against%20%26%23x201C%3Btrue%26%23x201D%3B%20scores.%20%3Ci%3EApplied%20Measurement%20in%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E31%3C%5C%2Fi%3E%283%29%2C%20241%26%23x2013%3B250.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1080%5C%2F08957347.2018.1464450%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1080%5C%2F08957347.2018.1464450%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Validating%20human%20and%20automated%20scoring%20of%20essays%20against%20%5Cu201ctrue%5Cu201d%20scores%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Y%22%2C%22lastName%22%3A%22Cohen%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22E%22%2C%22lastName%22%3A%22Levi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22A%22%2C%22lastName%22%3A%22Ben-Simon%22%7D%5D%2C%22abstractNote%22%3A%22In%20the%20current%20study%2C%20two%20pools%20of%20250%20essays%2C%20all%20written%20as%20a%20response%20to%20the%20same%20prompt%2C%20were%20rated%20by%20two%20groups%20of%20raters%20%2814%20or%2015%20raters%20per%20group%29%2C%20thereby%20providing%20an%20approximation%20to%20the%20essay%5Cu2019s%20true%20score.%20An%20automated%20essay%20scoring%20%28AES%29%20system%20was%20trained%20on%20the%20datasets%20and%20then%20scored%20the%20essays%20using%20a%20cross-validation%20scheme.%20By%20eliminating%20one%2C%20two%2C%20or%20three%20raters%20at%20a%20time%2C%20and%20by%20calculating%20an%20estimate%20of%20the%20true%20scores%20using%20the%20remaining%20raters%2C%20an%20independent%20criterion%20against%20which%20to%20judge%20the%20validity%20of%20the%20human%20raters%20and%20that%20of%20the%20AES%20system%2C%20as%20well%20as%20the%20interrater%20reliability%20was%20produced.%20The%20results%20of%20the%20study%20indicated%20that%20the%20automated%20scores%20correlate%20with%20human%20scores%20to%20the%20same%20degree%20as%20human%20raters%20correlate%20with%20each%20other.%20However%2C%20the%20findings%20regarding%20the%20validity%20of%20the%20ratings%20support%20a%20claim%20that%20the%20reliability%20and%20validity%20of%20AES%20diverge%3A%20although%20the%20AES%20scoring%20is%2C%20naturally%2C%20more%20consistent%20than%20the%20human%20ratings%2C%20it%20is%20less%20valid.%22%2C%22date%22%3A%222018%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.1080%5C%2F08957347.2018.1464450%22%2C%22ISSN%22%3A%22%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%22XSGKE5BJ%22%5D%2C%22dateModified%22%3A%222022-08-04T14%3A55%3A25Z%22%7D%7D%2C%7B%22key%22%3A%22GS92EC93%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Saha%20et%20al.%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ESaha%2C%20S.%2C%20Dhamecha%2C%20T.%20I.%2C%20Marvaniya%2C%20S.%2C%20Sindhgatta%2C%20R.%2C%20%26amp%3B%20Sengupta%2C%20B.%20%282018%29.%20Sentence%20Level%20or%20Token%20Level%20Features%20for%20Automatic%20Short%20Answer%20Grading%3F%3A%20Use%20Both.%20In%20C.%20Penstein%20Ros%26%23xE9%3B%2C%20R.%20Mart%26%23xED%3Bnez-Maldonado%2C%20H.%20U.%20Hoppe%2C%20R.%20Luckin%2C%20M.%20Mavrikis%2C%20K.%20Porayska-Pomsta%2C%20B.%20McLaren%2C%20%26amp%3B%20B.%20du%20Boulay%20%28Eds.%29%2C%20%3Ci%3EArtificial%20Intelligence%20in%20Education%3C%5C%2Fi%3E%20%28Vol.%2010947%2C%20pp.%20503%26%23x2013%3B517%29.%20Springer%20International%20Publishing.%20https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-319-93843-1_37%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22bookSection%22%2C%22title%22%3A%22Sentence%20Level%20or%20Token%20Level%20Features%20for%20Automatic%20Short%20Answer%20Grading%3F%3A%20Use%20Both%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Carolyn%22%2C%22lastName%22%3A%22Penstein%20Ros%5Cu00e9%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Roberto%22%2C%22lastName%22%3A%22Mart%5Cu00ednez-Maldonado%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22H.%20Ulrich%22%2C%22lastName%22%3A%22Hoppe%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Rose%22%2C%22lastName%22%3A%22Luckin%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Manolis%22%2C%22lastName%22%3A%22Mavrikis%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Kaska%22%2C%22lastName%22%3A%22Porayska-Pomsta%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Bruce%22%2C%22lastName%22%3A%22McLaren%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Benedict%22%2C%22lastName%22%3A%22du%20Boulay%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Swarnadeep%22%2C%22lastName%22%3A%22Saha%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tejas%20I.%22%2C%22lastName%22%3A%22Dhamecha%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Smit%22%2C%22lastName%22%3A%22Marvaniya%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Renuka%22%2C%22lastName%22%3A%22Sindhgatta%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Bikram%22%2C%22lastName%22%3A%22Sengupta%22%7D%5D%2C%22abstractNote%22%3A%22Automatic%20short%20answer%20grading%20for%20Intelligent%20Tutoring%20Sys-%20tems%20has%20attracted%20much%20attention%20of%20the%20researchers%20over%20the%20years.%20While%20the%20traditional%20techniques%20for%20short%20answer%20grading%20are%20rooted%20in%20statistical%20learning%20and%20hand-crafted%20features%2C%20recent%20research%20has%20explored%20sentence%20embedding%20based%20techniques.%20We%20observe%20that%20sentence%20embedding%20techniques%2C%20while%20being%20effective%20for%20grading%20in-domain%20stu-%20dent%20answers%2C%20may%20not%20be%20best%20suited%20for%20out-of-domain%20answers.%20Further%2C%20sentence%20embeddings%20can%20be%20affected%20by%20non-sentential%20answers%20%28answers%20given%20in%20the%20context%20of%20the%20question%29.%20On%20the%20other%20hand%2C%20token%20level%20hand-crafted%20features%20can%20be%20fairly%20domain%20independent%20and%20are%20less%20affected%20by%20non-sentential%20forms.%20We%20propose%20a%20novel%20feature%20encoding%20based%20on%20partial%20similarities%20of%20tokens%20%28Histogram%20of%20Partial%20Similarities%20or%20HoPS%29%2C%20its%20extension%20to%20part-of-speech%20tags%20%28HoPSTags%29%20and%20question%20type%20information.%20On%20combining%20the%20proposed%20features%20with%20sentence%20embedding%20based%20features%2C%20we%20are%20able%20to%20further%20improve%20the%20grading%20performance.%20Our%20final%20model%20achieves%20better%20or%20competitive%20results%20in%20experimental%20evaluation%20on%20multiple%20benchmarking%20datasets%20and%20a%20large%20scale%20industry%20dataset.%22%2C%22bookTitle%22%3A%22Artificial%20Intelligence%20in%20Education%22%2C%22date%22%3A%222018%22%2C%22language%22%3A%22%22%2C%22ISBN%22%3A%22978-3-319-93842-4%20978-3-319-93843-1%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Flink.springer.com%5C%2F10.1007%5C%2F978-3-319-93843-1_37%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-30T20%3A43%3A02Z%22%7D%7D%2C%7B%22key%22%3A%22VPX9GSJ5%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Wang%20et%20al.%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EWang%2C%20E.%2C%20Matsumura%2C%20L.%20C.%2C%20%26amp%3B%20Correnti%2C%20R.%20%282018%29.%20Student%20Writing%20Accepted%20as%20High-Quality%20Responses%20to%20Analytic%20Text-Based%20Writing%20Tasks.%20%3Ci%3EThe%20Elementary%20School%20Journal%3C%5C%2Fi%3E%2C%20%3Ci%3E118%3C%5C%2Fi%3E%283%29%2C%20357%26%23x2013%3B383.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1086%5C%2F696097%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1086%5C%2F696097%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Student%20Writing%20Accepted%20as%20High-Quality%20Responses%20to%20Analytic%20Text-Based%20Writing%20Tasks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Elaine%22%2C%22lastName%22%3A%22Wang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lindsay%20Clare%22%2C%22lastName%22%3A%22Matsumura%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Richard%22%2C%22lastName%22%3A%22Correnti%22%7D%5D%2C%22abstractNote%22%3A%22Literacy%20%20standards%20%20increasingly%20%20emphasize%20%20the%20%20impor-tance%20%20of%20%20analytic%20%20text-based%20%20writing.%20%20Little%20%20consensus%20exists%2C%20%20however%2C%20%20around%20%20what%20%20high-quality%20%20student%20%20responses%20should%20look%20like%20in%20this%20genre.%20In%20this%20study%2C%20we%20investigatedfifth-grade%20students%5Cu2019writing%20in%20response%20to%20analytic%20text-based%20writing%20tasks%20%2815%20teachers%2C44%20writing%20tasks%2C88pieces%20of%20student%20writing%29.%20We%20used%20qualitative%20analytic%20techniques%20to%20investigate%20teachers%5Cu2019stated%20assessment%20criteria%20and%20to%20compare%20teachers%5Cu2019and%20researchers%5Cu2019assessments%20of%20student%20writing%20nominated%20by%20teachersas%20high%20quality.%20We%20then%20characterized%20patterns%20in%20stu-dents%5Cu2019responses.%20%20Our%20%20results%20%20showed%20%20no%20%20variation%20%20inteachers%5Cu2019stated%20assessment%20criteria%20but%20substantial%20varia-tion%20%20in%20%20students%5Cu2019writing%20%20with%20%20respect%20%20to3researcher-defined%20elements%3A%20cognitive%20process%2C%20use%20of%20text%20evidence%2Cand%20explication.%20Only22%25%20of%20student%20responses%20nomi-nated%20by%20teachers%20as%20high%20quality%20were%20close%20to%20fully%20realizing%20the%20task%20potential.%22%2C%22date%22%3A%2203%5C%2F2018%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1086%5C%2F696097%22%2C%22ISSN%22%3A%220013-5984%2C%201554-8279%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.journals.uchicago.edu%5C%2Fdoi%5C%2F10.1086%5C%2F696097%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-29T18%3A39%3A37Z%22%7D%7D%2C%7B%22key%22%3A%22P9T5XHZY%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Gao%20et%20al.%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGao%2C%20Y.%2C%20M.Davies%2C%20P.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282018%29.%20Automated%20Content%20Analysis%3A%20A%20Case%20Study%20of%20Computer%20Science%20Student%20Summaries.%20%3Ci%3EProceedings%20of%20the%20Thirteenth%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%26%23xA0%3B%20%26%23xA0%3B%20%26%23xA0%3B%20%26%23xA0%3B%20%26%23xA0%3B%20%20Building%20Educational%20Applications%3C%5C%2Fi%3E%2C%20264%26%23x2013%3B272.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FW18-0531%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FW18-0531%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Automated%20Content%20Analysis%3A%20A%20Case%20Study%20of%20Computer%20Science%20Student%20Summaries%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yanjun%22%2C%22lastName%22%3A%22Gao%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Patricia%22%2C%22lastName%22%3A%22M.Davies%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222018%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20Thirteenth%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20%20%20%20%20%20%20%20%20%20%20Building%20Educational%20Applications%22%2C%22conferenceName%22%3A%22Proceedings%20of%20the%20Thirteenth%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20%20%20%20%20%20%20%20%20%20%20Building%20Educational%20Applications%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.18653%5C%2Fv1%5C%2FW18-0531%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Faclweb.org%5C%2Fanthology%5C%2FW18-0531%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222022-04-19T15%3A18%3A53Z%22%7D%7D%2C%7B%22key%22%3A%22C25R9V2R%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Bousmalis%20et%20al.%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EBousmalis%2C%20K.%2C%20Irpan%2C%20A.%2C%20Wohlhart%2C%20P.%2C%20Bai%2C%20Y.%2C%20Kelcey%2C%20M.%2C%20Kalakrishnan%2C%20M.%2C%20Downs%2C%20L.%2C%20Ibarz%2C%20J.%2C%20Pastor%2C%20P.%2C%20Konolige%2C%20K.%2C%20Levine%2C%20S.%2C%20%26amp%3B%20Vanhoucke%2C%20V.%20%282018%29.%20Using%20Simulation%20and%20Domain%20Adaptation%20to%20Improve%20Efficiency%20of%20Deep%20Robotic%20Grasping.%20%3Ci%3E2018%20IEEE%20International%20Conference%20on%20Robotics%20and%20Automation%20%28ICRA%29%3C%5C%2Fi%3E%2C%204243%26%23x2013%3B4250.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1109%5C%2FICRA.2018.8460875%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1109%5C%2FICRA.2018.8460875%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Using%20Simulation%20and%20Domain%20Adaptation%20to%20Improve%20Efficiency%20of%20Deep%20Robotic%20Grasping%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Konstantinos%22%2C%22lastName%22%3A%22Bousmalis%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alex%22%2C%22lastName%22%3A%22Irpan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Paul%22%2C%22lastName%22%3A%22Wohlhart%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yunfei%22%2C%22lastName%22%3A%22Bai%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Matthew%22%2C%22lastName%22%3A%22Kelcey%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mrinal%22%2C%22lastName%22%3A%22Kalakrishnan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Laura%22%2C%22lastName%22%3A%22Downs%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Julian%22%2C%22lastName%22%3A%22Ibarz%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Peter%22%2C%22lastName%22%3A%22Pastor%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kurt%22%2C%22lastName%22%3A%22Konolige%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Sergey%22%2C%22lastName%22%3A%22Levine%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Vincent%22%2C%22lastName%22%3A%22Vanhoucke%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%225%5C%2F2018%22%2C%22proceedingsTitle%22%3A%222018%20IEEE%20International%20Conference%20on%20Robotics%20and%20Automation%20%28ICRA%29%22%2C%22conferenceName%22%3A%222018%20IEEE%20International%20Conference%20on%20Robotics%20and%20Automation%20%28ICRA%29%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.1109%5C%2FICRA.2018.8460875%22%2C%22ISBN%22%3A%22978-1-5386-3081-5%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fieeexplore.ieee.org%5C%2Fdocument%5C%2F8460875%5C%2F%22%2C%22collections%22%3A%5B%2258RJFW5I%22%5D%2C%22dateModified%22%3A%222022-02-18T19%3A27%3A23Z%22%7D%7D%2C%7B%22key%22%3A%22KLXYTHPS%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Xu%20and%20Reitter%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EXu%2C%20Y.%2C%20%26amp%3B%20Reitter%2C%20D.%20%282018%29.%20Information%20density%20converges%20in%20dialogue%3A%20Towards%20an%20information-theoretic%20model.%20%3Ci%3ECognition%3C%5C%2Fi%3E%2C%20%3Ci%3E170%3C%5C%2Fi%3E%2C%20147%26%23x2013%3B163.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.cognition.2017.09.018%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.cognition.2017.09.018%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Information%20density%20converges%20in%20dialogue%3A%20Towards%20an%20information-theoretic%20model%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yang%22%2C%22lastName%22%3A%22Xu%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22David%22%2C%22lastName%22%3A%22Reitter%22%7D%5D%2C%22abstractNote%22%3A%22The%20principle%20of%20entropy%20rate%20constancy%20%28ERC%29%20states%20that%20language%20users%20distribute%20information%20such%20that%20words%20tend%20to%20be%20equally%20predictable%20given%20previous%20contexts.%20We%20examine%20the%20applicability%20of%20this%20principle%20to%20spoken%20dialogue%2C%20as%20previous%20findings%20primarily%20rest%20on%20written%20text.%20The%20study%20takes%20into%20account%20the%20joint-activity%20nature%20of%20dialogue%20and%20the%20topic%20shift%20mechanisms%20that%20are%20different%20from%20monologue.%20It%20examines%20how%20the%20information%20contributions%20from%20the%20two%20dialogue%20partners%20interactively%20evolve%20as%20the%20discourse%20develops.%20The%20increase%20of%20local%20sentence-level%20information%20density%20%28predicted%20by%20ERC%29%20is%20shown%20to%20apply%20to%20dialogue%20overall.%20However%2C%20when%20the%20different%20roles%20of%20interlocutors%20in%20introducing%20new%20topics%20are%20identified%2C%20their%20contribution%20in%20information%20content%20displays%20a%20new%20converging%20pattern.%20We%20draw%20explanations%20to%20this%20pattern%20from%20multiple%20perspectives%3A%20Casting%20dialogue%20as%20an%20information%20exchange%20system%20would%20mean%20that%20the%20pattern%20is%20the%20result%20of%20two%20interlocutors%20maintaining%20their%20own%20context%20rather%20than%20sharing%20one.%20Second%2C%20we%20present%20some%20empirical%20evidence%20that%20a%20model%20of%20Interactive%20Alignment%20may%20include%20information%20density%20to%20explain%20the%20effect.%20Third%2C%20we%20argue%20that%20building%20common%20ground%20is%20a%20process%20analogous%20to%20information%20convergence.%20Thus%2C%20we%20put%20forward%20an%20information-theoretic%20view%20of%20dialogue%2C%20under%20which%20some%20existing%20theories%20of%20human%20dialogue%20may%20eventually%20be%20unified.%22%2C%22date%22%3A%2201%5C%2F2018%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1016%5C%2Fj.cognition.2017.09.018%22%2C%22ISSN%22%3A%2200100277%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Flinkinghub.elsevier.com%5C%2Fretrieve%5C%2Fpii%5C%2FS0010027717302615%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T17%3A50%3A44Z%22%7D%7D%2C%7B%22key%22%3A%22ZGHQDNBL%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Shi%20and%20Yu%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EShi%2C%20W.%2C%20%26amp%3B%20Yu%2C%20Z.%20%282018%29.%20Sentiment%20Adaptive%20End-to-End%20Dialog%20Systems.%20%3Ci%3EProceedings%20of%20the%2056th%20Annual%20Meeting%20of%20the%20Association%20for%20Computational%20Linguistics%20%28Volume%201%3A%20Long%20Papers%29%3C%5C%2Fi%3E%2C%201509%26%23x2013%3B1519.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FP18-1140%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FP18-1140%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Sentiment%20Adaptive%20End-to-End%20Dialog%20Systems%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Weiyan%22%2C%22lastName%22%3A%22Shi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Zhou%22%2C%22lastName%22%3A%22Yu%22%7D%5D%2C%22abstractNote%22%3A%22End-to-end%20learning%20framework%20is%20useful%20for%20building%20dialog%20systems%20for%20its%20simplicity%20in%20training%20and%20efficiency%20in%20model%20up-%20dating.%20However%2C%20current%20end-to-end%20approaches%20only%20consider%20user%20semantic%20inputs%20in%20learning%20and%20under-utilize%20other%20user%20information.%20Therefore%2C%20we%20propose%20to%20include%20user%20sentiment%20obtained%20through%20multimodal%20information%20%28acoustic%2C%20dialogic%20and%20textual%29%2C%20in%20the%20end-to-end%20learning%20framework%20to%20make%20systems%20more%20user-adaptive%20and%20effective.%20We%20incorporated%20user%20sentiment%20information%20in%20both%20supervised%20and%20reinforcement%20learning%20settings.%20In%20both%20settings%2C%20adding%20sentiment%20information%20reduced%20the%20dialog%20length%20and%20improved%20the%20task%20success%20rate%20on%20a%20bus%20information%20search%20task.%20This%20work%20is%20the%20first%20attempt%20to%20incorporate%20multimodal%20user%20information%20in%20the%20adaptive%20end-to-%20end%20dialog%20system%20training%20framework%20and%20attained%20state-of-the-art%20performance.%22%2C%22date%22%3A%222018%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%2056th%20Annual%20Meeting%20of%20the%20Association%20for%20Computational%20Linguistics%20%28Volume%201%3A%20Long%20Papers%29%22%2C%22conferenceName%22%3A%22Proceedings%20of%20the%2056th%20Annual%20Meeting%20of%20the%20Association%20for%20Computational%20Linguistics%20%28Volume%201%3A%20Long%20Papers%29%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.18653%5C%2Fv1%5C%2FP18-1140%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Faclweb.org%5C%2Fanthology%5C%2FP18-1140%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T17%3A07%3A26Z%22%7D%7D%2C%7B%22key%22%3A%22B3UEGVMT%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Moon%20et%20al.%22%2C%22parsedDate%22%3A%222018%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EMoon%2C%20A.%2C%20Gere%2C%20A.%20R.%2C%20%26amp%3B%20Shultz%2C%20G.%20V.%20%282018%29.%20Writing%20in%20the%20STEM%20classroom%3A%20Faculty%20conceptions%20of%20writing%20and%20its%20role%20in%20the%20undergraduate%20classroom.%20%3Ci%3EScience%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E102%3C%5C%2Fi%3E%285%29%2C%201007%26%23x2013%3B1028.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fsce.21454%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fsce.21454%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Writing%20in%20the%20STEM%20classroom%3A%20Faculty%20conceptions%20of%20writing%20and%20its%20role%20in%20the%20undergraduate%20classroom%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alena%22%2C%22lastName%22%3A%22Moon%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Anne%20Ruggles%22%2C%22lastName%22%3A%22Gere%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ginger%20V.%22%2C%22lastName%22%3A%22Shultz%22%7D%5D%2C%22abstractNote%22%3A%22Writing%20is%20widely%20recognized%20as%20fundamental%20to%20the%20construction%20and%20communication%20of%20scientific%20knowledge.%20Building%20on%20this%20relationship%20between%20writing%20and%20knowledge%20construction%2C%20writing-to-learn%20%28WTL%29%20activities%20have%20shown%20to%20be%20effective%20in%20many%20science%20classrooms%2C%20but%20have%20not%20been%20widely%20implemented%20at%20the%20postsecondary%20level.%20To%20address%20the%20lack%20of%20implementation%2C%20we%20investigated%20potential%20adopters%20of%20this%20pedagogy.%20Potential%20adopters%2C%20postsecondary%20faculty%2C%20are%20unique%20given%20the%20key%20role%20writing%20plays%20in%20their%20professional%20practice%20as%20researchers.%20Because%20of%20this%20unique%20feature%20and%20the%20fact%20that%20an%20instructor%27s%20theoretical%20orientation%20toward%20a%20construct%20impacts%20their%20instruction%20of%20that%20construct%2C%20an%20investigation%20of%20postsecondary%20faculty%27s%20conceptions%20of%20writing%20instruction%20is%20necessary%20to%20understand%20the%20way%20writing%20is%20being%20used%20in%20the%20postsecondary%20classroom.%20To%20this%20end%2C%2033%20STEM%20faculty%20across%20multiple%20disciplines%20and%20positions%20were%20interviewed%20about%20writing%20and%20its%20role%20in%20their%20classes.%20A%20phenomenographic%20analysis%20resulted%20in%20four%20faculty%20%5C%22types%5C%22%20consisting%20of%20unique%20combinations%20of%20concept%20and%20practice%2C%20organized%20according%20to%20compatibility%20with%20WTL.%20Profiles%20were%20built%20that%20describe%20unique%20conceptions%2C%20desired%20outcomes%2C%20and%20challenges%20for%20each%20type.%20These%20profiles%20provide%20an%20understanding%20of%20the%20relationship%20between%20faculty%27s%20conceptions%20and%20instructional%20practices%20regarding%20writing%20and%20lay%20the%20groundwork%20for%20understanding%20how%20writing%20is%20used%20in%20the%20postsecondary%20classroom.%22%2C%22date%22%3A%222018%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.1002%5C%2Fsce.21454%22%2C%22ISSN%22%3A%220036-8326%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1002%5C%2Fsce.21454%22%2C%22collections%22%3A%5B%22L43JYTHB%22%5D%2C%22dateModified%22%3A%222021-04-20T19%3A22%3A30Z%22%7D%7D%2C%7B%22key%22%3A%223G9IGL4X%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Knight%20et%20al.%22%2C%22parsedDate%22%3A%222018-03-01%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EKnight%2C%20S.%2C%20Buckingham%20Shum%2C%20S.%2C%20Ryan%2C%20P.%2C%20S%26%23xE1%3Bndor%2C%20%26%23xC1%3B.%2C%20%26amp%3B%20Wang%2C%20X.%20%282018%29.%20Designing%20Academic%20Writing%20Analytics%20for%20Civil%20Law%20Student%20Self-Assessment.%20%3Ci%3EInternational%20Journal%20of%20Artificial%20Intelligence%20in%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E28%3C%5C%2Fi%3E%281%29%2C%201%26%23x2013%3B28.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0121-0%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0121-0%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Designing%20Academic%20Writing%20Analytics%20for%20Civil%20Law%20Student%20Self-Assessment%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Simon%22%2C%22lastName%22%3A%22Knight%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Simon%22%2C%22lastName%22%3A%22Buckingham%20Shum%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Philippa%22%2C%22lastName%22%3A%22Ryan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%5Cu00c1gnes%22%2C%22lastName%22%3A%22S%5Cu00e1ndor%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Xiaolong%22%2C%22lastName%22%3A%22Wang%22%7D%5D%2C%22abstractNote%22%3A%22Research%20into%20the%20teaching%20and%20assessment%20of%20student%20writing%20shows%20that%20many%20students%20find%20academic%20writing%20a%20challenge%20to%20learn%2C%20with%20legal%20writing%20no%20exception.%20Improving%20the%20availability%20and%20quality%20of%20timely%20formative%20feedback%20is%20an%20important%20aim.%20However%2C%20the%20time-consuming%20nature%20of%20assessing%20writing%20makes%20it%20impractical%20for%20instructors%20to%20provide%20rapid%2C%20detailed%20feedback%20on%20hundreds%20of%20draft%20texts%20which%20might%20be%20improved%20prior%20to%20submission.%20This%20paper%20describes%20the%20design%20of%20a%20natural%20language%20processing%20%28NLP%29%20tool%20to%20provide%20such%20support.%20We%20report%20progress%20in%20the%20development%20of%20a%20web%20application%20called%20AWA%20%28Academic%20Writing%20Analytics%29%2C%20which%20has%20been%20piloted%20in%20a%20Civil%20Law%20degree.%20We%20describe%3A%20the%20underlying%20NLP%20platform%20and%20the%20participatory%20design%20process%20through%20which%20the%20law%20academic%20and%20analytics%20team%20tested%20and%20refined%20an%20existing%20rhetorical%20parser%20for%20the%20discipline%3B%20the%20user%20interface%20design%20and%20evaluation%20process%3B%20and%20feedback%20from%20students%2C%20which%20was%20broadly%20positive%2C%20but%20also%20identifies%20important%20issues%20to%20address.%20We%20discuss%20how%20our%20approach%20is%20positioned%20in%20relation%20to%20concerns%20regarding%20automated%20essay%20grading%2C%20and%20ways%20in%20which%20AWA%20might%20provide%20more%20actionable%20feedback%20to%20students.%20We%20conclude%20by%20considering%20how%20this%20design%20process%20addresses%20the%20challenge%20of%20making%20explicit%20to%20learners%20and%20educators%20the%20underlying%20mode%20of%20action%20in%20analytic%20devices%20such%20as%20our%20rhetorical%20parser%2C%20which%20we%20term%20algorithmic%20accountability.%22%2C%22date%22%3A%22March%201%2C%202018%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.1007%5C%2Fs40593-016-0121-0%22%2C%22ISSN%22%3A%221560-4306%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0121-0%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222021-03-17T00%3A28%3A13Z%22%7D%7D%2C%7B%22key%22%3A%2256R6XXW7%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Lan%20and%20Xu%22%2C%22parsedDate%22%3A%222018-08%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ELan%2C%20W.%2C%20%26amp%3B%20Xu%2C%20W.%20%282018%29.%20Neural%20Network%20Models%20for%20Paraphrase%20Identification%2C%20Semantic%20Textual%20Similarity%2C%20Natural%20Language%20Inference%2C%20and%20Question%20Answering.%20%3Ci%3EProceedings%20of%20the%2027th%20International%20Conference%20on%20Computational%20Linguistics%3C%5C%2Fi%3E%2C%203890%26%23x2013%3B3902.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FC18-1328%27%3Ehttps%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FC18-1328%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Neural%20Network%20Models%20for%20Paraphrase%20Identification%2C%20Semantic%20Textual%20Similarity%2C%20Natural%20Language%20Inference%2C%20and%20Question%20Answering%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Wuwei%22%2C%22lastName%22%3A%22Lan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Wei%22%2C%22lastName%22%3A%22Xu%22%7D%5D%2C%22abstractNote%22%3A%22In%20this%20paper%2C%20we%20analyze%20several%20neural%20network%20designs%20%28and%20their%20variations%29%20for%20sentence%20pair%20modeling%20and%20compare%20their%20performance%20extensively%20across%20eight%20datasets%2C%20including%20paraphrase%20identification%2C%20semantic%20textual%20similarity%2C%20natural%20language%20inference%2C%20and%20question%20answering%20tasks.%20Although%20most%20of%20these%20models%20have%20claimed%20state-of-the-art%20performance%2C%20the%20original%20papers%20often%20reported%20on%20only%20one%20or%20two%20selected%20datasets.%20We%20provide%20a%20systematic%20study%20and%20show%20that%20%28i%29%20encoding%20contextual%20information%20by%20LSTM%20and%20inter-sentence%20interactions%20are%20critical%2C%20%28ii%29%20Tree-LSTM%20does%20not%20help%20as%20much%20as%20previously%20claimed%20but%20surprisingly%20improves%20performance%20on%20Twitter%20datasets%2C%20%28iii%29%20the%20Enhanced%20Sequential%20Inference%20Model%20is%20the%20best%20so%20far%20for%20larger%20datasets%2C%20while%20the%20Pairwise%20Word%20Interaction%20Model%20achieves%20the%20best%20performance%20when%20less%20data%20is%20available.%20We%20release%20our%20implementations%20as%20an%20open-source%20toolkit.%22%2C%22date%22%3A%222018-08%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%2027th%20International%20Conference%20on%20Computational%20Linguistics%22%2C%22conferenceName%22%3A%22COLING%202018%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.aclweb.org%5C%2Fanthology%5C%2FC18-1328%22%2C%22collections%22%3A%5B%22XJX4XB44%22%5D%2C%22dateModified%22%3A%222020-09-26T21%3A36%3A58Z%22%7D%7D%2C%7B%22key%22%3A%22H6656ITG%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Zafeiroudi%20et%20al.%22%2C%22parsedDate%22%3A%222018-10-08%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EZafeiroudi%2C%20K.%20D.%2C%20Eckman%2C%20L.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282018%2C%20October%208%29.%20Testing%20a%20Knowledge%20Inquiry%20System%20on%5CnQuestion%20Answering%20Tasks.%20%3Ci%3EJoint%20Proceedings%20of%20ISWC%202018%20Workshops%20SemDeep-4%20and%20NLIWoD-4.%3C%5C%2Fi%3E%20Natural%20Language%20Interfaces%20to%20Web%20of%20Data%20%28NLIWoD%29%2C%20Monterey%2C%20CA.%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Testing%20a%20Knowledge%20Inquiry%20System%20on%5CnQuestion%20Answering%20Tasks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kyriaki%20D.%22%2C%22lastName%22%3A%22Zafeiroudi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Leah%22%2C%22lastName%22%3A%22Eckman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22Question-Answering%20systems%20enable%20users%20to%20retrieve%20answers%20to%20factual%20questions%20from%20various%20kinds%20of%20knowledge%20sources%2C%20but%20do%20not%20address%20how%20to%20respond%20cooperatively.%20We%20present%20InK%2C%20an%20initial%20inquiry%20system%20for%20RDF%20knowledge%20graphs%20that%20aims%20to%20return%20relevant%20responses%2C%20even%20when%20an%20answer%20cannot%20be%20found.%20It%20assembles%20knowledge%5Cnrelevant%20to%20the%20entities%20mentioned%20in%20the%20question%20without%20translating%20the%20input%20question%20into%20a%20query%20language.%20A%20user%20study%20indicates%20responses%20are%20found%20to%20be%20intelligible%20and%20relevant.%20Evaluation%20of%20questions%20with%20known%20answers%20gives%20high%20recall%20of%200.70%20averaged%20on%20three%20QA%20datasets.%22%2C%22date%22%3A%22October%208-9%2C%202018%22%2C%22proceedingsTitle%22%3A%22Joint%20Proceedings%20of%20ISWC%202018%20Workshops%20SemDeep-4%20and%20NLIWoD-4.%22%2C%22conferenceName%22%3A%22Natural%20Language%20Interfaces%20to%20Web%20of%20Data%20%28NLIWoD%29%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222019-08-15T13%3A44%3A30Z%22%7D%7D%2C%7B%22key%22%3A%22ZAF9NJBN%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Passonneau%20et%20al.%22%2C%22parsedDate%22%3A%222018-03%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EPassonneau%2C%20R.%20J.%2C%20Poddar%2C%20A.%2C%20Gite%2C%20G.%2C%20Krivokapic%2C%20A.%2C%20Yang%2C%20Q.%2C%20%26amp%3B%20Perin%2C%20D.%20%282018%29.%20Wise%20Crowd%20Content%20Assessment%20and%20Educational%20Rubrics.%20%3Ci%3EInternational%20Journal%20of%20Artificial%20Intelligence%20in%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E28%3C%5C%2Fi%3E%281%29%2C%2029%26%23x2013%3B55.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0128-6%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0128-6%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Wise%20Crowd%20Content%20Assessment%20and%20Educational%20Rubrics%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ananya%22%2C%22lastName%22%3A%22Poddar%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Gaurav%22%2C%22lastName%22%3A%22Gite%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alisa%22%2C%22lastName%22%3A%22Krivokapic%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Qian%22%2C%22lastName%22%3A%22Yang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Dolores%22%2C%22lastName%22%3A%22Perin%22%7D%5D%2C%22abstractNote%22%3A%22Development%20of%20reliable%20rubrics%20for%20educational%20intervention%20studies%20that%20address%20reading%20and%20writing%20skills%20is%20labor-intensive%2C%20and%20could%20benefit%20from%20an%20automated%20approach.%20We%20compare%20a%20main%20ideas%20rubric%20used%20in%20a%20successful%20writing%20intervention%20study%20to%20a%20highly%20reliable%20wise-crowd%20content%20assessment%20method%20developed%20to%20evaluate%20machine-generated%20summaries.%20The%20ideas%20in%20the%20educational%20rubric%20were%20extracted%20from%20a%20source%20text%20that%20students%20were%20asked%20to%20summarize.%20The%20wise-crowd%20content%20assessment%20model%20is%20derived%20from%20summaries%20written%20by%20an%20independent%20group%20of%20proficient%20students%20who%20read%20the%20same%20source%20text%2C%20and%20followed%20the%20same%20instructions%20to%20write%20their%20summaries.%20The%20resulting%20content%20model%20includes%20a%20ranking%20over%20the%20derived%20content%20units.%20All%20main%20ideas%20in%20the%20rubric%20appear%20prominently%20in%20the%20wise-crowd%20content%20model.%20We%20present%20two%20methods%20that%20automate%20the%20content%20assessment.%20Scores%20based%20on%20the%20wise-crowd%20content%20assessment%2C%20both%20manual%20and%20automated%2C%20have%20high%20correlations%20with%20the%20main%20ideas%20rubric.%20The%20automated%20content%20assessment%20methods%20have%20several%20advantages%20over%20related%20methods%2C%20including%20high%20correlations%20with%20corresponding%20manual%20scores%2C%20a%20need%20for%20only%20half%20a%20dozen%20models%20instead%20of%20hundreds%2C%20and%20interpretable%20scores%20that%20independently%20assess%20content%20quality%20and%20coverage.%22%2C%22date%22%3A%22March%202018%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0128-6%22%2C%22ISSN%22%3A%221560-4292%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Flink.springer.com%5C%2Farticle%5C%2F10.1007%5C%2Fs40593-016-0128-6%23citeas%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222019-01-03T02%3A24%3A02Z%22%7D%7D%2C%7B%22key%22%3A%22JI6AU2BW%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Gao%20et%20al.%22%2C%22parsedDate%22%3A%222018-03%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGao%2C%20J.%2C%20Radeva%2C%20A.%2C%20Shen%2C%20C.%2C%20Wang%2C%20S.%2C%20Wang%2C%20Q.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282018%29.%20Prediction%20of%20a%20hotspot%20pattern%20in%20keyword%20search%20results.%20%3Ci%3EComputer%20Speech%20%26amp%3B%20Language%3C%5C%2Fi%3E%2C%20%3Ci%3E48%3C%5C%2Fi%3E%2C%2080%26%23x2013%3B102.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.csl.2017.10.005%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.csl.2017.10.005%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Prediction%20of%20a%20hotspot%20pattern%20in%20keyword%20search%20results%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Jie%22%2C%22lastName%22%3A%22Gao%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Axinia%22%2C%22lastName%22%3A%22Radeva%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Chuyao%22%2C%22lastName%22%3A%22Shen%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Shiqi%22%2C%22lastName%22%3A%22Wang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Qianbo%22%2C%22lastName%22%3A%22Wang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22This%20paper%20identifies%20and%20models%20a%20phenomenon%20observed%20across%20low-resource%20languages%20in%20keyword%20search%20results%20from%20speech%20retrieval%20systems%20where%20the%20speech%20recognition%20has%20high%20error%20rate%2C%20due%20to%20very%20limited%20training%20data.%20High%20confidence%20correct%20detections%20%28hccds%29%20of%20keywords%20are%20rare%2C%20yet%20often%20succeed%20one%20another%20closely%20in%20time.%20We%20refer%20to%20these%20close%20sequences%20of%20hccds%20as%20keyword%20hotspots.%20The%20ability%20to%20predict%20keyword%20hotspots%20could%20support%20speech%20retrieval%2C%20and%20provide%20new%20insights%20into%20the%20behavior%20of%20speech%20recognition%20systems.%20We%20treat%20hotspot%20prediction%20as%20a%20binary%20classification%20task%20on%20all%20word-sized%20time%20intervals%20in%20an%20audio%20file%20of%20a%20telephone%20conversation%2C%20using%20prosodic%20features%20as%20predictors.%20Rare%20events%20that%20follow%20this%20pattern%20are%20often%20modeled%20as%20a%20self-exciting%20point%20process%20%28sepp%29%2C%20meaning%20the%20occurrence%20of%20a%20rare%20event%20excites%20a%20following%20one.%20To%20label%20successive%20points%20in%20time%20as%20occurring%20within%20a%20hotspot%20or%20not%2C%20we%20fit%20a%20sepp%20function%20to%20the%20distribution%20of%20hccds%20in%20the%20keyword%20search%20output.%20Two%20major%20learning%20challenges%20are%20that%20the%20size%20of%20the%20positive%20class%20is%20very%20small%2C%20and%20the%20training%20and%20test%20data%20have%20dissimilar%20distributions.%20To%20address%20these%20challenges%2C%20we%20develop%20a%20novel%20data%20selection%20framework%20that%20chooses%20training%20data%20with%20good%20generalization%20properties.%20Results%20exhibit%20superior%20generalization%20performance.%22%2C%22date%22%3A%22March%202018%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.csl.2017.10.005%22%2C%22ISSN%22%3A%22%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222019-01-03T02%3A23%3A24Z%22%7D%7D%2C%7B%22key%22%3A%22ZPUBNQK9%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Zafeiroudi%20and%20Passonneau%22%2C%22parsedDate%22%3A%222018-11-06%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EZafeiroudi%2C%20K.%20D.%2C%20%26amp%3B%20Passonneau%2C%20R.%20J.%20%282018%2C%20November%206%29.%20%3Ci%3EKnowledge%20Inquiry%20for%20Information%20Foraging%3C%5C%2Fi%3E.%2023rd%20International%20Command%20and%20Control%20Research%20and%20Technology%20Symposium%20%28ICCRTS%29%2C%20Pensacola%2C%20FL.%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Knowledge%20Inquiry%20for%20Information%20Foraging%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kyriaki%20D.%22%2C%22lastName%22%3A%22Zafeiroudi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%20J.%22%2C%22lastName%22%3A%22Passonneau%22%7D%5D%2C%22abstractNote%22%3A%22Human%20analysts%20have%20a%20vital%20role%20in%20the%20task%20of%20sensemaking%2C%20the%20process%20of%20extracting%5Cninformation%20to%20reach%20conclusions%20and%20make%20decisions.%20Question-Answering%20%28QA%29%20is%20an%20existing%20natural%20language%20processing%20application%20that%20would%20appear%20to%20be%20relevant%20to%20the%20analyst%5Cu2019s%20task%2C%20given%20information%20needs%20to%20address%20in%20a%20structured%20knowledge%20source.%20Standard%20QA%20systems%2C%20however%2C%20assume%20an%20input%20question%20can%20be%20interpreted%20in%20isolation%2C%20meaning%20that%20there%20is%20a%20single%20translation%20of%20language%20to%20a%20structured%20query%2C%20and%20that%20there%20is%20a%20unique%20correct%20answer.%5CnWe%20assume%20that%20a%20more%20appropriate%20tool%20for%20an%20analyst%20would%20support%20open-ended%20exploration%20for%20relevant%20information%20from%20structured%20data%20sources%2C%20and%20would%20not%20commit%20too%20early%20to%20a%20single%20interpretation%20of%20the%20analyst%5Cu2019s%20question.%20We%20provide%20the%20capability%20to%20pose%20natural%20language%20questions%20to%20knowledge%20graphs%20in%20RDF%20format%20where%20information%20that%20is%20relevant%20to%20the%20question%20can%20be%20visualized%2C%20making%20the%20knowledge%20source%20more%20transparent%20to%20the%20user.%5CnThis%20paper%20presents%20InK%2C%20an%20inquiry%20system%20for%20knowledge%20graphs%20where%20the%20input%20is%20a%20NL%20natural%20language%20%28NL%29%20question%20and%20the%20output%20consists%20of%20knowledge%20assumed%20to%20be%20relevant%20to%20a%20general%20information%20need%20that%20motivates%20the%20question.%22%2C%22date%22%3A%22November%206-9%2C%202018%22%2C%22proceedingsTitle%22%3A%22%22%2C%22conferenceName%22%3A%2223rd%20International%20Command%20and%20Control%20Research%20and%20Technology%20Symposium%20%28ICCRTS%29%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222019-01-03T02%3A21%3A46Z%22%7D%7D%5D%7D
Kalman, C. S. (2018). Successful Science and Engineering Teaching: Theoretical and Learning Perspectives. Springer, Cham. https://doi.org/10.1007/978-3-319-66140-7
Gao, Y., Warner, A., & Passonneau, R. J. (2018, May 7). PyrEval: An Automated Method for Summary Content Analysis. Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). http://www.lrec-conf.org/proceedings/lrec2018/pdf/1096.pdf
Krippendorff, K. (2018). Content analysis: an introduction to its methodology (Fourth Edition). SAGE.
National Science & Technology Council. (2018). Charting a course for success: America’s strategy for STEM education. Office of Science and Technology Policy. https://www.energy.gov/sites/default/files/2019/05/f62/STEM-Education-Strategic-Plan-2018.pdf
Balgopal, M. M., Casper, A. M. A., Wallace, A. M., Laybourn, P. J., & Brisch, E. (2018). Writing Matters: Writing-to-Learn Activities Increase Undergraduate Performance in Cell Biology. BioScience, 68(6), 445–454. https://doi.org/10.1093/biosci/biy042
Hand, B., Shelley, M. C., Laugerman, M., Fostvedt, L., & Therrien, W. (2018). Improving critical thinking growth for disadvantaged groups within elementary school science: A randomized controlled trial using the Science Writing Heuristic approach. Science Education, 102(4), 693–710. https://doi.org/10.1002/sce.21341
Cohen, Y., Levi, E., & Ben-Simon, A. (2018). Validating human and automated scoring of essays against “true” scores. Applied Measurement in Education, 31(3), 241–250. https://doi.org/10.1080/08957347.2018.1464450
Saha, S., Dhamecha, T. I., Marvaniya, S., Sindhgatta, R., & Sengupta, B. (2018). Sentence Level or Token Level Features for Automatic Short Answer Grading?: Use Both. In C. Penstein Rosé, R. Martínez-Maldonado, H. U. Hoppe, R. Luckin, M. Mavrikis, K. Porayska-Pomsta, B. McLaren, & B. du Boulay (Eds.), Artificial Intelligence in Education (Vol. 10947, pp. 503–517). Springer International Publishing. https://doi.org/10.1007/978-3-319-93843-1_37
Wang, E., Matsumura, L. C., & Correnti, R. (2018). Student Writing Accepted as High-Quality Responses to Analytic Text-Based Writing Tasks. The Elementary School Journal, 118(3), 357–383. https://doi.org/10.1086/696097
Gao, Y., M.Davies, P., & Passonneau, R. J. (2018). Automated Content Analysis: A Case Study of Computer Science Student Summaries. Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, 264–272. https://doi.org/10.18653/v1/W18-0531
Bousmalis, K., Irpan, A., Wohlhart, P., Bai, Y., Kelcey, M., Kalakrishnan, M., Downs, L., Ibarz, J., Pastor, P., Konolige, K., Levine, S., & Vanhoucke, V. (2018). Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping. 2018 IEEE International Conference on Robotics and Automation (ICRA), 4243–4250. https://doi.org/10.1109/ICRA.2018.8460875
Xu, Y., & Reitter, D. (2018). Information density converges in dialogue: Towards an information-theoretic model. Cognition, 170, 147–163. https://doi.org/10.1016/j.cognition.2017.09.018
Shi, W., & Yu, Z. (2018). Sentiment Adaptive End-to-End Dialog Systems. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 1509–1519. https://doi.org/10.18653/v1/P18-1140
Moon, A., Gere, A. R., & Shultz, G. V. (2018). Writing in the STEM classroom: Faculty conceptions of writing and its role in the undergraduate classroom. Science Education, 102(5), 1007–1028. https://doi.org/10.1002/sce.21454
Knight, S., Buckingham Shum, S., Ryan, P., Sándor, Á., & Wang, X. (2018). Designing Academic Writing Analytics for Civil Law Student Self-Assessment. International Journal of Artificial Intelligence in Education, 28(1), 1–28. https://doi.org/10.1007/s40593-016-0121-0
Lan, W., & Xu, W. (2018). Neural Network Models for Paraphrase Identification, Semantic Textual Similarity, Natural Language Inference, and Question Answering. Proceedings of the 27th International Conference on Computational Linguistics, 3890–3902. https://www.aclweb.org/anthology/C18-1328
Zafeiroudi, K. D., Eckman, L., & Passonneau, R. J. (2018, October 8). Testing a Knowledge Inquiry System on
Question Answering Tasks. Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWoD-4. Natural Language Interfaces to Web of Data (NLIWoD), Monterey, CA.
Passonneau, R. J., Poddar, A., Gite, G., Krivokapic, A., Yang, Q., & Perin, D. (2018). Wise Crowd Content Assessment and Educational Rubrics. International Journal of Artificial Intelligence in Education, 28(1), 29–55. https://doi.org/https://doi.org/10.1007/s40593-016-0128-6
Gao, J., Radeva, A., Shen, C., Wang, S., Wang, Q., & Passonneau, R. J. (2018). Prediction of a hotspot pattern in keyword search results. Computer Speech & Language, 48, 80–102. https://doi.org/https://doi.org/10.1016/j.csl.2017.10.005
Zafeiroudi, K. D., & Passonneau, R. J. (2018, November 6). Knowledge Inquiry for Information Foraging. 23rd International Command and Control Research and Technology Symposium (ICCRTS), Pensacola, FL.
2017
5414994
2017
1
apa
50
default
349
https://www.nlplab.psu.edu/wp-content/plugins/zotpress/
%7B%22status%22%3A%22success%22%2C%22updateneeded%22%3Afalse%2C%22instance%22%3Afalse%2C%22meta%22%3A%7B%22request_last%22%3A0%2C%22request_next%22%3A0%2C%22used_cache%22%3Atrue%7D%2C%22data%22%3A%5B%7B%22key%22%3A%22JQQRYCRM%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Hendrycks%20and%20Gimpel%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EHendrycks%2C%20D.%2C%20%26amp%3B%20Gimpel%2C%20D.%20%282017%29.%20A%20Baseline%20for%20Detecting%20Misclassified%20and%20Out-of-Distribution%20Examples%20in%20Neural%20Networks.%20%3Ci%3E5th%20International%20Conference%20on%20Learning%20Representations%20%28ICLR%202017%29%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fopenreview.net%5C%2Fforum%3Fid%3DHkg4TI9xl%27%3Ehttps%3A%5C%2F%5C%2Fopenreview.net%5C%2Fforum%3Fid%3DHkg4TI9xl%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22A%20Baseline%20for%20Detecting%20Misclassified%20and%20Out-of-Distribution%20Examples%20in%20Neural%20Networks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Dan%22%2C%22lastName%22%3A%22Hendrycks%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Dan%22%2C%22lastName%22%3A%22Gimpel%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222017%22%2C%22proceedingsTitle%22%3A%225th%20International%20Conference%20on%20Learning%20Representations%20%28ICLR%202017%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fopenreview.net%5C%2Fforum%3Fid%3DHkg4TI9xl%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222023-01-07T01%3A40%3A46Z%22%7D%7D%2C%7B%22key%22%3A%22X48B5FDG%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Geifman%20and%20El-Yaniv%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EGeifman%2C%20Y.%2C%20%26amp%3B%20El-Yaniv%2C%20R.%20%282017%29.%20Selective%20Classification%20for%20Deep%20Neural%20Networks.%20%3Ci%3EAdvances%20in%20Neural%20Information%20Processing%20Systems%2030%20%28NIPS%202017%29%3C%5C%2Fi%3E%2C%20%3Ci%3E30%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27ttps%3A%5C%2F%5C%2Fproceedings.neurips.cc%5C%2Fpaper%5C%2F2017%5C%2Ffile%5C%2F4a8423d5e91fda00bb7e46540e2b0cf1-Paper.pdf%27%3Ettps%3A%5C%2F%5C%2Fproceedings.neurips.cc%5C%2Fpaper%5C%2F2017%5C%2Ffile%5C%2F4a8423d5e91fda00bb7e46540e2b0cf1-Paper.pdf%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Selective%20Classification%20for%20Deep%20Neural%20Networks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Yonatan%22%2C%22lastName%22%3A%22Geifman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ran%22%2C%22lastName%22%3A%22El-Yaniv%22%7D%5D%2C%22abstractNote%22%3A%22Selective%20classification%20techniques%20%28also%20known%20as%20reject%20option%29%20have%20not%20yet%20been%20considered%20in%20the%20context%20of%20deep%20neural%20networks%20%28DNNs%29.%20These%20techniques%20can%20potentially%20significantly%20improve%20DNNs%20prediction%20performance%20by%20trading-off%20coverage.%20In%20this%20paper%20we%20propose%20a%20method%20to%20construct%20a%20selective%20classifier%20given%20a%20trained%20neural%20network.%20Our%20method%20allows%20a%20user%20to%20set%20a%20desired%20risk%20level.%20At%20test%20time%2C%20the%20classifier%20rejects%20instances%20as%20needed%2C%20to%20grant%20the%20desired%20risk%20%28with%20high%20probability%29.%20Empirical%20results%20over%20CIFAR%20and%20ImageNet%20convincingly%20demonstrate%20the%20viability%20of%20our%20method%2C%20which%20opens%20up%20possibilities%20to%20operate%20DNNs%20in%20mission-critical%20applications.%20For%20example%2C%20using%20our%20method%20an%20unprecedented%202%25%20error%20in%20top-5%20ImageNet%20classification%20can%20be%20guaranteed%20with%20probability%2099.9%25%2C%20with%20almost%2060%25%20test%20coverage.%22%2C%22date%22%3A%222017%22%2C%22proceedingsTitle%22%3A%22Advances%20in%20Neural%20Information%20Processing%20Systems%2030%20%28NIPS%202017%29%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22ttps%3A%5C%2F%5C%2Fproceedings.neurips.cc%5C%2Fpaper%5C%2F2017%5C%2Ffile%5C%2F4a8423d5e91fda00bb7e46540e2b0cf1-Paper.pdf%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222023-01-06T23%3A42%3A19Z%22%7D%7D%2C%7B%22key%22%3A%22RIX984M7%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Rahimi%20et%20al.%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ERahimi%2C%20Z.%2C%20Litman%2C%20D.%2C%20Correnti%2C%20R.%2C%20Wang%2C%20E.%2C%20%26amp%3B%20Matsumura%2C%20L.%20C.%20%282017%29.%20Assessing%20Students%26%23x2019%3B%20Use%20of%20Evidence%20and%20Organization%20in%20Response-to-Text%20Writing%3A%20Using%20Natural%20Language%20Processing%20for%20Rubric-Based%20Automated%20Scoring.%20%3Ci%3EInternational%20Journal%20of%20Artificial%20Intelligence%20in%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E27%3C%5C%2Fi%3E%284%29%2C%20694%26%23x2013%3B728.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-017-0143-2%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-017-0143-2%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Assessing%20Students%5Cu2019%20Use%20of%20Evidence%20and%20Organization%20in%20Response-to-Text%20Writing%3A%20Using%20Natural%20Language%20Processing%20for%20Rubric-Based%20Automated%20Scoring%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Zahra%22%2C%22lastName%22%3A%22Rahimi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Diane%22%2C%22lastName%22%3A%22Litman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Richard%22%2C%22lastName%22%3A%22Correnti%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Elaine%22%2C%22lastName%22%3A%22Wang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lindsay%20Clare%22%2C%22lastName%22%3A%22Matsumura%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%2212%5C%2F2017%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1007%5C%2Fs40593-017-0143-2%22%2C%22ISSN%22%3A%221560-4292%2C%201560-4306%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Flink.springer.com%5C%2F10.1007%5C%2Fs40593-017-0143-2%22%2C%22collections%22%3A%5B%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-10-19T22%3A32%3A59Z%22%7D%7D%2C%7B%22key%22%3A%22KEBJ5C3K%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Park%20and%20Cho%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EPark%2C%20J.%2C%20%26amp%3B%20Cho%2C%20K.%20%282017%29.%20Toward%20the%20Integration%20of%20Peer%20Reviewing%20and%20Computational%20Linguistics%20Approaches.%20%3Ci%3EJournal%20of%20Educational%20Computing%20Research%3C%5C%2Fi%3E%2C%20%3Ci%3E55%3C%5C%2Fi%3E%281%29%2C%20123%26%23x2013%3B144.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1177%5C%2F0735633116656454%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1177%5C%2F0735633116656454%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Toward%20the%20Integration%20of%20Peer%20Reviewing%20and%20Computational%20Linguistics%20Approaches%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juhwa%22%2C%22lastName%22%3A%22Park%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kwangsu%22%2C%22lastName%22%3A%22Cho%22%7D%5D%2C%22abstractNote%22%3A%22Previous%20research%20has%20shown%20the%20effectiveness%20of%20peer%20reviewing%20on%20the%20improvement%20of%20writing%20quality.%20However%2C%20the%20fact%20that%20students%20themselves%2C%20arguably%20novices%2C%20judged%20the%20improvement%20leads%20to%20concerns%20about%20the%20validity%20of%20peer%20reviewing.%20We%20measured%20writing%20quality%20before%20and%20after%20peer%20reviewing%20using%20Coh-Metrix%2C%20which%20computationally%20evaluates%20the%20linguistic%20properties%20of%20writings.%20Participants%20also%20evaluated%20the%20quality%20of%20their%20peer%20writings%20using%20the%20SWoRD%20system.%20Both%20measurements%2C%20particularly%20the%20computational%20measurement%2C%20confirmed%20the%20effectiveness%20of%20peer%20reviewing.%20In%20addition%2C%20the%20computational%20measures%20found%20that%20awareness%20of%20cohesion%2C%20including%20the%20clarity%2C%20explicitness%2C%20and%20concreteness%20of%20writing%2C%20improved%20over%20the%20course%20of%20peer%20reviewing.%20The%20results%20are%20discussed%2C%20along%20with%20their%20possible%20implications%20for%20the%20complementary%20roles%20of%20peer%20reviewing%20and%20computational%20writing%20measurements.%22%2C%22date%22%3A%2203%5C%2F2017%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1177%5C%2F0735633116656454%22%2C%22ISSN%22%3A%220735-6331%2C%201541-4140%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fjournals.sagepub.com%5C%2Fdoi%5C%2F10.1177%5C%2F0735633116656454%22%2C%22collections%22%3A%5B%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-10-19T22%3A10%3A35Z%22%7D%7D%2C%7B%22key%22%3A%22ZF99SUNX%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22United%20States%20Chamber%20of%20Commerce%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EUnited%20States%20Chamber%20of%20Commerce.%20%282017%29.%20%3Ci%3EBridging%20the%20soft%20skills%20gap%3A%20How%20the%20business%20and%20education%20sectors%20are%20partnering%20to%20prepare%20students%20for%20the%2021%20st%20century%20workforce%3C%5C%2Fi%3E.%20Center%20for%20Education%20and%20Workforce.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fwww.uschamberfoundation.org%5C%2Fsites%5C%2Fdefault%5C%2Ffiles%5C%2FClosing%2520the%2520Soft%2520Skills%2520Gap.pdf%27%3Ehttps%3A%5C%2F%5C%2Fwww.uschamberfoundation.org%5C%2Fsites%5C%2Fdefault%5C%2Ffiles%5C%2FClosing%2520the%2520Soft%2520Skills%2520Gap.pdf%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22report%22%2C%22title%22%3A%22Bridging%20the%20soft%20skills%20gap%3A%20How%20the%20business%20and%20education%20sectors%20are%20partnering%20to%20prepare%20students%20for%20the%2021%20st%20century%20workforce%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22United%20States%20Chamber%20of%20Commerce%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22reportNumber%22%3A%22%22%2C%22reportType%22%3A%22%22%2C%22institution%22%3A%22Center%20for%20Education%20and%20Workforce%22%2C%22date%22%3A%222017%22%2C%22language%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.uschamberfoundation.org%5C%2Fsites%5C%2Fdefault%5C%2Ffiles%5C%2FClosing%2520the%2520Soft%2520Skills%2520Gap.pdf%22%2C%22collections%22%3A%5B%2294NU8LMA%22%5D%2C%22dateModified%22%3A%222022-10-18T21%3A09%3A07Z%22%7D%7D%2C%7B%22key%22%3A%22SRPBDFE5%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Belland%20et%20al.%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EBelland%2C%20B.%20R.%2C%20Walker%2C%20A.%20E.%2C%20Kim%2C%20N.%20J.%2C%20%26amp%3B%20Lefler%2C%20M.%20%282017%29.%20Synthesizing%20Results%20From%20Empirical%20Research%20on%20Computer-Based%20Scaffolding%20in%20STEM%20Education%3A%20A%20Meta-Analysis.%20%3Ci%3EReview%20of%20Educational%20Research%3C%5C%2Fi%3E%2C%20%3Ci%3E87%3C%5C%2Fi%3E%282%29%2C%20309%26%23x2013%3B344.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.3102%5C%2F0034654316670999%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.3102%5C%2F0034654316670999%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Synthesizing%20Results%20From%20Empirical%20Research%20on%20Computer-Based%20Scaffolding%20in%20STEM%20Education%3A%20A%20Meta-Analysis%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Brian%20R.%22%2C%22lastName%22%3A%22Belland%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Andrew%20E.%22%2C%22lastName%22%3A%22Walker%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Nam%20Ju%22%2C%22lastName%22%3A%22Kim%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mason%22%2C%22lastName%22%3A%22Lefler%22%7D%5D%2C%22abstractNote%22%3A%22Computer-based%20scaffolding%20assists%20students%20as%20they%20generate%20solutions%20to%20complex%20problems%2C%20goals%2C%20or%20tasks%2C%20helping%20increase%20and%20integrate%20their%20higher%20order%20skills%20in%20the%20process.%20However%2C%20despite%20decades%20of%20research%20on%20scaffolding%20in%20STEM%20%28science%2C%20technology%2C%20engineering%2C%20and%20mathematics%29%20education%2C%20no%20existing%20comprehensive%20meta-analysis%20has%20synthesized%20the%20results%20of%20these%20studies.%20This%20review%20addresses%20that%20need%20by%20synthesizing%20the%20results%20of%20144%20experimental%20studies%20%28333%20outcomes%29%20on%20the%20effects%20of%20computer-based%20scaffolding%20designed%20to%20assist%20the%20full%20range%20of%20STEM%20learners%20%28primary%20through%20adult%20education%29%20as%20they%20navigated%20ill-structured%2C%20problem-centered%20curricula.%20Results%20of%20our%20random%20effect%20meta-analysis%20%28a%29%20indicate%20that%20computer-based%20scaffolding%20showed%20a%20consistently%20positive%20%28%5Cu1e21%20%3D%200.46%29%20effect%20on%20cognitive%20outcomes%20across%20various%20contexts%20of%20use%2C%20scaffolding%20characteristics%2C%20and%20levels%20of%20assessment%20and%20%28b%29%20shed%20light%20on%20many%20scaffolding%20debates%2C%20including%20the%20roles%20of%20customization%20%28i.e.%2C%20fading%20and%20adding%29%20and%20context-specific%20support.%20Specifically%2C%20scaffolding%5Cu2019s%20influence%20on%20cognitive%20outcomes%20did%20not%20vary%20on%20the%20basis%20of%20context-specificity%2C%20presence%20or%20absence%20of%20scaffolding%20change%2C%20and%20logic%20by%20which%20scaffolding%20change%20is%20implemented.%20Scaffolding%5Cu2019s%20influence%20was%20greatest%20when%20measured%20at%20the%20principles%20level%20and%20among%20adult%20learners.%20Still%20scaffolding%5Cu2019s%20effect%20was%20substantial%20and%20significantly%20greater%20than%20zero%20across%20all%20age%20groups%20and%20assessment%20levels.%20These%20results%20suggest%20that%20scaffolding%20is%20a%20highly%20effective%20intervention%20across%20levels%20of%20different%20characteristics%20and%20can%20largely%20be%20designed%20in%20many%20different%20ways%20while%20still%20being%20highly%20effective.%22%2C%22date%22%3A%2204%5C%2F2017%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.3102%5C%2F0034654316670999%22%2C%22ISSN%22%3A%220034-6543%2C%201935-1046%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fjournals.sagepub.com%5C%2Fdoi%5C%2F10.3102%5C%2F0034654316670999%22%2C%22collections%22%3A%5B%22XJX4XB44%22%5D%2C%22dateModified%22%3A%222022-08-31T18%3A51%3A24Z%22%7D%7D%2C%7B%22key%22%3A%222Z2BJD64%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Li%20et%20al.%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ELi%2C%20H.%2C%20Gobert%2C%20J.%2C%20%26amp%3B%20Dickler%2C%20R.%20%282017%29.%20Automated%20assessment%20for%20scientific%20explanations%20in%20on-line%20science%20inquiry.%20%3Ci%3E10th%20International%20Conference%20on%20Educational%20Data%20Mining%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Ffiles.eric.ed.gov%5C%2Ffulltext%5C%2FED596581.pdf%27%3Ehttps%3A%5C%2F%5C%2Ffiles.eric.ed.gov%5C%2Ffulltext%5C%2FED596581.pdf%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Automated%20assessment%20for%20scientific%20explanations%20in%20on-line%20science%20inquiry%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Haiying%22%2C%22lastName%22%3A%22Li%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Janice%22%2C%22lastName%22%3A%22Gobert%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rachel%22%2C%22lastName%22%3A%22Dickler%22%7D%5D%2C%22abstractNote%22%3A%22Scientific%20explanations%2C%20which%20include%20a%20claim%2C%20evidence%2C%20and%20reasoning%20%28CER%29%2C%20are%20frequently%20used%20to%20measure%20students%5Cu2019%20deep%20conceptual%20understandings%20of%20science.%20In%20this%20study%2C%20we%20developed%20an%20automated%20scoring%20approach%20for%20the%20CER%20that%20students%20constructed%20as%20a%20part%20of%20virtual%20inquiry%20%28e.g.%2C%20formulating%20questions%2C%20analyzing%20data%2C%20and%20warranting%20claims%29%20in%20an%20intelligent%20tutoring%20system%20%28ITS%29%2C%20called%20Inq-ITS.%20Results%20showed%20that%20the%20automated%20scoring%20of%20CER%20was%20strongly%20correlated%20with%20human%20scores%20when%20validated%20using%20independent%20sets%20of%20data%20from%20both%20the%20same%20inquiry%20task%5C%2Fquestion%2C%20as%20well%20as%20when%20using%20data%20from%20a%20different%20inquiry%20task%5C%2Fquestion.%20These%20findings%20imply%20that%20automated%20CER%20is%20a%20very%20promising%20approach%20to%20reliably%20and%20efficiently%20score%20scientific%20explanations%20in%20open%20response%20format%20for%20both%20small-%20and%20large-%20scale%20assessments.%20It%20also%20provides%20Inq-ITS%20with%20the%20capability%20to%20assess%20the%20full%20complement%20of%20inquiry%20practices%20described%20by%20NGSS.%22%2C%22date%22%3A%222017%22%2C%22proceedingsTitle%22%3A%2210th%20International%20Conference%20on%20Educational%20Data%20Mining%22%2C%22conferenceName%22%3A%22%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Ffiles.eric.ed.gov%5C%2Ffulltext%5C%2FED596581.pdf%22%2C%22collections%22%3A%5B%22XSGKE5BJ%22%5D%2C%22dateModified%22%3A%222022-08-04T15%3A04%3A54Z%22%7D%7D%2C%7B%22key%22%3A%22QWBSRWL2%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Riordan%20et%20al.%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ERiordan%2C%20B.%2C%20Horbach%2C%20A.%2C%20Cahill%2C%20A.%2C%20Zesch%2C%20T.%2C%20%26amp%3B%20Lee%2C%20C.%20M.%20%282017%29.%20Investigating%20neural%20architectures%20for%20short%20answer%20scoring.%20%3Ci%3EProceedings%20of%20the%2012th%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20Building%26%23xA0%3B%20%26%23xA0%3B%20%26%23xA0%3B%20%26%23xA0%3B%20%26%23xA0%3B%20%20Educational%20Applications%3C%5C%2Fi%3E%2C%20159%26%23x2013%3B168.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FW17-5017%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.18653%5C%2Fv1%5C%2FW17-5017%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Investigating%20neural%20architectures%20for%20short%20answer%20scoring%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Brian%22%2C%22lastName%22%3A%22Riordan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Andrea%22%2C%22lastName%22%3A%22Horbach%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Aoife%22%2C%22lastName%22%3A%22Cahill%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Torsten%22%2C%22lastName%22%3A%22Zesch%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Chong%20Min%22%2C%22lastName%22%3A%22Lee%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222017%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%2012th%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20Building%20%20%20%20%20%20%20%20%20%20%20Educational%20Applications%22%2C%22conferenceName%22%3A%22Proceedings%20of%20the%2012th%20Workshop%20on%20Innovative%20Use%20of%20NLP%20for%20Building%20%20%20%20%20%20%20%20%20%20%20Educational%20Applications%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.18653%5C%2Fv1%5C%2FW17-5017%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Faclweb.org%5C%2Fanthology%5C%2FW17-5017%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-30T20%3A14%3A43Z%22%7D%7D%2C%7B%22key%22%3A%22U4X2SKNI%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Easterday%20et%20al.%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EEasterday%2C%20M.%20W.%2C%20Rees%20Lewis%2C%20D.%2C%20%26amp%3B%20Gerber%2C%20E.%20M.%20%282017%29.%20Designing%20Crowdcritique%20Systems%20for%20Formative%20Feedback.%20%3Ci%3EInternational%20Journal%20of%20Artificial%20Intelligence%20in%20Education%3C%5C%2Fi%3E%2C%20%3Ci%3E27%3C%5C%2Fi%3E%283%29%2C%20623%26%23x2013%3B663.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0125-9%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2Fs40593-016-0125-9%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Designing%20Crowdcritique%20Systems%20for%20Formative%20Feedback%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Matthew%20W.%22%2C%22lastName%22%3A%22Easterday%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Daniel%22%2C%22lastName%22%3A%22Rees%20Lewis%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Elizabeth%20M.%22%2C%22lastName%22%3A%22Gerber%22%7D%5D%2C%22abstractNote%22%3A%22Intelligent%20tutors%20based%20on%20expert%20systems%20often%20struggle%20to%20provide%20formative%5Cnfeedback%20on%20complex%2C%20ill-defined%20problems%20where%20answers%20are%20unknown.%20Hybrid%5Cncrowdsourcing%20systems%20that%20combine%20the%20intelligence%20of%20multiple%20novices%20in%20face-toface%20settings%20might%20provide%20an%20alternate%20approach%20for%20providing%20intelligent%20formative%5Cnfeedback.%20The%20purpose%20of%20this%20study%20was%20to%20develop%20empirically%20grounded%20design%5Cnprinciples%20for%20crowdcritique%20systems%20that%20provide%20intelligent%20formative%20feedback%20on%5Cncomplex%2C%20ill-defined%20problems.%20In%20this%20design%20research%20project%2C%20we%20iteratively%20developed%5Cnand%20tested%20a%20crowdcritique%20system%20through%203%20studies%20of%2043%20novice%20problem%20solvers%20in%203%5Cnformal%20and%20informal%20learning%20environments.%20We%20collected%20observations%2C%20interviews%2C%20and%5Cnsurveys%20and%20used%20a%20grounded%20theory%20approach%20to%20develop%20and%20test%20socio-technical%5Cndesign%20principles%20for%20crowdcritique%20systems.%20The%20project%20found%20that%20to%20provide%20formative%20feedback%20on%20ill-defined%20problems%2C%20crowdcritique%20systems%20should%20provide%20a%20combination%20of%20technical%20features%20including%3A%20quick%20invite%20tools%3B%20formative%20framing%3B%20a%20public%2C%5Cnnear-synchronous%20social%20media%20interface%3B%20critique%20scaffolds%3B%20Blike%5E%20system%3B%20community%5Cnhashtags%3B%20analysis%20tools%20and%20Bto%20do%5E%20lists%3B%20along%20with%20social%20practices%20including%3A%5Cnprep%5C%2Fwrite-first%5C%2Fwrite-last%20script%20and%20critique%20training.%20Such%20a%20system%20creates%20a%20dualchannel%20conversation%20that%20increases%20the%20volume%20of%20quality%20critique%20by%20grounding%5Cncomments%2C%20scaffolding%20and%20recording%20critique%2C%20and%20reducing%20production%20blocking.%5CnSuch%20a%20design%20provides%20the%20benefits%20of%20both%20face-to-face%20critique%20and%20computer%20support%20in%20both%20formal%20and%20informal%20learning%20environments%20while%20reducing%20the%20orchestration%20burden%20on%20instructors.%22%2C%22date%22%3A%2209%5C%2F2017%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1007%5C%2Fs40593-016-0125-9%22%2C%22ISSN%22%3A%221560-4292%2C%201560-4306%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Flink.springer.com%5C%2F10.1007%5C%2Fs40593-016-0125-9%22%2C%22collections%22%3A%5B%224D2WXMN4%22%5D%2C%22dateModified%22%3A%222022-06-29T18%3A34%3A18Z%22%7D%7D%2C%7B%22key%22%3A%22Z7YZTTAV%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Liang%20et%20al.%22%2C%22parsedDate%22%3A%222017-12-04%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ELiang%2C%20C.%2C%20Yang%2C%20X.%2C%20Wham%2C%20D.%2C%20Pursel%2C%20B.%2C%20Passonneau%2C%20R.%2C%20%26amp%3B%20Giles%2C%20C.%20L.%20%282017%29.%20Distractor%20Generation%20with%20Generative%20Adversarial%20Nets%20for%20Automatically%20Creating%20Fill-in-the-blank%20Questions.%20%3Ci%3EProceedings%20of%20the%20Knowledge%20Capture%20Conference%3C%5C%2Fi%3E%2C%201%26%23x2013%3B4.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3148011.3154463%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1145%5C%2F3148011.3154463%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Distractor%20Generation%20with%20Generative%20Adversarial%20Nets%20for%20Automatically%20Creating%20Fill-in-the-blank%20Questions%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Chen%22%2C%22lastName%22%3A%22Liang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Xiao%22%2C%22lastName%22%3A%22Yang%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Drew%22%2C%22lastName%22%3A%22Wham%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Bart%22%2C%22lastName%22%3A%22Pursel%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%22%2C%22lastName%22%3A%22Passonneau%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22C.%20Lee%22%2C%22lastName%22%3A%22Giles%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222017-12-04%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20Knowledge%20Capture%20Conference%22%2C%22conferenceName%22%3A%22K-CAP%202017%3A%20Knowledge%20Capture%20Conference%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1145%5C%2F3148011.3154463%22%2C%22ISBN%22%3A%22978-1-4503-5553-7%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fdoi%5C%2F10.1145%5C%2F3148011.3154463%22%2C%22collections%22%3A%5B%2286KRVVHK%22%5D%2C%22dateModified%22%3A%222022-04-21T18%3A55%3A11Z%22%7D%7D%2C%7B%22key%22%3A%22MSSB6L4S%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Chinaei%20et%20al.%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EChinaei%2C%20H.%2C%20Currie%2C%20L.%20C.%2C%20Danks%2C%20A.%2C%20Lin%2C%20H.%2C%20Mehta%2C%20T.%2C%20%26amp%3B%20Rudzicz%2C%20F.%20%282017%29.%20Identifying%20and%20Avoiding%20Confusion%20in%20Dialogue%20with%20People%20with%20Alzheimer%26%23x2019%3Bs%20Disease.%20%3Ci%3EComputational%20Linguistics%3C%5C%2Fi%3E%2C%20%3Ci%3E43%3C%5C%2Fi%3E%282%29%2C%20377%26%23x2013%3B406.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1162%5C%2FCOLI_a_00290%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1162%5C%2FCOLI_a_00290%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Identifying%20and%20Avoiding%20Confusion%20in%20Dialogue%20with%20People%20with%20Alzheimer%27s%20Disease%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Hamidreza%22%2C%22lastName%22%3A%22Chinaei%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Leila%20Chan%22%2C%22lastName%22%3A%22Currie%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Andrew%22%2C%22lastName%22%3A%22Danks%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Hubert%22%2C%22lastName%22%3A%22Lin%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Tejas%22%2C%22lastName%22%3A%22Mehta%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Frank%22%2C%22lastName%22%3A%22Rudzicz%22%7D%5D%2C%22abstractNote%22%3A%22Alzheimer%27s%20disease%20%28AD%29%20is%20an%20increasingly%20prevalent%20cognitive%20disorder%20in%20which%20memory%2C%20language%2C%20and%20executive%20function%20deteriorate%2C%20usually%20in%20that%20order.%20There%20is%20a%20growing%20need%20to%20support%20individuals%20with%20AD%20and%20other%20forms%20of%20dementia%20in%20their%20daily%20lives%2C%20and%20our%20goal%20is%20to%20do%20so%20through%20speech-based%20interaction.%20Given%20that%2033%25%20of%20conversations%20with%20people%20with%20middle-stage%20AD%20involve%20a%20breakdown%20in%20communication%2C%20it%20is%20vital%20that%20automated%20dialogue%20systems%20be%20able%20to%20identify%20those%20breakdowns%20and%2C%20if%20possible%2C%20avoid%20them.%20%20In%20this%20article%2C%20we%20discuss%20several%20linguistic%20features%20that%20are%20verbal%20indicators%20of%20confusion%20in%20AD%20%28including%20vocabulary%20richness%2C%20parse%20tree%20structures%2C%20and%20acoustic%20cues%29%20and%20apply%20several%20machine%20learning%20algorithms%20to%20identify%20dialogue-relevant%20confusion%20from%20speech%20with%20up%20to%2082%25%20accuracy.%20We%20also%20learn%20dialogue%20strategies%20to%20avoid%20confusion%20in%20the%20first%20place%2C%20which%20is%20accomplished%20using%20a%20partially%20observable%20Markov%20decision%20process%20and%20which%20obtains%20accuracies%20%28up%20to%2096.1%25%29%20that%20are%20significantly%20higher%20than%20several%20baselines.%20This%20work%20represents%20a%20major%20step%20towards%20automated%20dialogue%20systems%20for%20individuals%20with%20dementia.%22%2C%22date%22%3A%2206%5C%2F2017%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1162%5C%2FCOLI_a_00290%22%2C%22ISSN%22%3A%220891-2017%2C%201530-9312%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdirect.mit.edu%5C%2Fcoli%5C%2Farticle%5C%2F43%5C%2F2%5C%2F377-406%5C%2F1570%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T16%3A53%3A27Z%22%7D%7D%2C%7B%22key%22%3A%22LWDN94SD%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Yu%20et%20al.%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EYu%2C%20Z.%2C%20Ramanarayanan%2C%20V.%2C%20Mundkowsky%2C%20R.%2C%20Lange%2C%20P.%2C%20Ivanov%2C%20A.%2C%20Black%2C%20A.%20W.%2C%20%26amp%3B%20Suendermann-Oeft%2C%20D.%20%282017%29.%20Multimodal%20HALEF%3A%20An%20Open-Source%20Modular%20Web-Based%20Multimodal%20Dialog%20Framework.%20In%20K.%20Jokinen%20%26amp%3B%20G.%20Wilcock%20%28Eds.%29%2C%20%3Ci%3EDialogues%20with%20Social%20Robots%3C%5C%2Fi%3E%20%28Vol.%20427%2C%20pp.%20233%26%23x2013%3B244%29.%20Springer%20Singapore.%20https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-981-10-2585-3_18%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22bookSection%22%2C%22title%22%3A%22Multimodal%20HALEF%3A%20An%20Open-Source%20Modular%20Web-Based%20Multimodal%20Dialog%20Framework%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Kristiina%22%2C%22lastName%22%3A%22Jokinen%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Graham%22%2C%22lastName%22%3A%22Wilcock%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Zhou%22%2C%22lastName%22%3A%22Yu%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Vikram%22%2C%22lastName%22%3A%22Ramanarayanan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Robert%22%2C%22lastName%22%3A%22Mundkowsky%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Patrick%22%2C%22lastName%22%3A%22Lange%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alexei%22%2C%22lastName%22%3A%22Ivanov%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alan%20W.%22%2C%22lastName%22%3A%22Black%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22David%22%2C%22lastName%22%3A%22Suendermann-Oeft%22%7D%5D%2C%22abstractNote%22%3A%22We%20present%20an%20open-source%20web-based%20multimodal%20dialog%20framework%2C%20%5Cu201cMultimodal%20HALEF%5Cu201d%2C%20that%20integrates%20video%20conferencing%20and%20telephony%20abilities%20into%20the%20existing%20HALEF%20cloud-based%20dialog%20framework%20via%20the%20FreeSWITCH%20video%20telephony%20server.%20Due%20to%20its%20distributed%20and%20cloud-based%20architecture%2C%20Multimodal%20HALEF%20allows%20researchers%20to%20collect%20video%20and%20speech%20data%20from%20participants%20interacting%20with%20the%20dialog%20system%20outside%20of%20traditional%20lab%20settings%2C%20therefore%20largely%20reducing%20cost%20and%20labor%20incurred%20during%20the%20traditional%20audio-visual%20data%20collection%20process.%20The%20framework%20is%20equipped%20with%20a%20set%20of%20tools%20including%20a%20web-based%20user%20survey%20template%2C%20a%20speech%20transcription%2C%20annotation%20and%20rating%20portal%2C%20a%20web%20visual%20processing%20server%20that%20performs%20head%20tracking%2C%20and%20a%20database%20that%20logs%20full-call%20audio%20and%20video%20recordings%20as%20well%20as%20other%20call-specific%20information.%20We%20present%20observations%20from%20an%20initial%20data%20collection%20based%20on%20an%20job%20interview%20application.%20Finally%20we%20report%20on%20some%20future%20plans%20for%20development%20of%20the%20framework.%22%2C%22bookTitle%22%3A%22Dialogues%20with%20Social%20Robots%22%2C%22date%22%3A%222017%22%2C%22language%22%3A%22%22%2C%22ISBN%22%3A%22978-981-10-2584-6%20978-981-10-2585-3%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Flink.springer.com%5C%2F10.1007%5C%2F978-981-10-2585-3_18%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T16%3A41%3A07Z%22%7D%7D%2C%7B%22key%22%3A%22PANLQ7LM%22%2C%22library%22%3A%7B%22id%22%3A5414994%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Zhou%20Yu%20and%20Alan%20W.%20Black%22%2C%22parsedDate%22%3A%222017%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EZhou%20Yu%2C%20%26amp%3B%20Alan%20W.%20Black.%20%282017%29.%20Learning%20conversational%20systems%20that%20interleave%20task%20and%20non-task%20content.%20%3Ci%3EProceedings%20of%20the%2026th%20International%20Joint%20Conference%20on%20Artificial%20Intelligence%20%28IJCAI%26%23x2019%3B17%29%3C%5C%2Fi%3E%2C%204214%26%23x2013%3B4220.%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Learning%20conversational%20systems%20that%20interleave%20task%20and%20non-task%20content%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22%22%2C%22lastName%22%3A%22Zhou%20Yu%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22name%22%3A%22Alan%20W.%20Black%22%7D%5D%2C%22abstractNote%22%3A%22Task-oriented%20dialog%20systems%20have%20been%20applied%20in%20various%20tasks%2C%20such%20as%20automated%20personal%20assistants%2C%20customer%20service%20providers%20and%20tutors.%20These%20systems%20work%20well%20when%20users%20have%20clear%20and%20explicit%20intentions%20that%20are%20well-aligned%20to%20the%20systems%27%20capabilities.%20However%2C%20they%20fail%20if%20users%20intentions%20are%20not%20explicit.%20To%20address%20this%20shortcoming%2C%20we%20propose%20a%20framework%20to%20interleave%20nontask%20content%20%28i.e.%20everyday%20social%20conversation%29%20into%20task%20conversations.%20When%20the%20task%20content%20fails%2C%20the%20system%20can%20still%20keep%20the%20user%20engaged%20with%20the%20non-task%20content.%20We%20trained%20a%20policy%20using%20reinforcement%20learning%20algorithms%20to%20promote%20long-turn%20conversation%20coherence%20and%20consistency%2C%20so%20that%20the%20system%20can%20have%20smooth%20transitions%20between%20task%20and%20non-task%20content.%20To%20test%20the%20effectiveness%20of%20the%20proposed%20framework%2C%20we%20developed%20a%20movie%20promotion%20dialog%20system.%20Experiments%20with%20human%20users%20indicate%20that%20a%20system%20that%20interleaves%20social%20and%20task%20content%20achieves%20a%20better%20task%20success%20rate%20and%20is%20also%20rated%20as%20more%20engaging%20compared%20to%20a%20pure%20task-oriented%20system.%22%2C%22date%22%3A%222017%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%2026th%20International%20Joint%20Conference%20on%20Artificial%20Intelligence%20%28IJCAI%2717%29%22%2C%22conferenceName%22%3A%22International%20Joint%20Conferences%20on%20Artificial%20Intelligence%20%28IJCAI%202017%29%22%2C%22language%22%3A%22eng%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22url%22%3A%22%22%2C%22collections%22%3A%5B%22Q2FHGMDC%22%5D%2C%22dateModified%22%3A%222022-02-13T16%3A29%3A15Z%22%7D%7D%5D%7D
Hendrycks, D., & Gimpel, D. (2017). A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks. 5th International Conference on Learning Representations (ICLR 2017). https://openreview.net/forum?id=Hkg4TI9xl
Geifman, Y., & El-Yaniv, R. (2017). Selective Classification for Deep Neural Networks. Advances in Neural Information Processing Systems 30 (NIPS 2017), 30. ttps://proceedings.neurips.cc/paper/2017/file/4a8423d5e91fda00bb7e46540e2b0cf1-Paper.pdf
Rahimi, Z., Litman, D., Correnti, R., Wang, E., & Matsumura, L. C. (2017). Assessing Students’ Use of Evidence and Organization in Response-to-Text Writing: Using Natural Language Processing for Rubric-Based Automated Scoring. International Journal of Artificial Intelligence in Education, 27(4), 694–728. https://doi.org/10.1007/s40593-017-0143-2
Park, J., & Cho, K. (2017). Toward the Integration of Peer Reviewing and Computational Linguistics Approaches. Journal of Educational Computing Research, 55(1), 123–144. https://doi.org/10.1177/0735633116656454
United States Chamber of Commerce. (2017). Bridging the soft skills gap: How the business and education sectors are partnering to prepare students for the 21 st century workforce. Center for Education and Workforce. https://www.uschamberfoundation.org/sites/default/files/Closing%20the%20Soft%20Skills%20Gap.pdf
Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2017). Synthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education: A Meta-Analysis. Review of Educational Research, 87(2), 309–344. https://doi.org/10.3102/0034654316670999
Li, H., Gobert, J., & Dickler, R. (2017). Automated assessment for scientific explanations in on-line science inquiry. 10th International Conference on Educational Data Mining. https://files.eric.ed.gov/fulltext/ED596581.pdf
Riordan, B., Horbach, A., Cahill, A., Zesch, T., & Lee, C. M. (2017). Investigating neural architectures for short answer scoring. Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications, 159–168. https://doi.org/10.18653/v1/W17-5017
Easterday, M. W., Rees Lewis, D., & Gerber, E. M. (2017). Designing Crowdcritique Systems for Formative Feedback. International Journal of Artificial Intelligence in Education, 27(3), 623–663. https://doi.org/10.1007/s40593-016-0125-9
Liang, C., Yang, X., Wham, D., Pursel, B., Passonneau, R., & Giles, C. L. (2017). Distractor Generation with Generative Adversarial Nets for Automatically Creating Fill-in-the-blank Questions. Proceedings of the Knowledge Capture Conference, 1–4. https://doi.org/10.1145/3148011.3154463
Chinaei, H., Currie, L. C., Danks, A., Lin, H., Mehta, T., & Rudzicz, F. (2017). Identifying and Avoiding Confusion in Dialogue with People with Alzheimer’s Disease. Computational Linguistics, 43(2), 377–406. https://doi.org/10.1162/COLI_a_00290
Yu, Z., Ramanarayanan, V., Mundkowsky, R., Lange, P., Ivanov, A., Black, A. W., & Suendermann-Oeft, D. (2017). Multimodal HALEF: An Open-Source Modular Web-Based Multimodal Dialog Framework. In K. Jokinen & G. Wilcock (Eds.), Dialogues with Social Robots (Vol. 427, pp. 233–244). Springer Singapore. https://doi.org/10.1007/978-981-10-2585-3_18
Zhou Yu, & Alan W. Black. (2017). Learning conversational systems that interleave task and non-task content. Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI’17), 4214–4220.
2016
- Yang, Qian; Passonneau, Rebecca J.; de Melo, Gerard. To appear. PEAK: Pyramid Evaluation via Automated Knowledge Extraction. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, February 12-17, 2016, Phoenix, AZ. Code and data. Alternate code and data.
2015
- Xie, Boyi; Rebecca J. Passonneau. 2015. OmniGraph: Rich Representation and Graph Kernel Learning. arXiv.org, arXiv:1510.02983v1. 10 Oct 2015.
- Huang, Ziheng; Zhong, Jialu; Passonneau, Rebecca J. 2015. Estimation of Discourse Segmentation Labels from Crowd Data. (poster; dataset and code) Conference on Empirical Methods in Natural Language Processing (EMNLP), September 17-21. Lisbon, Portugal.
- Xie, Boyi and Rebecca J. Passonneau. 2015. Graph Structured Semantic Representation and Learning for Financial News 28th International FLAIRS Conference, Florida Artificial Intelligence Research Society, Hollywood, FL. May 18-20 2015.
- John, Rogers Jeffrey Leo; Rebecca J. Passonneau; Thomas S. McTavish. 2015. Semantic Similarity Graphs of Mathematics Word Problems: Can Terminology Detection Help? The 8th International Conference on Educational Data Mining. June 26-29, Madrid, Spain.
- John, Rogers Jeffrey Leo; Thomas S. McTavish; Rebecca J. Passonneau. 2015. Semantic Graphs for Mathematics Word Problems Based on Mathematics Terminology Graph-based Educational Data Mining, Workshop G-EDM at the 8th International Conference on Educational Data Mining. June 26-29, Madrid, Spain.
- Bing, Lidong; Li, Piji; Lam, Wai; Guo, Weiwei; Passonneau, Rebecca J. 2015. Abstractive Multi-Document Summarization via Phrase Selection and Merging. Proceedings of the 2013 Annual Meeting of the Association for Computational Linguistics. July 26-31, Beijing, China.
2014
- Passonneau, Rebecca J.; Ramelson, Tifara; Xie, Boyi. 2014. Company Mention Detection for Large Scale Text Mining. International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K, Special Session on Text Mining (KDIR). 21-24 October, Rome Italy. BEST PAPER AWARD!
- Passonneau, Rebecca J. and Bob Carpenter. 2014. The Benefits of a Model of Annotation Transactions of the Association for Computational Linguistics (TACL). 2 (Oct): 311-326. (Erratum)
- Passonneau, Rebecca J.; Ide, Nancy; Su, Songqiao; Stuart, Jesse. 2014. Biber Redux: Reconsidering Dimensions of Variation in American English. 25th International Conference on Computational Linguistics (poster), Dublin, August 23-29, 2014.
- Passonneau, Rebecca J.; Guan, Boxuan; Yeung, Cho Ho; Du, Yuan; Conner, Emma. 2014. Aspectual Properties of Conversational Activities. Proceedings of the 15th Annual SIGdial Meeting on Discourse and Dialogue, Philadelphia, PA, June 18-20, 2014.
- Wang, Dingquan; Passonneau, Rebecca J.; Collins, Michael; Rudin, Cynthia. 2014. Modeling Weather Impact on a Secondary Electrical Grid. (pdf) 4th International Conference on Sustainable Energy Information Technology. Hasselt, Belgium. June 2-5, 2014.
- Moro, Andrea; Navigli, Roberto; Tucci, Francesco Maria; Passonneau; Rebecca J. 2014. Annotating the MASC Corpus with BabelNet. Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC). Reykjavik, Iceland, May 26-31, 2014.
- Xie, Boyi; Wang, Dingquan; Passonneau, Rebecca J. 2014. Semantic Feature Representation to Capture News Impact. 27th International FLAIRS Conference, Florida Artificial Intelligence Research Society Pensacola Beach, FL. May 21-23, 2014.