"Few are they who have not appeared one time or other in print, and in these days, no man is safe. The most idle and thoughtless, trusting in their imagination write novels, - the most sage and stupid write essays or political pamphlets. Such being the case, I also join the crowd, and present to the Reader this unpretending little book, trusting it may afford some information and amusement."

- Lieut. J.Orlebar, R.N., A Midshipman's Journal on board H.M.S. Seringapatam, during the year, 1830

Hellman, S., Murray, W.R., Wiemerslage, A., Rosenstein, M., Foltz, P.W., Becker L., & Derr, M. (2020, July). Multiple Instance Learning for Content Feedback Localization without Annotation. In Proceedings of the 15th Workshop on Innovative Use of NLP for Building Educational Applications.

Hellman, S., Rosenstein, M., Gorman, A., Murray, W., Becker, L., Baikadi, A., Budden, J., & Foltz, P. W. (2019). Scaling Up Writing in the Curriculum: Batch Mode Active Learning for Automated Essay Scoring. In Proceedings of the sixth ACM conference on Learning @ Scale. Chicago, IL. June 2019. Copy of paper. http://dx.doi.org/10.1145/3330430.3333629

Baikadi, A., Becker, L., Budden, J., Foltz, P.W., Gorman, A., Hellman, S., Murray W. & Rosenstein, M. (2019). An apprenticeship model for human and AI collaborative essay grading. In User Interactions for Building Knowledge Workshop (UIBK 2019) at IUI 2019. Los Angeles, CA. March 2019.

Foltz, P.W., Rosenstein, M., Schultz, M. & Stopek, J. (2018). Automated scoring of critical thinking in accounting. Presented in the "Artificial Intelligence and Automated Essay Scoring: The next Measurement Frontier for Licensure and Certification?" session. ATP 2018, San Antonio, TX.

Wind, S. A., Wolfe, E. W., Engelhard, Jr., G., Foltz, P. W., & Rosenstein, M. (2018). The influence of rater effects in training sets on the psychometric quality of automated scoring for writing assessments. International Journal of Testing 18(1), 27-49. http://dx.doi.org/10.1080/15305058.2017.1361426

Elvevåg, B., Foltz, P. W., Rosenstein, M., Ferrer-i-Cancho, R., De Deyne, S., Mizraji, E., & Cohen, A. (2017). Thoughts about disordered thinking: Measuring and quantifying the laws of order and disorder. Schizophrenia Bulletin 43 (3), 509-513. http://dx.doi.org/10.1093/schbul/sbx040

Foltz, P. W., & Rosenstein, M. (2017). Data mining large scale formative writing. In C. Lang, G. Siemens, A. Wise & D. Gašević (Eds.), Handbook of Learning Analytics & Educational Data Mining (pp. 199-210). Society for Learning Analytics Research.

Foltz, P. W., & Rosenstein, M. (2016). Visualizing teacher assignment behavior in a statewide implementation of a formative writing system. In Gallary of top submissions for the 2016 cover graphic/data visualization competition. Education Measurement: Issues and Practice 35(2), 31. http://dx.doi.org/10.1111/emip.12114 Extended abstract.

Foltz, P. W., Rosenstein, M., & Elvevåg, B. (2016). Detecting clinically significant events through automated language analysis: Quo imus. Npj Schizophrenia, 2, 15054. http://dx.doi.org/10.1038/npjschz.2015.54

Rosenstein, M., Foltz, P. W., DeLisi, L. E., & Elvevåg, B. (2015). Language as a biomarker in those at high-risk for psychosis. Schizophrenia Research, 165, 249-250. http://dx.doi.org/10.1016/j.schres.2015.04.023

Rosenstein, M., Foltz, P. W., Vaskinn, A., & Elvevåg, B. (2015). Practical issues in developing semantic frameworks for the analysis of verbal fluency data: A Norwegian data case study. In Proceedings of the Second Workshop on Computational Linguistics and Clinical Psychology. Denver, CO. ACL. 38-47. http://dx.doi.org/10.3115/v1/w15-1215

Foltz, P. W., & Rosenstein, M. (2015). Longitudinal Analysis of First Grade Texts Using the Reading Maturity Metric. American Educational Research Association (AERA) Annual Meeting. April. Available here.

Foltz, P. W., & Rosenstein, M. (2015). Analysis of a large-scale formative writing assessment system with automated feedback. In Proceedings of the second ACM conference on Learning @ Scale conference, 339-342. Also, available here. http://dx.doi.org/10.1145/2724660.2728688

Rosenstein, M., Diaz-Asper, C., Foltz, P. W., & Elvevåg, B. (2014). A computational language approach to modeling prose recall in schizophrenia. Cortex, 55, 148-166. http://dx.doi.org/10.1016/j.cortex.2014.01.021 Author Manuscript in PubMed Central.

Nicodemus, K. K., Elvevåg, B., Foltz, P. W., Rosenstein, M., Diaz-Asper, C., Weinberger, D. R. (2014). Category fluency, latent semantic analysis and schizophrenia: a candidate gene approach. Cortex, 55, 182-191. http://dx.doi.org/10.1016/j.cortex.2013.12.004 Also available from edepositIreland.

Foltz, P. W., Rosenstein, M., Dronen, N., and Dooley, S. (2014). Automated feedback in a large-scale implementation of a formative writing system: Implications for improving student writing. American Educational Research Association (AERA) Annual Meeting. April. Also available here.

Biemiller, A., Rosenstein, M., Sparks, R., Landauer, T. K, and Foltz, P. (2014). Models of vocabulary acquisition: Direct tests and text-derived simulations of vocabulary growth. Scientific Studies of Reading, 18(2), 130-154. http://dx.doi.org/10.1080/10888438.2013.821992

Foltz, P. W. and Rosenstein, M. (2013). Tracking student learning in a state-wide implementation of automated writing scoring. NIPS Workshop on Data Driven Education. Lake Tahoe, NV. Dec. 9-10.

Lochbaum, K. E., Rosenstein, M., Foltz, P. W. and Derr, M. A. (2013). Detection of gaming in automated scoring of essays with the IEA. National Council on Measurement in Education (NCME) Conference, San Francisco. April. Also available as a Pearson Research Report and here.

Foltz, P. W., Rosenstein, M. and Lochbaum, K. E. (2013). Improving performance of automated scoring through detection of outliers and understanding model instabilities. National Council on Measurement in Education (NCME) Conference, San Francisco. April. Also available as a Pearson Research Report and here.

Foltz, P., Rosenstein, M., Lochbaum, K., Davis, L. (2012). Improving reliability throughout the automated scoring development process. National Council on Measurement in Education, Vancouver. April.

Foltz, P. W., Lochbaum, K. E., and Rosenstein, M. (2011), Analysis of student ELA writing performance for a large scale implementation of formative assessment. National Council on Measurement in Education, New Orleans. April. Also available here.

Elvevåg, B., Foltz, P. W., Rosenstein, M., and DeLisi, L. E. (2010). An automated method to analyze language use in patients with schizophrenia and their first-degree relatives. Journal of Neurolingistics, 23 (3), 270-284. Author Manuscript in PubMed Central.

Foltz, P. W., Sparks, R., Rosenstein, M., Carley, K., Martin, M., Warwick, W., Matessa, M., LaVoie, N., and Lauper, U. (2009). Developing an Integrated Toolset for the Tactical Human Integration of Networked Knowledge ATO. Network Sciences Workshop. United States Military Academy Network Science Center. October 26-28.

LaVoie, N., Foltz, P., Rosenstein, M., Oberbreckling, R., Chatham, R., and Psotka, J. (2008). Automating convoy training assessment to improve soldier performance (abstract and handout of poster). Army Sciences Conference, Orlando Fl, December 2008.

Foltz, P., Rosenstein, M., LaVoie, N., Oberbreckling, R., Chatham, R., and Psotka, J. (2008). DARCAAT: DARPA competence assessment and alarms for teams. Interservice/Industry Training, Simulation and Education Conference (I/ITSEC 2008), Orlando, FL., December 1-4, 2008.

LaVoie, N., Foltz, P., Rosenstein, M., Oberbreckling, R., Chatham, R., and Psotka, J. (2008). Automated support for AARs: Exploiting communication to assess team performance. Interservice/Industry Training, Simulation and Education Conference (I/ITSEC 2008), Orlando, FL., December 1-4, 2008.

Foltz, P., LaVoie, N., Oberbreckling, R., and Rosenstein, M. (2008). Automated Performance Assessment of Teams in Virtual Environments. In Dylan Schmorrow, Joseph Cohn and Denise Nicholson, eds., The PSI Handbook of Virtual Environments for Training and Education: Developments for the Military and Beyond. Praeger Security International, 2008.

Foltz, P., Bolstad, C., Cuevas, H., Franzke, M., Rosenstein, M. and Costello, A. (2008). Measuring Situation Awareness Through Automated Communications Analysis. In M. Letsky, N. Warner, S. Fiore & CAP Smith, eds., Macrocognition in Teams. Elsevier, 2008. http://dx.doi.org/10.1201/9781315593166-15

Bolstad, C. A., Foltz, P., Franzke, M., Cuevas, H. M., Rosenstein, M., and Costello, A. M. (2007). Predicting Situation Awareness from Team Communications. Proceedings of the Human Factors and Ergonomics Society (HFES) 51st Annual Meeting, October 1-5.

Foltz, P. W, LaVoie, N., Oberbreckling, R. J. and Rosenstein, M. (2007). Tools for automated analysis of networked verbal communication. Network Science Report, Volume 1, 1. pp 19-24. United States Military Academy Network Science Center. October.

Foltz, P., Martin, M., Abdelali, A., Rosenstein, M. and Oberbreckling, R. (2006). Automated Team Discourse Modeling: Test of Performance and Generalization, Proceedings of the 28th Annual Conference of the Cognitive Science Society, Vancouver, BC. July 26-29.

Dalal, S., Egan, D., Ho, Y. and Rosenstein, M. (2003). The Promise and Challenge of Mining Web Transaction Data. In: C.R. Rao and R. Khattree, eds., Statistics in Industry (Handbook of Statistics, Vol. 22). Elsevier Science, Amsterdam, The Netherlands. http://dx.doi.org/10.1016/s0169-7161(03)22014-9

Rosenstein, M. (2000). What is Actually Taking Place on Web Sites: E-Commerce Lessons from Web Server Logs, Proceedings of the 2nd ACM conference on Electronic Commerce (EC-00). October 17-20, Minneapolis, Minnesota, USA. slides from talk. http://dx.doi.org/10.1145/352871.352876

Rosenstein, M. and Lochbaum, C. (2000). Recommending from Content: Preliminary Results from an E-Commerce Experiment. CHI 2000. April 1-6, The Hague, The Netherlands. http://dx.doi.org/10.1145/633292.633462

Dalal, S.R., Egan, D., Ho, Y., Lochbaum, C. and Rosenstein, M. (1999). Mining Gold from E-Commerce Transactions: Challenges. Measurement of E-Commerce Conference. December 6-8. Singapore. Slides from talk.

Sigman, E., Farrell, R. and Rosenstein, M. (1998). SiteSeer: An Interactive Treeviewer for Visualizing Web Activity. HCI'98. September 1-4, 1998. Sheffield, UK.

Workshop on Trust and Accountability: Preserving Human Values in Interactional Experiences. Invited participant, April 20, 1998 held in conjunction with ACM's CHI' 98. April 19-23, 1998. Los Angeles, CA.

Workshop on User Autonomy, Invited participant, April 15, 1996 held in conjunction with ACM'S CHI' 96. April 13-18, 1996. Vancouver, BC. Reported in SigCHI Bulletin, Volume 30, Number 1, pgs. 26-29, January 1998.

Workshop on Collaborative Filtering, Invited participant, March 16, 1996 held at School of Information Sciences, University of California, Berkeley.

Hill, W., Stead, L., Rosenstein, M. and Furnas, G. (1995). Recommending and Evaluating Choices in a Virtual Community of Use, CHI'95. May 7-11, 1995. http://dx.doi.org/10.1145/223904.223929

A Communal History-of-Use Mechanism to Aid Resource Discover in the WWW, with Will Hill and Larry Stead. The Second International WWW Conference '94 Proceedings, October 17-20, 1994.

Workshop on New Uses and Abuses of Interaction History, Invited participant, April 25, 1994 held in conjunction with ACM's CHI' 94. April 24-28, 1994. Boston, MA.

Duffy, D.E., McIntosh, A., Rosenstein, M. and Willinger, W. (1993). Analyzing Telecommunications Traffic Data from Working Common Channel Signaling Subnetworks, In Michael E. Tarter and Michael D. Lock, Co-Editors, Computing Science and Statistics Interface, Volume 25, Proceedings of the 25th Symposium on the Interface. San Diego, California, April 14-17, 1993. Also available as Bellcore Technical Report TM-ARH-023638. February 1994.

Statistical Analysis of CCSN/SS7 Traffic Data from Working CCS Subnetworks, with D.E. Duffy, A. McIntosh, and W.Willinger. IEEE Journal on Selected Areas in Communications 12(3), 544-551, April 1994. Also available as Bellcore Technical Report TM-ARH-023706. December 1993. http://dx.doi.org/10.1109/49.285297

Analyzing CCSN/SS7 Traffic Data from Working CCS Subnetworks: Implications for Engineering and Modeling, with Diane E. Duffy, Allen A. McIntosh, and Walter Willinger. Bellcore TR.

Analysis of CCSN/SS7 Data Collected at Bell Atlantic on 9/8/92, with Diane E. Duffy, Allen McIntosh, David McSherry, Deborah Swayne and Walter Willinger, Bellcore TR.

Traffic Rate and Load Balancing as Observed in Actual CCSN/SS7 Data, with Diane E. Duffy, and Allen A. McIntosh. Bellcore TM-ARH-022323, December 15, 1992. Also available in IL-92/12-033, Common Channel Signaling Network Notes, December 1992.

Rosenstein, M. (1992). Proposal to Participate in International Workshop on Feature Interaction. International Workshop on Feature Interactions in Telecommuncations Software Systems, IEEE Communications Society. St. Petersburg, FL Dec 3-4, 1992.

Stead, L., Hollan, J.D., Rosenstein, M., and Hill, W. (1992). CHI'92 Demonstration of ART. Demonstration, CHI'92, ACM Annual Conference on Human Factors in Computing Systems, May 3-7, 1992.

Salasoo, A., Rosenstein, M. and Collier G.H. (1991). Insight from Situated Action Analysis: The Case of Telephone Operating Company Engineers. Short talk, CHI'91, Conference on Human Factors in Computing Systems, April 28-May 2, 1991. A slightly edited version appears in SIGCHI Bulletin, Volume 3, Number 4, October 1991. http://dx.doi.org/10.1145/126729.1056074

Rosenstein, M. and Weitzman, L. (1990). The HITS Icon Editor. Proceedings of the 23rd Hawaii International Conference on System Sciences, January 2-5, 1990. http://dx.doi.org/10.1109/hicss.1990.205227

Rosenstein, M. and Weitzman, L. (1989). The HITS Icon Editor. MCC Technical Report ACT-HI-135-89. June 1989.

The Simulation Environment with Andrea Winkler and Louis Weitzman. MCC Technical Report ACT-HI-120-89-P. May 1989.

Demonstrations of HITS 1.0: The Human Interface Tool Suite, with Members of the Technical Staff, Human Interface Laboratory. MCC Technical Report ACT-HI-116-89-P. March. 1989.

Hollan, J., Wroblewski, D., Avery, J., Pittman, J., Martin, G., Wittenburg, K., Rosenstein, M., Weitzman, L., Hill, W., McCandless, T., Kroll, C. (1989). Human Interface Toolset [Video]. CHI '89 Technical Video Program. Issue 47 SIGGRAPH Video Review. ACM SIGCHI 1989 Conference on Computer Human Interaction, Austin, Texas, 30 April-5 May 1989. https://www.youtube.com/watch?v=V-VqDdrEtt0&list=PLqhXYFYmZ-VerqK2Mkm7sdZ37DiQMWPeg&index=5

An Introduction to HITS: Human Interface Tool Suite, with Members of the Technical Staff, Human Interface Laboratory. MCC Technical Report ACT-HI-406-88. December 1988.

Graphic Interfaces for Simulation, with James D. Hollan, Edwin L. Hutchins, Timothy P. McCandless, and Louis Weitzman. In William B. Rouse, editor, Advances in Man Machine Systems Research, Volume 3, pages 129-163. Jai Press Inc,. 55 Old Post Road, No. 2, Greenwich, CN 06836, 1987.

Workshop on Object-oriented Graphics and User Interfaces, Invited participant, September 29, 1986 held in conjunction with ACM's First Annual Conference on Object-Oriented Programming Systems, Languages and Applications. Sept. 29-Oct. 2, 1986. Portland Oregon.

Interface Design for Simulations, with J. D. Hollan and L. Weitzman. Proceedings of the First Annual Artificial Intelligence & Advanced Computer Technology Conference, Long Beach, CA, 1985, 357-368.

Tools for Graphical Interface Design, with J. D. Hollan, E. L. Hutchins, and L. Weitzman. Combining Human and Artificial Intelligence: A New Frontier in Human Factors, Proceedings from the Human Factors Society, New York, November 15, 1984, 24-40.

Rosenstein, M. (1983). Modeling Macroeconomic Systems. Seminar presentation for dissertation topic. University of California, San Diego, 1983.

Rosenstein, M. (1980). Substitution among Labor, Capital and Energy for United States Manufacturing. BS Honors Thesis, The Ohio State University, 1980. Also available at OSU Knowledge Bank.

Baikadi, A., Hellman, S., Budden, J., Hopkins, S., Habermehl, K., Foltz, P., Becker, L., Rosenstein M. (2024). Systems and methods for automated machine learning model training quality control (U.S. Patent No. 11875706). U.S. Patent and Trademark Office. Also, here.

Becker, L., Murray, W., Foltz, P., Rosenstein, M., Baikadi, A., Hellman, S., Habermehl, K., Budden, J., Hopkins, S., Gorman, A. (2023). Systems and methods for interface-based automated custom authored prompt evaluation (U.S. Patent No. 11817014). U.S. Patent and Trademark Office. Also, here.

Hellman, S. , Murray, W., Habermehl, K., Baikadi, A., Budden, J., Gorman, A., Rosenstein, M., Becker, L., Hopkins, S., Foltz P. (2023). Systems and methods for interface-based machine learning model output customization (U.S. Patent No. 11741849). U.S. Patent and Trademark Office. Also, here.

Foltz, P., Rosenstein, M., Baikadi, A., Becker, L., Hopkins, S., Budden, J., Oros, L. M., Habermehl, K., Hellman, S., Murray, W., Gorman, A. (2022). Systems and methods for automated evaluation model customization (U.S. Patent No. 11475245). U.S. Patent and Trademark Office. Also, here.

Rosenstein, M., Habermehl, K., Hellman, S., Baikadi, A., Foltz, P., Becker, L., Oros, L. M., Budden, J., and Derr, M. (2022). Real time development of auto scoring essay models for custom created prompts (U.S. Patent No. 11449762). U.S. Patent and Trademark Office. Also, here.

Hellman, S., Becker, L., Downs, S., Baikadi, A., Murray, W., Habermehl, K., Foltz, P., and Rosenstein M. (2022). Systems and methods for automated machine learning model training for a custom authored prompt (U.S. Patent No. 11443140). U.S. Patent and Trademark Office. Also, here.

Behrens, C. A., Egan, D. E., Ho, Y-Y., Lochbaum, C. and Rosenstein, M. (2003). Automatic recommendation of products using latent semantic indexing of content (U.S. Patent No. 6615208). U.S. Patent and Trademark Office. Also, here.

Last updated: Mar 6, 2024

Click on anchor to return to main sailing page

Copyright 1994-2024 Mark Rosenstein. Disclaimer.