Ryan Watkins, Ph.D.
Education
Post-Doctorate Studies and Research, Engineering Management, Old Dominion University, Norfolk, Virginia.
Doctor of Philosophy, Instructional Systems Design, October of 1997: Florida State University, Tallahassee, Florida. Major Professor: Roger Kaufman, Ph.D. Complete dissertation available in PDF format upon request.
Master of Science, Instructional Systems Design, August of 1995: Florida State University, Tallahassee, Fl.
Bachelor of Science, Secondary Mathematics Education, May of 1994: Florida State University, Tallahassee, Florida.Additional Training
Additional Training
Open Science + Research Software Engineering (URSSI)
AI Policy Certificate, Center for Artificial Intelligence and Digital Policy (CAIDP)
Python Bootcamp, George Washington University
Visual Display of Quantitative Information, Edward Tufte: Washington DC.
MS Groove Trainer, Groove Networks: Boston, Ma.
Fundamentals of Web Design, Cisco Networking Academy: Washington DC.
Managing Organizational Change, ODR, Incorporated: Atlanta, Ga.
Improving Program Performance, Southeast Evaluation Association: Tallahassee, Fl.
Evaluating for Results, Southeast Evaluation Association: Tallahassee, Fl.
Professional Experience
Professor in Educational Technology Leadership (MA, program director 2022/current), Human-Technology Collaboration (PhD, program director, 2017/current), Trustworthy AI (Director of Education, 2024/current). Responsibilities include the design, development, and delivery of graduate and undergraduate courses delivered both at a distance as well as on-campus; scholarly research; student advising; service on university, college, and departmental committees; as well as other general academic duties. (Assistant Professor 2001/2007, Associate Professor 2007/2016, Full Professor 2016/current, ETL Program Director 2022/current, Interim Associate Dean of Research 2024)
Visiting Scholar (IPA): Responsibilities include the development and facilitation of distance learning and instructional design projects for the NSF Academy, coordinating the implementation of a learning management system, supporting knowledge management and communities of practice, delivery of training, and providing consultation to research directorates on issues related to distance learning. (2005/2006)
Program (Assistant) Professor of Instructional Technology and Distance Education: Responsibilities include the design and development of distance education courses and materials for doctoral and masters degree seeking students; facilitation of distance education courses; recruitment and training of adjunct faculty; student advising on applied dissertations; demonstration of educational technologies for university faculty; facilitation of workshops on teaching through technology; service on college and department committees; as well as other general academic duties. (1999/2001)
Research Associate with the Learning Systems Institute’s Office for Needs Assessment and Planning: Duties include coordination of cooperative projects, project management, research and development of conceptual and application models in the areas of needs assessment, strategic planning, evaluation, development of data collection and analysis instruments, grant/contract writing, and the facilitation of needs assessment and strategic planning projects. Responsibilities included Technical director and project manager for three grants with the Chief of Naval Education and Training (CNET) of the US Navy; Project director for the design, development, and implementation of a needs assessment for Workforce Development OCSEA/AFSCME; and development of a needs assessment comparison framework and instructional model for the US Veteran’s Benefits Administration. (1994/1999)
Teaching Experience
George Washington University (2001/present)
· Needs Assessment and Analysis (3 credit hours): a course designed to provide practitioners with the knowledge, tools, and experience to define, prioritize, and accomplish useful results through system-focused needs assessments.
· Advanced Instructional Design (3 credit hours): an innovative course focusing on the rapid design and development of instruction.
· ICT Applications in International Education (3 credit hours): a seminar course on the application of ICTs and related technologies in international contexts.
· Instructional Design (3 credit hours): a course focused on the systematic design and development of academic and/or training courses with integrated technologies.
· Learning, Technologies, and Organizations (3 credit hours): an introduction to the role of learning, professional development, and human capital in creating successful organizations — including perspectives on knowledge management, e-learning, learning organizations, and social responsibility.
· Research Methods (3 credit hours): an introductory course to educational research with emphasis on both quantitative and qualitative methods.
· Computer Literacy (3 credit hours): an introductory course on the use of computers for undergraduate students (including how computers function; use of word processing, spreadsheet, and presentation software; the design and development of instructional Web sites; and the use of digital media).
· Managing Multimedia Production (3 credit hours): a course that examines the historical, conceptual, and practical issues associated with the management of multimedia production.
· Masters Project (1 credit hours): a short course on media and electronic portfolio development for Masters students.
Nova Southeastern University (1999/2001)
· Instructional Design and Development (5 credit hours): Two courses, taught together, with specific consideration to the design and development of academic courses and/or training with integrated technology.
· Technology Management (3 credit hours): Developed for managers of instructional technology projects and programs, this course focuses on managing educational processes that utilize technology.
· Technology for Teachers (2 credit hours): A course designed for K-12 educators who want to integrate technology into their lesson design and classroom activities.
· System Planning and Design (7 credit hours): Two courses, taught together, with emphasis on the analysis and design of educational systems for distance education.
Florida State University (1995/1998)
· Performance System Design (3 credit hours): Teaching assistant to Roger Kaufman.
Fairview Middle School (1994)
· Seventh grade mathematics
Doctoral Student Committees
· Faruqe, Farhana (2023). How intelligent machines can sense and respond to human trust.
· Willford, John (2021). The Effect Of Algorithm Transparency On Algorithm Utilization.
· Kaminsky, Samuel (2019). Video-Recorded Vs. Synchronous Interviews: Equivalence and Applicant Reactions.· Sedgwick, Randy (2014). How New Employees Learn Their Professional Role: A Case Study of a Blended Learning Program
· Barnes, Karen (2009). Distance Learning Policy Implementation.
· Bronson, Rowan (2008). Teaching Critical Thinking Skills in Distance Education.
· Moody, Kevin (2000, chair). Collaborative Learning for Pharmacists at a Distance: Improved quality and access of continuing professional development programs.
· Parker, Jonnie (2000, chair). Using Web-Enhanced Instruction to Enable Teachers at a Science and Technology Magnet School to Implement Technology.
· Sodano-Richards, Verna (2000, chair). Teacher Technology Competencies and Professional Development.
· McDonough, Ellen (2000, chair). Technology Integration: A Tool to Enhance Learning.
· McVay, Marguerita (1998, chair). Developing a Web-Based Environment to Enhance Inter and Intra-Agency Communications in a Rural Multi-Office Social Service Agency.
Publications
[Downloads are for individual use only. The distribution of any materials is strictly prohibited. If you would like multiple copies of the articles, please contact the publisher. Thank you for your cooperation.]Books
Barba, L., Barker, L., Blank, D., Brown, J., Downey, A., George, T., Heagy, L., Mandli, K., Moore, J., Lippert, D., Niemeyer, K., Watkins, R., West, R., Wickes, E., Willing, C. and Zingale, M. (2018). Teaching and Learning with Jupyter. Open Source on Github.
Kumar, S., Watkins, R. (2017). The Art of Designing and Implementing Study Tours. Washington, DC: World Bank. Available in print, or free online.
Kumar, S., Leonard, A., Watkins, R. and Vovides, Y. (2014). Art of Knowledge Exchange. Washington, DC: World Bank. Will be available in print, or free online.
Watkins, R. and Corry, M. (2013). E-learning Companion: A student’s guide to online success (4th Ed.). New York: Wadsworth/Cengage.
Watkins, R., West Meiers, M. and Visser, Y. (2012). A Guide to Assessing Needs: Tools for collecting information, making decisions, and achieving development results. Washington, DC: World Bank. Available in print, or free online.
Watkins, R. and Corry, M. (2010). E-learning Companion: A student’s guide to online success (3rd Ed.). New York: Wadsworth/Cengage.
Watkins, R. and Leigh, D. (Eds.) (2009). The Handbook of Improving Performance in the Workplace – Volume 2: Selecting and Implementing Performance Interventions. San Francisco: Wiley-Jossey/Bass. Honored with a 2011 ISPI Award of Excellence in the field of performance improvement.
Kaufman, R., Guerra-Lopez, I., Watkins, R., and Leigh, D. (2008). The Assessment Book: Applied Strategic Thinking and Performance Improvement Through Self-Assessments. Amherst, Ma:HRD Press.
Watkins, R. and Corry, M. (2007). E-learning Companion: A student’s guide to online success (2nd Ed.). New York: Houghton Mifflin.
Watkins, R. (2007). Performance By Design: The systematic selection, design, and development of performance technologies that produce useful results. Amherst, Ma:HRD Press and Silver Spring, Md:International Society for Performance Improvement.
Watkins, R. (2005). 75 E-learning Activities: Making online courses more interactive. San Francisco, CA:Jossey-Bass/Pfeiffer. (Review from ASTD’s T&D Magazine; Review from ISPI’s Performance Improvement Journal). Now available in English and Korean.
Watkins, R. and Corry, M. (2004). E-learning Companion: A student’s guide to online success. New York: Houghton Mifflin.
Kaufman, R., Oakley-Brown, H., Watkins, R., and Leigh, D. (2003). Strategic Planning for Success: Aligning people, performance, and payoffs. San Francisco: Jossey-Bass. (Review from Business Process Trends)
Kaufman, R., Watkins, R., and Leigh, D. (2001). Useful Educational Results: Defining, prioritizing and achieving. Lancaster, PA: Proactive Publishing.
Technology & Multimedia Projects
[Projects done in: Python, PHP, Javascript, WordPress; other coding projects available on Github]Watkins, R. (2024). PreprintScout. (an open source Python package)
Watkins, R. (2023). We Share Research. (a LLM-based recommender system for research articles)
Watkins, R. (2023). LLM in Science. (a clearinghouse for resources on LLM use in scientific workflows)
Watkins, R., Banson, J., Kumar Parekh, P. (2022). Code2Learn Tutorials. (coding project tutorials)
Watkins, R. (2020). SciencePods. (create a podcast about your research)
Watkins, R. (2019). Science Podcast Playlist. (a curated playlist of podcasts for researchers)
Watkins, R. (2017). Understanding Needs. (micro e-learning course)
Watkins, R. (2014). Collaborative Science Network: Helping GWU affiliated researchers collaborate. (database/website)
Watkins, R. (2014). Needs Assessment Docs: Online repository for needs assessment documents. (online database)
Watkins, R. (2013). We Share Science: A place to search, share, and discuss today’s research. (social media website)
Watkins, R. (2006). NeedsAssessment.Org: All things needs assessment. (curated website)
Watkins, R. (2003). High Impact Results: Implementer’s companion for Strategic Planning for Success (CD-ROM). San Francisco: Jossey-Bass. (multimedia DVD)
Parsing Science Podcast
Watkins, R., Leigh, D., & Christ, A.. (2021). Parsing Science – Cold War Ice Core Reveals Historic Glacial Melt. doi: 10.6084/m9.figshare.14593743
Leigh, D., Watkins, R., & Teixeira, J.. (2021). Parsing Science – DNA Evidence of Denisovan Interbreeding. doi: 10.6084/m9.figshare.14462403
Watkins, R., Leigh, D., Puzrin, A. M. (2021): Parsing Science – The Dyatlov Pass incident. doi: 10.6084/m9.figshare.14390822
Watkins, R., Leigh, D., & Leca, J.B.. (2021). Parsing Science – Monkey Business. doi: 10.6084/m9.figshare.14307824
Leigh, D., Watkins, R., & Melumad, S.. (2021). Parsing Science – Positively Negative. doi: 10.6084/m9.figshare.14207465
Watkins, R., Leigh, D., Zhao, Z., & McBride, L.. (2021). Parsing Science – How Mosquitoes Target Us. doi: 10.6084/m9.figshare.14110274
Leigh, D., Watkins, R., & Cuddy, L.. (2021). Parsing Science – Epistemic Puzzles in ‘The Witness’. 10.6084/m9.figshare.13956419
Watkins, R., Leigh, D., & Medina, A. Z.. (2021). Parsing Science – Unintended Consequences of Legal Reforms. doi: 10.6084/m9.figshare.13661042
Leigh, D., Watkins, R., & Ferrara, E.. (2021). Parsing Science – Bots’ Meddling in the 2020 Presidential Election. doi: 10.6084/m9.figshare.13569017
Watkins, R., Leigh, D., & Tourigny, E.. (2020). Parsing Science – Pet Project. doi: 10.6084/m9.figshare.13506681
Leigh, D., Watkins, R., & Casana, J.. (2020). Parsing Science – Drones Revealing the Past (Version 1). doi: 10.6084/m9.figshare.13392302
Leigh, D., Watkins, R., & Long, A.. (2020). Parsing Science – Early Galaxies’ Formation. doi: 10.6084/m9.figshare.13283789
Watkins, R., Leigh, D., & Miller, T.. (2020). Parsing Science – Silencing an ALS Gene. doi: 10.6084/m9.figshare.13232651
Leigh, D., Watkins, R., & Guevarra, D.. (2020). Parsing Science – Fool Me Once Again. figshare. doi: 10.6084/m9.figshare.13176983
Watkins, R., Leigh, D., & Jennings, K.. (2020). Parsing Science – Hot Girl Summer. doi: 10.6084/m9.figshare.13096718
Leigh, D., Watkins, R., Howes, T., & Kausel, E.. (2020). Parsing Science – Why Narcissists Are “Never Wrong”. doi: 0.6084/m9.figshare.13030964
Watkins, R., Leigh, D., Singh, M.. (2020). Parsing Science – Adhering to Prohibitive Taboos. doi: 10.6084/m9.figshare.13003580
Leigh, D., Watkins, R., & Barbaro, N.. (2020). Parsing Science – Moderating Spanking’s Lasting Impacts. doi: 10.6084/m9.figshare.12921989
Watkins, R., Leigh, D., & R. Tangherlini, T.. (2020). Parsing Science – Picking Apart Conspiracy Theories. doi: 10.6084/m9.figshare.12830939
Leigh, D., Watkins, R., & Theriault, J.. (2020). Parsing Science – The Metaethics of Moral Claims. doi: 10.6084/m9.figshare.12765473
Leigh, D., Watkins, R., & Garg, N.. (2020). Parsing Science – A Marijuana Breathalyzer. doi: 10.6084/m9.figshare.12693167
Watkins, R., Leigh, D., & Bomphrey, R.. (2020). Parsing Science – Mosquito-inspired Biotechnology. doi: 10.6084/m9.figshare.12622817
Leigh, D., Watkins, R., & Logan, T. D.. (2020). Parsing Science – How Black Politicians Matter. doi: 10.6084/m9.figshare.12555239
Watkins, R., Leigh, D., & Ho, E.. (2020). Parsing Science – When Ignorance is Bliss. doi: 10.6084/m9.figshare.12478502
Leigh, D., Watkins, R., & J. Field, D.. (2020). Parsing Science – Birds’ Evolution Across Mass Extinctions. doi: 10.6084/m9.figshare.12440495
Leigh, D., Watkins, R., & Bastos, A.. (2020). Parsing Science – Parroting Probabilities. doi: 10.6084/m9.figshare.12307394
Watkins, R., Leigh, D., Coughenour, C., & Pharr, J.. (2020). Parsing Science – Anything but Pedestrian. figshare. https://doi.org/10.6084/m9.figshare.12221009
Watkins, R., Leigh, D., & Sevillano, V.. (2020). Parsing Science – Why We Love & Exploit Animals. figshare. https://doi.org/10.6084/m9.figshare.12084204
Leigh, D., Watkins, R., & Gunawardena, J.. (2020). Parsing Science – The minds of single-celled organisms. figshare. https://doi.org/10.6084/m9.figshare.12006792
Watkins, R., Leigh, D., & Wardill, T.. (2020). Parsing Science – Cuttlefish in 3D Glasses. figshare. https://doi.org/10.6084/m9.figshare.11936289
Leigh, D., Watkins, R., & Johnson, R.. (2020). Parsing Science – Undergraduates Formerly in Foster Care. figshare. https://doi.org/10.6084/m9.figshare.11872152
Watkins, R., Leigh, D., & Grandin, T.. (2020). Parsing Science – Ivory Towers and Abattoirs. figshare. https://doi.org/10.6084/m9.figshare.11816607
Leigh, D., Watkins, R., & Wood, K.. (2020, January 21). Parsing Science – Hiding in Plain Site. figshare. https://doi.org/10.6084/m9.figshare.11691765
Watkins, R., Leigh, D., & Chang, L.. (2020, January 7). Parsing Science – Transmitting Placebo Effects. figshare. https://doi.org/10.6084/m9.figshare.11550186
Leigh, D., Watkins, R., & Santos, M. R.. (2019, December 10). Parsing Science – Global decline of homicide. figshare. https://doi.org/10.6084/m9.figshare.11356400
Watkins, R., Leigh, D., & Gelman, S. A.. (2019, November 26). Parsing Science – Extraordinary Claims, Ordinary Evidence. figshare. https://doi.org/10.6084/m9.figshare.11295614
Leigh, D., Watkins, R., & Xygalatas, D.. (2019, November 12). Parsing Episode – Ritual Pain for Social Gain. figshare. https://doi.org/10.6084/m9.figshare.10302101
Watkins, R., Leigh, D., & Das, S.. (2019, Oct. 29). Parsing Science – Hearing better than a barn owl. figshare. https://doi.org/10.6084/m9.figshare.10157003
Leigh, D., Watkins, R., & Hampson, M.. (2019, October 18). Parsing Science – Enduring effects of Nneurofeedback. figshare. https://doi.org/10.6084/m9.figshare.10002581
Watkins, R., Leigh, D., & Macnamara, B. (2019, October 1). Parsing Science – Does practice make perfect?. figshare. https://doi.org/10.6084/m9.figshare.9937238
Leigh, D., Watkins, R., & Hamid, N.. (2019, September 17). Parsing Science – The Neuroscience of Terrorism. figshare. https://doi.org/10.6084/m9.figshare.9894509
Watkins, R., Leigh, D., & Macours, K.. (2019, September 3). Parsing Science – Not-So Big Personality Traits? figshare. https://doi.org/10.6084/m9.figshare.9783836
Leigh, D., Watkins, R., & Butler-Craig, N.. (2019, August 20). Parsing Science – Taking Heat in Space. figshare. https://doi.org/10.6084/m9.figshare.9757793
Watkins, R., Leigh, D., & Musilová, Z.. (2019, August 9). Parsing Science – Fishing for Color. figshare. https://doi.org/10.6084/m9.figshare.9452402
Leigh, D., Watkins, R., Momennejad, I., & Duker, A.. (2019, July 23). Parsing Science – Collective Memories. figshare. https://doi.org/10.6084/m9.figshare.9247865
Watkins, R., Leigh, D., & Kim, B.. (2019, July 9). Parsing Science – Peeking Behind the Curtain of Algorithms. figshare. https://doi.org/10.6084/m9.figshare.8862242
Leigh, D., Watkins, R., & Schilling, A.. (2019, June 25). Parsing Science – Bending the Laws of Physics. figshare. https://doi.org/10.6084/m9.figshare.8862209
Watkins, R., Leigh, D., & M. Bik, E.. (2019, June 11). Parsing Science – Double Trouble. figshare. https://doi.org/10.6084/m9.figshare.8279714
Leigh, D., Watkins, R., & Toyokawa, W.. (2019, May 28). Parsing Science – Wisdom & Madness of Crowds. figshare. https://doi.org/10.6084/m9.figshare.8198426
Watkins, R., Leigh, D., & Graham, C.. (2019, May 14). Parsing Science – Men Without Work. figshare. https://doi.org/10.6084/m9.figshare.8135117
Leigh, D., Watkins, R., & Youngblood, M.. (2019, April 30). Parsing Science – Sampling Music Networks. figshare. https://doi.org/10.6084/m9.figshare.8061899
Watkins, R., Leigh, D., & Orben, A.. (2019, April 16). Parsing Science – Forking Paths of Kids’ Screen Time. figshare. https://doi.org/10.6084/m9.figshare.8061890
Watkins, R., Leigh, D., & Jain, N.. (2019, April 3). Parsing Science – Trusting Our Machines. figshare. https://doi.org/10.6084/m9.figshare.7955777
Leigh, D., Watkins, R., & MacDonald, E.. (2019, March 20). Parsing Science – The Wonder of STEVE. figshare. https://doi.org/10.6084/m9.figshare.7885070
Watkins, R., Leigh, D., & Mauldin, L.. (2019, March 6). Parsing Science – Becoming Deaf. figshare. https://doi.org/10.6084/m9.figshare.7817966
Leigh, D., Watkins, R., & Berman, R.. (2019, February 20). Parsing Science – p-Hacking Business. figshare. https://doi.org/10.6084/m9.figshare.7749683
Watkins, R., Leigh, D., & Soma, M.. (2019, February 20). Parsing Science – Voyeuristic Birds. figshare. https://doi.org/10.6084/m9.figshare.7743758.v1
Leigh, D., Watkins, R., & Williams, J.. (2019, January 23). Parsing Science – A Sniff Test of Stress. figshare. https://doi.org/10.6084/m9.figshare.7619045
Watkins, R., Leigh, D., Feingold, J., & Carter, E.. (2019, January 9). Parsing Science – Cognitive Biases on the Supreme Court. figshare. https://doi.org/10.6084/m9.figshare.7571369
Leigh, D., Watkins, R., & Capelotti, P.. (2018, December 25). Parsing Science – Archaeology of the Recent Past (Part 2 of 2). figshare. https://doi.org/10.6084/m9.figshare.7560023
Leigh, D., Watkins, R., & Capelotti, P.. (2018, December 11). Parsing Science – Archaeology of the Recent Past (Part 1 of 2). figshare. https://doi.org/10.6084/m9.figshare.7454747
Watkins, R., Leigh, D., & Balas, B.. (2018, Novemeber 27). Parsing Science: Illusions in the Periphery. figshare. https://doi.org/10.6084/m9.figshare.7410104
Watkins, R., Leigh, D., & Behrmann, M.. (2018, November 14). Parsing Science: Plasticity & Face Recognition. figshare. https://doi.org/10.6084/m9.figshare.7343879
Leigh, D., Watkins, R., & Gauvin, J.-F.. (2018, October 30). Parsing Science – Playing with Science History. figshare. https://doi.org/10.6084/m9.figshare.7273064
Watkins, R., Leigh, D., & E. Feigin, M.. (2018, October 16). Parsing Science – Decoding Cancers’ Expression. figshare. https://doi.org/10.6084/m9.figshare.7216019
Leigh, D., Watkins, R., & Lewis, J. D.. (2018, October 2). Parsing Science – Halting Cancer’s Spread. figshare. https://doi.org/10.6084/m9.figshare.7158998
Watkins, R., Leigh, D., & S. Vitevitch, M.. (2018, September 19). Parsing Science – Speech-to-Song Illusion. figshare. https://doi.org/10.6084/m9.figshare.7109084
Leigh, D., Watkins, R., & Dyer, A.. (2018, September 4). Parsing Science – Nothing to a Bee. figshare. https://doi.org/10.6084/m9.figshare.7048544
Watkins, R., Leigh, D., & Lee, Y. S.. (2018, August 22). Parsing Science – Hearing Loss and Cognition. figshare. https://doi.org/10.6084/m9.figshare.6994613
Leigh, D., & Jr., N. L.. (2018, August 7). Parsing Science – Differing Interpretations of Difficulty. figshare. https://doi.org/10.6084/m9.figshare.6959309
Leigh, D., Watkins, R., & Manafzadeh, A.. (2018, July 24). Parsing Science – Debunking Pterosaurs Flight. figshare. https://doi.org/10.6084/m9.figshare.6855110
Watkins, R., Leigh, D., & Bhullar, B.-A.. (2018, July 10). Parsing Science – Prehistoric origins of birds. figshare. https://doi.org/10.6084/m9.figshare.6799199
Leigh, D., Watkins, R., & Hughes, B. (2018, July 5). Parsing Science – Retaining LGBT Undergraduates in STEM. figshare. https://doi.org/10.6084/m9.figshare.6741911
Watkins, R., Leigh, D., Caza, B., Moss, S., & Vough, H.. (2018, June 12). Parsing Science – Multiple Work Identities. figshare. https://doi.org/10.6084/m9.figshare.6510287Leigh, D., Watkins, R., & Knopov, A.. (2018, May 30). Parsing Science – Structural Racism & Police Shootings. figshare. https://doi.org/10.6084/m9.figshare.6387800
Watkins, R., Leigh, D., & Kernot, D.. (2018, May 15). Parsing Science – Uncovering Uncertain Identities. figshare. https://doi.org/10.6084/m9.figshare.6281486
Leigh, D., Watkins, R., & Creanza, N.. (2018, May 2). Parsing Science – Linguistic Artifacts in Creole. figshare. https://doi.org/10.6084/m9.figshare.6207635Watkins, R., Leigh, D., & Zimbardo, P.. (2018, April 17). Parsing Science – Defying Unjust Authorities. figshare. https://doi.org/10.6084/m9.figshare.6151133
Leigh, D., Watkins, R., & Vosoughi, S..(2018, April 2). Parsing Science – How Misinformation Spreads Online. figshare. https://doi.org/10.6084/m9.figshare.6081206
Watkins, R., Leigh, D., & Wahl, A.-S.. (2018, March 21). Parsing Science – Stroke Recovery with Light. figshare. https://doi.org/10.6084/m9.figshare.6007733
Leigh, D., Watkins, R., & Kraus, M.. (2018, March 6). Parsing Science – Empathic Accuracy. figshare. https://doi.org/10.6084/m9.figshare.595620Leigh, D., & Watkins, R.. (2018, February 20). Parsing Science – Universals in Songs with Sam Mehr and Manvir Singh. figshare. https://doi.org/10.6084/m9.figshare.5915416
Watkins, R., & Leigh, D.. (2018, February 6). Parsing Science – Creating Deceptive Performance with Niki den Nieuwenboer. figshare. https://doi.org/10.6084/m9.figshare.591541
Leigh, D., & Watkins, R.. (2018, January 23). Parsing Science – Decisions to Move with Bill Clark. figshare. https://doi.org/10.6084/m9.figshare.5915404
Watkins, R., & Leigh, D.. (2018, January 9). Parsing Science – Capacity for Number with Rafael Núñez. figshare. https://doi.org/10.6084/m9.figshare.5915368
Leigh, D., & Watkins, R.. (2017, December 12). Parsing Science – Fault Reactivation and Earthquakes with Folarin Kolawole. figshare. https://doi.org/10.6084/m9.figshare.5915350
Watkins, R., & Leigh, D.. (2017, November 28). Parsing Science – Retaliatory Punishment with Adam Morris. figshare. https://doi.org/10.6084/m9.figshare.5915119
Leigh, D., & Watkins, R.. (2017, November 14). Parsing Science – Electoral Systems and Female Candidates with Laura Stephenson. figshare. https://doi.org/10.6084/m9.figshare.5915032
Watkins, R., & Leigh, D.. (2017, October 31). Parsing Science – Emotions and Rubber Hand Illusion with Beatrice de Gelder. figshare. https://doi.org/10.6084/m9.figshare.5915020
Leigh, D., & Watkins, R.. (2017, October 24). Parsing Science – Open Science and Replications (Part 2 of 2) with Tim Errington & Brian Nosek. figshare. https://doi.org/10.6084/m9.figshare.5907973
Watkins, R., & Leigh, D.. (2017, October 17). Parsing Science – Open Science and Replications (Part 1 of 2) with Brian Nosek & Tim Errington . figshare. https://doi.org/10.6084/m9.figshare.5907961
Leigh, D., & Watkins, R.. (2017, October 3). Parsing Science – Archaeology of Space Culture with Alice Gorman. figshare. https://doi.org/10.6084/m9.figshare.5907727
Watkins, R., & Leigh, D.. (2017, September 19). Parsing Science – Induced Auditory Hallucinations with Al Powers & Phil Corlett. figshare. https://doi.org/10.6084/m9.figshare.5907430
Leigh, D., & Watkins, R.. (2017, September 5). Parsing Science – Semantic Meaning in Images with Devi Parikh. figshare. https://doi.org/10.6084/m9.figshare.5907418
Watkins, R., & Leigh, D.. (2017, August 22). Parsing Science – Christians and Science with Kim Rios . figshare. https://doi.org/10.6084/m9.figshare.5907415
Leigh, D., & Watkins, R.. (2017, August 9). Parsing Science – Accuracy of Health Outcome Predictions with Scott Halpern. figshare. https://doi.org/10.6084/m9.figshare.5907412
Watkins, R., & Leigh, D.. (2017, July 25). Parsing Science – Science Writing as Storytelling with Ryan Kelly. figshare. https://doi.org/10.6084/m9.figshare.5877399
Current Pre-Prints
Watkins, R., & Barak-Medina, E. (2024). AI’s Influence on Human Creative Agency. osf.io/md5ef.
Faruque, F., Watkins, R., Medsker, L. (2021). Competency Model Approach to AI Literacy: Research-based Path from Initial Framework to Model. [paper Presented as part of AI4EDU at IJCAI2021; listen to a summary below]
Faruque, F., Watkins, R., Medsker, L. (2020). Monitoring Trust in Human-Machine Interactions for Public Sector Applications. arXiv. [paper presented at AAAI 2020 Fall Symposium]
Blind Peer-Reviewed Publications
Shioji, E., Meliksetyan, A., Simko, L, Watkins, R., Aviv, A. & Cohney, S. (accepted) “It’s been lovely watching you”: Institutional Decision-Making on Online Proctoring Software. IEEE Symposium on Security and Privacy 2025.
Watkins, R., & Barak-Medina, E. (2024). AI’s Influence on Human Creative Agency. Creativity Research Journal, 1–13. https://doi.org/10.1080/10400419.2024.24372642437264
Watkins, R. (2023). Guidance for researchers and peer‑reviewers on the ethical use of Large Language Models (LLMs) in scientific research workflows. AI and Ethics. https://doi.org/10.1007/s43681-023-00294-5 [Listen to a summary below]
Human, S. and Watkins, R. (2022). Needs and Artificial Intelligence. AI and Ethics. https://doi.org/10.1007/s43681-022-00206-z [preprint arXiv or epub.wu.ac.at; listen to a summary below]
Watkins, R., Human, S. (2022). Needs-aware artificial intelligence: AI that ‘serves [human] needs’. AI and Ethics. https://doi.org/10.1007/s43681-022-00181-5 [preprint arXiv]
Wallen, M.M., Guerra-Lopez, I., Meroueh, L., Mohamed, R., Sankar, A., Sopory, P., Watkins, R., and Kashian, D.R. (2022). Designing and Implementing a Novel Graduate Program to Develop Transdisciplinary Leaders in Urban Sustainability. Ecosphere doi: http://doi.org/10.1002/ecs2.3901.
Watkins, R., Corry, M., Dardick, W., and Stella, J. (2015). Note-taking Habits of Online Students: Value, Quality, and Support. Quarterly Review of Distance Education. https://doi.org/10.1007/s10639-016-9530-9
Lim, J., Dannels, S. and Watkins, R. (2009). Qualitative Investigation of Doctoral Students’ Learning Experiences in Online Research Method Courses. Quarterly Review of Distance Education. https://doi.org/10.4018/978-1-60566-198-8.ch075
Leigh, D. and Watkins, R. (2005). E-learner Success: Validating a Self-Assessment of Learner Readiness for Online Training. Referred proceedings from the international conference of the American Society for Training and Development: Orlando, Fl. https://doi.org/10.1093/med/9780198736134.003.0011
Ronsisvalle, T, and Watkins, R. (2005). Student Success in Online K-12 Education. Quarterly Review of Distance Education. 6(2). https://doi.org/10.4324/9780203095737-8
Watkins, R., Leigh, D., and Triner, D. (2004). Assessing Readiness for E-learning. Performance Improvement Quarterly, 17(4), 66-79. https://doi.org/10.1111/j.1937-8327.2004.tb00321.x
Watkins, R. and Corry, M. (2004). E-learning: It is not just for distance education students anymore. Proceedings from AACE E-learning Conference: Washington DC. https://doi.org/10.4018/978-1-59140-555-9.ch114
Watkins, R. (2003). Determining if Distance Education is the Right Choice: Applied strategic thinking in education. Computers in the Schools, 20(2), 103-120. https://doi.org/10.1300/j025v20n03_10
Watkins, R. and Schlosser, C. (2003). Conceptualizing Educational Research in Distance Education. Quarterly Review of Distance Education, 4(3), 331-341. https://doi.org/10.1080/08923640009527063
Guerra, I. and Watkins, R. (2003). Systematically Designing Instruction for Distance Education. Quarterly Review of Distance Education, 4(3), 199-201. https://doi.org/10.1207/s15389286ajde1703_6
Watkins, R., & Schlosser, C. (2003). It’s Not About Time: A fresh approach to educational equivalency. TechTrends Journal, 47(3), 35-39. https://doi.org/10.1207/s15389286ajde1703_6
Watkins, R. and Schlosser, C. (2002). Moving Past Time as the Criteria: The application of Capabilities-Based Educational Equivalency Units in higher education. The Online Journal of Distance Education Administration, 5(3). 35-40. https://doi.org/10.1080/08923640009527063
Kaufman, R., Watkins, R., and Guerra, I. (2002). Getting Valid and Useful Educational Results and Payoffs: We are what do, say, and deliver. International Journal of Educational Reform, 11(1), 77-92. https://doi.org/10.1177/105678790201100105
Watkins, R. (2001). The Relationship of Some Personality and Individual Characteristics with and Individual’s Commitment to an Ideal Vision for Performance Improvement.Performance Improvement Quarterly, 14(3), 118-133. https://doi.org/10.1111/j.1937-8327.2001.tb00221.x
Watkins, R. (2000). How Distance Education is Changing Workforce Development. Quarterly Review of Distance Education, 1(3), 241-246. https://doi.org/10.1080/01587919.2015.1055055
Watkins, R. and Schlosser, C. (2000). Capabilities Based Educational Equivalency Units Beginning a professional dialogue. American Journal of Distance Education, 14(3), 34-47. https://doi.org/10.1080/08923640009527063
Kaufman, R. and Watkins, R. (2000). Assuring the Future of Distance Learning. The Quarterly Review of Distance Education, 1(1), 59-67. https://doi.org/10.4324/9780203803738.ch28
Leigh, D., Watkins, R., Platt, W., and Kaufman, R. (2000). Alternate Models of Needs Assessment: Selecting the right one for your organization? Human Resource Development Quarterly, 11(1), 87-93. 3.0.co;2-a” target=”_blank” rel=”noopener noreferrer”>https://doi.org/10.1002/1532-1096(200021)11:1<87::aid-hrdq7>3.0.co;2-a
Kaufman, R., Stith, M., Triner, D. And Watkins, R. (1998). The Changing Corporate Mind: Organizations, vision, mission, purposes, and indicators on the move toward societal payoffs. Performance Improvement Quarterly, 11(3), 32-34. https://doi.org/10.1111/j.1937-8327.1998.tb00098.x
Kaufman, R., Watkins, R. And Sims, L. (1997). Cost-Consequences Analysis: A case study. Performance Improvement Quarterly, 10(2), 7-21. https://doi.org/10.1111/j.1937-8327.1997.tb00056.x
Watkins, R., Triner, D. and Kaufman, R. (1996). The Death and Resurrection of Strategic Planning: A review of Mintzberg’s The Rise and Fall of Strategic Planning.International Journal of Educational Reform, 5(3), 390-393. https://doi.org/10.1177/105678799600500318
Kaufman, R. and Watkins, R. (1996). Cost-Consequences Analysis. Human Resources Development Quarterly, 7(1), 87 – 100. https://doi.org/10.1002/hrdq.3920070109
Chapters in Books
Faruqe, F., Medsker, L., Watkins, R. (2023). ATIAS: A Model for Understanding Intentions to Use AI Technology. In: Daimi, K., Alsadoon, A., Coelho, L. (eds) Cutting Edge Applications of Computational Intelligence Tools and Techniques. Studies in Computational Intelligence, vol 1118. Springer, Cham. https://doi.org/10.1007/978-3-031-44127-1_5
Watkins, R., Milman, N. and Corry, M. (2023). Lifelong Learning as a Learning and Instructional Design Technology Professional. in West, R. and Leary, H. (Ed.). Becoming an LIDT Professional. Ed Tech Book.
Milman, N. and Watkins, R. (2022). Designing with Instructional Continuity in Mind. , A Practitioner’s Guide to Instructional Design in Higher Education, Stefaniak, J., Ed Tech Books, Open Source Book
Watkins, R. (2021). Decision Pathways Leading to the Successful Digital Transformation of Learning. In Jagannathan, S. (Ed). Reimagining Digital Learning for Sustainable Development: How Upskilling, Data Analytics, and Educational Technologies Close the Skills Gap (the “Work”). Routledge.
Watkins, R. (2015). Point-Counterpoint. In Beich, E. (Ed.). 101 Ways to Make Digital Learning Active. San Francisco: Jossey-Bass/Wiley.
Watkins, R. and Corry, M. (2014). Preparing Students for E-learning Success. In Hirumi, A. (Ed.). Online and Hybrid Learning: Design Fundamentals. Eugene, OR: International Society for Technology in Education (ISTE).
Watkins, R., Kaufman, R., and Odunlami, B. (2013). Strategic Planning for Distance Education – Revised . In Moore, M. (Ed.). Handbook of American Distance Education(3rd Ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Watkins, R. and West Meiers, M. (2011). Needs Assessment Management Checklist. In Biech, E. (Ed.) The 2012 Pfeiffer Annual. San Francisco:Jossey-Bass/Pfeiffer.
Watkins, R. and Wedman, J. (2010). Are We Creating a Performance System or a Hodgepodge of Interventions. In Biech, E. (Ed.) The 2011 Pfeiffer Annual. San Francisco:Jossey-Bass/Pfeiffer.
Watkins, R. (2009). E-learning. In Watkins, R. and Leigh, D. (Eds.) (2009). The Handbook of Improving Performance in the Workplace – Volume 2: Selecting and Implementing Performance Interventions. San Francisco: Wiley-Jossey/Bass and Silver Spring, MD: ISPI.
Watkins, R. and Visser, Y. (2009). Cognitive Task Analysis. In Biech, E. (Ed.) The 2009 Pfeiffer Annual: Talent Management. San Francisco:Jossey-Bass/Pfeiffer.
Watkins, R. (2008). E-learning Success: Creating positive experiences for online students. In Boetcher, J. (Ed.) The Encyclopedia of Distance Education. Volume II (2nd Ed.). Hershey, PA.: Idea Group Reference.
Corry, M. & Watkins, R. (2007). A Student’s Guide to E-learning Success. In Brandon, W. (Ed.) The eLearning Guild’s Handbook on e-Learning Strategy. eLearning Guild Press.
Watkins, R. and Kaufman, R. (2007). Strategic Planning for Distance Education – Revised . In Moore, M. (Ed.). Handbook of American Distance Education (2nd Ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Watkins, R. (2006). Aligning Performance Technology with Organizational Strategic Plans. In Pershing, J. (Ed.) The Handbook of Human Performance Technology. San Francisco, CA:Jossey-Bass/Pfeiffer.
Watkins, R. (2005). Preparing E-learners for Success. In Boetcher, J. (Ed.) The Encyclopedia of Distance Education. Volume II. Hershey, PA.: Idea Group Reference.
Watkins, R. (2005). Three Activites for Making Online Courses More Interactive. In Biech, E. (Ed.) The 2005 Pfeiffer Annual: Training. San Francisco:Jossey-Bass/Pfeiffer.
Watkins, R. (2005). Roger Kaufman: Creating a shared vision of the ideal future… starting today. In Orey, M. (Ed.) Educational Media and Technology Yearbook, Volume 29. Westport, CT: Libraries Unlimited.
Watkins, R., Leigh, D., and Kaufman, R. (2004). A Scientific Dialogue: A Performance Accomplishment Code of Professional Conduct. (reprint). In Chevalier, R. (Ed.) Human Performance Technology Revisited. Silver Spring, MD: International Society for Performance Improvement.
Watkins, R., Leigh, D., Platt, W., and Kaufman, R. (2004). Needs Assessment: A Digest, Review, and Comparison of Needs Assessment Literature. (reprint). In Chevalier, R. (Ed.) Human Performance Technology Revisited. Silver Spring, MD: International Society for Performance Improvement.
Watkins, R. (2004). 20 Essential Study Tips for E-learners. In Biech, E. (Ed.) The 2004 Pfeiffer Annual: Training. San Francisco: Jossey-Bass-Pfeiffer.
Watkins, R. (2003). Determining if Distance Education is the Right Choice: Applied strategic thinking in education. In Corry, M, and Tu, C. (Ed.). Distance Education: What works well. Binghamton, NY: Haworth Press [also in Computers in the Schools. 20(2).]
Muir, M., Watkins, R., Kaufman, R., & Leigh, D. (2003). Cost-Consequences Analysis: A Primer. (reprint) In Dickelman, G. J. (Ed.) EPSS Revisited: A Lifecycle for Developing Performance-Centered Systems. Silver Spring, MD: International Society for Performance Improvement.
Watkins, R., Leigh, D., Platt, W., and Kaufman, R. (2003). Needs Assessment: A Digest, Review, and Comparison of Needs Assessment Literature. (reprint). In Strayer, J. (Ed.) Instructional Systems Design Revisited. Silver Spring, MD: International Society for Performance Improvement.
Watkins, R. and Kaufman, R. (2003). Strategic Planning for Distance Education. In Moore, M. (Ed.). Handbook of American Distance Education. Mahwah, NJ: Lawrence Erlbaum Associates.
Watkins, R. (2003). Readiness for Online Learning Self-Assessment. In Biech, E. (Ed.). The 2003 Pfeiffer Annual: Training. San Francisco: Jossey-Bass-Pfeiffer.
Watkins, R. (2003). Online Readings: Gaining the most from what you read. Piskurich, G. (Ed.). Preparing for E-learning: A learner’s perspective. San Francisco: Jossey-Bass.
Watkins, R. and Guerra, I. (2002). Assessing or Evaluating: Determining which approach is required. In Silberman, M. (Ed.). The 2003 Training and Performance Sourcebook. Princeton, NJ: Active Training.
Watkins, R. and Corry, M. (2002). Virtual Universities: Challenging the conventions of education. In Haddad, W. and Draxler A. (Ed.). Technologies for Education: Potentials, Parameters and Prospects. Paris: UNESCO.
Kaufman, R., Watkins, R. And Leigh, D. (2002). How Committed is the Organization to Quality Improvement?. In Silberman, M. (Ed.). The Consultant’s Big Book of Reproducible Surveys and Questionnaires: 50 Instruments to Help You Assess and Diagnose Client Needs. Princeton, NJ: Active Training.
Watkins, R. and Kaufman, R. (2002). Will Your Client’s Distance Education Program Accomplish Useful Results? In Silberman, M. (Ed.). The Consultant’s Big Book of Reproducible Surveys and Questionnaires: 50 Instruments to Help You Assess and Diagnose Client Needs. Princeton, NJ: Active Training.
Watkins, R. and Kaufman, R. (2002). Is Your Distance Education Program Going to Accomplish Useful Results? In Silberman, M. (Ed.). The 2002 Training and Performance Sourcebook. Princeton, NJ: McGraw Hill.
Watkins, R. and Leigh, D. (2001). Performance Improvement: Mehr als nur die Verbesserung des Hier und Jetzt. In Wittkuhn, K. and Bartscher, T. (Ed.). Improving Performance: Leistungspotenziale in organizationen entfalten. Germany: Luchterhand. (in German)
Kaufman, R., and Watkins, R. (1999). An Ideal Vision to Guides Florida’s Revision of the State Comprehensive Plan. In DeHaven-Smith, L. (Ed.) Charting Florida’s Future. Tallahassee, Fl: The Florida Institute of Government.
Watkins, R. And Kaufman, R. (1999). Strategic Planning. In Langdon, D. (Ed.). The Resource Guide to Performance Interventions. San Francisco, CA:Jossey-Bass.
Kaufman, R. And Watkins, R. (1999). Needs Assessment. In Langdon, D. (Ed.). The Resource Guide to Performance Interventions. San Francisco, CA:Jossey-Bass.
Kaufman, R., Watkins, R. And Leigh, D. (1998). What is Your Organization’s Quality Management Culture?. In Silberman, M. (Ed.). The 1998 Team and Organization Development Sourcebook. Princeton, NJ: McGraw Hill.
Kaufman, R. and Watkins, R. (1996) Mega Planning: A framework for integrating strategic planning, needs assessment, quality management, benchmarking, and reengineering. In Jones, J. E. & Biech, E. (Ed.). The HR Handbook, Vol. 1. Amherst MA., HRD Press.
Editor Reviewed Journals and Publications
Kurtz, G., Salmon, G., Watkins, R., Kaltz, M., and Buchem, I. (2024). Special Issue: The Integration of Generative AI in Teaching and Learning. European Journal of Open, Distance and E-Learning, 26(S1).
Watkins, R., Milman, N., Corry, M. (2022). New Artificial Intelligence Technologies and Potential Educational Implications. Distance Learning; Charlotte Vol. 19(4), 101-105. URLJayawardena, M., Heijndermans, E., West Meyers, M., Watkins, R., Butscher, J., Feng, S., and Berrah, N. (2021). Delphi Technique: Predicting Emerging Opportunities and Challenges in Renewable Energy. World Bank Group. https://doi.org/10.2172/15011466
Rubinson, C., Jayawardena, M., Watkins, R., Butscher, J., and Berrah, N. (2021). Qualitative Comparative Analysis: Exploring Causal Links for Scaling Up Investments in Renewable Energy. World Bank Group. https://doi.org/10.1016/b978-0-12-804436-0.00004-7
Watkins, R. (2020). Looking Back from the Future to Look Forward to Tomorrow. Performance Improvement Journal. https://doi.org/10.1002/pfi.21911
Watkins, R. (2017). Monitoring and Evaluation Training: A Systematic Approach [book review]. Journal of Evaluation and Program Planning. https://doi.org/10.1016/j.evalprogplan.2017.03.008
Watkins, R., Engel, L., and Hastedt, D. (2015). Is the “Net Generation” Ready for Digital Citizenship?: Perspectives from the International Computer and Information Literacy Study. [policy brief] International Association of the Evaluation of Educational Achievement. https://doi.org/10.1007/978-3-030-26203-7_3
Altschuld, J. W., & Watkins, R. (2014). A primer on needs assessment: More than 40 years of research and practice. In J. W. Altschuld & R. Watkins (Eds.), Needs assessment: Trends and a view toward the future. New Directions for Evaluation, 144, 5–18. https://doi.org/10.1007/978-3-030-26203-7_3
Watkins, R., & Kavale, J. (2014). Needs: Defining what you are assessing. In J. W. Altschuld & R. Watkins (Eds.), Needs assessment: Trends and a view toward the future. New Directions for Evaluation, 144, 19–31. https://doi.org/10.1007/978-3-030-26203-7_3
West Meiers, M. W., Watkins, R., & Song, K. M. (2014). International perspectives: Similarities and differences around the globe. In J. W. Altschuld & R. Watkins (Eds.), Needs assessment: Trends and a view toward the future. New Directions for Evaluation, 144, 75–87. https://doi.org/10.1007/978-3-030-26203-7_3
Watkins, R., & Altschuld, J. M. (2014). A final note about improving needs assessment research and practice. In J. W. Altschuld & R. Watkins (Eds.), Needs assessment: Trends and a view toward the future New Directions for Evaluation, 144, 105–114. https://doi.org/10.1007/978-3-030-26203-7_3
Watkins, R. (2014). Book Review: Trends and Issues in Distance Education: International Perspectives, 2nd ed. Performance Improvement Journal, 53(1). https://doi.org/10.1002/pfi.21392
Watkins, R., West Meiers, M., and Marsh Song, K. (2013). Performance Improvement: A Key to Success in International Development Projects. Performance Improvement Journal. https://doi.org/10.1002/pfi.21319
Leigh, D. and Watkins, R. (2011). Don’t Waste Your Time. Performance Improvement Journal. https://doi.org/10.1002/pfi.20214
Watkins, R. (2007). Designing for Performance: Design, develop, improve (part 3 of 3). Performance Improvement Journal. https://doi.org/10.1002/pfi.124
Watkins, R. (2007). Designing for Performance: Selecting your performance technologies (part 2 of 3). Performance Improvement Journal. https://doi.org/10.1002/pfi.102
Watkins, R. (2007). Designing for Performance: Aligning all of your HPT decisions from top to bottom (part 1 of 3). Performance Improvement Journal. https://doi.org/10.1002/pfi.033
Watkins, R. (2005, Sept.). Preparing e-Learners for Online Success. LearningCircuits Magazine. https://doi.org/10.1002/nsr.30373
Watkins, R. (2005). Developing Interactive E-learning Activities. Performance Improvement Journal, 44(5). https://doi.org/10.1002/pfi.4140440504
Watkins, R. and Wedman, J. (2003). A Process for Aligning Performance Improvement Resources and Strategies. Performance Improvement Journal, 42(7), 9-17. https://doi.org/10.1002/pfi.4930420704
Watkins, R. and Kaufman, R. (2002). Assessing and Evaluating: Differentiating perspectives. Performance Improvement Journal, 41(2), 22-28. https://doi.org/10.1002/pfi.4140410206
Watkins, R. and Leigh, D. (2001). Performance Improvement: More than bettering the here and now. Performance Improvement Journal, 40(8), 10-15. https://doi.org/10.1002/pfi.4140400805
Kaufman, R., Watkins, R., and Guerra, I. (2001). The Future of Distance Education: Defining and sustaining useful results. Educational Technology, 41(3), 19-26. https://doi.org/10.1177/105678790201100105
Watkins, R. and Schlosser, C. (2000). The Impact of Technology on Educational Equivalency: Capabilities Based Educational Equivalency (CBEE) Units. Educational Technology, 40(6), 49-54. https://doi.org/10.1080/08923640009527063
Watkins, R., Kaufman, R., and Leigh, D. (2000). A Scientific Dialogue: A performance accomplishment code of professional conduct. Performance Improvement Journal, 39(4), 17-22. https://doi.org/10.1002/pfi.4140390408
Kaufman, R. and Watkins, R. (2000) Getting Serious About Results and Payoffs: We are what we say, do, and deliver. Performance Improvement Journal, 39(4), 23-32. https://doi.org/10.1002/pfi.4140390409
Watkins, R., Leigh, D. And Kaufman, R. (1998). Needs Assessment: A digest, review, and comparison of needs assessment literature. Performance Improvement Journal,37(7), 40-53. https://doi.org/10.1002/pfi.4140370711
Watkins, R. (1998). Is Distance Learning Right for Your Organization? ISPI Global Network Chapter. Available: http://www.pignc-ispi.com/articles/distance/isdistance.htm[July 10, 1998]. https://doi.org/10.1108/lcd.1998.10206jab.003
Muir, M., Watkins, R., Kaufman, R., And Leigh, D. (1998). Costs-Consequences Analysis: A primer. Performance Improvement Journal, 37(4), 8-17. https://doi.org/10.1002/pfi.4140370405
Watkins, R. (1997; November) Assessment of Florida Government Cost Savings Reported by Florida TaxWatch. Tallahassee, FL: Florida TaxWatch Incorporated. https://doi.org/10.21474/ijar01/6660
Watkins, R. and Kaufman, R. (1996). An Update on Relating Needs Assessment and Needs Analysis. Performance Improvement Journal, 35(10), 10-13. https://doi.org/10.1002/pfi.4170351005
Triner, D.,Greenberry, A. and Watkins, R. (1996). Training Needs Assessment: A Contradiction in Terms. Educational Technology, 36(6), 51-55. https://doi.org/10.4324/9780203962701-18
Hall, J., Sprague, D. and Watkins, R. (1995; August). Florida’s Job Training Programs: What is the return on taxpayers’ investment? Tallahassee, Fl: Florida TaxWatch Incorporated. https://doi.org/10.25082/swsw.2020.01.002
Crispo, N., Wenner, K. and Watkins, R. (1995; March). Rounding Unemployment Tax to Fourth Digit Adds Accuracy for Government and Taxpayers Alike. Tallahassee, FL: Florida TaxWatch Incorporated. https://doi.org/10.35256/sp58
Kaufman, R., Keller, J. and Watkins, R. (1995). What Works and What Doesn’t: Evaluation beyond Kirkpatrick. Performance and Instruction, 35(2), 8-12. https://doi.org/10.1002/pfi.4170350204
Magazines and Blogs
Watkins, R. (2024). Curating Content for Course Chatbots: Ethical Considerations for Educators. https://doi.org/10.31219/osf.io/g25zs (Medium and OSF)
Watkins, R., Barak-Medina, E., & Pugh, K. B. (2024). Is AI Hijacking Our Agency?. https://doi.org/10.31219/osf.io/8bpaq (Medium and OSF)
Watkins, R. (2023). From AI to A+: Prepare Your Students for Using ChatGPT and other AI. (Medium)
Watkins, R. & Feuer, M. (2023). AI challenges: Practical and Theoretical. Advancing and Evaluating the Societal Impact of Science (AESIS).
Watkins, R. (2022). Update Your Course Syllabus for chatGPT. Medium. [60k + reads]
Watkins, R. (2021). Needs and Artificial Intelligence. American Evaluation Association 365 Blog.
Watkins, R. (2020). Necessity and Sufficiency: A quick example. American Evaluation Association 365 Blog.
Watkins, R. (2019). Measuring Necessity and Sufficiency. American Evaluation Association 365 Blog.
Watkins, R. (2016). Using Video to Share Your Science. AddGene.
Watkins, R. (2016). Needs Assessment: Making Recommendations. American Evaluation Association 365 Blog.
Watkins, R. (2015). Words Matter: As is the case with needs. American Evaluation Association 365 Blog.
Watkins, R. (2015). Research Paradigms for Needs Assessment (or Evaluation). American Evaluation Association 365 Blog.
Watkins, R. (2015). Crowdfunding science: what are the options and opportunities? Wiley Exchanges Blog.
Watkins, R. (2014). Planning to Measure Needs. AEA365 Blog.
Watkins, R. (2014). Using Video to Assess Student Critical Thinking on Research. Wiley Exchanges Blog.
Watkins, R. (2013). Sharing science – how social media can help break down disciplinary boundaries. Wiley Exchanges Blog.
Watkins, R. (2012). Staying Current. American Evaluation Association 365 Blog.
Watkins, R. (2012). Overcoming Five Obstacles to a Successful Needs Assessment. American Evaluation Association 365 Blog.
Watkins, R. (2012). Five Must Read Articles on Needs Assessment. American Evaluation Association 365 Blog.
Watkins, R. (2007). The Systematic Design of Performance Improvement Systems. PerformanceXpress.
Watkins, R. and Corry, M. (2004). E-learning: It’s Not Just for Distance Education Students Anymore. E-Source, 1(6).
Watkins, R. (2007). Ends and Means: If E-learning is the Solution, What is the Problem? Distance Learning Magazine, 4(5)
Watkins, R. (2007). Ends and Means: Is Google making us dumber? Distance Learning Magazine, 4(3)
Watkins, R. (2007). Ends and Means: Where are we going and why? Distance Learning Magazine, 4(2)
Watkins, R. (2007). Ends and Means: Research on Distance Education. Distance Learning Magazine, 4(1)
Watkins, R. (2006). Ends and Means: Twenty Essential Questions for Deciding if Your Organization is Ready for E-learning. Distance Learning Magazine, 3(4).
Watkins, R. (2006). Ends and Means: Proactive planning for success. Distance Learning Magazine, 3(2).
Watkins, R. (2006). Ends and Means: The value of technology tools in team projects. Distance Learning Magazine, 3(1).
Watkins, R. (2005). Ends and Means: Distance education’s role in university disaster planning. Distance Learning Magazine, 2(6).
Watkins, R. (2005). Ends and Means: Turning common conversations into consulting contracts. Distance Learning Magazine, 2(5).
Watkins, R. (2005). Ends and Means: Comprehensive assessments. Distance Learning Magazine, 2(4).
Watkins, R. (2005). Ends and Means: Marketing our success. Distance Learning Magazine, 2(3).
Watkins, R. (2005). Ends and Means: The role of e-learning in corporate universities. Distance Learning Magazine, 2(2).
Watkins, R. (2005). Ends and Means: Developing e-learning activities. Distance Learning Magazine, 2(1).
Watkins, R. (2004). Ends and Means: Building skills for e-learning success. Distance Learning Magazine, 1(6).
Watkins, R. (2004). Ends and Means: Aligning e-learning with strategic plans. Distance Learning Magazine, 1(5).
Watkins, R. (2004). Ends and Means: What’s important? Distance Learning Magazine, 1(4).
Watkins, R. (2004). Ends and Means: E-learning study skills and strategies. Distance Learning Magazine, 1(3) 24-26.
Watkins, R. (2004). Ends and Means: Defining success. Distance Learning Magazine, 1(2), 85-86.
Watkins, R. (2004). Ends and Means: Performance and performing. Distance Learning Magazine, 1(1), 42-44.
Articles, Chapters, and Books in Preparation
Watkins, R. (in preparation). Needs Assessment: A Framework for Research and Theory.
Scholarly Presentations and Workshops
Refereed Scholarly Presentations and Workshops
Faruque, F., Watkins, R., Medsker, L. (2021). Competency Model Approach to AI Literacy: Research-based Path from Initial Framework to Model. AI4EDU at IJCAI2021
Faruque, F., Watkins, R., Medsker, L. (2020). Monitoring Trust in Human-Machine Interactions for Public Sector Applications. AAAI 2020 Fall Symposium
Faruqe, F, Watkins, R., Medsker, L. (2020). Monitoring Trust in Human-Machine Interactions for Public Sector Applications. AAAI Fall Symposium.
West Meiers, M., Watkins, R., and Guerra-Lopez, I. (Nov. 2017). Quick and not so dirty needs assessment. Washington DC: Annual Conference of the American Evaluation Association.
Watkins, R. (2017). Collaborative Technologies: Facilitating How we Conduct Research Together. Clearwater, FL: Science of Team Science Conference.
Watkins, R., and West Meiers, M. , Okada, S., Wessal, A. (2013). Evaluation Capacity Building – Practical Tools for Moving Beyond Training. Washington DC: Annual Conference of the American Evaluation Association.
Watkins, R., Altschuld, J., Hung, S. and West Meiers, M. (2013). Challenges and Opportunities for Needs Assessment and Program Planning in the 21st Century. Washington DC: Annual Conference of the American Evaluation Association.
Watkins, R., and West Meiers, M. (2013). Needs Assessment Tools to Guide Decision-making: Multicriteria Analysis and Pair-wise Comparison. Washington DC: Annual Conference of the American Evaluation Association.
Watkins, R. (2012). Rapid Review of the Research from 2011. Toronto: Annual conference of the International Society for Performance Improvement.Watkins, R. and West Meiers, M. (2011). Using Needs Assessments to Improve Front-end Decisions. Anaheim, CA: Annual Conference of the American Evaluation Association.
Watkins, R. (2011). Research You May Have Missed. Orlando: Annual conference of the International Society for Performance Improvement.
Watkins, R. (2010). Don’t Waste Your Time: Selecting and implementing performance systems. San Francisco: Annual conference of the International Society for Performance Improvement.
Watkins, R. (2009). Best of 2008: Research findings you may have missed. Orlando: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Leigh, D. (2008). Performance By Design. New York: Annual conference of the International Society for Performance Improvement.
West Meiers, M., Behrens, J., and Watkins, R. (Nov. 2007). Mainstreaming and Supporting Needs Assessment in a Large Organization. Baltimore, MD: Annual conference of the American Evaluation Association.
Watkins, R. and Leigh, D. (2007). Performance By Design. San Francisco, Ca: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Leigh, D. (2007). Snake oil or results: Research round tables. San Francisco, Ca: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Leigh, D. (2007). 5th Annual Research Exchange. San Francisco, Ca:Annual conference of the International Society for Performance Improvement.
Watkins, R. and Guerra, I. (2006). Snake oil or results: Research round tables. Dallas, Tx.: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Guerra, I. (2006). 4th Annual Research Exchange. Dallas, Tx.: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Livingston, D. (2005). Managing LMS Implementation. Washington DC: Interactive Technologies Conference of the Society for Applied Learning Technology (SALT).
Watkins, R. (2005). e-Learning Success: Validating a Self-Assessment of Learner Readiness for Online Training. Orlando, Fl.: Annual conference of the American Society for Training and Development.
Watkins, R. and Guerra, I. (2005). Snake oil or results: Research round tables. Vancouver, Canada: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Guerra, I. (2005). Research Exchange. Vancouver, Canada: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Corry, M. (2004). E-learning: It is not just for distance education students anymore. Washington DC: AACE E-learning Conference.
Watkins, R. and Corry, M. (2004). Online Survival: Success strategies for students and instructors. Addison, TX: First Year Experience.
Watkins, R. (April, 2003). Research Exchange: Validation of an Instrument to Measure the Preparedness of Students for Online Courses. Boston, MA: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Guerra, I. (2002). Needs Assessment: A tool for evaluators. Washington DC: Annual Conference of the American Evaluation Association.
Watkins, R. (2002). Needs Assessment (panelist). Washington DC: Annual Conference of the American Evaluation Association.
Watkins, R. (2002). Achieving Useful Educational Results. Washington, DC: George Washington University’s New Directions XXVII Conference.
Watkins, R. and Leigh D. (2002). Essential Perspectives on E-learning. Dallas, Texas: Annual conference of the International Society for Performance Improvement.
Kaufman, R., Watkins, R., and Leigh, D. (April, 2001). Needs Assessment: Defining and Achieving Useful Results (2-day Workshop). San Francisco, CA: Annual conference of the International Society for Performance Improvement.
Watkins, R., Leigh, D. and Kaufman, R. (April, 2001). ISPI of the Future: Snake Oil, Happiness Factor or Science? (Encore presentation). San Francisco, CA: Annual conference of the International Society for Performance Improvement.
Watkins, R. (November, 2000). Perspectives on Distance Education. Caracas, Venezuela: Annual Conference of The Inter-American Distance Education Consortium – CREAD
Watkins, R., Leigh, D. and Kaufman, R. (March, 2000). ISPI of the Future: Snake Oil, Happiness Factor or Science?. Cincinnati, Ohio: Annual conference of the International Society for Performance Improvement.
Watkins, R., Leigh, D. and Jones, M. (March, 2000).A Management Guide for Needs Assessment Projects . Cincinnati, Ohio: Annual conference of the International Society for Performance Improvement.
Watkins, R. (June, 1999). If Distance Education is the Solution, What is the Problem? Fort Lauderdale, Fl: Building Bridges Through Educational Technology and Distance Education.
Watkins, R., Leigh, D., and Kaufman, R. (March, 1999). Choosing the Right Needs Assessment Model. Cincinnati, Ohio: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Leigh, D. (March, 1998). PT in the Community: A Needs and Assets Assessment of Human Services. Long Beach, CA: Annual conference of the International Society for Performance Improvement.
Kaufman, R. and Watkins, R. (March, 1998). Needs Assessment: Defining and Achieving Useful Results (1-day Workshop). Long Beach, CA: Annual conference of the International Society for Performance Improvement.
Watkins, R. and Leigh, D. (February, 1998). Needs Assessment versus Evaluation: If evaluation is the answer what is the problem?. Tallahassee, Fl: Southeast Evaluation Association.
Kaufman, R. and Watkins, R. (April, 1997). Needs Assessment: Defining and Achieving Useful Results (2-day Workshop). Anaheim, CA: Annual conference of the International Society for Performance Improvement.
Invited Presentations and Workshops
Watkins, R. (2024). Capital AI: Innovating for a Smarter DC. Washington DC: Washington DC Chamber of Commerce.
Watkins, R. (2024). AI and Ethics. Washington DC: Association of American Universities (AAU) Public Affairs Network conference.
Watkins, R. (2023). From Blank Pages to AI-Infused Brilliance: Crafting Future-Ready Writers. Bedford’s WPA/Writing Director Workshop. NYC.Watkins, R. (2023). Let’s ChatGPT: AI in Educations. Southwestern College.
Watkins, R. (2023). AI in the Classroom: Let’s ChatGPT About It. San Diego Miramar College and San Diego County Community Colleges
Watkins, R. (2023). AI in Education. University of Santo Tomas (Philippines).
Watkins, R. (2021). Learning Analytics, Equity, and Social Change Panel. Learning Analytics Learning Network, DC.
Watkins, R. (Aug. 2019). Are We Ready For A Life Interdisciplinary. Work in the Age of Intelligent Machines conference. NY, NY.
Watkins, R. (Jan. 2019). Tools for Sharing Your Science. Southern California Clinical and Translational Science Institute (@ USC).
Watkins, R. (Jan., July 2013; July 2014; July 2015; Feb., July, 2016; March, July, Sept. 2017; Jan. 2018 in Bosnia; Feb. , July, 2018; March, 2019). Needs Assessments: Getting the Results You Really Want. The Evaluator’s Institute.
Watkins, R. (Feb. 2019). Growing Interdisciplinary. Roadmapping Engaged Science Education (NSF funded workshop hosted at GWU)
Rist, R, and Morra, L., & Watkins, R. (July 2018). Monitoring and Evaluation: Core Course. International Program for Development Evaluation Training (IPDET). Bern, Switzerland
Watkins, R. (Nov. 2018). Creating Tools for Interdisciplinary. NAFSA: Association of International Educators.
Watkins, R. (April 2016). What are Needs? A Master’s Series Session. International Society for Performance Improvement, Philadelphia, PA.
Watkins, R. (March 2016). Needs Assessment, Learning Design, and Evaluation of Learning. Ministry of Finance, Beijing, China.Watkins, R. (Nov. 2015, Oct. 2016). Monitoring and Evaluation: Core Course. Shanghai International Program for Development Evaluation Training (SHIPDET). Shanghai, China.
Watkins, R. (June 2015). Need Now: Basic Human Needs in the 21st Century. Edinburgh, UK: Just World Institute at the University of Edinburgh.
Watkins, R. (March 2015). Panel: Networked Education Meets Intellectual Property: Friends or Friction? Washington DC: GSEHD and GWU Law School.
Watkins, R. (March 2015). Linking Projects to the Twin Goals of the Institution. Washington DC: World Bank Group.
Watkins, R. and Okada, S. (May 2014). Monitoring Capacity Building in International Development. Washington DC: USAID.
Watkins, R. (multiple times per year 2012 – 2016). The Art of Knowledge Exchange. Washington DC: World Bank Group.
Watkins, R. (April 2014). Connecting with People: Publishing Cross-Disciplinary Research. Washington DC: GWU Research Days.
Watkins, R. (May 2013). Managing Your Needs Assessment. Washington DC: GoodWill Industries.
Watkins, R. (May 2013). Connecting People. Washington DC: Wiley Publishing Association Conference.
Watkins, R. (May 2013). Managing Your Needs Assessment. Washington DC: Goodwill Industries Conference.Watkins, R. (May 2013). Connecting People. Washington DC: Wiley Publications Association CEO Conference.
Watkins, R. (Sept. 2012). The Very Latest Research to Improve HPT Practice. Detroit, MI: Michigan Chapter of ISPI.Watkins, R. (Sept. 2012). E-learning Study Skills Webinar. George Washington University.
Watkins, R. (March, 2011). Applying Research To Improve Results: Research You May Have Missed. Washington DC: World Bank Group (Africa Region)
Watkins, R. (June 2010). E-learning Study Skills: Capital-izing on Technology to Improve College Survival. Washington DC: Cengage Student Success Conference.
Watkins, R. (June 2010). Student Success = Our Success. Monroe, LA: Career Technical College.
Watkins, R. (May 2010). Capacity Assessment Tools and Techniques. Vientiane, Laos: Lao Ministry of Education and the World Bank.
Watkins, R. (Oct. 2009). E-learning Study Skills: Caffeine for a tired student success course. Chicago: Cengage Student Success Conference.
Watkins, R. (Sept. 2009). Best of 2008: Research findings you may have missed. Williamsburg, VA: U.S. Coast Guard’s Human Performance Technology Conference.
Watkins, R. (June, 2009). Needs Assessment and Training Evaluation. Shanghai and Chongqing, China: Chinese Ministry of Finance and the World Bank.
Watkins, R. (April 2009). E-learning Study Skills: Keeping yourself and your students ahead of the curve. Cengage Webinar.
Watkins, R. (Sept. 2007). Performance By Design. Tampa, FL: Tampa Bay Chapter of the International Society for Performance Improvement.
Watkins, R. (Aug. 2007). Success Strategies for Online Instructors. Washington DC: George Washington University’s Summer Intensive Workshop Institute.
Watkins, R. (Jan. 2007). Learning to e-Learn: Preparing e-learners for success. E-learning Guild ‘s Online Forums on Strategies and Techniques for Engaging and Retaining the e-Learner. (Watch and listen to the recorded presentation here)
Watkins, R. (Aug. 2006). Success Strategies for Students. Washington, DC: George Washington University’s Tourism Administration Orientation.
Watkins, R. (Aug. 2006). Success Strategies for Online Instructors. Washington DC: George Washington University’s Summer Intensive Workshop Institute.
Watkins, R. (May 2006). Success Strategies for Students. Washington, DC: George Washington University’s Tourism Administration Orientation.
Watkins, R. (Oct. 2005). Workshop on Instructional Design for Blended e-Learning. Washington DC: George Washington University’s School of Business.
Watkins, R. (Aug. 2005). Faculty Essentials: Teaching essentials. Washington DC: George Washington University’s Summer Intensive Workshop Institute.
Watkins, R. and Corry, M. (April 2005). Tips for Online Survival. Washington DC: George Washington University Undergraduate Seminars.
Watkins, R. and Corry, M. (Feb. 2005). Tips for Online Survival. Washington DC: George Washington University Undergraduate Seminars.
Watkins, R. (Nov. 2004). Online Survival: Strategies for students and instructors. Washington DC: Distance Learning Coalition.
Watkins, R. (Sept. 2004). Success Strategies for Online Instructors. Washington DC: George Washington University’s Summer Distance Learning Initiative.
Watkins, R. (June 2004). Online Survival: Strategies for students and instructors. Orlando, Fl: Annual of Student Success Conference sponsored by Houghton Mifflin Company.
Watkins, R. (March 2004). Success Strategies for Students. Washington, DC: George Washington University’s Tourism Administration Orientation.
Watkins, R. (March 2004). Teaching with technology: Opportunities, options, obstacles, and outlooks. Ft. Lauderdale, Fl: Monster.com and Nova Southeastern University’s Career Expo.
Watkins, R. (March, 2004). Online Student Success. Washington DC: George Washington University’s Educational Symposium for Research and Innovations.
Watkins, R. (February, 2004). Online Survival: Strategies for instructors. Dallas, TX:University of Texas workshop.
Watkins, R. (October, 2003). Online Survival: Strategies for students and instructors. San Antonio, TX: Annual of Student Success Conference sponsored by Houghton Mifflin Company.
Watkins, R. (September, 2003). Online Student Success. Washington DC: George Washington University’s Teaching with Technology Series.
Watkins, R. and Corry, M. (July, 2003). Student Success in Online Activities and Assignments. Chicago, IL: Annual of Student Success Conference sponsored by Houghton Mifflin Company.
Watkins, R. (May, 2003). Preparing Students for Online Success. Washington DC: George Washington University School of Medicine and Health Sciences professional development workshop.
Watkins, R. (February, 2003). Moving Past Time as the Criteria in the Accreditation of Distance Education. Salt Lake City, Utah: The Oquirrh Institute‘s Center for Competency-Measured Education.
Watkins, R. (May, 2002). Distance Education in Higher Education (invited symposium panelist). Washington, DC: Consortium of Universities of the Washington Metropolitan Area.
Watkins, R. (July, 2000). Workforce Development and Distance Education. Pierre, South Dakota: Invited by Governor Janklow to present at 2000 Digital Dakota Network conclave.
Watkins, R. (December, 1997). Cost-Consequences Analysis. Tallahassee, Fl: Return-On-Investment Conference hosted by Florida State University and Florida TaxWatch.
Watkins, R. (October, 1996). Needs Assessment. Dayton Beach, FL: Florida Department of Corrections: Human Resources Development Conference.
Funded Research Grants
The Design Decisions that Make LLM Development Projects Open, Secure, and Trustworthy. Co-PI with Amir Jafari, Zoe Szajnfarber, David Lippert. Funded by the National Science Foundation and National Institute of Standards and Technology for 2024 – 2025 (competitive sub-award #2229885)
Co-Design of Trustworthy AI and Future Work Systems. Co-Investigator Internal Evaluator. Funded by the National Science Foundation for 2021 – 2026 (Award #2125677)
Security and Privacy Implications of Remote Proctoring for School Policies and Practices. Co-PI with Adam Aviv and Micah Sherr. Funded by the National Science Foundation for 2022 – 2024 (Award #2138654)A Digital Nudge: Assessing the Impact of an Immutable Records Data Management Platform on Student Researcher Ethics. Co-PI with Ekundayo Shittu, Chung Hyuk Park, Payman Dehghanian, and Hiromi Sanders. Funded by the National Science Foundation for 2022 – 2024 (Award #2124866)
GW Coders. Co-PI with John Helveston. Funded by the New America and Ford Foundations through the Public Interest Technology University Consortium for 2021-2022.
The Code Maker: Computational Thinking for Engineers with Interactive, Contextual Learning. Co-PI with Lorena Barba and Adam Wickenheiser. Funded by the National Science Foundation for 2017 – 2021. (Award #1730170)
Transformative Research in Urban Sustainability Training. Co-Investigator external evaluator. Funded by the National Science Foundation 2017 – 2022 with Donna Kashian at Wayne State University as PI. (Award #1735038)
Event Based Surveillance Curriculum Development and Training. Co-PI with Dr. Katz as Principal Investigator. Funded by the Skoll Foundation for 2015 & 2016.Performance Monitoring and Evaluation of the Health Information Technology (HIT) University Training Grant. Co-PI with Dr. Burke as Principal Investigator. Funded by the American Recovery and Reinvestment Act (ARRA) for 2010 – 2013.
Leading Innovation through Technology E-Assessment (LITE): The GSEHD Pilot Assessment of Technology and Information Literacy Integration Research Project. Co-PI with Drs. Milman, Molasso, and Corry. Funded by the Department of Educational Research, GSEHD for 2010.
Visiting Scholar (IPA) grant with the National Science Foundation. 2005-2006.
E-learning Orientation: Preparing distance learning students at GSEHD for success. PI. Funded by the Graduate School of Education and Human Services for 2004.
Validation of an Instrument to Measure the Preparedness of Students for Online Courses. PI. Funded by the International Society for Performance Improvement for 2002-2003.
Honors, Awards, and Media Appearances
AI and Education (2024): EdFix Podcast
AI and Education (2023): Good Morning America, WTOP Radio, WUSA News, Fox5
Distinguished Service Award, International Society for Performance Improvement (2014).2011 Award of Excellence for the Handbook of Improving Performance in the Workplace, International Society for Performance Improvement (2011).
Leadership Award, International Society for Performance Improvement (2007).
Service Award, International Society for Performance Improvement (2004).
Ruby Diamond Professor of Instructional Development and Technology Award for Excellent Performance in the Instructional Systems Design Doctorate Program from the Department of Educational Research at Florida State University.
E-learning Readiness (2004): NPR’s Kojo Nnamdi Show,
http://www.wamu.org/ram/2004/k1040921.ram; WUSA News; interviewed on ABC and CNN Financial.
Professional Affiliations
Partnerships (past and present)
The Evaluator’s Institute (TEI)
Advisory Boards/Councils (present to past)
Horowitz Foundation for Social Policy: Board of Trustees (2024 – present)
iOpening Enterprises: Advisory Board (2021 – present)
Sage Publishing and E-learning: Data Science for Social Scientists
International Society for Performance Improvement: Board of Directors (2017 – 2019)
Institute for Needs Assessment and Evaluation
Center for the Advancement of Research in Distance Education
Northwestern University’s Forum for People Performance, Management, and Measurement – Human Performance Think Tank
Excelsior College‘s Business Faculty Advisory Committee for the School of Business and Technology
Digital Dakota Network
American Association for Higher Education
Grant Reviewer (past and present)
Social Sciences and Humanities Research Council of Canada
Memberships (present to past)
International Society for Performance Improvement (ISPI) – Member for life
Association for the Advancement of Artificial Intelligence
American Evaluation Association
Association for the Advancement of Computing in Education
United States Distance Learning Association
The Inter-American Distance Education Consortium (CREAD)
American Society for Training and Development (ASTD)
Southeast Evaluation Association
Consulting Clients (past and present)
Cherie Blair Foundation for Women
Including workshops and projects for the World Bank Institute Capacity for Results (WBICR, formerly the WBIEG), Independent Evaluation Group (IEG), World Bank Institute Knowledge Exchange (WBIKE), the Africa Region Learning (AFRLN), the Latin-American Countries Development Effectiveness (LCSDE), Learning, Leadership, Innovation (LLI), Poverty Reduction and Economic Management (LCSPE, LCSPP), the Human Resource Services Leadership Board (HRSLB), Human Resource Analytics, WBG e-Institute, Finance and Private Sector Development (FPD), World Bank Institute Growth and Competitiveness Practice (WBIGC), Agriculture and Rural Development Sector (ARD), and the World Bank Institute Global Multimedia (WBIGM). Missions include China, Laos, Tunisia, Mexico, and Kenya.
Inter-American Development Bank
Pro-bono work for the UNDP Evaluation Office.
CACI, Inc.Electronic Classroom of Tomorrow (ECOT)
Workforce Development OCSEA/AFSCME
McGraw-Hill Lifetime Learning, London
U.S. Veteran’s Benefits Administration
Professional Service
Service to the University
George Washington University’s Alternative Credentials Task Force (2023 – present)
George Washington University’s GW Coders, co-founder (2020 – present)
George Washington University’s Research Showcase, judge (2022)
George Washington University’s Python Peer-Instructors program (2019)
George Washington University’s Big Data, High Performance Computing, and IT Support Committee (2019 – 2020)
George Washington University’s Dispute Resolution Committee (2018 – 2020)
George Washington University’s Faculty Senator (2016 – 2018)
George Washington University’s Board of Trustees Working Group on School Rules and Procedures as Per the Faculty Code (2014 – 2015)
George Washington University’s Collaborative Science Network (2013 – present)
George Washington University’s Professional Ethics and Academic Freedom (2006 – 2013)
George Washington University’s Center for Innovative Teaching and Learning Faculty Advisory Group (2007 – 2010)
Service to the Graduate School
George Washington University’s Graduate School of Education and Human Development’s Re-Imagining the Masters Task Force (2023 – present)
George Washington University’s Graduate School of Education and Human Development’s PhD Oversight Committee (2017 – present, Chair 2024)
George Washington University’s Graduate School of Education and Human Development’s School-wide Personnel Committee (2017 – present, Chair 2020 -present)
George Washington University’s Graduate School of Education and Human Development’s Vision 2020 Finance Committee (2013 – 2014)
George Washington University’s Graduate School of Education and Human Development’s Ph.D. Advisory Committee (2012 – 2014)
George Washington University’s Graduate School of Education and Human Development’s Restructuring Committee (2008 – 2009)
George Washington University’s Graduate School of Education and Human Development’s Action Planning Task Force (2007 – 2008)
George Washington University’s Graduate School of Education and Human Development’s Technology Advisory Committee (2006)
George Washington University’s Graduate School of Education and Human Development’s Doctoral Studies Committee (2004 – 2007)
George Washington University’s Graduate School of Education and Human Development’s Constitution and Bylaws Committee (2004 – 2008)
George Washington University’s Graduate School of Education and Human Development’s Advisory Committee on Admissions and Student Services (2002 – 2004; Committee Chair)
Service to the Department
George Washington University’s Department of Educational Leadership’s Personnel Committee (2014 – present)
George Washington University’s Department of Educational Leadership’s Academic Program Review Committee (2013)
George Washington University’s Program in Higher Education Administration New Faculty Search Committee (2007)
George Washington University’s Department of Educational Leadership’s Ad Hoc Committee on Promotion for Non-Tenure Accruing Faculty (2006 – 2007)George Washington University’s Department of Educational Leadership’s Ad Hoc Committee on Professional Development (2004 – 2008; Committee Chair)
George Washington University’s Department of Educational Leadership’s Constitution and Bylaws Committee (2004 – 2008; Committee Chair)
George Washington University’s Department of Educational Leadership’s Ad Hoc Committee on Peer Teaching Evaluations (2003 – 2004; Committee Chair)
George Washington University’s Department of Educational Leadership’s Executive Committee (2002 – 2006)
Service to previous institutions
Nova Southeastern University’s Online Learning Task Force (2000)
Nova Southeastern University’s Fischler Graduate School of Education and Human Services’ Faculty Peer Evaluation Committee (2000)
Nova Southeastern University’s Fischler Graduate School of Education and Human Services’ Research Center Steering Committee (1999)
Florida State University’s Learning Systems Institute’s Research Group (Chair – 1998)
Florida State University’s Learning Systems Institute’s Technology Committee (1998)
Florida State University’s Department of Educational Research’s Faculty Search Committee (1997)
Florida State University’s College of Education’s Strategic Visioning Committee (1997)
Service to Associations
America Evaluation Association: Needs Assessment Topical Interest Group Deputy Chair (2013 – 2016)
America Evaluation Association: Needs Assessment Topical Interest Group Webpage Developer (2012 – 2019)
American Evaluation Association: Reviewer for Annual Conference Presentations in the Needs Assessment Topic Interest Group (2001; 2002)
International Society for Performance Improvement: Board of Directors (2017 – 2019)
International Society for Performance Improvement: Roger Kaufman Societal Contributions Award Committee (2013 – present; Chair 2013)
International Society for Performance Improvement: Thomas Gilbert Lifetime Achieve Award Committee (2012 – present; Chair 2013)
International Society for Performance Improvement: Honorary Life Member Award Committee (2011 – 2012)
International Society for Performance Improvement: Development Aid Effectiveness Committee (2010 – 2011)
International Society for Performance Improvement: Research Committee (2003 – 2011; 2014 – present)
International Society for Performance Improvement: Science and Research Professional Community (2005 – 2008, Chair 2007)
International Society for Performance Improvement: Reviewer for Annual Conference Presentations (1999; 2003; 2006)
International Society for Performance Improvement: Member for Life Committee (2001)
American Association for Higher Education: Alternatives to Student Credit Hours Task Force (2004)
The Oquirrh Institute‘s Center for Competency-Measured Education: Advisory Board Member (2003 – Present)
U.S. Department of Education Office of Educational Research and Improvement – Small Business Innovation Research (SBIR) Program: Research Grant Review Board
Digital Dakota Network’s: Advisory Board (2000)
The Inter-American Distance Education Consortium (CREAD), Vice Present for the United States (2000)
Prevention Policy Board for the Leon County Juvenile Justice Council, Chair (1998)
Citizen’s Study Group on Human Services volunteer member (1997)
Editorial Contributions
Journal of Engineering Education (2024/2025, Special Issue editor)
AI & Ethics: Editorial Board (2022 – Present)
Ethics and Information Technology: Editorial Board (2024 – Present)
Quarterly Review of Distance Education: Editorial Board (1999 – Present)
Telematics and Informatics: Editorial Board (2023)
Distance Learning Magazine: Guest Editor of a Special Issue with N. Milman (2015)
New Directions in Evaluation: Guest Editor of a Special Issue on Needs Assessment with J.W. Altschuld (2014; PDF available here)
Performance Improvement Quarterly: Editorial Board (2006 – 2020)
Human Resources and Development Quarterly: Editorial Board (1999 – 2020)
Distance Learning Magazine: Column Editor (2004 – 2007)
Guest Editor for a Special Issue of the Quarterly Review of Distance Education (2003) on Instructional Design in Distance Education
Manuscripts Reviewed
Reviewer for Altshuldt, J. (2009). Needs Assessment Toolkit: Phase Three. San Francisco: Sage.
Reviewer for Carliner, S. (2006). e-Learning: Lessons Learned, Challenges Ahead. San Francisco: Jossey-Bass/Pfeiffer.
Reviewer for Katherine, C., & Debby, K. (2004). Real World Instructional Design. New York: Wadsworth.Reviewer for Gupta, K. (1998). A Practical Guide to Needs Assessment. San Diego, CA: Jossey-Bass/Pfeiffer.
Revised 11-24