Current LLM evaluations do not sufficiently measure all we need

Current LLM evaluations do not sufficiently measure all we need

Written By: Tristan Koh Ly Wey Research Assistant, AI Singapore Evaluating Large Language Models (LLMs) presents a complex challenge. Although evaluations provide metrics that seem to objectively measure LLM performance, these figures often do not always effectively capture their nuanced behaviours in real-world applications. Therefore, evaluations, while useful, are not absolute and require careful interpretation….

What are we even talking about?

What are we even talking about?

Written By: Eric J W Orlowski Research Fellow, AI Singapore Jargon matters;  it is time to re-think how we talk about AI. Someone once said that “one ought to call things by their right names” – though that might be easier said than done. After all, German philosopher Ludwig Wittgenstein’s “language-game” famously argued that the…

Saving artificial intelligence from humanity

Saving artificial intelligence from humanity

(Original article is featured here: https://www.straitstimes.com/singapore/saving-artificial-intelligence-from-humanity– Straits Times, 25 March 2024) Written By: Professor Simon ChestermanDavid Marshall Professor and Vice Provost (Educational Innovation), National University of SingaporeDean of NUS CollegeSenior Director of AI Governance, AI Singapore AI is poised to disrupt almost every aspect of the economy – and, perhaps, our politics. How can we…

You think AI will render coding redundant? Not so fast

You think AI will render coding redundant? Not so fast

(Original article is featured here: https://www.straitstimes.com/opinion/you-think-ai-will-render-coding-redundant-not-so-fast (Straits Times, 19 March 2024) Written By: Professor Hahn JungpilVice Dean, CommunicationsDirector, NUS Fintech LabDeputy Director (AI Governance), AI SingaporeDeputy Director, Centre for Technology, Robotics, Artificial Intelligence & the Law In an era where artificial intelligence (AI) is no longer a specialized topic of academic interest but has now…

Good models borrow, great models steal: intellectual property rights and generative AI 

Good models borrow, great models steal: intellectual property rights and generative AI 

Written By: Professor Simon ChestermanDavid Marshall Professor and Vice Provost (Educational Innovation), National University of SingaporeDean of NUS CollegeSenior Director of AI Governance, AI Singapore Two critical policy questions will determine the impact of generative artificial intelligence (AI) on the knowledge economy and the creative sector. The first concerns how we think about the training…

Image by Margarita Yudina

Truth Decay

Written By: Professor Simon ChestermanDavid Marshall Professor and Vice Provost (Educational Innovation), National University of SingaporeDean of NUS CollegeSenior Director of AI Governance, AI Singapore Though Donald Trump would like credit for coining the term, “fake news” was a headline in the New York Times more than a century ago. The history of propaganda is far older. An early…

Commentary: We must become better writers in an age of ChatGPT

Commentary: We must become better writers in an age of ChatGPT

Written By: Professor Edson C. Tandoc JrWee Kim Wee School of Communication and InformationNanyang Technological University (NTU) Using generative AI tools to string sentences together, whether for school or work, would be silencing your own voice, says Edson C Tandoc Jr of NTU Wee Kim Wee School of Communication and Information. SINGAPORE: Last semester, I…

Trustworthiness of AI for autonomous vehicles: What the public would look for

Trustworthiness of AI for autonomous vehicles: What the public would look for

Written By: Professor Shirley S. HoAssociate Vice PresidentHumanities, Social Sciences & Research CommunicationNanyang Technological University (NTU) Dr. Goh Tong JeeResearch FellowWee Kim Wee School of Communication and InformationNanyang Technological University (NTU) Media features of enhanced capabilities of artificial intelligence (AI) for autonomous vehicles (AVs) are interspersed with reports on crashes involving the mobility technology. Such…