Skip to content
AI Singapore
  • Home
  • AI TALENT DEVELOPMENT
  • AI4E
  • HOMEExpand
    • International Outreach
    • Careers
    • Internships
    • The Team
    • International Advisory Panel (IAP)
  • RESEARCHExpand
    • AI Research Grant Calls
    • AISG Research-Governance Joint Call
    • AI Research Grant Call Awardees
    • AISG PhD Fellowship Programme
    • AI Accelerated Masters Programme
    • AI Researcher Articles
  • GOVERNANCEExpand
    • AI Governance Research Grant Call
    • AISG Research-Governance Joint Call
    • AI Governance Research Grant Call Awardees
    • AI Ethics & Governance Course
    • Updates
    • Roundtables
    • Resources
  • TECHNOLOGYExpand
    • Grand Challenges
    • Prize Challenges
    • Technology Challenges
    • International Grant Calls
    • Ideation Challenges
    • Artificial Intelligence Centre for Educational Technologies (AICET)
  • INNOVATIONExpand
    • 100 Experiments
    • AI Apprenticeship Programme (AIAP)®
    • AI Readiness Index (AIRI)
    • AI Advisory
    • Platforms Engineering
    • AI Standards
    • AIAP foundation
    • AIxTech
    • LLM Application Developer Programme (LADP)
    • AI Internship Programme (AIIP)
  • PRODUCTSExpand
    • SEA-LION
    • Project SEALD
    • AI BricksExpand
      • CV Hub
      • NLP Hub
      • TagUI
      • StorywrAIter
      • Speech Lab
    • DSO-AISG Incentive Award
  • TALENT DEVELOPMENTExpand
    • National Olympiad in AI
    • International Olympiad in AI 2027
    • AI Student Developer Conference
    • National AI Student Challenge
    • AI for Good
    • LearnAI
    • NAISC 2026
    • AISDC 2026
  • TECH OFFERS
  • FAQs
  • CONTACT US

I am a:

  • IHL/ResearcherExpand
    • AI Governance Research Grant Call
    • AI Governance Postdoctoral Fellows
    • AI Research Grant Calls
    • AISG PhD Fellowship Programme
    • Grand Challenges
    • Ideation Challenges
    • Prize Challenges
    • Technology Challenges
    • 100Experiments
  • StudentExpand
    • AI Apprenticeship Programme (AIAP)®
    • AI TALENT DEVELOPMENT
  • ProfessionalExpand
    • AI TALENT DEVELOPMENT
    • AI Apprenticeship Programme (AIAP)®
    • AI Readiness Index (AIRI)
    • AI Standards
  • Startup/Enterprise/GovtExpand
    • AI Readiness Index (AIRI)
    • 100Experiments
    • AI Apprenticeship Programme (AIAP)®
    • AI Advisory
    • Technology Offers
    • The ConnectAI
    • AI TALENT DEVELOPMENT
    • CV Hub
    • NLP Hub
    • Speech Lab
    • Synergos
    • AI Standards
Search
AI Singapore
AI Community | AI Innovation

10 Gradient Descent Optimisation Algorithms + Cheat Sheet

Byliyi_ang June 19, 2019May 27, 2025

Read the full article at Towards Data Science here.

Post navigation

Previous Previous
How I improved a Human Action Classifier to 80% Validation Accuracy in 6 Easy Steps
NextContinue
AIAP™ Batch 1 has graduated!

Mailing list

Get the latest AI Singapore news, programme updates and offers directly into your INBOX.

Sign Up

To anchor deep national capabilities in Artificial Intelligence, thereby creating social and economic impacts, grow local talent, build an AI ecosystem and put Singapore on the world map.

Join our mailing list to get the latest AI Singapore news and updates in your inbox!

Sign Up
Linkedin YouTube Facebook Facebook Group Instagram Medium Twitter Reddit Github
  • Privacy Policy
  • Legal
  • Terms of Use

© 2026 AI Singapore. All Rights Reserved.

AI Singapore is a national programme supported by the National Research Foundation, Singapore, and hosted by the National University of Singapore (Company Registration No. 200604346E) and Nanyang Technological University (Company Registration No. 200604393R)

Mailing List Sign Up

Get the latest AI Singapore news, programme updates and offers directly into your INBOX.

Subscription Form
By submitting this form, you agree to receive updates and news about AI Singapore via email. You can unsubscribe whenever you want.
Cleantalk Pixel
  • HOME
    • International Outreach
    • Careers
    • Internships
    • The Team
    • International Advisory Panel (IAP)
  • RESEARCH
    • AI Research Grant Calls
    • AISG Research-Governance Joint Call
    • AI Research Grant Call Awardees
    • AISG PhD Fellowship Programme
    • AI Accelerated Masters Programme
    • AI Researcher Articles
  • GOVERNANCE
    • AI Governance Research Grant Call
    • AISG Research-Governance Joint Call
    • AI Governance Research Grant Call Awardees
    • AI Ethics & Governance Course
    • Updates
    • Roundtables
    • Resources
  • TECHNOLOGY
    • Grand Challenges
    • Prize Challenges
    • Technology Challenges
    • International Grant Calls
    • Ideation Challenges
    • Artificial Intelligence Centre for Educational Technologies (AICET)
  • INNOVATION
    • 100 Experiments
    • AI Apprenticeship Programme (AIAP)®
    • AI Readiness Index (AIRI)
    • AI Advisory
    • Platforms Engineering
    • AI Standards
    • AIAP foundation
    • AIxTech
    • LLM Application Developer Programme (LADP)
    • AI Internship Programme (AIIP)
  • PRODUCTS
    • SEA-LION
    • Project SEALD
    • AI Bricks
      • CV Hub
      • NLP Hub
      • TagUI
      • StorywrAIter
      • Speech Lab
    • DSO-AISG Incentive Award
  • TALENT DEVELOPMENT
    • National Olympiad in AI
    • International Olympiad in AI 2027
    • AI Student Developer Conference
    • National AI Student Challenge
    • AI for Good
    • LearnAI
    • NAISC 2026
    • AISDC 2026
  • TECH OFFERS
  • FAQs
  • CONTACT US