Introducing the Sophia optimizer, a faster alternative to AdamW | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Introducing the Sophia optimizer, a faster alternative to AdamW (twitter.com/tengyuma)
		16 points by m00x on May 24, 2023 \| hide \| past \| favorite \| 4 comments

m00x on May 24, 2023 | [–]

Paper: https://arxiv.org/pdf/2305.14342.pdf

tylergem on May 25, 2023 | | [–]

Code: https://github.com/Liuhong99/Sophia

alephxyz on May 24, 2023 | [–]

Unofficial implementation: https://github.com/kyegomez/Sophia

Looking forward to trying it out this week

alephxyz on May 25, 2023 | [–]

Ignore that link. Their implementation doesn't even run and seems to be almosy entirely chatgpt-generated.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact