Rami's Readings #118 - 1 Trillion Parameter Model 🔥
The latest on AI, LLMs, Kimi K2, Swiss National LLM, Reinforcement Learning, Apple, Section 174, Canadianisms, and more.
Welcome to Rami’s Readings #118 - a weekly digest of interesting articles, papers, videos, and X threads from my various sources across the Internet. Expect a list of reads covering AI, technology, business, culture, fashion, travel, and more. Learn about what I do at ramisayar.com/about.
👋🏼 Welcome New Subscribers
Hello! A hearty thank you for subscribing to Rami's Readings! There are quite a few new subscribers this week, thanks to recommendations from The AI Ethics Brief, Global Fintech Insider, and The VC Corner. I am thrilled to have you on board! In this newsletter, I curate the best papers, tweets, and articles I have read during the week focusing on LLMs, AI, economics, business, and technology news. You can learn more about me on my website.
📈 Top Recent Editions According to Substack
🤖 AI Reads
Kimi K2: Open Agentic Intelligence
Notes: Moonshot AI released their moonshot, a 1 trillion parameter model! SOTA in a number of tasks and open source. I have no idea who is the target customer, but wow!
Swiss National LLM: A Language Model Built for the Public Good
Notes: Trained by ETH Zurich, EPFL & the Swiss National Supercomputing Center.
OpenPipe / ART: Agent Reinforcement Trainer
Notes: Agent reinforcement training using GRPO. Interesting project. v0.4 was released a few days ago.
Bridging Offline and Online Reinforcement Learning for LLMs
Notes: Paper about offline and online reinforcement learning from FAIR at Meta.
💼 Business Reads
Tax Section 174 Change Brings Back Domestic R&D Full Tax Year Deductions
Notes: I covered Section 147 in #113. Businesses & startups are now able to fully deduct domestic R&D activities in the tax year incurred.
On Apple
Notes: Highly relevant weekend read considering the recent Meta AI hiring spree. Another great read from John Gruber.
Used Watch Market Posts Best Quarterly Performance
Notes: For my watch collecting friends, prices on the used watch market have stabilized per Morgan Stanley. Personally, I enjoy browsing Watch Charts.
🔀 Other Reads
A Dictionary of Canadianisms on Historical Principles
Notes: For my American friends, this dictionary contains a number of Canadianisms 🇨🇦. Read the definitions of loonie, toonie, & double-double.
Classic Web on Mastodon
Notes: This channel is a blast from the past. I’ll be honest, I kinda miss Web 2.0 and 2010s design. Must be nostalgia for my youth, see my personal website in October 2011. (The Wayback Machine didn’t capture the CSS.)
Signing off from Redmond, WA.