Rami's Readings #44
The latest on Coding, LLMs, Prompt Attacks, Nvidia, Rogue Amoeba, Edge AI, Deep Learning & Materials Science, Startups & Recessions, Obesity Pay Gap, Chrome & Bluetooth Exploits, and more.
Welcome to Rami’s Readings #44 - a weekly digest of interesting articles, papers, videos, and X (formerly known as Twitter) threads from my various sources across the Internet. Expect a list of reads covering AI, technology, business, culture, fashion, travel, and more. Learn about what I do at ramisayar.com/about.
Thanks for reading Rami’s Readings! Are you enjoying this newsletter? Subscribe for free to receive each new post and support my work.
Vacation Notice: From Dec 16, 2023 to Jan 13, 2024, I'll be on a holiday break. You might receive a few surprise newsletters during this time. Wishing you a splendid end to the year.
🤖 AI Reads
Hacking is forever.
Notes: New open-source LLM for Medical applications from EPFL!
Overall, MEDITRON achieves a 6% absolute performance gain over the best public baseline in its parameter class and 3% over the strongest baseline we finetuned from Llama-2. Compared to closed-source LLMs, MEDITRON-70B outperforms GPT-3.5 and Med-PaLM and is within 5% of GPT-4 and 10% of Med-PaLM-2.
Notus 7B: A New Open Source LLM, Fine-tuned Using Direct Preference Optimization and AI Feedback Techniques
Notes: Another new open-source model.
Notes: New paper from NTU in Singapore. I don’t need to read the paper to say yes unequivocally.
Notes: This technique for extracting training data from many LLMs is intriguing and capturing much attention this week. Arguably much of the efficacy in Large Language Models (LLMs) stems from memorization; fully solving training data extraction is not reasonable. The paper on ArXiv.
Notes: Another great long read about Huang.
There will be another category of companies that will distill or fine-tune existing machine learning models to suit their needs. This category will be larger than the previous one. Only some companies need to train their own models. This category’s training and inference capacity needs will be modest. They will also be the primary beneficiaries of open-source AI models and the optimizations making AI inference on edge devices a reality. Their costs will trend to zero. 🤔 Why buy entire data centers of expensive hardware when many open-source models with some fine-tuning suit your needs? Rent GPUs just enough to get by. Run inference on edge devices as much as possible. [From Rami’s Readings #23]
Rogue Amoeba is doing exactly thing… building incredibly valuable features (transcription) into their software with minimal ML training (not sure if they even fine-tuned Whisper at all) and zero inference costs (running locally on the fabulous Apple Silicon). #Edge-AI
It’s also completely private. When you use Transcribe, everything happens right on your Mac. That means your data is never sent to the cloud, nor shared with anyone else. [From Rogue Amoeba]
Notes: My friends in China, can you please share any additional local news coverage?
Notes: Great UX approach for tracking authorship if you plan to use ChatGPT as a writing copilot.
💼 Business Reads
Notes: A commonly heard adage from the startup community in Silicon Valley is that 'the best startups are founded in a recession.' This seems to be confirmed by this paper.
Notes: The Economist found men also face a large obesity-wage penalty. From personal experience (I actively lost 50 lbs of body fat in 4 years), I am not surprised. I vividly remember the difference in tone and interactions before and after.
The conclusion—that well-educated workers in particular are penalised for their weight—holds for both sexes. Moreover, the higher your level of education, the greater the penalty. We found that obese men with a bachelor’s degree earn 5% less than their thinner colleagues, while those with a graduate degree earn 14% less. Obese women, it is true, still have it worse: for them, the equivalent figures are 12% and 19%, respectively.
Notes: What?!? Write wills people!
The king is profiting from the deaths of thousands of people in the north-west of England whose assets are secretly being used to upgrade a commercial property empire managed by his hereditary estate, the Guardian can reveal.
Notes: Update your iOS & Mac devices as well.
Notes: Distributing a fix for this will be fairly difficult.
Notes: More of a data/backup read. Also, why I still use a local NAS.
That is all for this week. Signing off from Redmond, WA.