This is how it's done.
A strong and principled response by WilmerHale to the illegal Executive Order attack - a form of attempted government intimidation declared unconstitutional by a federal judge.
This is how to guard the rule of law.
The hardest part about finetuning is that people don't have labeled data. Today, @databricks.bsky.social introduced TAO, a new finetuning method that only needs inputs, no labels necessary. Best of all, it actually beats supervised finetuning on labeled data. www.databricks.com/blog/tao-usi...
A poster with three professor's pictures with the text "can your professors handle the heat"
Join @kumarde.bsky.social Bryan, and me in CSE tomorrow as we do Hot Ones for Academics. My normally spicy research takes will get even spicier
Excited to share our work with friends from MIT/Google on Learned Asynchronous Decoding! LLM responses often contain chunks of tokens that are semantically independent. What if we can train LLMs to identify such chunks and decode them in parallel, thereby speeding up inference? 1/N
We're probably a little too obsessed with zero-shot retrieval. If you have documents (you do), then you can generate synthetic data, and finetune your embedding. Blog post lead by @jacobianneuro.bsky.social shows how well this works in practice.
www.databricks.com/blog/improvi...
In case it is not clear from my reposts, the Trump administration is engaged in an illegal AND unconstitutional to seize power over the federal government away from Congress and the courts. "Pausing" payment on the government's bills is just one part of it, but it is among the worst.
Being right for the wrong reasons doesn't increase my confidence...
All the more convinced that the markets don't understand AI. Both the irrational hype and the irrational pessimism. DeepSeek is incredibly bullish for GPU sales...
Thank goodness for Greek letters!
Very excited that our Series J is complete. Especially thrilled to have our friends at Meta on board!
Gives a new meaning to "Infrastructure Week"
Tweet from the Anti-Defamation League, or ADL: This is a delicate moment. It's a new day and yet so many are on edge. Our politics are inflamed, and social media only adds to the anxiety. It seems that @elonmusk made an awkward gesture in a moment of enthusiasm, not a Nazi salute, but again, we appreciate that people are on edge. In this moment, all sides should give one another a bit of grace, perhaps even the benefit of the doubt, and take a breath. This is a new beginning. Let's hope for healing and work toward unity in the months and years ahead. 5:52 PM • Jan 20, 2025
This is so bad
I wasn’t expecting a nazi salute on day 1 but here we are. I of course understand that due to the palm on heart there’s plausible deniability but we all understand the intent
Impressed by those able to talk about Deepseek right now.
Interesting Friday evening code drop from @rajammanabrolu.bsky.social and Brandon Cui at @databricks.bsky.social. That's all I'm allowed to say for now... github.com/databricks/c...
Absolutely loving the RM Twitter/Bluesky discourse.
🧵 Super proud to finally share this work I led last quarter - the
@databricks.bsky.social Domain Intelligence Benchmark Suite (DIBS)! TL;DR: Academic benchmarks ≠ real performance and domain intelligence > general capabilities for enterprise tasks. 1/3
Price of the brick going up
Databricks raises $10b Series J at $62b valuation, the largest venture round ever.
www.databricks.com/company/news...
The world needs data intelligence, and @databricks.bsky.social is delivering. Thank you to the investors who continue to support us on this journey. 🧱🧱🧱 www.databricks.com/company/news...
Lastly, thank you as always to the amazing team at @databricks.bsky.social and the scientific and open source communities. You all keep me especially excited about the bright future we're creating. The folks at Meta, AI2, Eleuther, HuggingFace, Kaggle, among many many others.
TLDR: See the TLDR at the top of the thread. Merry NeurIPS to everyone in the AI community. 2025 will be an exciting year ♥️🧱📈
11. My understanding of semiconductor progress is that, even it looks nice on a log/log plot, progress was never certain and hard-fought new ideas were always needed to get to the next step. If we knew how to get straight to 2nm, we wouldn't have done 65nm or 4nm.
10. Next metaphor: Moore's "law." Gordon Moore wrote a great article in 2003 reflecting on that trend called "No Exponential is Forever...But Forever Can Be Delayed!" cseweb.ucsd.edu/classes/wi10...
9. Even the worst case scenario for progress (model quality freezes forever at the level of GPT4++ and cost to use it keeps coming down) will lead to decades of new ideas and advances on top of AI that will leave the world transformed. Even the most bearish case is bullish.
8. But the world was transformed by the internet. It took decades of trial and error and experience and evolution and culture to make the most of it. Lower cost and greater access meant things that didn't make sense before (video sharing) later did. Imagine explaining "demure" to someone in 1995.
7. I look to the history of computing. From what I understand, the technology behind the internet was largely fixed ("ossified" according to some) by the mid 90s. All that changed between then and now is that cost came down and access improved.
6. Or maybe an incremental gain is enough to unlock extraordinary economic value that far outstrips the overall cost of building and using the model.
5. Maybe scaling trends continue but incremental bumps on real tasks mean the models aren't worth deploying given inference costs. I don't have inside info, but my guess is this is why we don't have Gemini 1.5 Ultra or Claude 3.5 Opus. Of course someone tried to train them.
