Very ML
State-of-the-art Machine Learning News Feed
/r/MachineLearning
последний пост 7 часов назад
[D] Issue with arxiv - abstract not matching pdf/html [D]
[D] Issue with arxiv - abstract not matching pdf/html [D]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

7 часов назад @ reddit.com
Masked depth modeling with sensor-validity masking: reports best RMSE on 7 of 8 masked/sparse depth benchmarks, plus a controlled encoder-init study[R]
Masked depth modeling with sensor-validity masking: reports best RMSE on 7 of 8 masked/sparse depth benchmarks, plus a controlled encoder-init study[R] Masked depth modeling with sensor-validity masking: reports best RMSE on 7 of 8 masked/sparse depth benchmarks, plus a controlled encoder-init study[R]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

8 часов назад @ reddit.com
MIRA: Multiplayer Interactive World Models trained on Rocket League [R]
MIRA: Multiplayer Interactive World Models trained on Rocket League [R]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

10 часов назад @ reddit.com
does quantising a model reduce its performance ?[R]
does quantising a model reduce its performance ?[R]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

14 часов назад @ reddit.com
ICML Position Track: Want Better ML Reviews? Stop Asking Nicely and Start Incentivizing with a Credit System [D]
ICML Position Track: Want Better ML Reviews? Stop Asking Nicely and Start Incentivizing with a Credit System [D]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

14 часов назад @ reddit.com
How should I encode both target and feature variable for a multiclass classification? [D]
How should I encode both target and feature variable for a multiclass classification? [D]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

21 час назад @ reddit.com
LingBot-Vision: masked boundary modeling for self-supervised pretraining (0.296 NYUv2 linear-probe RMSE at 1.1B vs 0.309 for DINOv3-7B, trails on ImageNet); weights in 4 sizes[R]
LingBot-Vision: masked boundary modeling for self-supervised pretraining (0.296 NYUv2 linear-probe RMSE at 1.1B vs 0.309 for DINOv3-7B, trails on ImageNet); weights in 4 sizes[R] LingBot-Vision: masked boundary modeling for self-supervised pretraining (0.296 NYUv2 linear-probe RMSE at 1.1B vs 0.309 for DINOv3-7B, trails on ImageNet); weights in 4 sizes[R]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

1 day назад @ reddit.com
Edge AI ASL Recognition on Raspberry Pi 5 – Looking for Feedback on My System Design [P]
Edge AI ASL Recognition on Raspberry Pi 5 – Looking for Feedback on My System Design [P]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

1 day, 1 hour назад @ reddit.com
CPU TTS benchmark with UTMOS MOS scoring: Kokoro, Supertonic, Inflect-Nano, and Kyutai's new Pocket TTS [P]
CPU TTS benchmark with UTMOS MOS scoring: Kokoro, Supertonic, Inflect-Nano, and Kyutai's new Pocket TTS [P]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

1 day, 2 hours назад @ reddit.com
TRACE: open-source hierarchical memory for LLM agents, 82.5% on MemoryAgentBench’s EventQA using gpt-oss-20B [P]
TRACE: open-source hierarchical memory for LLM agents, 82.5% on MemoryAgentBench’s EventQA using gpt-oss-20B [P]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

1 day, 3 hours назад @ reddit.com
Machine learning industry job requirements used to be myopic, but now it feels impossible. Anyone else seeing this? [D]
Machine learning industry job requirements used to be myopic, but now it feels impossible. Anyone else seeing this? [D]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

1 day, 6 hours назад @ reddit.com
Does anyone have a name for that subtle "Sameness" creeping into model outputs lately? [R]
Does anyone have a name for that subtle "Sameness" creeping into model outputs lately? [R]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

1 day, 13 hours назад @ reddit.com
Best models for generating red-team attacks? Also looking for public datasets [R]
Best models for generating red-team attacks? Also looking for public datasets [R]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

1 day, 20 hours назад @ reddit.com
I built an open, from-scratch MT pipeline + parallel corpus for Tunisian Darija (Arabizi) early baseline, and I'm growing it into a curated community corpus [P]
I built an open, from-scratch MT pipeline + parallel corpus for Tunisian Darija (Arabizi) early baseline, and I'm growing it into a curated community corpus [P]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

2 days назад @ reddit.com
Is Intrinsic Motivation a Viable PhD Topic in 2026? [D]
Is Intrinsic Motivation a Viable PhD Topic in 2026? [D]

Your request has been blocked due to a network policy.

If you're running a script or application, please register or sign in with your developer credentials here.

Additionally make sure your User-Agent is not empty and is something unique and descriptive and try again.

if you're supplying an alternate User-Agent string, try changing back to default as that can sometimes result in a block.

If you think that we've incorrectly blocked you or you would like to discuss easier ways to get the data you want, please file a ticket here.

2 days, 2 hours назад @ reddit.com
Towards Data Science
последний пост 1 час назад
A Production RAG Pipeline for PDFs: Relational Parsing, TOC Retrieval, Typed Answers
A Production RAG Pipeline for PDFs: Relational Parsing, TOC Retrieval, Typed Answers A Production RAG Pipeline for PDFs: Relational Parsing, TOC Retrieval, Typed Answers

III of Enterprise Document Intelligence, a series that builds an enterprise RAG system from four bricks: document parsing, question parsing, retrieval, and generation.

Question parsing : the question users type is rarely clean.

In: the RetrievalQuery brief (from question parsing), plus line_df and toc_df (from document parsing).

: keyword hits counted per TOC section, then the LLM TOC router reads the outline and picks the section that answers the question.

Generation emits a typed answer with a span per item, not a paragraph the caller has to read again.

1 час назад @ towardsdatascience.com
Proxy-Pointer RAG: Temporal Reasoning Without Semantic Precompilation
Proxy-Pointer RAG: Temporal Reasoning Without Semantic Precompilation Proxy-Pointer RAG: Temporal Reasoning Without Semantic Precompilation

Rather than eagerly compiling semantic knowledge during ingestion, Proxy-Pointer preserves the structural organization of documents and performs semantic synthesis only when a query requires it.

For example, multiple annual reports may collectively update canonical pages such as “Acquisitions”, “Artificial Intelligence”, “Cloud Strategy”, “Sustainability”, “Product Portfolio”, “Supply chain” etc.

Alongside these canonical pages, the system maintains an index that helps locate the appropriate pages for future queries.

Rather than building a preemptive semantic knowledge base, Proxy-Pointer builds a structural representation (skeletal tree) of each document at ingestion.

Proxy-Pointer on the …

3 часа назад @ towardsdatascience.com
Identifying Microbes in Space
Identifying Microbes in Space Identifying Microbes in Space

k k -mers don’t count as matching unless they are exactly the same, but if sequences are similar some of the multiple k k -mers do match exactly and we get a hit.

Overlapping k k -mers have a lot of redundancy, adjacent k k -mers have mostly the same sequence.

By taking the minimizer of a set of similar k k -mers you can get a single subsequence to represent multiple the k k -mers.

To get the minimizer, each k k -mer is broken into smaller k k -mers (we use l l for this smaller length and call them l l -mers to avoid confusion).

Similar k k -mers will give you the same minimizer so you don’t have to save each k k -mer.

4 часа назад @ towardsdatascience.com
Survival Analysis for Data Drift and ML Reliability
Survival Analysis for Data Drift and ML Reliability Survival Analysis for Data Drift and ML Reliability

A central idea in survival analysis is the relationship between the survival function and the hazard function.

Survival & Hazard Functions: Links survival probability to hazard rateWeibull DistributionThe Weibull distribution is a flexible two‑parameter probability model that plays a central role in reliability engineering, survival analysis, and failure‑time modeling.

Simulated ML Reliability DatasetThe goal of the simulation is to create a realistic reliability dataset for a single ML model that is deployed many times.

SummaryWe examined how survival analysis provides a practical framework for managing the reliability of ML systems.

This article has covered the core ideas behind ML reliab…

6 часов назад @ towardsdatascience.com
How to Run End-to-End Tests with Claude Code
How to Run End-to-End Tests with Claude Code How to Run End-to-End Tests with Claude Code

I’ll discuss how to run end-to-end tests with Claude Code, why you should be running end-to-end tests, and specific techniques you can use to make end-to-end testing effective.

Why run end-to-end tests with Claude CodeFirst of all, I’d like to cover why you should care about this topic.

The reason you should run end-to-end tests with Claude Code is simply that it’s an effective way of testing your code implementations.

How to run end-to-end tests with Claude CodeNow it’s time to discuss how to actually run end-to-end tests.

Thus, I’ll cover some different techniques I use to run end-to-end testing with Claude Code that make my end-to-end testing more effective.

1 day, 3 hours назад @ towardsdatascience.com
Validating the RAG Answer Before the User Sees It: Spans, Quotes, and the Feedback Loop
Validating the RAG Answer Before the User Sees It: Spans, Quotes, and the Feedback Loop Validating the RAG Answer Before the User Sees It: Spans, Quotes, and the Feedback Loop

Article 8A (the answer contract) declared the typed answer schema; Article 8B (prompt assembly) built the dispatcher that calls the model against it.

1.4 “Not found” as a first-class outputIn enterprise RAG, returning the wrong answer is worse than returning no answer.

A “not found” forces the user to look further, which is the right behavior when the system doesn’t have the answer.

if provider == "openai": return _openai_call(system, user, schema, model, temperature) if provider == "anthropic": return _anthropic_call(system, user, schema, model, temperature) if provider == "ollama": return _ollama_call(system, user, schema, model, temperature) if provider == "mistral": return _mistral_call…

1 day, 4 hours назад @ towardsdatascience.com
Stop Ranking Agent Configs by Average Score
Stop Ranking Agent Configs by Average Score Stop Ranking Agent Configs by Average Score

Effect Importance 95% Bootstrap CI Triple interaction (Model × Prompt × Tool) 0.31 [0.023, 0.635] Model (main) 0.25 [0.018, 0.572] Model × Prompt 0.15 [0.009, 0.528] Tool (main) 0.13 [0.006, 0.451] Prompt × Tool 0.07 [0.006, 0.319] Prompt (main) 0.03 [0.005, 0.338] Model × Tool 0.01 [0.004, 0.341]In this particular experiment, the biggest signal is the three-way interaction between model, prompt, and tool.

What makes it stand out is that the model, prompt, and tool reinforce each other.

The weaker model may need the scaffold and semantic tool more, while the stronger model may experience the same scaffold as friction.

In this setup, the Systematic Planner and semantic tool appear to create …

1 day, 6 hours назад @ towardsdatascience.com
Assemble Each RAG Generation Prompt from a Base Prompt Plus the Rules Each Question Needs
Assemble Each RAG Generation Prompt from a Base Prompt Plus the Rules Each Question Needs Assemble Each RAG Generation Prompt from a Base Prompt Plus the Rules Each Question Needs

From brief to prompt: the dispatcherOne prompt per question shape, composed at call time.

Contract: a ParsedQuestion comes in; three things come out: the schema (picked from ANSWER_REGISTRY by expected_answer_shape ), the system prompt (a fixed BASE plus the fragments the brief requests), and the user prompt (question + keywords + labeled passage lines).

The schema and the dispatcher get promoted to the package once the question parsing brick lands its full implementation.

1.3 The system prompt: BASE + fragmentsThe BASE is shape-agnostic: it encodes the contract that holds for every call: cite, type, fail honestly.

Spelling it out in the system prompt and labeling the columns in the user pr…

2 days, 3 hours назад @ towardsdatascience.com
PANet Paper Walkthrough: When Feature Pyramids Go Bottom-Up
PANet Paper Walkthrough: When Feature Pyramids Go Bottom-Up PANet Paper Walkthrough: When Feature Pyramids Go Bottom-Up

I wrote about the FPN (Feature Pyramid Network) architecture [1], which is one of the most influential necks we can apply to a backbone model.

And here’s the problem FPN doesn’t solve: while FPN effectively enriches feature maps in shallower layers, the deeper feature maps still lack spatial information.

PANet From ScratchThe idea of our implementation here is that we will create a dummy backbone with an FPN and place the PANet layers on top of it.

# Codeblock 7 panet = PANet() out_panet = panet(p2, p3, p4, p5) n2, n3, n4, n5 = out_panetAnd below is what the output looks like.

# Codeblock 7 Output n2 : torch.Size([1, 256, 56, 56]) n2 downsampled : torch.Size([1, 256, 28, 28]) after sum : to…

2 days, 5 hours назад @ towardsdatascience.com
Setting Up Your Own Large Language Model
Setting Up Your Own Large Language Model Setting Up Your Own Large Language Model

I’m going to start by asking my local model what it thinks about open source models:Answer from the Local Model (Thinking Tokens)The light grey text represents the model’s internal reasoning process.

Here are three common and practical uses for a **local LLM (Large Language Model)**: 1.

**Content Creation and Language Processing** You can use a local LLM to generate creative content such as blog posts, stories, scripts, or marketing copy.

You can now create your own applications with your own local model quite easily.

Here is how you bypass the reasoning pass:Disable it entirely: ollama run qwen3:8b --think=falseRun it, but hide it from the UI: ollama run qwen3:8b --hidethinkingIn scripts: …

3 days, 3 hours назад @ towardsdatascience.com
Stop Returning Text from RAG: The Typed Answer Contract That Prevents Hallucination
Stop Returning Text from RAG: The Typed Answer Contract That Prevents Hallucination Stop Returning Text from RAG: The Typed Answer Contract That Prevents Hallucination

This is the first of its three parts: the contract, the typed answer schema the model has to fill.

Asking the model for more than “the answer”The schema is the contract between the pipeline and the model, and it doesn’t have to stop at “the answer”.

Schema (or Answer) = the top-level Pydantic class passed to responses.parse ( AmountAnswer , TextAnswer , …); inherits AnswerBase for the shared feedback fields.

2.1 Typed values, one schema per answer_typeThe first layer of the schema is the value: the typed primitive the model fills in.

The citation-bearing answer schema ( AnswerWithEvidence ) is in the same family as Bohnet et al.

3 days, 5 hours назад @ towardsdatascience.com
AI Agents Explained: What Is a ReAct Loop and How Does It Work?
AI Agents Explained: What Is a ReAct Loop and How Does It Work? AI Agents Explained: What Is a ReAct Loop and How Does It Work?

This is precisely the kind of dependency that parallel tool calling can’t resolve in one round, and exactly what a ReAct loop is built for.

And now that we have set up everything, we can finally see the ReAct loop in action.

This is the major differentiation (at least for this simple scenario) between parallel tool calling and the ReAct loop.

On my mindSo, when does a ReAct loop actually beat parallel tool calling?

This ReAct loop, in one form or another, is the actual mechanism behind most of what people mean by an “agent”.

4 days, 1 hour назад @ towardsdatascience.com
Long Context vs. Short Context Model: When Does a Long Context Model Win?
Long Context vs. Short Context Model: When Does a Long Context Model Win? Long Context vs. Short Context Model: When Does a Long Context Model Win?

What do 512 tokens vs. 8192 tokens actually cost you — in training time, inference time, on GPU, and on CPU?

What do 512 tokens vs. 8192 tokens actually cost you — in training time, inference time, on GPU, and on CPU?

2.1 Reaching a long context windowA standard transformer works by having every token attend to every other token.

That quadratic scaling is why long context is costly, and on a smaller GPU, sometimes just not possible.

A careless cut can throw away exactly the thing a long context window would have preserved.

4 days, 3 hours назад @ towardsdatascience.com
LLM Wikis Are Over-Engineered — I Replaced Mine With a Pure Python Compiler
LLM Wikis Are Over-Engineered — I Replaced Mine With a Pure Python Compiler LLM Wikis Are Over-Engineered — I Replaced Mine With a Pure Python Compiler

So I replaced the entire pipeline with a pure Python compiler.

Unlike an LLM which varies its output, a compiler gives you the same result every single time you run it.

Once you strip away the LLM calls, what’s actually left to do is text parsing, string manipulation, and graph traversal over an in-memory dictionary.

Nothing had changed in the source files.

## Notes _(add your own notes here -- preserved on recompile)_Nothing in the raw file told the compiler that Gradient Descent references this page.

4 days, 4 hours назад @ towardsdatascience.com
The Untaught Lessons of RAG Retrieval: Cosine Is Not the Foundation
The Untaught Lessons of RAG Retrieval: Cosine Is Not the Foundation The Untaught Lessons of RAG Retrieval: Cosine Is Not the Foundation

It zooms in on brick 3 (retrieval) of the four-brick architecture and surfaces the lessons most tutorials skip.

where this article sits in the series: brick 7 (retrieval) highlighted – Image by author📓 Runnable companion notebooks are on GitHub: doc-intel/notebooks-vol1.

Keywords always run, the TOC always reasons, embeddings fire only when the vocabulary mismatches – Image by authorBelow are the six untaught lessons of this brick.

The shift is simple to state: the question has columns, the document has columns, and retrieval is the join.

Series retrieval returns anchor + scope as a typed pair.

4 days, 6 hours назад @ towardsdatascience.com
Distill.pub Distill.pub
последний пост None
TheSequence TheSequence
последний пост 7 часов назад
The Sequence Knowledge #890: A Brief History of Model Distillation
The Sequence Knowledge #890: A Brief History of Model Distillation The Sequence Knowledge #890: A Brief History of Model Distillation

The story most people tell about knowledge distillation starts in 2015, with Geoffrey Hinton, Oriol Vinyals, and Jeff Dean introducing a clever softmax temperature trick and a phrase — “dark knowledge” — that immediately lodged itself in the field’s vocabulary.

The real history is quieter, more pragmatic, and worth recovering, because the conceptual moves the field made between 2006 and 2015 still define how we think about distillation today.

The vocabulary changed.

The diagrams changed.

The underlying question — what exactly is being transferred from a teacher to a student?

7 часов назад @ thesequence.substack.com
The Sequence Radar #889: Fable 5's Comeback, ZCode's Debut, Claude Science, and the $3.5B Deployment Land Grab
The Sequence Radar #889: Fable 5's Comeback, ZCode's Debut, Claude Science, and the $3.5B Deployment Land Grab The Sequence Radar #889: Fable 5's Comeback, ZCode's Debut, Claude Science, and the $3.5B Deployment Land Grab

The opinion section, discusses that domains are a good fit for rapid progress of AI models vs which ones are challenging.

Subscribe and don’t miss out:📝 Editorial: Fable 5's Comeback, ZCode's Debut, Claude Science, and the $3.5B Deployment Land GrabThis week’s developments in AI provide a clear direction where the space is going: more capable models and the imperative of capable delivery capabilities.

Start at the model layer, where we just watched the first frontier model get hot-patched by a government.

One layer up, Anthropic launched what I’d call claude --science .

Claude ScienceAnthropic announced Claude Science, a workbench for scientists.

2 days, 7 hours назад @ thesequence.substack.com
The Sequence Opinion #888: Everything You Need to Know About the AI in Space Race
The Sequence Opinion #888: Everything You Need to Know About the AI in Space Race The Sequence Opinion #888: Everything You Need to Know About the AI in Space Race

The core thesis of this essay is simple to state: space is becoming a new frontier for AI — and one of the most competitive ones.

When the scarce thing was ideas, the frontier was architectures; when it was data, the frontier was the open web; when it was FLOPs, the frontier was the fab.

Today the scarce thing is energy — grid capacity, cooling water, land, permits — and orbit is the one place in reach where energy is effectively unmetered and no zoning board has jurisdiction.

This essay discusses the core thesis of AI in space: value proposition, key players, architecture differences and much more.

The core thesis: compute is now an energy problem, and space is an energy solution

5 days, 7 hours назад @ thesequence.substack.com
The Sequence AI of the Week #887: Meta's Autodata: When Models Learn to Make Their Own Lessons
The Sequence AI of the Week #887: Meta's Autodata: When Models Learn to Make Their Own Lessons The Sequence AI of the Week #887: Meta's Autodata: When Models Learn to Make Their Own Lessons

Today, we are covering an amazing paper published by Meta last week: https://arxiv.org/abs/2606.25996There is a quiet shift happening in AI training.

For years, the center of gravity was the model: more parameters, more GPUs, better architectures, longer context windows, better optimizers.

Meta’s new Autodata work flips that perspective.

Not “ask a strong model to generate a million examples and hope the distribution is useful.” Instead, Autodata treats data generation like a miniature research loop.

An AI agent creates examples, tests them, studies the failures, updates its recipe, and tries again.

6 days, 7 hours назад @ thesequence.substack.com
The Sequence Knowledge #886: Demystifying Model Distillation
The Sequence Knowledge #886: Demystifying Model Distillation The Sequence Knowledge #886: Demystifying Model Distillation

The simplest way to understand knowledge distillation is to imagine a very expensive teacher and a very cheap student.

The teacher is a large model: smart, slow, high-capacity, expensive to run.

The student is smaller: faster, cheaper, easier to deploy, but usually less capable if trained in the standard way.

Distillation asks a very practical question:Can the student learn not only from the original dataset, but from the teacher’s behavior?

In other words, instead of training the small model directly on reality, we train it on reality as interpreted by the big model.

1 week назад @ thesequence.substack.com
The Sequence Radar #885: Last Week in AI: Models, Games, and the Future of Evaluation
The Sequence Radar #885: Last Week in AI: Models, Games, and the Future of Evaluation The Sequence Radar #885: Last Week in AI: Models, Games, and the Future of Evaluation

Subscribe and don’t miss out:📝 Editorial: Last Week in AI: Models, Games, and the Future of EvaluationThis week in AI had the strange feeling of a stack trace resolving itself.

Frontier AI releases are starting to look less like software updates and more like controlled deployment of critical infrastructure.

Then came General Intuition’s new raise, which feels like the cleanest signal yet that the next data frontier is not text, or even video, but action.

AI Lab: Qwen TeamSummary: This research introduces Qwen-AgentWorld, a foundational language world model designed to simulate seven diverse agentic environments through long chain-of-thought reasoning.

🤖 AI Tech ReleasesGPT 5.6 SolOpenAI un…

1 week, 2 days назад @ thesequence.substack.com
The Sequence Opinion #884: Self-Driving Labs: The Laboratory That Chooses Its Next Experiment
The Sequence Opinion #884: Self-Driving Labs: The Laboratory That Chooses Its Next Experiment The Sequence Opinion #884: Self-Driving Labs: The Laboratory That Chooses Its Next Experiment

The scientist decides what to test, transfers samples between instruments, inspects the results, updates their mental model and chooses the next experiment.

A self-driving lab moves part of that loop into software.

It makes something, measures it, updates a model and chooses the next move.

A self-driving lab can run the first few hundred experiments, notice that most of the remaining design space looks unpromising and redirect itself toward better candidates.

The simplest mental model is a loop:design → make → test → learn → design again

1 week, 4 days назад @ thesequence.substack.com
The Sequence AI of the Week #883: Qwen is Getting Into Robotics
The Sequence AI of the Week #883: Qwen is Getting Into Robotics The Sequence AI of the Week #883: Qwen is Getting Into Robotics

For about three years now, the Qwen family has lived inside a rectangle.

It reads your code, looks at your screenshots, answers your questions, and the whole time it has been doing this behind glass.

The Tongyi Lab team put it plainly: seeing is not acting.

Let me explain why I think this is the right shape, and where I’d keep my skepticism.

The actual bottleneck is not intelligence, it’s tokenization

1 week, 5 days назад @ thesequence.substack.com
The Sequence Knowledge #882: A New Series About Distillation
The Sequence Knowledge #882: A New Series About Distillation The Sequence Knowledge #882: A New Series About Distillation

I am super excited about this series that deep dives into distillation techniques.

Bigger models.

The frontier model became one of the strangest artifacts in the history of computing: a single neural network that looks less like a program and more like a compressed civilization of patterns.

A coding agent does not always need a frontier model for every token.

It may need a smaller draft model, a specialized debugging model, or a distilled planner trained on expert trajectories.

1 week, 6 days назад @ thesequence.substack.com
The Sequence Special #881: The Soccer World Cup of AI Models
The Sequence Special #881: The Soccer World Cup of AI Models The Sequence Special #881: The Soccer World Cup of AI Models

A fun, personal note to start the week — about AI evaluations, and why we made the best models in the world fight over a virtual ball.

LayerLens builds the evaluation and observability layer for that world, working alongside frontier AI teams to ship benchmarks that probe what the standard suites miss.

Introducing the Stratix CupToday, LayerLens is launching the Stratix Cup — a soccer (football, if you insist) tournament in which the top frontier models compete against each other inside a harness that simulates a full soccer environment.

The format is straight out of the World Cup playbook: 16 models, four groups of four, group stage into knockouts, all the way to a single final.

Here’s GLM…

2 weeks, 1 day назад @ thesequence.substack.com
The Sequence Radar #880: Last Week in AI: A $60B Cursor Deal, Google's Brain Drain, and Midjourney's Body Scanner
The Sequence Radar #880: Last Week in AI: A $60B Cursor Deal, Google's Brain Drain, and Midjourney's Body Scanner

A week of really unexpected turns in the AI market.

2 weeks, 2 days назад @ thesequence.substack.com
The Sequence Opinion #879: When Tokens Become Balance Sheet Items
The Sequence Opinion #879: When Tokens Become Balance Sheet Items The Sequence Opinion #879: When Tokens Become Balance Sheet Items

AI tokens are becoming are incresingly becoming part of every company economics.

You see large companies measuring and reporting token expenses and forecasts like a well understood accounting units.

In reality, we are entering a new era: the token economy.

An ERP for tokens?

The Smallest Billable ThoughtSomething strange happened quietly, and then all at once: the token became the atomic unit of the AI economy.

2 weeks, 5 days назад @ thesequence.substack.com
The Sequence AI of the Week #878: Inside Google Deepmind's First Real Crack in Next-Token Generation
The Sequence AI of the Week #878: Inside Google Deepmind's First Real Crack in Next-Token Generation The Sequence AI of the Week #878: Inside Google Deepmind's First Real Crack in Next-Token Generation

As we wrap up our series about alternatives to transformer architectures, Google DeepMind just released one of the most impressive models in this category.

DiffusionGemma is a text-diffusion model that challenges the conventional transfromer models.

Most language models write like a typewriter.

This architecture has carried the entire modern LLM era: GPT-style chatbots, coding copilots, reasoning models, agent frameworks, enterprise assistants.

Google’s new DiffusionGemma asks a deceptively simple question: what if text generation did not have to work that way?

2 weeks, 6 days назад @ thesequence.substack.com
The Sequence Knowledge #878: Beyond Transformer: What We Learned
The Sequence Knowledge #878: Beyond Transformer: What We Learned The Sequence Knowledge #878: Beyond Transformer: What We Learned

The Transformer didn’t win because it was the most elegant or the most brain-like design.

Every token looks at every other token, the whole thing maps cleanly onto a GPU grid, and you train it all at once.

The cost is that attention scales quadratically with sequence length, and autoregressive decoding drags around a KV-cache that grows linearly with every token you’ve already seen.

The second family is state space models — the SSM/Mamba line, the most serious challenger of the bunch.

The third family is text diffusion — generation that abandons left-to-right decoding entirely, refining a whole sequence in parallel over a handful of denoising steps.

3 weeks назад @ thesequence.substack.com
The Sequence Radar #877: Last Week in AI: Anthropic Ships, Apple Borrows, Musk Lists, Bezos Builds
The Sequence Radar #877: Last Week in AI: Anthropic Ships, Apple Borrows, Musk Lists, Bezos Builds The Sequence Radar #877: Last Week in AI: Anthropic Ships, Apple Borrows, Musk Lists, Bezos Builds

Subscribe and don’t miss out:📝 Editorial: Last Week in AI: Anthropic Ships, Apple Borrows, Musk Lists, Bezos BuildsSome weeks in AI feel like incremental patch releases.

🔎 AI ResearchAI Lab: Google Research & Google DeepMindSummary: This paper introduces a unified framework for constructing practical, kernel-based two-sample tests derived from the family of f-divergences.

AI Lab: Stanford UniversitySummary: DELM is a novel multi-agent framework that eliminates the bottleneck of centralized orchestration by relying on a shared, verified context and an asynchronous task queue.

🤖 AI Tech ReleasesClaude Fable 5 and Mythos 5Anthropic released its highly anticipated Fable 5 model, a limited Mytho…

3 weeks, 2 days назад @ thesequence.substack.com
Synced Review
последний пост None
📓 Cool Blogs
ODS.ai Habr ODS.ai Habr
последний пост 3 months назад
Вайбкодинг по Chess’ноку. 1. e4
Вайбкодинг по Chess’ноку. 1. e4 Вайбкодинг по Chess’ноку. 1. e4

Но это не вайбкодинг, а тяжёлая профессиональная ИИ-разработка.

За это время по этому проекту в ChatGPT было создано 112 чатов — это примерно 560 промптов.

И в особо напряжённые периоды приходилось вставать по ночам, чтобы оптимально использовать лимиты, которые делятся на 5-часовые и недельные сессии.

Но это не магия и не кнопка «сделать хорошо».

Именно поэтому будущее не за вайбкодингом, а за теми, кто научится управлять этой скоростью.

3 months назад @ habr.com
Почему я стал ИТ-волонтером & Датасет новостей о противоречиях современного общества
Почему я стал ИТ-волонтером & Датасет новостей о противоречиях современного общества Почему я стал ИТ-волонтером & Датасет новостей о противоречиях современного общества

Простой пример с ценами на топливо: бензин дорожает и из-за роста цены на нефть, и из-за ее падения.

Осознание того, что твой труд увеличивает чью-то капитализацию, но не решает реальных проблем общества, видимых в быту и в новостях, подтолкнуло искать еще какую-то деятельность.

Кроме того, благодаря АМБ появился уникальный датасет новостей с противоречиями современного общества на kaggle и github, далее о нем.

Датасет новостей о противоречиях современного обществаАктивисты АМБ и волонтеры дружественных коллективов собрали и разметили датасет новостей, подсвечивающие те самые системные противоречия, о которых я задумывался ранее.

Пример Б В 2023 году в мире голодал каждый 11-й человек, а в …

4 months, 2 weeks назад @ habr.com
[Перевод] Как устроен Codex
[Перевод] Как устроен Codex [Перевод] Как устроен Codex

Подробный разбор того, как команда OpenAI Codex создаёт своего кодового агента, как его используют инженеры и что это может значить для будущего разработки ПО.

Чтобы разобраться, как устроен Codex, как команды внутри OpenAI его используют и как он влияет на инженерные практики у создателей ChatGPT, я поговорил с тремя сотрудниками OpenAI:Тибо Соттио (Thibault Sottiaux) — руководитель Codex.

Оба продукта были запущены весной: Codex CLI анонсировали в апреле 2025 года, а Codex в ChatGPT представили в мае.

В команде Codex эти файлы объясняют агенту, как ориентироваться в кодовой базе, какие команды запускать для тестирования и как следовать стандартам проекта.

Использование Codex в OpenAIПомим…

4 months, 2 weeks назад @ habr.com
Курс Natural Language Processing & LLMs — новый сезон
Курс Natural Language Processing & LLMs — новый сезон Курс Natural Language Processing & LLMs — новый сезон

10 февраля мы в очередной раз запускаем бесплатный онлайн-курс по обработке естественного языка (Natural Language Processing).

Что будем проходить:классическое начало: закон Ципфа, TF-IDF, RNN, CNN, Transformer;основные задачи NLP: классификация текста, тегирование и генерация;специфичные области: агенты и вайб-кодинг;LLM и их применение.

Если вы студент ИТМО, МФТИ или ВШЭ, то курс можно зачесть, как учебный.

Работаю в области NLP более 12 лет, успел поработать в Яндексе и ВКонтакте, защитить кандидатскую диссертацию.

Если есть вопросы, то приходите с ними в ODS Mattermost – там будут все ответы, время семинаров и ссылки.

5 months, 1 week назад @ habr.com
SWE-MERA — новый динамический бенчмарк для моделей агентной генерации кода
SWE-MERA — новый динамический бенчмарк для моделей агентной генерации кода SWE-MERA — новый динамический бенчмарк для моделей агентной генерации кода

Однако все задачи в MERA CODE, как впрочем и в SWE-bench и других бенчмарках подобного назначения, следуют классической парадигме, когда у нас есть фиксированный обучающий набор данных и, что более важно, фиксированный проверочный набор.

Но большие языковые модели для кодинга, которые мы и пытаемся оценивать нашим набором, также учатся на GitHub – со времен еще первой модели LLaMa.

Кажется, что 700 задач немного, но это уже очень приличное количество, и что самое важное — это новые задачи.

Current behavior: from sympy import ask, Q, Symbol x = Symbol('x') print(ask(Q.finite(x**-1), Q.real(x))) # Output: True Expected behavior: The function should return None to indicate uncertainty, as x**-…

9 months, 3 weeks назад @ habr.com
Machine Learning Mastery
последний пост 1 day, 6 hours назад
The Complete Guide to Tool Selection in AI Agents
The Complete Guide to Tool Selection in AI Agents The Complete Guide to Tool Selection in AI Agents

tools = tools self .

tools = tools self .

threshold : return { "status" : "resolved" , "tool" : tool [ "name" ] , "confidence" : score , "attempts" : 1 } # Reformulate by stripping filler words.

tools = tools self .

full_catalog_tokens = sum ( estimate_tokens ( d ) for d in descs ) def _retrieve ( self , query : str , top_k : int ) -> list [ dict ] : query_vec = self .

1 day, 6 hours назад @ machinelearningmastery.com
Context vs. Memory Engineering in Agentic AI Systems
Context vs. Memory Engineering in Agentic AI Systems Context vs. Memory Engineering in Agentic AI Systems

Share Post ShareIn this article, you will learn how context engineering and memory engineering solve different problems in agentic AI systems, and how the two disciplines meet at the point where retrieved memory enters the context window.

Most of the time, the problem lies in two areas that get built together, conflated, or skipped: context engineering and memory engineering.

Memory Engineering: Designing Persistent AI Memory SystemsOnce an inference call completes, memory engineering determines what deserves to persist and under what conditions it gets used again.

trust_level >= 0.5 )AI Agent Memory Design Guide – Working, Long-Term, and Procedural Memory with Forgetting and Staleness Mana…

5 days, 4 hours назад @ machinelearningmastery.com
Context Window Management for Long-Running Agents: Strategies and Tradeoffs
Context Window Management for Long-Running Agents: Strategies and Tradeoffs Context Window Management for Long-Running Agents: Strategies and Tradeoffs

Share Post ShareIn this article, you will learn five practical strategies for managing context windows in long-running AI agent applications, along with the key tradeoffs each approach introduces.

Five distinct context management strategies: sliding windows, recursive summarization, structured state management, ephemeral context via RAG, and dynamic context routing.

Accordingly, shifting from “LLMs as prompt-response engines” to “(agent-endowed) LLMs as long-running background processes” turns context windows into a major AI engineering bottleneck.

For all these reasons, managing context windows in the long run requires specific strategies like sliding windows, tiered memory, and dynamic su…

1 week назад @ machinelearningmastery.com
Model Context Protocol Explained in 3 Levels of Difficulty
Model Context Protocol Explained in 3 Levels of Difficulty Model Context Protocol Explained in 3 Levels of Difficulty

Share Post ShareIn this article, you will learn how the Model Context Protocol (MCP) standardizes the way AI applications connect to external tools and data sources, broken down across three levels of depth.

How the host, client, and server work together, and what happens when a model’s request flows through an MCP server.

The transport options, security risks, and deployment choices that matter once an MCP server is running in production.

Accessing information outside that context requires external tools.

Because both sides follow the same protocol, an MCP server can be used by any compatible MCP client without requiring a custom integration for that specific client.

1 week, 1 day назад @ machinelearningmastery.com
The AI Agent Tech Stack Explained
The AI Agent Tech Stack Explained The AI Agent Tech Stack Explained

According to Atlan’s research on AI agent memory, 95% of enterprise generative AI pilots delivered zero measurable ROI in 2025, with failure attributed to context readiness rather than model quality.

isoformat ( ) , "user" : user_input , "agent" : agent _ response } ) def load_recent_episodes ( n : int = 5 ) -> str : "" "Retrieve the last N episodes as a formatted string for injection into context."

Prerequisites:pip install langchain langchain-openai langchain-chroma langchain-text-splitters chromadb python-dotenv 1 pip install langchain langchain - openai langchain - chroma langchain - text - splitters chromadb python - dotenvHow to run: Save as rag_pipeline.py, add OPENAI_API_KEY to your…

1 week, 4 days назад @ machinelearningmastery.com
Agentic Workflow vs. Autonomous Agent: What’s the Difference?
Agentic Workflow vs. Autonomous Agent: What’s the Difference? Agentic Workflow vs. Autonomous Agent: What’s the Difference?

lower ( ) : return "billing" return "general" def extract ( raw_input : str ) -> str : "" "Step 1 -- always runs, always leads to step 2.

def handle_billing(text: str) -> str: return f"[BILLING TEAM] Routed: {text[:50]}" def handle_technical(text: str) -> str: return f"[TECH SUPPORT] Routed: {text[:50]}" def handle_general(text: str) -> str: return f"[GENERAL QUEUE] Routed: {text[:50]}" # The branch map IS the entire decision space.

def handle_billing ( text : str ) -> str : return f "[BILLING TEAM] Routed: {text[:50]}" def handle_technical ( text : str ) -> str : return f "[TECH SUPPORT] Routed: {text[:50]}" def handle_general ( text : str ) -> str : return f "[GENERAL QUEUE] Routed: {text…

1 week, 5 days назад @ machinelearningmastery.com
Context Windows Are Not Memory: What AI Agent Developers Need to Understand
Context Windows Are Not Memory: What AI Agent Developers Need to Understand Context Windows Are Not Memory: What AI Agent Developers Need to Understand

Topics we will cover include:Why a context window behaves like a stateless scratchpad rather than persistent memory.

Deeming a huge context window as “memory” is, in architectural terms, similar to buying a 25-foot-wide office desk because you are reluctant to acquire a filing cabinet.

Context WindowA context window in an AI model, particularly agent-based ones with underlying language models, is like a desk surface or a stateless scratchpad.

When passing an agent a conversation history spanning over 200K tokens (large context window), it isn’t remembering what happened at a previous step in time.

Generate a compact summary for the active prompt summary = summarizer_model.generate(raw_trans…

1 week, 6 days назад @ machinelearningmastery.com
Clustering Unstructured Text with LLM Embeddings and HDBSCAN
Clustering Unstructured Text with LLM Embeddings and HDBSCAN Clustering Unstructured Text with LLM Embeddings and HDBSCAN

Share Post ShareIn this article, you will learn how to build a text clustering pipeline by combining large language model embeddings with HDBSCAN, a density-based clustering algorithm, to automatically discover topics in unlabeled text data.

target } ) df = df [ df [ 'text' ] .

) print ( "Sample document:" ) print ( df [ 'text' ] .

cluster import HDBSCAN # Initializing HDBSCAN # min_cluster_size=8: we specified that each cluster must have at least 8 documents clusterer = HDBSCAN ( min_cluster_size = 8 , min_samples = 3 , store_centers = 'centroid' ) df [ 'cluster' ] = clusterer .

shape [ 1 ] ) ] ) reduced_df [ 'cluster' ] = df [ 'cluster' ] # Getting all unique pairwise combinations of the …

2 weeks назад @ machinelearningmastery.com
Building Browser-Using AI Agents in Python
Building Browser-Using AI Agents in Python Building Browser-Using AI Agents in Python

# Prerequisites: pip install playwright && playwright install chromium # How to run: python scrape_books.py import asyncio import json from playwright .

"" page = await get_page ( ) await page .

"" page = await get_page ( ) await page .

"" page = await get_page ( ) await page .

"" page = await get_page ( ) try : await page .

2 weeks, 1 day назад @ machinelearningmastery.com
The Roadmap to Mastering AI Agent Evaluation
The Roadmap to Mastering AI Agent Evaluation The Roadmap to Mastering AI Agent Evaluation

Step 1: Understanding Why Agent Evaluation Is ImportantThe instinct when an agent fails is to treat it as a prompting problem: the system prompt needs to be clearer.

Step 2: Defining What Agent Evaluation Success Looks LikeEvaluation is only as good as its success criteria.

Step 4: Grading Agent Reasoning and Output Quality with Model-Based JudgesSome agent evaluation dimensions resist deterministic checking — output quality, tone, faithfulness to retrieved context, appropriate empathy.

Step 5: Matching Agent Evaluation Strategy to Agent TypeGrading strategies apply broadly, but agent type determines which graders carry the most weight and which failure modes to prioritize.

Summary of Key A…

2 weeks, 5 days назад @ machinelearningmastery.com
Building an End-to-End Sentiment Analysis Pipeline with Scikit-LLM
Building an End-to-End Sentiment Analysis Pipeline with Scikit-LLM Building an End-to-End Sentiment Analysis Pipeline with Scikit-LLM

How to build, run, and evaluate a zero-shot sentiment classification pipeline using scikit-learn-compatible syntax.

from sklearn.pipeline import Pipeline from skllm.models.gpt.classification.zero_shot import ZeroShotGPTClassifier # Define the end-to-end pipeline sentiment_pipeline = Pipeline([ ("cleaner", text_cleaner), # Updated to use Groq's active Llama 3.1 8B model ("llm_classifier", ZeroShotGPTClassifier(model="custom_url::llama-3.1-8b-instant")) ]) # Fit the pipeline # Note: For Zero-Shot classification, fit() doesn't train the LLM.

pipeline import Pipeline from skllm .

. . Actual : negative | Predicted : negative Review : This entry is certainly interesting for series fans ( like mys…

3 weeks назад @ machinelearningmastery.com
AI Agent Tool Design: What Works and What Doesn’t
AI Agent Tool Design: What Works and What Doesn’t AI Agent Tool Design: What Works and What Doesn’t

What Works in AI Agent Tool Design1.

The difference becomes clearer when comparing a multi-action tool against dedicated single-purpose tools:# Avoid: action-based multi-behavior tool @tool def manage_customer( action: str, customer_id: str | None = None, data: dict | None = None ): """ action: create | get | update | delete | suspend """ ... # Prefer: single-responsibility tools @tool def create_customer(data: CustomerInput) -> Customer: """Create a new customer record."""

... @tool def suspend_customer(customer_id: str, reason: str) -> SuspensionResult: """Suspend a customer account."""

. . # Prefer: single-responsibility tools @ tool def create_customer ( data : CustomerInput ) -> Custom…

3 weeks, 1 day назад @ machinelearningmastery.com
Python Concepts Every AI Engineer Must Master
Python Concepts Every AI Engineer Must Master Python Concepts Every AI Engineer Must Master

Share Post ShareIn this article, you will learn five essential Python concepts that every AI engineer must master to build scalable, production-grade AI systems.

training = True def __call__ ( self , x ) : return [ val * 1.5 for val in x ] class InferenceProfiler : def __init__ ( self , model ) : self .

model = model def __enter__ ( self ) : self .

) return self def __exit__ ( self , exc_type , exc_val , exc_tb ) : # Restore the original training state self .

training = self .

3 weeks, 4 days назад @ machinelearningmastery.com
Multi-Label Text Classification with Scikit-LLM
Multi-Label Text Classification with Scikit-LLM Multi-Label Text Classification with Scikit-LLM

Share Post ShareIn this article, you will learn how to perform multi-label text classification using large language models and the scikit-LLM library, without the need for labeled training data or complex model training.

Topics we will cover include:What multi-label classification is and why it matters for nuanced text analysis.

And that’s precisely what we will do: load, adapt, and leverage a pre-trained LLM for a multi-label classification task where a piece of text can be assigned one or multiple categories.

to_pandas ( ) # Extract the raw text comments texts = df [ 'text' ] .

Wrapping UpThis article illustrated how to conduct a multi-label text classification process with scikit-LLM: a …

3 weeks, 5 days назад @ machinelearningmastery.com
Multimodal Browser AI with Transformers.js for Images and Speech
Multimodal Browser AI with Transformers.js for Images and Speech Multimodal Browser AI with Transformers.js for Images and Speech

. . < / div > < div class = "tabs" > < div class = "tab active" data - tab = "file" > Upload File < / div > < div class = "tab" data - tab = "mic" > Record Microphone < / div > < / div > < !

. . < / div > < / div > < / div > < !

< / div > < div class = "tabs" > < div class = "tab active" data - tab = "image" > 🖼 Image Analysis < / div > < div class = "tab" data - tab = "speech" > 🎙 Speech Transcription < / div > < / div > < !

. . < / div > < / div > < / div > < !

all ( [ pipeline ( 'image-classification' , 'Xenova/vit-base-patch16-224' , { dtype : 'q8' , progress_callback : p = > p . status === 'done' && markReady ( 'badge-cls' , 'Classifier' ) } ) , pipeline ( 'image-to-text' , 'Xenova/vit…

3 weeks, 6 days назад @ machinelearningmastery.com
ML in Production
последний пост None
Sorta Insightful Sorta Insightful
последний пост 1 month, 2 weeks назад
AI Will Not Make Your Job Chill
AI Will Not Make Your Job Chill AI Will Not Make Your Job Chill

People keep talking about how AI will make their job easy, and I don’t really understand why.

I assume the factory job producing this was still hard work.

I don’t think AI has made my job chill, and I feel like I am front-line compared to much of the economy.

It’s not widely known, but transportation and warehousing has the highest rate of nonfatal work injuries in the US.

For a while, this will not lead to any job loss, because increasing abundance will lead to higher demand.

1 month, 2 weeks назад @ alexirpan.com
Why I Signed The Amicus Brief for Anthropic v Department of War
Why I Signed The Amicus Brief for Anthropic v Department of War Why I Signed The Amicus Brief for Anthropic v Department of War

On Monday, Anthropic filed a lawsuit against the Department of War, and an amicus brief in support of Anthropic was filed on behalf of a number of OpenAI and Google employees.

There’s also an amicus brief filed on behalf of Microsoft.

There’s conflicting reporting, but very broadly, Anthropic signed an agreement with the government to deploy Claude in classified, military contexts.

Anthropic said no, Pete Hegseth declared them a supply chain risk, and Anthropic filed a lawsuit against this.

The amicus brief was broadly aligned with my thoughts on the matter, so I signed.

3 months, 4 weeks назад @ alexirpan.com
MIT Mystery Hunt 2026
MIT Mystery Hunt 2026 MIT Mystery Hunt 2026

This has spoilers for MIT Mystery Hunt 2026.

Pre-HuntThe time running up to Hunt was more stressful than usual…very briefly, I typically hunt with teammate.

Just last year, I did GPH 2025, LN Hunt, Teammate Hunt 2025, Microsoft Hunt 2025, and Silph Puzzle Hunt 2025, all of which had significant 3+ hour solve puzzles that would not be out of place in Mystery Hunt.

Not to mention smaller hunts like Advent Hunt, and then I didn’t even do Brown Puzzlehunt or Vertex Hunt or the fall CMU Hunt.

To me, the crux is whether Mystery Hunt is broken, or Mystery Hunt is fine.

5 months, 1 week назад @ alexirpan.com
Authentic Imperfection
Authentic Imperfection Authentic Imperfection

* * *I’ve been thinking about the anger surrounding generative AI.

To keep things fair, he took the best human images and best AI images, meaning human art from famous artists, and AI art from prompters skilled at removing obvious tells of image generation.

When people complain about AI slop, I see it as a complaint against the deluge of default style AI images.

We’ve seen this happen in all forms: AI text, AI music, older forms of computer generated content like CGI.

As much as we celebrate imperfection, digital imperfection is a step too far.

7 months, 3 weeks назад @ alexirpan.com
Lil'Log
последний пост None
inFERENCe
последний пост 4 months, 1 week назад
The Future of Software
The Future of Software The Future of Software

February 25, 2026The Future of SoftwareThe world of software is undergoing a shift not seen since the advent of compilers in the 1970s.

How will humans tell AI agents what software artefacts we would like to create?

How will humans tell AI agents what software artefacts we would like to create?

This future of software creation, in which our programming languages are abstracted away, raises two very important questions:What will the instruction/specification language look like?

This should be a clear layer of separation between the developer and the pool of AI agents working to maintain software.

4 months, 1 week назад @ inference.vc
Deep Learning is Powerful Because It Makes Hard Things Easy - Reflections 10 Years On
Deep Learning is Powerful Because It Makes Hard Things Easy - Reflections 10 Years On Deep Learning is Powerful Because It Makes Hard Things Easy - Reflections 10 Years On

Deep Learning is Powerful Because It Makes Hard Things Easy - Reflections 10 Years OnTen years ago this week, I wrote a provocative and bold post that blew up, made it to top spot on HackerNews.

In hindsight: There is a lot of stuff in deep learning that we don't understand nearly enough.

Sometimes things work for reasons completely unrelated to why we thought they would work.

(Pop some 🍿 in the microwave and read till the end for more)🎯 "Deep learning is powerful exactly because it makes hard things easy"Okay, this was a great insight.

🎯 Generative ModelingIn the post I suggested people learn "something harder" instead of - or in addition to - deep learning.

5 months, 1 week назад @ inference.vc
The Spectator
последний пост None
The Unofficial Google Data Science Blog The Unofficial Google Data Science Blog
последний пост None
Off the Convex Path
последний пост None
Jay Alammar
последний пост None
Piekniewski's blog
последний пост None
fast.ai NLP fast.ai NLP
последний пост None
Sebastian Ruder
последний пост None
大トロ 大トロ
последний пост None
🔬 Science
Papers With Code Papers With Code
последний пост None
Papers With Code Papers With Code
последний пост None
Papers With Code Papers With Code
последний пост None
💼 University and corporation labs
DeepMind DeepMind
последний пост 4 days, 3 hours назад
Google DeepMind and A24 announce first-of-its-kind research partnership
Google DeepMind and A24 announce first-of-its-kind research partnership Google DeepMind and A24 announce first-of-its-kind research partnership

Today, Google DeepMind and A24 are announcing a first-of-its-kind partnership focused on research.

The collaboration pairs a world-leading research lab with the industry’s most filmmaker-forward studio to help artists develop new workflows and techniques.

This partnership creates a deep research and development collaboration between A24 and Google DeepMind spanning multiple projects over time.

This hands-on collaboration provides Google DeepMind with invaluable feedback and guidance from leading artists.

As A24 and Google DeepMind’s researchers work side-by-side to test, iterate and build, this partnership aims to expand what is possible in the future of entertainment.

4 days, 3 hours назад @ blog.google
Start building with Nano Banana 2 Lite and Gemini Omni Flash
Start building with Nano Banana 2 Lite and Gemini Omni Flash Start building with Nano Banana 2 Lite and Gemini Omni Flash

Uploading audio references and scene extension is not yet supported in the Gemini API for this model.

Video references up to 3 seconds in duration are accepted by the API schema but are not correctly processed by the model at this time.

Gemini Omni is available in public preview starting today in Google AI Studio and the Gemini API.

Use Nano Banana 2 Lite as a high-speed image generation model, then pass that image as a reference to Gemini Omni Flash to animate it into a high-quality video.

To help you get started we created a few demo apps you can remix that let you experience how you can pair both Nano Banana 2 Lite and Gemini Omni Flash into one workflow.

1 week назад @ blog.google
Introducing computer use in Gemini 3.5 Flash
Introducing computer use in Gemini 3.5 Flash Introducing computer use in Gemini 3.5 Flash

Making computer use safe in 3.5 FlashTo mitigate some of the prompt injection risks for agents operating in live environments, we use targeted adversarial training for computer use in Gemini 3.5 Flash.

We’re also releasing two optional enterprise safeguard systems that enable enterprises to:Require explicit user confirmation for sensitive or irreversible actions.

Automatically stop tasks if an indirect prompt injection is identified.

Taking a “defense-in-depth” approach, we encourage developers to combine these features with secure sandboxing, human-in-the-loop verification and strict access controls.

We are already seeing customers drive value with computer use.

1 week, 6 days назад @ blog.google
Unlocking UK house-building with AI-accelerated planning
Unlocking UK house-building with AI-accelerated planning Unlocking UK house-building with AI-accelerated planning

New UK government AI planning prototype built with Gemini aims to halve the time it takes to process homeowner applicationsAround the world, Governments are exploring how AI can deliver better public services, faster.

The UK is working to build 1.5 million new homes by 2029, but local planning authorities are often slowed down by dense paperwork and administrative backlogs.

To help get Britain building, we’re partnering with the UK government to help radically shorten the time it takes to process householder planning applications.

Following early trials in Barnet, Camden and Dorset, the government plans for the new AI planning tool to be made available to all councils nationally from 2027.

2 weeks, 6 days назад @ deepmind.google
Securing the future of AI agents
Securing the future of AI agents Securing the future of AI agents

How we’re securing internal systems against increasingly capable and imperfectly aligned AIAI agents are transforming our relationship with technology.

In the U.S alone, AI agents could create $2.9 trillion in economic value by 2030.

That’s why we developed our AI Control Roadmap: a framework for building and managing the advanced AI we deploy within Google.

Similarly, our AI control system grants AI agents permissions based on their verified behavior, allowing us to build trust through controlled, incremental access.

In our AI Control Roadmap, we map security protocols to measurable milestones in AI capabilities on two critical fronts:

3 weeks назад @ deepmind.google
DiffusionGemma: 4x faster text generation
DiffusionGemma: 4x faster text generation DiffusionGemma: 4x faster text generation

While the AI research community has explored diffusion-based text generation for years, applying it to large models has remained a challenge.

DiffusionGemma changes this by shifting how models use hardware.

But when run locally for a single user, this word-by-word process leaves your dedicated GPU or TPU underutilized — it spends most of its time simply waiting for the next "keystroke."

By giving the computer's processor a larger chunk of work at once, DiffusionGemma utilizes your hardware to its full potential.

It upgrades your model inference from a single, sequential typewriter to a massive printing press that stamps the entire block of text simultaneously.

3 weeks, 6 days назад @ blog.google
Investing in multi-agent AI safety research
Investing in multi-agent AI safety research Investing in multi-agent AI safety research

Scaling AI Safety Research for a Multi-Agent WorldFor the past decade, we’ve focused on making individual AI models more capable, helpful and safe.

The funding call focuses on the study of how large-scale multi-agent AI systems behave as a group, and how we can provide frameworks to understand and mitigate against potential risks.

Scaling the frontier of multi-agent safety researchAlthough foundational frameworks for multi-agent safety exist, the rapid evolution of these systems requires an immediate, large-scale expansion of research.

A collaborative call to actionNo single lab can solve multi-agent safety alone.

Building realistic, reproducible environments to evaluate, compare and accele…

3 weeks, 6 days назад @ deepmind.google
Fluid, natural voice translation with Gemini 3.5 Live Translate
Fluid, natural voice translation with Gemini 3.5 Live Translate Fluid, natural voice translation with Gemini 3.5 Live Translate

Today, we’re taking our next step with the release of Gemini 3.5 Live Translate, our latest audio model for live speech-to-speech translation.

The model automatically detects 70+ languages and generates smooth, natural-sounding translated speech that preserves the speakers' intonation, pacing and pitch.

Unlike turn by turn systems that wait for the speaker to finish speaking before responding, 3.5 Live Translate generates speech continuously, balancing the trade-off between waiting for context to improve quality and translating immediately to stay in sync with the speaker.

Gemini 3.5 Live Translate is rolling out starting today across Google products:For developers in public preview via the…

4 weeks назад @ blog.google
Introducing Gemma 4 12B: a unified, encoder-free multimodal model
Introducing Gemma 4 12B: a unified, encoder-free multimodal model Introducing Gemma 4 12B: a unified, encoder-free multimodal model

Today, we are introducing Gemma 4 12B, our latest model designed to bring agentic multimodal intelligence directly to laptops.

Here’s an overview of what makes Gemma 4 12B unique:Novel unified architecture: No multimodal encoders.

Advanced reasoning: Benchmark performance nearing our 26B model, unlocking powerful multi-step reasoning and agentic workflows.

Benchmark performance nearing our 26B model, unlocking powerful multi-step reasoning and agentic workflows.

Small enough to run locally on consumer laptops with 16GB of RAM, it unlocks powerful multimodal and agentic experiences right on your machine.

4 weeks назад @ blog.google
Powering the future of robotics in Europe
Powering the future of robotics in Europe Powering the future of robotics in Europe

That’s why we’re launching the Google DeepMind Accelerator: Robotics, a three-month program for early-stage robotics startups across Europe.

They’ll have access to our AI stack, technical expertise and Gemini robotics models.

Extend Robotics ( United Kingdom ): Provides teleoperation software and data pipelines that help train and fine-tune foundation models for real-world robotics applications.

Generative Bionics ( Italy ): Amplifies human potential by developing humanoid robots based on physical AI, developed in Europe but built to scale globally.

): Amplifies human potential by developing humanoid robots based on physical AI, developed in Europe but built to scale globally.

4 weeks назад @ blog.google
Measuring the impact of learning with AI in Sierra Leone and beyond
Measuring the impact of learning with AI in Sierra Leone and beyond Measuring the impact of learning with AI in Sierra Leone and beyond

The results from this pre-registered trial suggest that AI can be a powerful pedagogical partner — not by replacing teachers, but by augmenting their reach.

Students using Guided Learning saw a gain of +0.258 standard deviations in their math scores compared to the control group.

In practical terms, this represents roughly 1.2 to 1.7 years of typical learning progress achieved within the eight-week trial.

To further understand the impact of Guided Learning on student learning, we are conducting a series of additional pre-registered RCTs globally.

Additionally, our support of the Global AI for Learning Alliance (GAILA) will accelerate these commitments and others through collective action.

4 weeks, 1 day назад @ deepmind.google
We’re launching the Google DeepMind Accelerator program in Asia Pacific to tackle environmental risks
We’re launching the Google DeepMind Accelerator program in Asia Pacific to tackle environmental risks We’re launching the Google DeepMind Accelerator program in Asia Pacific to tackle environmental risks

The Asia-Pacific region is a global engine for economic growth, but it's also highly vulnerable to climate change.

While green technologies are gaining momentum, a recent report shows they aren’t scaling fast enough to keep up with the region’s rising environmental risks.

Selected organizations will receive expert mentorship, tailored support and help integrating frontier AI and science AI models from Google AI experts into their projects or products.

If you're working on climate solutions, we want to help you scale your work.

The program kicks off with an in-person bootcamp in Singapore, and you can learn more and register your interest today.

1 month, 2 weeks назад @ blog.google
Fast-tracking genetic leads to reverse cellular aging
Fast-tracking genetic leads to reverse cellular aging Fast-tracking genetic leads to reverse cellular aging

Biologists Omar Abudayyeh and Jonathan Gootenberg are using Co-Scientist to help them blast through both.

Their lab runs huge genetic screens that flip thousands of genes on or off then reads how cells respond to these changes.

Co-Scientist is helping on two fronts.

Second, Co-Scientist speeds up the follow-through.

Having Co-Scientist analyse their screening data alongside the literature, that work is slashed to just a few days.

1 month, 2 weeks назад @ deepmind.google
Simulate real-world places with Project Genie and Street View
Simulate real-world places with Project Genie and Street View Simulate real-world places with Project Genie and Street View

Street View: ground your worlds in real placesWhen creating imaginative worlds in Project Genie, you can now also base them on real places.

This capability is powered by Maps Imagery Grounding, the same technology developers use to create stunning AI visuals with Street View.

Street View imagery in Project Genie is available now for places in the U.S. with plans to expand to more places over time.

Project Genie: now available with Google AI UltraStarting today, Project Genie — including the new Street View capability — is gradually rolling out to all eligible Google AI Ultra $200 subscribers globally (18+).

Try creating today with Project Genie.

1 month, 2 weeks назад @ blog.google
Introducing Gemini Omni
Introducing Gemini Omni Introducing Gemini Omni

We’re introducing Gemini Omni, where Gemini’s ability to reason meets the ability to create.

Omni is our new model that can create anything from any input — starting with video.

With Omni, you can combine images, audio, video and text as input and generate high-quality videos grounded in Gemini's real-world knowledge.

Today, we’re rolling out the first model in the Omni family: Gemini Omni Flash, to the Gemini app, Google Flow and YouTube Shorts.

Here’s some of what makes Omni special:Edit your videos through conversationGemini Omni gives you an easier way to edit video — with natural language.

1 month, 2 weeks назад @ blog.google
Google
последний пост 2 часа назад
Report: 83% of organizations need to upgrade their infrastructure to support agentic AI
Report: 83% of organizations need to upgrade their infrastructure to support agentic AI Report: 83% of organizations need to upgrade their infrastructure to support agentic AI

In this blog, we lay out the core insights from our research on how leading organizations are rethinking their infrastructure to build resilient, fluid foundations.

To fix this, organizations need fluid compute — the ability to dynamically match the right silicon to the right task while minimizing operational overheads.

For orchestration: General-purpose compute powered by CPUs is emerging as a critical component for driving AI control plane operations.

But as agentic AI scales, organizations are facing a new challenge: agent sprawl.

Agent Gateway gives you the visibility you need to see exactly how agents are sharing data.

2 часа назад @ cloud.google.com
20 questions for the Agentic Enterprise (and how Agent Platform can help)
20 questions for the Agentic Enterprise (and how Agent Platform can help) 20 questions for the Agentic Enterprise (and how Agent Platform can help)

That’s why we built Gemini Enterprise Agent Platform.

When integrated with Agent Platform, Model Armor intercepts prompts before they reach Gemini models, and intercepts responses before your application receives them.

This is where Agent Platform Threat Detection (part of Security Command Center) comes in.

Example: Build with Agents CLI hereGet started todayBy tackling these 20 questions early, you can build agents that actually do real work for your business — without keeping your security and operations teams up at night.

Get started with Gemini Enterprise Agent Platform here.

2 часа назад @ cloud.google.com
Drive proactive security, prioritize risks with Google Threat Intelligence and Wiz ASM
Drive proactive security, prioritize risks with Google Threat Intelligence and Wiz ASM Drive proactive security, prioritize risks with Google Threat Intelligence and Wiz ASM

To help you be more proactive by matching your real-world exposures with real-time adversary activity, we’ve begun integration efforts between Google Threat Intelligence and Wiz Attack Surface Management (ASM).

By connecting exposure and validated exploitable risks directly to real-time threat intelligence, we can help you detect and prioritize external-facing exploitable issues and uncover logic-driven vulnerabilities with AI scanning at the speed needed for today’s defenses.

This allows you to shift to a strategy that prioritizes actions based on the real-world threats that pose the greatest risks to your organization.

Combining these two perspectives on threats can help you move from rea…

2 часа назад @ cloud.google.com
A developer's guide to publishing agents in Gemini Enterprise and Google Cloud Marketplace
A developer's guide to publishing agents in Gemini Enterprise and Google Cloud Marketplace A developer's guide to publishing agents in Gemini Enterprise and Google Cloud Marketplace

Here’s an overview of these architectural elements:Customer project: Where users discover agents via the dedicated Agent Marketplace category within Google Cloud Marketplace and interact with these agents through the Gemini Enterprise app.

Step 2: Review the organizational requirements to sell on MarketplaceJoin the Google Cloud Partner Network : If you're new to offering your solutions on Marketplace, join the Google Cloud Partner Network.

Nominate your agent for Google Cloud Marketplace by contacting your Google Cloud representative.

A2A Agent Card: Create an Agent Card, a JSON file declaring capabilities (skills), authentication methods, and service endpoints.

A2A agent cardTo list your …

2 часа назад @ cloud.google.com
Shift into high gear with agents: Securing the software-defined vehicle
Shift into high gear with agents: Securing the software-defined vehicle Shift into high gear with agents: Securing the software-defined vehicle

The era of the traditional connected vehicle has shifted into the age of the software-defined vehicle (SDV), notable for rapid innovation with many new capabilities delivered over the air.

To better support and secure SDVs, Google Cloud and Valtech have partnered to develop Nexus SDV, a highly-scalable, AI-enabled connected vehicle platform built on Google Cloud.

Cloud-native under the hoodThe architecture of Nexus SDV is built on a modular, cloud-native foundation designed to bridge the gap between the vehicle edge and the data center.

This robust data loop allows Nexus AI to quickly push intelligent updates and services back to the vehicle.

By providing this developer-friendly, open frame…

1 day, 2 hours назад @ cloud.google.com
AlloyDB AI Functions - now with revolutionary performance boosts and cost savings
AlloyDB AI Functions - now with revolutionary performance boosts and cost savings AlloyDB AI Functions - now with revolutionary performance boosts and cost savings

Here is a sample result of summarized reviews for two gaming console products:productname reviews_summary AlphaCore Console Users praise the stunning 4K graphics, smooth 120Hz frame rates, and the highly ergonomic controller design.

We have shattered these barriers by introducing two breakthrough capabilities:Smart Batching for AI Functions: This AI Function Acceleration capability provides intelligent batching of AI function calls for optimal performance and quality.

That’s because, AlloyDB intelligently determines the right batch size for optimal results - if you underestimate the batch size, you won’t reap gains for cost and latency, and if you overestimate the batch size, the prompt to …

6 days назад @ cloud.google.com
Get started with the Claude apps gateway for Google Cloud
Get started with the Claude apps gateway for Google Cloud Get started with the Claude apps gateway for Google Cloud

Anthropic's agentic coding tool Claude Code has worked with Google Cloud for a while now.

An individual developer could easily point CLAUDE_CODE_USE_VERTEX=1 at a Google Cloud (GCP) project, grant the role roles/aiplatform.user , and inference stays inside your Google Cloud perimeter.

It is a self-hosted service, shipped with the same claude binary, that sits directly between your local Claude Code clients and Google Cloud.

This post breaks down exactly why you should run it and what a secure deployment looks like on Google Cloud.

(Note: If you want to jump straight to the code, the full walkthrough lives in the Claude apps gateway on Google Cloud docs.)

6 days, 2 hours назад @ cloud.google.com
Build agents even faster with Gemini Enterprise Agent Platform’s fully-managed, remote MCP server
Build agents even faster with Gemini Enterprise Agent Platform’s fully-managed, remote MCP server Build agents even faster with Gemini Enterprise Agent Platform’s fully-managed, remote MCP server

Today, we’ll dive into how to use the Gemini Enterprise Agent Platform remote MCP server to securely connect your external AI agents to the resources inside your Google Cloud environment.

Connect your IDE to Google CloudThink of the Agent Platform MCP server as a bridge between your favorite external development tools and your Google Cloud architecture.

If you are building an agent in Antigravity CLI or Claude Code, for example, the Agent Platform MCP server allows that agent to securely interact with your Agent Platform resources.

The Agent Platform MCP server provides a single, standardized interface for your external agents so you can spend less time writing integration code and more tim…

1 week назад @ cloud.google.com
How Schrödinger sped up molecular discovery by 4x with Alphaevolve
How Schrödinger sped up molecular discovery by 4x with Alphaevolve How Schrödinger sped up molecular discovery by 4x with Alphaevolve

When it comes to modern drug discovery and materials design, though, there’s demand for even faster processing speeds to handle massive chemical libraries involved.

Schrödinger's primary technical goal was speeding up AI model training for energy and force calculations.

Specifically, they targeted the Ewald summation, a critical but computationally demanding function used in molecular mechanics.

By incorporating AlphaEvolve into their models, the system could generate a batched implementation of the Ewald summation using parallel batch matrix multiplication.

This acceleration lets researchers compress molecular screening timelines and directly benefits several key research areas:Drug discov…

1 week назад @ cloud.google.com
Bringing speed and strong cost performance to the market with Gemini Omni Flash and Nano Banana 2 Lite
Bringing speed and strong cost performance to the market with Gemini Omni Flash and Nano Banana 2 Lite Bringing speed and strong cost performance to the market with Gemini Omni Flash and Nano Banana 2 Lite

To help you create rich, reliable experiences while reducing regeneration time and costs, we’re adding two new models to Gemini Enterprise Agent Platform.

First, we’re announcing the general availability of Nano Banana 2 Lite (Gemini 3.1 Flash-Lite Image).

This model is the fastest and most cost-efficient image generation and editing model within the Nano Banana model family.

We’re also releasing Gemini Omni Flash in public preview.

Grounded in Gemini's real-world knowledge, it powers high-quality video generation and conversational editing.

1 week назад @ cloud.google.com
Cloud CISO Perspectives: How Google Cloud Security uses AI internally
Cloud CISO Perspectives: How Google Cloud Security uses AI internally Cloud CISO Perspectives: How Google Cloud Security uses AI internally

Centralized AI code scanning and the Mantis frameworkNaive, decentralized AI code scanning suffers from sloppiness, frequently hallucinating bugs and yielding true-positive rates under 7%.

To solve this, we built Mantis, our core multi-agent orchestration framework designed specifically for scalable, context-aware repository analysis.

The core skills at the heart of Mantis are now open source to demonstrate the fundamental concept.

Research agents : Acting as specialized domain investigators, these agents use internal code searches to drill into raw source files, examining data tracking, control flows, and sanitization logic.

Self-healing fuzz testingWhile code scanning provides breadth, dy…

1 week, 1 day назад @ cloud.google.com
Synthesize the big picture and analyze trends with BigQuery's AI.AGG function
Synthesize the big picture and analyze trends with BigQuery's AI.AGG function Synthesize the big picture and analyze trends with BigQuery's AI.AGG function

While BigQuery already offers powerful AI functions that help you analyze individual rows of data, analyzing unstructured data at scale requires a different approach.

AI.AGG() lets you ask questions from unstructured data such as logs and documents, for example:What are the top three feature requests among the negative product reviews?

Analyzing system logs with AI.AGG()A great example of the power of AI.AGG() is analyzing system logging.

In fact, our BigQuery engineering team used this exact approach while developing AI.AGG() — using the function to help identify edge cases related to input handling for the feature itself!

You can load the sample data file into BigQuery using any of the su…

1 week, 1 day назад @ cloud.google.com
Securing agentic AI with perimeter guardrails: What's new in VPC Service Controls
Securing agentic AI with perimeter guardrails: What's new in VPC Service Controls Securing agentic AI with perimeter guardrails: What's new in VPC Service Controls

To help organizations confidently deploy these workflows, we recommend VPC Service Controls (VPC-SC) to establish an essential network-level, destination-based perimeter.

What's new in VPC Service ControlsDesigned to enhance AI security, the new capabilities we’re announcing today strengthen boundaries enforced by VPC-SC.

VPC Service Controls now support conditional access rules based on specific MCP attributes, including mcp.toolName , mcp.method , and mcp.tool.isReadOnly .

"At Mercado Libre, VPC Service Controls serve as an essential, foundational layer of our security architecture.

While identity and network controls effectively secure the front door, VPC Service Controls provide a criti…

1 week, 4 days назад @ cloud.google.com
Verifiable, private AI: Google Cloud expands Confidential Computing frontiers
Verifiable, private AI: Google Cloud expands Confidential Computing frontiers Verifiable, private AI: Google Cloud expands Confidential Computing frontiers

This includes leveraging Google Cloud Confidential Computing with Intel TDX, NVIDIA Confidential Computing with NVIDIA Blackwell GPUs, our Titanium security architecture with the Titan chip, and a co-engineered open-source host stack to ensure verifiable transparency.

To dive deeper into this collaboration, read our blog post: Powering the next era of Confidential AI.

Advancing confidential foundationsGoogle Cloud is committed to making Confidential Computing capabilities broadly available across our infrastructure.

Accelerating secure collaboration: Confidential Space with H100 GPU supportTo power secure multi-party AI and machine learning, Confidential Space support for NVIDIA Hopper GPUs…

2 weeks назад @ cloud.google.com
From AI potential to agentic reality: Driving the UK’s next chapter
From AI potential to agentic reality: Driving the UK’s next chapter From AI potential to agentic reality: Driving the UK’s next chapter

Developed in collaboration with Google Cloud, the studio will help British organisations move beyond AI experimentation to deploy autonomous, action-oriented AI systems at scale.

Deloitte is also committing to upskill 1,000 members of its UK AI and data workforce on Gemini Enterprise.

We also continue to foster the next generation of British unicorn startups through our ongoing partnership with Tech Nation at the London AI Hub.

At Google, we are committed to carbon-free energy 24/7, ensuring that the UK’s AI growth does not come at the cost of our climate goals.

Architecting the future togetherGoogle Cloud is the primary partner for the UK’s agentic transition.

2 weeks, 6 days назад @ cloud.google.com
OpenAI
последний пост None
Microsoft Microsoft
последний пост 1 week назад
SkillOpt: Agent skills as trainable parameters
SkillOpt: Agent skills as trainable parameters SkillOpt: Agent skills as trainable parameters

SkillOpt treats an agent skill file as a trainable parameter outside a frozen target model, turning skill writing from one-shot prompting into a controlled optimization process.

SkillOpt keeps skills compact and auditable through bounded text edits, validation gating, rejected-edit feedback, and slow/meta updates, avoiding uncontrolled prompt drift.

The optimized skills transfer across model scales, agent harnesses, and related tasks, suggesting that they capture reusable workflow knowledge rather than benchmark-specific instructions.

Today, agent skills typically come from three sources: experts write them by hand, a frontier model generates them one-shot, or the agent loosely revises them…

1 week назад @ microsoft.com
Memora: A Harmonic Memory Representation Balancing Abstraction and Specificity
Memora: A Harmonic Memory Representation Balancing Abstraction and Specificity Memora: A Harmonic Memory Representation Balancing Abstraction and Specificity

Memora is a scalable memory system that dramatically increases agent productivity on long-horizon tasks by decoupling what is stored (rich memory content) from how it’s retrieved (lightweight abstractions and cue anchors), balancing abstraction and specificity.

is a scalable memory system that dramatically increases agent productivity on long-horizon tasks by decoupling is stored (rich memory content) from it’s retrieved (lightweight abstractions and cue anchors), balancing abstraction and specificity.

Why this is hard: the abstraction–specificity tensionExisting memory systems fall into two extremes.

None of these resolves the underlying tension between abstraction (which keeps memory effi…

1 week назад @ microsoft.com
Understanding the brain with AI-driven explanations and experiments
Understanding the brain with AI-driven explanations and experiments Understanding the brain with AI-driven explanations and experiments

As black-box models spread, the gap between prediction and understanding has become one of the central problems in computational neuroscience.

GCT distills brain-prediction models into short, readable accounts of what each patch of cortex responds to, then tests those claims.

An LLM writes new stories engineered to activate a specific brain area, subjects hear them in the scanner, and if the explanation is correct, the targeted region lights up.

An LLM writes new stories engineered to activate a specific brain area, subjects hear them in the scanner, and if the explanation is correct, the targeted region lights up.

To build trust in the explanation, GCT uses an LLM to write new stories in w…

1 week, 5 days назад @ microsoft.com
Talos: Scaling rare disease diagnosis with automated, iterative genomic reanalysis
Talos: Scaling rare disease diagnosis with automated, iterative genomic reanalysis Talos: Scaling rare disease diagnosis with automated, iterative genomic reanalysis

At a glance Talos is an open-source tool for automated, iterative reanalysis of genomic data in rare disease.

Deployed across a prospective cohort of almost 5,000 undiagnosed patients, Talos delivered 241 new diagnoses (5.1% additional yield).

On monthly iterative cycles, analysts only needed to review one new variant per 200 patients, demonstrating that frequent, systematic reanalysis can be run sustainably.

Why genome reanalysis mattersGenomic testing has transformed the diagnosis of rare disease, but even with this advancement, more than half of patients remain undiagnosed after their first test.

Looking aheadTalos reframes genomic reanalysis from a rare, labor-intensive event into a con…

1 week, 6 days назад @ microsoft.com
Ire identifies another LOTUSLITE specimen
Ire identifies another LOTUSLITE specimen Ire identifies another LOTUSLITE specimen

At a glance Project Ire identifies a LOTUSLITE variant that shares TTPs (tools, tactics, procedures) with the public family but none of its indicators of compromise (IOC).

On Ire’s calibrationOne noteworthy observation in Ire’s report (opens in new tab) is worth highlighting first.

The Ire report does not surface a matching entry-point name, but it identifies that the behavioral shape is the same.

Ire never named LOTUSLITE in its report or chain of evidence.

Ire described the behavior precisely enough to make the mapping straightforward of this sample to LOTUSLITE.

3 weeks, 3 days назад @ microsoft.com
Data Formulator 0.7: AI-powered data analytics for enterprise data
Data Formulator 0.7: AI-powered data analytics for enterprise data Data Formulator 0.7: AI-powered data analytics for enterprise data

At a glance Data Formulator 0.7 is an open-source AI-powered system for enterprise data analytics that combines data connectivity, agent-guided exploration, and visualization refinement in a shared workspace.

Enterprise teams increasingly rely on AI systems for analytics, but enterprise data workflows are often fragmented across storage systems and tools.

Listen now Opens in a new tabConnecting enterprise data with Data ConnectorsData Formulator helps teams bring enterprise data into an AI-ready workspace without needing to rebuild the same connections for every source of data.

Data Connectors provide persistent connections between enterprise data sources and Data Formulator, allowing analy…

1 month, 1 week назад @ microsoft.com
Extending Human Intelligence Through AI
Extending Human Intelligence Through AI Extending Human Intelligence Through AI

At a glance Modern AI systems are powerful not because they replicate human intelligence, but because they presuppose it, by extending structures already present in human cognition and language.

Understanding AI as an extension of human intelligence—not a replacement for it—offers a more grounded path for building trustworthy AI systems.

Rather than asking whether AI systems are becoming intelligent in the human sense, these approaches ask a more basic question: What if AI systems work because they rely on structures that are rooted in human cognition?

In our recent paper, The Origins of Artificial Intelligence in Natural Intelligence, we argue that modern AI systems are best understood nei…

1 month, 1 week назад @ microsoft.com
MagenticLite, MagenticBrain, Fara1.5: An agentic experience optimized for small models
MagenticLite, MagenticBrain, Fara1.5: An agentic experience optimized for small models MagenticLite, MagenticBrain, Fara1.5: An agentic experience optimized for small models

Built as the next generation of Magentic-UI, it combines a redesigned app with a harness optimized for small models.

MagenticBrain and Fara1.5 are small models designed for orchestration and computer-use tasks, respectively.

Together, these releases explore how far agentic performance can be pushed with smaller models, codesigned tools, and an optimized execution harness.

Today, Microsoft Research AI Frontiers releases MagenticLite (opens in new tab), an experimental agentic application designed for small models.

The result is an agent that runs efficiently, keeps data on the user’s machine, and supports a broad range of agentic tasks.

1 month, 2 weeks назад @ microsoft.com
Vega: Zero-knowledge proofs for digital identity in the age of AI
Vega: Zero-knowledge proofs for digital identity in the age of AI Vega: Zero-knowledge proofs for digital identity in the age of AI

Vega puts these building blocks together into a single proof system.

The hashing problem, and how folding solves itA credential proof must do two expensive things: hash the credential bytes with SHA-256 and verify the issuer’s digital signature.

Making it zero-knowledge, cheaplyA proof system needs to be zero-knowledge: the verifier should learn nothing beyond the claim being proved.

Device bindingA zero-knowledge credential proof is only useful if it is tied to the person holding the credential.

The proof system powering Vega is already available as the open-source spartan2 (opens in new tab) project on GitHub.

1 month, 2 weeks назад @ microsoft.com
Further Notes on Our Recent Research on AI Delegation and Long-Horizon Reliability
Further Notes on Our Recent Research on AI Delegation and Long-Horizon Reliability Further Notes on Our Recent Research on AI Delegation and Long-Horizon Reliability

Our recent paper, “LLMs Corrupt Your Documents When You Delegate”, has generated discussion about the reliability of AI systems in delegated workflows.

Using a controlled evaluation methodology, we examine how well information is preserved across these extended workflows.

We use chained transformation-and-inversion tasks that evaluate whether semantic content is preserved accurately across extended delegated workflows.

Azure AI Foundry Labs Get a glimpse of potential future directions for AI, with these experimental technologies from Microsoft Research.

At the same time, the findings should not be interpreted as evidence that AI systems lack practical value in real-world work today.

1 month, 3 weeks назад @ microsoft.com
mimalloc: A new, high-performance, scalable memory allocator for the modern era
mimalloc: A new, high-performance, scalable memory allocator for the modern era mimalloc: A new, high-performance, scalable memory allocator for the modern era

mimalloc is an open-source, modern, scalable memory allocator that is a drop-in replacement for malloc and free.

The mimalloc memory allocator was initially designed in 2020 as a fast allocator for the state-of-the-art Lean (opens in new tab) and Koka (opens in new tab) programming languages developed at RiSE, both of which use novel compiler-guided reference counting (see Perceus).

ja .LBB0_generic leaq 7 ( %rsi ), %rax ; round to sizeof(void*) andq $-8 , %rax movq 232 ( %rdi , %rax ), %rcx ; rcx = heap->small_pages[index] movq 8 ( %rcx ), %rax ; block = rax = page->free testq %rax , %rax ; block == NULL?

Thus, mimalloc has three free lists per (64 KiB) mimalloc page, and effectively that …

1 month, 3 weeks назад @ microsoft.com
GridSFM: A new, small foundation model for the electric grid
GridSFM: A new, small foundation model for the electric grid GridSFM: A new, small foundation model for the electric grid

Microsoft releases a lightweight foundation model that can predict AC optimal power flow in milliseconds, boosting efficiency and unlocking cost savings in grid analysis.

It provides a foundation for the community to build advanced power grid simulators and planning tools without recreating data or models from scratch.

Microsoft introduces GridSFM, a small foundation model for solving AC optimal power flow (AC-OPF) problems in transmission power grids.

Power grids face increasing strain from surging demand, the need to integrate renewable energy sources, transportation electrification, and extreme weather events.

This release adds the first open AC-OPF model that supports multiple grid topo…

1 month, 3 weeks назад @ microsoft.com
Advancing AI for materials with MatterSim: experimental synthesis, faster simulation, and multi-task models
Advancing AI for materials with MatterSim: experimental synthesis, faster simulation, and multi-task models Advancing AI for materials with MatterSim: experimental synthesis, faster simulation, and multi-task models

Now we have experimentally synthesized it and measured its thermal conductivity (152 W/m/K) to be close to the thermal conductivity of silicon.

Now we have experimentally synthesized it and measured its thermal conductivity (152 W/m/K) to be close to the thermal conductivity of silicon.

Faster simulation : We have accelerated MatterSim-v1 model inference by 3-5x and integrated it with the LAMMPS software package, enabling large-scale simulations across multiple GPUs.

These include experimental validation of MatterSim predictions for thermal conductors, performance improvements for faster simulation, and the introduction of a new multi-task foundation model for materials characterization.

Le…

1 month, 3 weeks назад @ microsoft.com
SocialReasoning-Bench: Measuring whether AI agents act in users’ best interests
SocialReasoning-Bench: Measuring whether AI agents act in users’ best interests SocialReasoning-Bench: Measuring whether AI agents act in users’ best interests

In our simulated multi-agent marketplace, agents accepted the first proposal they received up to 93% of the time without exploring alternatives.

Introducing SocialReasoning-BenchFigure 1: Our benchmark measures agents’ social reasoning ability in two domains, calendar coordination and marketplace negotiation.

Finding 3: Outcome optimality shows how much value agents leave on the table.

In calendar, agents perform better but still settle below the midpoint on average.

Finally, Outcome Optimality works well in settings with clear boundaries, where a “good” outcome can be defined and measured.

1 month, 3 weeks назад @ microsoft.com
Building realistic electric transmission grid dataset at scale: a pipeline from open dataset
Building realistic electric transmission grid dataset at scale: a pipeline from open dataset Building realistic electric transmission grid dataset at scale: a pipeline from open dataset

The ability to study transmission-level power grid behavior is essential for modern power systems research.

In most of the world, including the United States, realistic transmission-level grid data is classified as critical infrastructure information and subject to strict access controls.

These restrictions exist for good reasons, but the resulting lack of realistic grid models is increasingly exacerbating the challenges power systems face.

In this work, we introduce an open-data-derived pipeline for constructing large-scale, transmission-level power grid models that realistically approximate existing networks without relying on proprietary or restricted datasets.

Using only publicly access…

1 month, 4 weeks назад @ microsoft.com
MIT AI MIT AI
последний пост 47 минут назад
How novice coders can develop AI programs for military applications
How novice coders can develop AI programs for military applications How novice coders can develop AI programs for military applications

We both wanted to understand better where and how AI could be used by nontechnical users in the military."

During the project, Lynch completed several professional development courses in AI and familiarized himself with both military and nonmilitary uses of the technology.

For the basis for his code generation, he used the paid models of three AI chatbots: Anthropic's Claude, OpenAI's ChatGPT, and Google's Gemini.

For example, he often encountered difficulties with the AI chatbots lacking hierarchical focus and modifying unrelated code sections.

Although AI can generate significant amounts of functional code, code review remains a bottleneck in this space.

47 минут назад @ news.mit.edu
Jesse Thaler named director of the Laboratory for Nuclear Science
Jesse Thaler named director of the Laboratory for Nuclear Science Jesse Thaler named director of the Laboratory for Nuclear Science

Professor Jesse Thaler has been named director of the MIT Laboratory for Nuclear Science (LNS), effective Aug. 1.

Thaler is a theoretical particle physicist who combines techniques from quantum field theory and machine learning to address outstanding questions in fundamental physics.

Mike Williams, professor of physics, will succeed Thaler as IAIFI director.

Established in 1946 to support nuclear and particle physics, LNS now encompasses research spanning cosmology, gravity, field theory, and quantum information science.

As head of LNS, Thaler will also oversee his home center of CTP-LI, which last year received a donation from the Leinweber Foundation to establish a network of theoretical …

3 часа назад @ news.mit.edu
Toward a future that preserves benefits of neurotechnology for all
Toward a future that preserves benefits of neurotechnology for all Toward a future that preserves benefits of neurotechnology for all

Sava’s concept was inspired by an internship at IBM, where she worked on a project with the PACE Center in London.

As advanced medical technology gets closer to hitting consumer markets, the need for guardrails on protected usage should increase.

What might begin as a neural implant to aid in communication could become a device used to police one’s innermost thoughts.

From its inception, the competition has consistently attracted undergraduate and graduate students from across a wide range of disciplines.

The judges also named four honorable mentions, each of whom received a $500 cash prize.

22 часа назад @ news.mit.edu
MIT in the media: Innovating and educating for the next 250 years of America
MIT in the media: Innovating and educating for the next 250 years of America MIT in the media: Innovating and educating for the next 250 years of America

Inspired by MIT’s motto, “mens et manus” (mind and hand), she shared: “We really want students to be able to use physical AI.

The economic impact of MIT on this country is equivalent to the 14th largest GDP in the world.

She further highlighted MIT for America, an initiative expanding access to calculus, a required course for institutions such as MIT, in under-resourced high schools nationwide.

“What we [ASU] learn from MIT is, where’s the edge of technology,” said Crow.

Kornbluth expressed her hope for MIT to continue its longstanding tradition of research and education in service of the nation’s next 250 years.

5 days, 21 hours назад @ news.mit.edu
Q&A: What is agentic AI today, and what do we want it to be?
Q&A: What is agentic AI today, and what do we want it to be? Q&A: What is agentic AI today, and what do we want it to be?

A November 2025 report by MIT Sloan School of Management and Boston Consulting Group found that 35 percent of surveyed businesses had already deployed AI agents, while another 44 percent planned to implement agentic AI soon.

Q: What is agentic AI and how is it different from generative AI models like ChatGPT and Claude?

A: Agentic AI is AI that takes actions in the world.

Q: What are some promising applications of agentic AI?

Q: What does the future hold for agentic AI?

1 week назад @ news.mit.edu
Inaugural Music Technology Research Showcase celebrates work of new graduate program’s initial students
Inaugural Music Technology Research Showcase celebrates work of new graduate program’s initial students Inaugural Music Technology Research Showcase celebrates work of new graduate program’s initial students

The MIT Music Technology and Computation (MTC) Graduate Program — launched in fall 2024 as a collaboration between the Music and Theater Arts Section in the School of Humanities, Arts, and Social Sciences (SHASS), and the School of Engineering (SoE) — presented its inaugural MIT Music Technology Research Showcase on May 13.

Each scholar presented inspiring exemplars of artful engineering that reflected the broader and burgeoning music technology scene at MIT.

“The MIT Music Technology and Computation Graduate Program taught me so much about the possibilities at the intersection of STEM and the arts," she says.

What does it mean to build music technology in this context?

All considered, the …

1 week назад @ news.mit.edu
3 Questions: Beyond data-driven aesthetics
3 Questions: Beyond data-driven aesthetics 3 Questions: Beyond data-driven aesthetics

Q: What inspired “Beyond Data-Driven Aesthetics,” and what questions does it explore?

A: The conceptual origins of “Beyond Data-Driven Aesthetics” emerged from three intersecting lines of research.

Second, the exhibition was influenced by research in design computation and shape grammars that investigates relationships between human insight and computation through rule-based methods, rather than purely data-driven learning.

The exhibition itself is organized around five thematic areas: Aesthetic Measure, Aesthetic Guidelines, Algorithmic Aesthetics, Aesthetic Appropriation, and Aesthetic Novelty.

A: “Beyond Data-Driven Aesthetics” is conceived both as a research exhibition and as an ongoing…

1 week, 1 day назад @ news.mit.edu
David Autor named head of the Department of Economics
David Autor named head of the Department of Economics David Autor named head of the Department of Economics

David Autor, the Daniel (1972) and Gail Rubinfeld Professor in the MIT Department of Economics, has been named head of the Department of Economics, effective July 1.

“David is a world-class labor economist,” says Agustín Rayo, the Kenan Sahin Dean of the School of Humanities, Arts, and Social Sciences.

“I’ve been at MIT since 1999, and I owe my career to the Institute, the department, and colleagues who are as kind as they are accomplished,” Autor says.

Autor serves as co-director of the National Bureau of Economic Research (NBER) Labor Studies Program.

In 2024, Autor was one of five senior scholars selected by the Schmidt Sciences Foundation as an AI2050 Senior Fellow.

1 week, 4 days назад @ news.mit.edu
LLMs help robots understand vague instructions and focus on key details
LLMs help robots understand vague instructions and focus on key details LLMs help robots understand vague instructions and focus on key details

Their “Masked Inverse Reinforcement Learning” (Masked IRL) approach uses a large language model (LLM) to elaborate on ambiguous prompts based on the data collected from a user’s demo.

To learn new tasks in these situations, Masked IRL uses the robot’s sensors to capture information about its surroundings.

These masks gave Masked IRL a key advantage over comparable baselines in both 3D and real-world demos because it taught a robot which information to prioritize.

During simulation experiments, CSAIL researchers also found that Masked IRL was a fast learner.

Masked IRL senses and explains what users leave unsaid, but soon, it might “see” it too.

1 week, 4 days назад @ news.mit.edu
MIT in the media: Exploring how curiosity-driven science is an essential ingredient in America’s success
MIT in the media: Exploring how curiosity-driven science is an essential ingredient in America’s success MIT in the media: Exploring how curiosity-driven science is an essential ingredient in America’s success

Over the past 80 years, America’s bold, sustained investment in scientific research, and the discoveries, ideas and innovations that flowed from it made America a world leader.

The nation’s scientific leadership has been essential to our shared prosperity and national security, and delivered real benefits for all Americans.

Likewise, Prof. John Urschel, a former NFL player, emphasizes the importance of collaboration and having a wide range of interests.

The benefits of scientific collaborationWhat happens when scientific disciplines join forces at MIT?

“Computers have changed everything, including science.”The state of American scienceWithin the profiles, interviewees were asked what needs …

1 week, 5 days назад @ news.mit.edu
Improving the speed and energy-efficiency of AI agents
Improving the speed and energy-efficiency of AI agents Improving the speed and energy-efficiency of AI agents

To improve efficiency, researchers from MIT and Microsoft developed an intelligent system that streamlines the process of designing agentic workflows and automatically optimizes how those workflows are implemented.

It adjusts those configurations on the fly based on each user’s priorities, such as minimizing costs or maximizing speed.

“Agentic workflows are getting very complicated and quickly becoming the backbone of what cloud providers are doing.

They need to define which AI agents, models, and tools to use, and the order in which to use them.

When tested on diverse agentic workflows for video Q&A and code generation, Murakkab met user requirements while using only about 35 percent of th…

1 week, 5 days назад @ news.mit.edu
Exploring the societal impacts of AI
Exploring the societal impacts of AI Exploring the societal impacts of AI

It was presented in collaboration with two of MIT’s strategic initiatives: the MIT Generative AI Impact Consortium (MGAIC) and the MIT Human Insight Collaborative (MITHIC).

“Paying attention to the societal consequences of AI is not a departure from MIT’s mission; it’s a way of ensuring that our technical leadership has maximum impact,” Rayo said.

He argued that AI will likely create new specialized work, requiring proactive policies around worker training, wage insurance, and broader capital ownership.

Her research team is now working on a new audit of the 2026 U.S. midterm elections, using a redesigned survey with input from political science experts.

“So there are absolutely examples of …

1 week, 6 days назад @ news.mit.edu
New chip could help tiny robots traverse complex environments
New chip could help tiny robots traverse complex environments New chip could help tiny robots traverse complex environments

A new chip developed by MIT researchers could help tiny, low-power UAVs avoid obstacles as they zip around tight corners inside an industrial HVAC system to check for gas leaks.

The chip allows small autonomous robots and other battery-limited devices to construct detailed 3D maps of their environments in real-time using only about as much power as a single LED.

This system-on-a-chip consumes only about 6 milliwatts of power, a fraction of the power required by other systems.

It required only about 2.5 percent of the power that the best existing chip for map construction would need.

Gleanmer makes that possible for the first time in a chip you can hold between your fingers,” says Karaman.

2 weeks назад @ news.mit.edu
A better way to model the behavior of metal alloys
A better way to model the behavior of metal alloys A better way to model the behavior of metal alloys

That’s because even the most powerful simulation techniques struggle to model the complex chemical arrangements in most of today’s solid materials.

Now a team of MIT researchers has created a way to accurately model the behavior of metals, regardless of the complexity of their chemical arrangement.

At the center of the approach are machine-learning models that make simulations of materials faster and more accurate.

The researchers improved those models by building training datasets that capture the diversity of atomic environments in chemically disordered materials.

“Chemical disorder means there’s a huge variety of local chemical environments, which is hard for the machine-learning model t…

2 weeks, 4 days назад @ news.mit.edu
MIT in the media: For the future of tech, "Massachusetts can absolutely lead"
MIT in the media: For the future of tech, "Massachusetts can absolutely lead" MIT in the media: For the future of tech, "Massachusetts can absolutely lead"

On June 9, The Boston Globe released its 2026 “Tech Power Players” list, recognizing 50 influential local leaders in technology and business across Massachusetts.

Advancing AI and entrepreneurshipWhen it comes to AI, MIT is “working to drive artificial intelligence forward in sectors where the region is strongest, from biotechnology and robotics to defense and clean energy.

Looking ahead, The Globe highlights how MIT aims to remain a central driver of AI advancement within higher ed.

And when it comes to applying AI technologies to real-world problems, MIT aims to ensure the greater Boston area remains a leader.

The most promising area for the Greater Boston tech sceneThe Globe concludes by…

2 weeks, 5 days назад @ news.mit.edu
Berkeley AI
последний пост 9 часов назад
Intelligence is Free, Now What? Data Systems for, of, and by Agents
Intelligence is Free, Now What?  Data Systems for, of, and by Agents Intelligence is Free, Now What? Data Systems for, of, and by Agents

Agents are rapidly becoming capable of synthesizing entire data systems in one go—meaning we can rebuild custom systems for each new workload.

Data Systems For, Of, and By AgentsNext, we will discuss each in more detail, followed by discussing the intertwined future of data systems and agents, especially as the three challenges intersect.

Data Systems Of AgentsPreviously, we focused on how agents interact with data systems.

Data Systems By AgentsFinally, if intelligence is effectively free, then we can employ this intelligence to synthesize new data systems from scratch.

Co-Evolution of Data Systems and AgentsLooking further out, the boundaries between agents and data systems will likely …

9 часов назад @ bair.berkeley.edu
2026 BAIR Graduate Showcase
2026 BAIR Graduate Showcase 2026 BAIR Graduate Showcase

2026 BAIR Graduate ShowcaseCongratulations to the Berkeley Artificial Intelligence Research (BAIR) Lab class of 2026!

This year, BAIR celebrates another remarkable group of Ph.D. graduates whose curiosity, creativity, and perseverance have pushed the frontiers of artificial intelligence and machine learning.

Their work spans the breadth of modern AI — robotics and embodied intelligence, large language models and reasoning, computer vision, generative modeling, AI safety, human-AI interaction, AI for science and healthcare, and much more.

Along the way, they have published influential research, built systems with real-world impact, mentored their peers, and shaped the BAIR community for th…

6 days, 9 hours назад @ bair.berkeley.edu
Adaptive Parallel Reasoning: The Next Paradigm in Efficient Inference Scaling
Adaptive Parallel Reasoning: The Next Paradigm in Efficient Inference Scaling Adaptive Parallel Reasoning: The Next Paradigm in Efficient Inference Scaling

Adaptive Parallel Reasoning: The Next Paradigm in Efficient Inference ScalingOverview of adaptive parallel reasoning.

We provide a detailed analysis of recent progress in the field of parallel reasoning, especially Adaptive Parallel Reasoning.

Figure 4: Special Tokens Variants across Adaptive Parallel Reasoning PapersInference Systems for Adaptive ParallelismHow do we actually execute parallel branches?

Figure 14: Difference in Model Choice Across Adaptive Parallel Reasoning PapersEach paper also offers a slightly different interpretation about how adaptive parallel reasoning contributes to the research field.

(Yang et al., 2025; Lian et al., 2025) aim to deliver sequential-AR-model-level a…

2 months назад @ bair.berkeley.edu
Gradient-based Planning for World Models at Longer Horizons
Gradient-based Planning for World Models at Longer Horizons Gradient-based Planning for World Models at Longer Horizons

Large, learned world models are becoming increasingly capable.

Why is adversarial robustness an issue for world model planning?

We thus exploit the differentiability of learned world models $F_{\theta}$, while not falling victim to the inherent sensitivity of the state Jacobians $D_s F_{\theta}$.

It’s a funny sweet spot where the background literature (planning and control overall) is incredibly mature and well-developed, but the current setting (pure planning optimization over modern, large-scale world models) is still heavily underexplored.

But, once we figure out all the right ideas, world model planners will likely become as commonplace as RL.

2 months, 2 weeks назад @ bair.berkeley.edu
Identifying Interactions at Scale for LLMs
Identifying Interactions at Scale for LLMs Identifying Interactions at Scale for LLMs

Identifying Interactions at Scale for LLMsUnderstanding the behavior of complex machine learning systems, particularly Large Language Models (LLMs), is a critical challenge in modern artificial intelligence.

Therefore, grounded or reality-checked interpretability methods must also be able to capture these influential interactions.

In this blog post, we describe the fundamental ideas behind SPEX and ProxySPEX, algorithms capable of identifying these critical interactions at scale.

SPEX and ProxySPEX FrameworkTo discover influential interactions with a tractable number of ablations, we have developed SPEX (Spectral Explainer).

We formalize this through two observations: sparsity (relatively f…

3 months, 3 weeks назад @ bair.berkeley.edu
Information-Driven Design of Imaging Systems
Information-Driven Design of Imaging Systems Information-Driven Design of Imaging Systems

We developed a framework that enables direct evaluation and optimization of imaging systems based on their information content.

The first approach treated imaging systems as unconstrained communication channels, ignoring the physical limitations of lenses and sensors.

Our Information-Driven Encoder Analysis Learning (IDEAL) method uses gradient ascent on information estimates to optimize imaging system parameters.

The standard approach to computational imaging design, end-to-end optimization, jointly trains the imaging hardware and a neural network decoder.

The computational efficiency of IDEAL suggests possibilities for designing imaging systems that were previously intractable.

5 months, 4 weeks назад @ bair.berkeley.edu
RL without TD learning
RL without TD learning RL without TD learning

RL without TD learningIn this post, I’ll introduce a reinforcement learning (RL) algorithm based on an “alternative” paradigm: divide and conquer.

We can do Reinforcement Learning (RL) based on divide and conquer, instead of temporal difference (TD) learning.

There are two classes of algorithms in RL: on-policy RL and off-policy RL.

We compared TRL with $n$-step TD learning with different values of $n$, from $1$ (pure TD) to $\infty$ (pure MC).

I still think one of the most important problems in RL (and even in machine learning) is to find a scalable off-policy RL algorithm.

8 months, 1 week назад @ bair.berkeley.edu
AWS Machine Learning AWS Machine Learning
последний пост 1 час назад
Enrich your datasets with business context: Migrating from legacy Topics to semantic datasets in Amazon Quick
Enrich your datasets with business context: Migrating from legacy Topics to semantic datasets in Amazon Quick Enrich your datasets with business context: Migrating from legacy Topics to semantic datasets in Amazon Quick

If you’ve been managing Amazon Quick legacy Topics alongside your datasets, you know the challenge: two assets that must stay perfectly synchronized, each with its own permissions, lineage, and versioning.

Dataset Enrichment is the foundation that makes this possible: each dataset must carry its own semantic context before Topics can unify them at a higher level.

You validate the enriched dataset’s Q&A behavior against the legacy Topic’s and only remove the legacy Topic after you’re ready.

You validate the enriched dataset’s Q&A behavior against the legacy Topic’s and only remove the legacy Topic after you’re ready.

The following step automates the enrichment of an Amazon Quick Sight datase…

1 час назад @ aws.amazon.com
Data modeling best practices for Amazon Quick Sight multi-dataset relationships
Data modeling best practices for Amazon Quick Sight multi-dataset relationships Data modeling best practices for Amazon Quick Sight multi-dataset relationships

Today, we are excited to announce Multi-Dataset Relationships in Amazon Quick Sight.

This new capability lets you define logical relationships between Quick Sight datasets and perform runtime joins at query time.

In this post, we cover data modeling concepts, supported patterns, and best practices for designing your multi-dataset data model in Quick Sight.

For a deep dive into each schema pattern with SQL examples and advanced workarounds, see the second post in this series: Data Modeling Patterns for Amazon Quick Sight Multi-Dataset Relationships [link].

Read Part 2: Data Modeling Patterns for Amazon Quick Sight Multi-Dataset RelationshipsAbout the authors

1 час назад @ aws.amazon.com
Data modeling patterns for Amazon Quick Sight multi-dataset relationships
Data modeling patterns for Amazon Quick Sight multi-dataset relationships Data modeling patterns for Amazon Quick Sight multi-dataset relationships

Dimension tables are normalized into multi-level chains.

Key considerationThe multi-hop join (fact → customer → geography) increases query complexity slightly.

Key considerationConformed dimensions must use identical grain and keys across both fact tables.

High-velocity fact tables can refresh hourly, and slowly changing dimensions can refresh daily or weekly.

Department-level access control on shared dimension tables (for example, HR data visible only to HR).

1 час назад @ aws.amazon.com
Multi-dataset Topic best practices for Amazon Quick Chat
Multi-dataset Topic best practices for Amazon Quick Chat Multi-dataset Topic best practices for Amazon Quick Chat

For details on the differences, see Build a unified semantic layer across datasets with multi-dataset Topics in Amazon Quick.

Amazon Quick Sight’s Multi-Dataset Topics change that equation by letting analytics teams bring multiple datasets into a single Topic in one of two ways.

How Chat differs from defined relationshipsBefore diving into best practices, it helps to understand the fundamental architectural distinction between Quick Sight’s two multi-dataset modes.

For the best practices of defined relationship, please refer to Data modeling best practices for Amazon Quick Sight multi-dataset relationships and Data modeling patterns for Amazon Quick Sight multi-dataset relationshipsThe sema…

1 час назад @ aws.amazon.com
Build a unified semantic layer across datasets with multi-dataset Topics in Amazon Quick
Build a unified semantic layer across datasets with multi-dataset Topics in Amazon Quick Build a unified semantic layer across datasets with multi-dataset Topics in Amazon Quick

Amazon Quick Sight, the business intelligence (BI) capability within Amazon Quick, delivers interactive dashboards, natural language querying, pixel-perfect reports, machine learning (ML)-driven insights, and embedded analytics.

From the Quick console’s left pane, under Quick Sight choose Data.

ConclusionIn this post, you learned how to use multi-dataset Topics in Amazon Quick Sight to build a unified semantic layer across multiple normalized datasets without pre-joining or duplicating data.

For the full configuration reference, see Working with Amazon Quick Sight Topics in the documentation.

Refer to the Data Modeling Best Practices for Amazon Quick Sight Multi-Dataset Relationships blog p…

1 час назад @ aws.amazon.com
Build a serverless image editing agent with Amazon Bedrock AgentCore harness
Build a serverless image editing agent with Amazon Bedrock AgentCore harness Build a serverless image editing agent with Amazon Bedrock AgentCore harness

Amazon Bedrock AgentCore harness handles that entire stack with configuration.

An Amazon Bedrock AgentCore harness agent with AgentCore Memory for conversation persistence.

Creating the agent using configurationWith an AgentCore harness, the agent definition is a set of parameters passed to the create_harness API.

These tools are orchestrated by an AgentCore harness agent equipped with memory, accessed via a Lambda proxy.

To get started with AgentCore harness, visit the AgentCore harness documentation or explore the Amazon Bedrock AgentCore product page for pricing and availability details.

1 час назад @ aws.amazon.com
Monitoring discriminative ML models using Amazon SageMaker AI with MLflow
Monitoring discriminative ML models using Amazon SageMaker AI with MLflow Monitoring discriminative ML models using Amazon SageMaker AI with MLflow

For generative AI models, see Production-Ready Real-Time Monitoring Solution for LLMs on Amazon SageMaker AI Endpoint inference.

Amazon SageMaker AI is a fully managed machine learning service that helps organizations build, train, deploy, and manage both discriminative and generative ML models.

Solution overviewThis solution demonstrates how to implement model monitoring in the machine learning workflow, from model training to model deployment.

For more information on implementing MLOps with SageMaker AI, see MLOps foundation roadmap for enterprises with Amazon SageMaker AI.

To learn more about MLOps on Amazon SageMaker AI, see the Amazon SageMaker AI MLOps workshop.

1 час назад @ aws.amazon.com
Build an AI-powered AWS support companion with Amazon Bedrock AgentCore
Build an AI-powered AWS support companion with Amazon Bedrock AgentCore Build an AI-powered AWS support companion with Amazon Bedrock AgentCore

For each incident, an engineer opens the AWS Management Console, checks Amazon CloudWatch, searches AWS documentation, reviews community posts, and files a support case.

In this post, you build an AWS Support Companion using Amazon Bedrock AgentCore.

MCP servers – Three MCP servers give the agent access to AWS documentation ( aws-documentation-mcp-server ), AWS Support APIs ( aws-support-mcp-server ), and AWS service APIs ( aws-api-mcp-server ).

The agent has access to AWS MCP servers for documentation and support, and AWS re:Post through AgentCore Gateway.

The agent combines foundation model reasoning with real-time access to AWS documentation, support APIs, and community knowledge through…

1 час назад @ aws.amazon.com
How AWS Finance teams reclaimed hundreds of hours with Amazon Quick
How AWS Finance teams reclaimed hundreds of hours with Amazon Quick How AWS Finance teams reclaimed hundreds of hours with Amazon Quick

Across AWS Finance, teams were spending hundreds of hours a month on exactly this kind of work.

A single customer analysis consumed up to 6 hours of manual work, including extracting data, running models, and documenting findings.

The time reclaimed went directly back into strategic work: risk analysis, customer anecdote synthesis, and identifying opportunities for growth.

Every finance team deals with fragmented data, recurring reporting cycles, and the tension between compiling numbers and actually using them.

In the next post in this series, we will explore how AWS Finance teams are using Quick to automate cost optimization and streamline approval workflows, turning hours of manual analy…

1 час назад @ aws.amazon.com
From Hugging Face to Amazon SageMaker Studio in one click
From Hugging Face to Amazon SageMaker Studio in one click From Hugging Face to Amazon SageMaker Studio in one click

Previously, getting started on SageMaker Studio after discovering a model on Hugging Face required navigating multiple steps.

What’s newThis launch introduces three capabilities that shorten the path from a Hugging Face model to a working SageMaker Studio workflow.

Walkthrough: Deep-linking from Hugging Face to SageMaker StudioLet’s walk through the experience of customizing or deploying a model starting from Hugging Face.

By connecting Hugging Face directly to the SageMaker Studio workflows, developers can stay in their flow.

To get started, visit the Amazon SageMaker Studio page or explore models on Hugging Face and choose Deploy or Customize on SageMaker AI.

19 часов назад @ aws.amazon.com
Teaching models to forget: Selective unlearning with Amazon Nova
Teaching models to forget: Selective unlearning with Amazon Nova Teaching models to forget: Selective unlearning with Amazon Nova

Amazon Nova Customizable Content Moderation Settings (CCMS) addresses this by letting approved customers selectively adjust safeguards across four responsible AI (RAI) pillars.

Amazon Nova enforces essential, non-configurable controls for responsible use of AI, such as controls to prevent harm to children and preserve privacy.

See Customize Amazon Nova in Amazon SageMaker AI using Direct Preference Optimization for a step-by-step walkthrough.

Importantly, these customizations operate within the bounds of Amazon Nova universal, non-configurable protections, ensuring that core safeguards remain intact regardless of adapter configuration.

These techniques power Amazon Nova CCMS, which provides…

19 часов назад @ aws.amazon.com
Run MiniMax models on Amazon Bedrock
Run MiniMax models on Amazon Bedrock Run MiniMax models on Amazon Bedrock

MiniMax models on Amazon BedrockAmazon Bedrock supports three models from the MiniMax M2 family.

Amazon Bedrock continues to expand its catalog of MiniMax models as new versions become available.

Two endpoints for accessing MiniMax models on Amazon BedrockAmazon Bedrock provides two endpoints for invoking MiniMax models: bedrock-mantle and bedrock-runtime .

Getting started with MiniMax M2.5 in Amazon BedrockComplete the following steps to start using MiniMax M2.5 in Amazon Bedrock.

To control which identities can generate or use Amazon Bedrock API keys, see Control permissions for generating and using Amazon Bedrock API keys.

1 day, 1 hour назад @ aws.amazon.com
Deploying Multi-Turn RL Infrastructure for Amazon Nova on Amazon SageMaker HyperPod
Deploying Multi-Turn RL Infrastructure for Amazon Nova on Amazon SageMaker HyperPod Deploying Multi-Turn RL Infrastructure for Amazon Nova on Amazon SageMaker HyperPod

Amazon SageMaker AI also offers multi-turn RL as a fully managed, serverless capability, bringing this technique to SageMaker training jobs with no infrastructure to manage.

For these cases, the multi-turn RL infrastructure for Amazon Nova on Amazon SageMaker HyperPod gives you the compute, orchestration, and reward-routing layers to train agents on these complex workflows.

Amazon Nova delivers frontier intelligence and industry-leading price performance, and Amazon Nova Forge extends this with multi-turn RL training capabilities.

In this post, you deploy a two-phase infrastructure for multi-turn RL using Amazon Nova Forge on Amazon SageMaker HyperPod.

ConclusionYou now have a production-re…

1 day, 1 hour назад @ aws.amazon.com
Automatically redact PII in images with Amazon Nova
Automatically redact PII in images with Amazon Nova Automatically redact PII in images with Amazon Nova

When Nova identifies visual PII elements, it delegates the segmentation task to SAM 3 to produce exact boundaries for redaction.

Familiarity with Amazon Bedrock, Amazon SageMaker AI, Amazon Simple Storage Service (Amazon S3), AWS Lambda, AWS Step Functions, Amazon EventBridge, and Amazon Textract.

Based on Nova’s classification, the Step Functions workflow selectively invokes one or both specialized processes: the textual process if Nova detected textual PII, the visual process if Nova detected visual PII, or both processes in parallel if Nova identified both types.

Finally, Amazon Textract returns the coordinates of the text that Nova identified as PII for use in the next step.

To get star…

1 day, 1 hour назад @ aws.amazon.com
Streaming benchmark and recommendation results to MLflow with Amazon SageMaker AI
Streaming benchmark and recommendation results to MLflow with Amazon SageMaker AI Streaming benchmark and recommendation results to MLflow with Amazon SageMaker AI

In this post, you learn how to use the new MLflow integration with Amazon SageMaker AI optimized inference recommendation jobs and Amazon SageMaker AI benchmark jobs to automatically stream experiment data into a unified tracking interface.

Solution overviewWith this release, when you submit an optimized inference recommendation job or a benchmarking job, Amazon SageMaker AI automatically streams results into a SageMaker MLflow app of your choice.

Set up Amazon SageMaker Studio for your development environment on Amazon SageMaker AI.

Create a SageMaker MLflow App from SageMaker Unified Studio (SageMaker Unified Studio → MLflow → Create MLflow App).

Step 3: Verify the MLflow App and define e…

1 day, 1 hour назад @ aws.amazon.com
NVIDIA
последний пост 3 часа назад
AI Innovators Adopt NVIDIA Vera — Why Max Single-Threaded CPU at Scale Matters
AI Innovators Adopt NVIDIA Vera — Why Max Single-Threaded CPU at Scale Matters AI Innovators Adopt NVIDIA Vera — Why Max Single-Threaded CPU at Scale Matters

AI factories need a CPU with max single-threaded performance to maximize AI factory revenue and agent performance.

How Max Single-Threaded CPUs at Scale Are Built to Run the Agentic LoopAn AI agent doesn’t stop running after a single request.

At the core of Vera is Olympus, NVIDIA’s custom CPU core, which delivers 50% higher instructions per cycle than NVIDIA Grace.

Rigel is NVIDIA’s next-generation Arm v9.2 CPU core, delivering higher per-core performance than Olympus while keeping the same silicon footprint.

Learn more about the NVIDIA Vera CPU.

3 часа назад @ blogs.nvidia.com
NVIDIA and Hugging Face Bring New Models and Frameworks to LeRobot for the Open Robotics Community
NVIDIA and Hugging Face Bring New Models and Frameworks to LeRobot for the Open Robotics Community NVIDIA and Hugging Face Bring New Models and Frameworks to LeRobot for the Open Robotics Community

Open source AI has shown how quickly developers can innovate when models, data and tools are shared.

NVIDIA and Hugging Face are collaborating to bring the NVIDIA Isaac GR00T 1.7 open, reasoning vision language action (VLA) model for humanoid robots and the NVIDIA Isaac Teleop framework to LeRobot — Hugging Face’s open source library for robotics — with NVIDIA Cosmos 3, a frontier model for physical AI, planned soon.

“Open source is how a field turns advanced research into something people can study, adapt and build on,” said Thomas Wolf, cofounder and chief science officer at Hugging Face.

NVIDIA’s continued partnership with Hugging Face connects NVIDIA’s 3 million robotics developers with…

12 часов назад @ blogs.nvidia.com
How Open Models Are Driving AI Research
How Open Models Are Driving AI Research How Open Models Are Driving AI Research

This year’s accepted papers reveal a clear direction: open frontier models and open AI infrastructure have become foundational to how modern AI science gets done.

Approximately 2,000 accepted papers cite NVIDIA GPUs, and 145 cite NVIDIA Nemotron — a family of open models, including open datasets — as the foundation for new research.

Hundreds more draw on NVIDIA Cosmos, NVIDIA Isaac GR00T, BioNeMo and other NVIDIA open model families, spanning physical AI, robotics, autonomous vehicles and biomedical research.

AI for life sciences was fueled by NVIDIA BioNeMo open models and research contributions that help researchers understand protein function, molecular behavior and genetic code.

Sakana …

1 day, 2 hours назад @ blogs.nvidia.com
How Nations Are Deploying AI for Strategic Priorities
How Nations Are Deploying AI for Strategic Priorities How Nations Are Deploying AI for Strategic Priorities

Why AI Capabilities MatterThe urgency for countries to build and deploy AI capabilities has grown with the rise of generative and agentic AI, which is reshaping markets, inspiring new industries and transforming existing ones — from gaming to healthcare.

Ingredients of a National AI StrategyThere are five ingredients of a national AI strategy:AI Imperative: Domestic AI capabilities are critical to economic growth, national security, cultural preservation and innovation — with responsible, trustworthy AI aligned to local policies as well as national goals.

AI-Ready Workforce: A wide spectrum of local AI skills and talent, plus basic AI literacy across the population.

National AI Strategies U…

1 day, 3 hours назад @ blogs.nvidia.com
Joyride Through July With 12 Games Coming to GeForce NOW
Joyride Through July With 12 Games Coming to GeForce NOW Joyride Through July With 12 Games Coming to GeForce NOW

Summer is heating up — and GeForce NOW is taking players along for the ride.

Start the month with Monopoly: Star Wars Heroes vs. Villains, bringing a galaxy far, far away to the iconic board-game franchise, alongside 12 new games joining the cloud this month.

Plus, don’t let the sun set on the biggest GeForce NOW savings of the year.

GeForce NOW makes it easy to take the battle between the light and dark sides across nearly any device.

Plus, check out this spreadsheet, made by a community member, featuring discounted games streaming on GeForce NOW and build out a bigger library at the best bargains during the Steam Summer Sale.

5 days, 5 hours назад @ blogs.nvidia.com
NVIDIA Unlocks AI Compute at Scale, Inviting Capital Partners to Power the AI Infrastructure Buildout
NVIDIA Unlocks AI Compute at Scale, Inviting Capital Partners to Power the AI Infrastructure Buildout NVIDIA Unlocks AI Compute at Scale, Inviting Capital Partners to Power the AI Infrastructure Buildout

Emerging AI companies historically have had limited access to capital-intensive infrastructure, with even long-term commitments insufficient to unlock financing for compute.

Through this new model with NVIDIA, AI cloud companies will sell cloud services delivered through NVIDIA DSX AI factories that manufacture tokens at scale.

NVIDIA AI Factory Capacity Built Around DemandThe initiative is already taking shape, with AI cloud companies building DSX AI factories designed to serve customers and workloads across regions.

“This strategic collaboration with NVIDIA marks a pivotal moment in Sharon AI’s mission to deliver sovereign, large-scale AI compute infrastructure,” said James Manning, cofou…

5 days, 14 hours назад @ blogs.nvidia.com
NVIDIA and Partners Build in America, for America
NVIDIA and Partners Build in America, for America NVIDIA and Partners Build in America, for America

America is a nation of builders.

For 250 years, America has built railroads that connected a continent, power grids that lit up cities, factories that powered prosperity, semiconductors that made the digital age possible and the internet that opened knowledge to the world.

Now, America is building again.

NVIDIA and its partners are investing in American manufacturing, supply chains, energy grids and skilled workforces so the U.S. can produce the infrastructure needed for better healthcare, breakthrough scientific discovery, stronger industrial productivity and global technology leadership.

It depends on the wide range of physical components behind them: advanced semiconductors, packaging, p…

6 days, 5 hours назад @ blogs.nvidia.com
Designing GPU-Accelerated Query Engines with NVIDIA GQE
Designing GPU-Accelerated Query Engines with NVIDIA GQE Designing GPU-Accelerated Query Engines with NVIDIA GQE

In this post, we show how databases can use these technologies to accelerate GPU query execution.

Data layout and transfer orchestrationThe GQE data layer is optimized to efficiently transfer data from host memory to device memory.

CompressionGQE receives two main benefits from compression: query dataset capacity and query acceleration.

Apply GQE best practices to data platformsDatabase engines can translate NVIDIA Grace Blackwell hardware features into measurable query performance gains with targeted optimizations.

These optimizations reduce transfer time and compose into sophisticated query execution using NVIDIA cuDF, NVIDIA nvCOMP, and other CUDA-X libraries.

1 week назад @ developer.nvidia.com
NVIDIA BioNeMo Agent Toolkit Brings Accelerated AI to Life Sciences Researchers in Claude Science
NVIDIA BioNeMo Agent Toolkit Brings Accelerated AI to Life Sciences Researchers in Claude Science NVIDIA BioNeMo Agent Toolkit Brings Accelerated AI to Life Sciences Researchers in Claude Science

Claude Science integrates with NVIDIA BioNeMo Agent Toolkit as a resource that scientists can access within their workflow.

BioNeMo Agent Toolkit gives these agents the context needed to connect each step with an appropriate NVIDIA scientific capability.

Claude Science integrated with BioNeMo Agent Toolkit and NVIDIA NIM microservices accelerates high-throughput inhibitor prediction, optimization and validation.

NVIDIA BioNeMo Agent Toolkit gives scientific agents the accelerated tools they need to operate at the speed of science.

NVIDIA BioNeMo Agent Toolkit is open and harness-agnostic, allowing the same scientific skills to work across agent frameworks and research platforms.

1 week назад @ blogs.nvidia.com
How NVIDIA’s Inference Software Stack Powers the Lowest Token Cost
How NVIDIA’s Inference Software Stack Powers the Lowest Token Cost How NVIDIA’s Inference Software Stack Powers the Lowest Token Cost

Deep Infra uses the NVIDIA inference software stack to serve frontier open source models performantly on Blackwell from day zero, including DeepSeek V4.

The software stack determines whether that complexity turns into wasted capacity or lower cost per token.

NVIDIA’s inference software stack does this by connecting three layers:Production Operation: Coordinates distributed serving, orchestration, autoscaling and memory management so inference can run across the right compute and storage resources.

NVIDIA’s inference software stack is designed to make those layers work together so each optimization can build on the others.

Open Source Amplifies the Full-Stack AdvantageThat same full-stack fo…

1 week назад @ blogs.nvidia.com
How Jaiveer Singh Is Helping Robots — and Developers — Move Faster
How Jaiveer Singh Is Helping Robots — and Developers — Move Faster How Jaiveer Singh Is Helping Robots — and Developers — Move Faster

As a robotics software engineer who leads the team behind NVIDIA Isaac ROS (Robot Operating System), Singh works on the connective tissue of the physical AI era.

Built on the open source ROS 2 framework, Isaac ROS brings CUDA-accelerated libraries and AI models to developers building autonomous mobile robots, manipulation systems and humanoids.

“Compared with the original Isaac SDK, Isaac ROS is completely modular,” Singh said.

With open software, developers can inspect the code, change it, contribute fixes and carry it forward.

“When more people can build robots,” Singh said, “the future gets here faster.”Follow @nvidialife on Instagram and learn more about NVIDIA life, culture and careers.

1 week назад @ blogs.nvidia.com
Into the Omniverse: Three Workflows for Improving Vision AI Agent Accuracy With Synthetic Data and Fine-Tuning
Into the Omniverse: Three Workflows for Improving Vision AI Agent Accuracy With Synthetic Data and Fine-Tuning Into the Omniverse: Three Workflows for Improving Vision AI Agent Accuracy With Synthetic Data and Fine-Tuning

Vision AI agents are becoming a practical way to automatically turn video data from the physical world into operational intelligence in factories, cities, warehouses and transportation systems.

Turning that data into useful action requires vision AI agents that can understand video, adapt to real-world conditions and connect insights to operational workflows.

NVIDIA Metropolis agent skills and blueprints give developers reusable workflows to build, operate and optimize vision AI agents across that lifecycle.

Where Vision AI Agent Projects Can Get StuckAs organizations move toward autonomous vision agents, three challenges often come up:Accuracy Plateaus With Data Gaps: Vision AI agents need…

1 week назад @ blogs.nvidia.com
Claude Meets Blackwell Ultra: Anthropic’s Models Now Run on NVIDIA GB300 in Azure
Claude Meets Blackwell Ultra: Anthropic’s Models Now Run on NVIDIA GB300 in Azure Claude Meets Blackwell Ultra: Anthropic’s Models Now Run on NVIDIA GB300 in Azure

Anthropic’s Claude models in Microsoft Foundry — hosted on Microsoft Azure and running on NVIDIA GB300 Blackwell Ultra GPUs — are now generally available, giving Azure-native enterprises a powerful new way to build autonomous and domain-specific AI agents.

Enterprises can run Claude agents on Azure by using the NVIDIA Secure Agent Workspace Reference Design.

It provides a blueprint for running autonomous agents in a governed environment where identity, network access, credentials and runtime policy are controlled at the infrastructure level.

Claude in Microsoft Foundry accelerated by NVIDIA GB300 GPUs on Azure builds on the strategic partnership Microsoft, NVIDIA and Anthropic announced in …

1 week, 1 day назад @ blogs.nvidia.com
Firefly Aerospace Operates NVIDIA Jetson in Lunar Orbit for the First Time
Firefly Aerospace Operates NVIDIA Jetson in Lunar Orbit for the First Time Firefly Aerospace Operates NVIDIA Jetson in Lunar Orbit for the First Time

This time, rather than sending massive volumes of raw data home for processing that takes weeks or months, Ocula will run AI algorithms directly on orbit, using Jetson to extract critical insights and transmit only the most relevant information — based on customer need — back to Earth in near real time, vastly reducing latency and costly downlink.

For Blue Ghost Mission 2, a lunar lander will separate and descend to the far side of the moon — carrying science and technology instruments including a radio telescope — in support of NASA-funded, UC Berkeley-led research to detect faint signals from the cosmic Dark Ages shortly after the Big Bang.

Meanwhile, Firefly’s Elytra spacecraft will cont…

1 week, 1 day назад @ blogs.nvidia.com
Open Models, Closed Environments: Palantir Brings Secure AI to US Agencies With NVIDIA Nemotron
Open Models, Closed Environments: Palantir Brings Secure AI to US Agencies With NVIDIA Nemotron Open Models, Closed Environments: Palantir Brings Secure AI to US Agencies With NVIDIA Nemotron

Showcasing the importance of open source innovation in American AI, Palantir’s new intelligent engine — introduced today — uses NVIDIA Nemotron open models to serve the needs of U.S. government agencies.

Today’s Palantir announcement brings NVIDIA Nemotron open models into air-gapped environments — secure setups that are completely isolated from unsecured networks — on NVIDIA accelerated computing.

Palantir will use NVIDIA Nemotron open models to build custom frontier-quality models to serve the U.S. government.

While NVIDIA Nemotron open models provide a customizable and continually learning model layer on Palantir’s Sovereign AI Operating System, enterprise-grade deployments can be suppor…

1 week, 1 day назад @ blogs.nvidia.com
Facebook
последний пост 1 week назад
10 Years of Meta’s Commitment to Python
10 Years of Meta’s Commitment to Python 10 Years of Meta’s Commitment to Python

This year marks Meta’s 10th consecutive year as a sponsor of the Python Software Foundation (PSF), the charitable organization dedicated to advancing, supporting, and protecting the open-source Python programming language and the community that sustains it.

Some of the core maintainers of Python are Meta engineers who have authored new features and Python Enhancement Proposals (PEPs) for the Python community.

These improvements are vital for protecting the global Python community and ensuring that developers everywhere – including our own engineers – can safely share and consume packages.

These investments help grow the Python community and foster the new talent that is essential for Python…

1 week назад @ engineering.fb.com
Privacy-Aware Infrastructure in the AI-Native Era: An Asset Classification Case Study
Privacy-Aware Infrastructure in the AI-Native Era: An Asset Classification Case Study Privacy-Aware Infrastructure in the AI-Native Era: An Asset Classification Case Study

Why Asset Classification MattersAsset classification is the foundation for many privacy controls.

The rest of this post walks through those pieces using asset classification as the case study.

All three share a single judge model, a larger reasoning model deliberately different from the classifier model.

Distill Stable Behavior Into RulesEven a strong LLM classifier should not be the default enforcement path forever.

Expand to other PAI workflows: The same pattern (context → LLM reasoning → distillation → deterministic enforcement) applies to lineage validation, purpose-boundary checking, and retention policy assignment.

1 week, 4 days назад @ engineering.fb.com
SilverTorch: Index as Model — A New Retrieval Paradigm for Recommendation Systems
SilverTorch: Index as Model — A New Retrieval Paradigm for Recommendation Systems SilverTorch: Index as Model — A New Retrieval Paradigm for Recommendation Systems

The retrieval system within industry recommendation systems have consisted of microservices stitched together, with neural networks inconsistently integrated.

Under Index as Model previous microservice-based item indices used for retrieval become a tensor inside the model.

Moving From Microservice Mesh to One Integrated Neural NetworkThe Microservice Paradigm We ReplacedTraditional recommendation retrieval is built as a mesh of microservices.

We call this Index as Model: Every retrieval component — the item index, eligibility filter, scoring layer and user tower — becomes a tensor or operator inside a single PyTorch model.

Index FreshnessWith index as a model module, maintaining index fresh…

1 month, 1 week назад @ engineering.fb.com
Reel Friends: Building Social Discovery that Scales to Billions
Reel Friends: Building Social Discovery that Scales to Billions Reel Friends: Building Social Discovery that Scales to Billions

On its face the new Friend Bubbles feature looks simple enough.

It highlights Reels your friends have watched and reacted to.

On this episode of the Meta Tech Podcast, Pascal Hartig chats with Subasree and Joseph, two software engineers from the Facebook Reels team, about what it took to bring Friend Bubbles to life.

If you’ve ever underestimated a “simple” feature, this one’s for you.

And if you’re interested in learning more about career opportunities at Meta visit the Meta Careers page.

1 month, 3 weeks назад @ engineering.fb.com
Modernizing the Facebook Groups Search to Unlock the Power of Community Knowledge
Modernizing the Facebook Groups Search to Unlock the Power of Community Knowledge Modernizing the Facebook Groups Search to Unlock the Power of Community Knowledge

We’ve fundamentally transformed Facebook Groups Search to help people more reliably discover, sort through, and validate community content that’s most relevant to them.

We’ve adopted a new hybrid retrieval architecture and implemented automated model-based evaluation to address the major friction points people experience when searching community content.

Addressing the Friction Points in Community KnowledgePeople struggle with three friction points when searching for answers in community content – discovery, consumption, and validation.

The Solution: A Modernized Hybrid Retrieval ArchitectureWe engineered a hybrid retrieval architecture that powers a discussions module on Facebook Search.

R…

2 months, 2 weeks назад @ engineering.fb.com
Capacity Efficiency at Meta: How Unified AI Agents Optimize Performance at Hyperscale
Capacity Efficiency at Meta: How Unified AI Agents Optimize Performance at Hyperscale Capacity Efficiency at Meta: How Unified AI Agents Optimize Performance at Hyperscale

We’ve built a unified AI agent platform that encodes the domain expertise of senior efficiency engineers into reusable, composable skills.

Introducing the Capacity Efficiency ProgramWhen the code you ship serves more than 3 billion people, even a 0.1% performance regression can translate to significant additional power consumption.

Many engineers at Meta use our efficiency tools to work on these problems every day.

Skills : These encode domain expertise about performance efficiency.

The pipeline mirrors the defensive AI Regression Solver:Gather context with tools: The AI agent looks up: Opportunity metadata.

2 months, 3 weeks назад @ engineering.fb.com
How Meta Used AI to Map Tribal Knowledge in Large-Scale Data Pipelines
How Meta Used AI to Map Tribal Knowledge in Large-Scale Data Pipelines How Meta Used AI to Map Tribal Knowledge in Large-Scale Data Pipelines

Challenging the Conventional Wisdom on AI Context FilesRecent academic research found that AI-generated context files actually decreased agent success rates on well-known open-source Python repositories.

Our codebase is the opposite: proprietary config-as-code with tribal knowledge that exists nowhere in any model’s training data.

Any team with a large, proprietary codebase can benefit:Identify your tribal knowledge gaps.

What’s NextWe are expanding context coverage to additional pipelines across Meta’s data infrastructure and exploring tighter integration between context files and code generation workflows.

This approach turned undocumented tribal knowledge into structured, AI-readable con…

3 months назад @ engineering.fb.com
KernelEvolve: How Meta’s Ranking Engineer Agent Optimizes AI Infrastructure
KernelEvolve: How Meta’s Ranking Engineer Agent Optimizes AI Infrastructure KernelEvolve: How Meta’s Ranking Engineer Agent Optimizes AI Infrastructure

This is the second post in the Ranking Engineer Agent blog series exploring the autonomous AI capabilities accelerating Meta’s Ads Ranking innovation.

We introduce KernelEvolve, an agentic kernel authoring system used by Ranking Engineer Agent and generally applicable to a range of AI models beyond Ads Ranking.

Unlike typical large language model (LLM)-based agents that perform one-shot code generation, KernelEvolve treats kernel optimization as a search problem.

A standard coding assistant lacks the context to write optimized MTIA kernels because it has never seen MTIA documentation, instruction set details, or programming idioms.

KernelEvolve represents an early step toward the vision of …

3 months назад @ engineering.fb.com
Meta Adaptive Ranking Model: Bending the Inference Scaling Curve to Serve LLM-Scale Models for Ads
Meta Adaptive Ranking Model: Bending the Inference Scaling Curve to Serve LLM-Scale Models for Ads Meta Adaptive Ranking Model: Bending the Inference Scaling Curve to Serve LLM-Scale Models for Ads

To overcome this, we have developed the Meta Adaptive Ranking Model, which effectively bends the inference scaling curve with high ROI and industry-leading efficiency.

Introducing Meta Adaptive Ranking ModelServing LLM-scale & complexity models in a real-time ads recommendation environment requires resolving a fundamental tension between model complexity and system efficiency.

Adaptive Ranking Model addresses these challenges through a paradigm shift powered by three core innovations across the serving stack:Inference-efficient model scaling: Adaptive Ranking Model achieves a model complexity equivalent to the O(10 GFLOPs) per token used by top-tier LLMs.

To minimize compute overhead, Adapt…

3 months, 1 week назад @ engineering.fb.com
AI for American-Produced Cement and Concrete
AI for American-Produced Cement and Concrete AI for American-Produced Cement and Concrete

Concurrent with the 2026 American Concrete Institute (ACI) Spring Convention, Meta is releasing a new AI model for designing concrete mixes – Bayesian Optimization for Concrete (BOxCrete), as well as the foundational data used to develop award-winning concrete mixes.

Amrize operates 18 cement plants, 141 cement terminals and 269 ready-mix concrete sites across North America.

Alongside the event, Meta is releasing a new AI model for designing concrete mixes, Bayesian Optimization for Concrete (BOxCrete).

How Meta Leverages AI for Concrete MixturesMeta’s AI for concrete model can help suppliers more quickly incorporate U.S. materials into their mixes through an approach called adaptive experi…

3 months, 1 week назад @ engineering.fb.com
Friend Bubbles: Enhancing Social Discovery on Facebook Reels
Friend Bubbles: Enhancing Social Discovery on Facebook Reels Friend Bubbles: Enhancing Social Discovery on Facebook Reels

Friend bubbles in Facebook Reels highlight Reels your friends have liked or reacted to, helping you discover new content and making it easier to connect over shared interests.

Friend bubbles enhance the social experience on Facebook Reels by helping you discover content your friends enjoy, creating a shared viewing experience and sparking new conversations.

Along with additional optimizations in the underlying method, this approach enabled us to ship friend bubbles while preserving core Reels performance.

Friend bubbles work because the signal is high value: It adds meaningful social context that helps people decide what’s worth watching.

Engagement also scales consistently with the number …

3 months, 2 weeks назад @ engineering.fb.com
Ranking Engineer Agent (REA): The Autonomous AI Agent Accelerating Meta’s Ads Ranking Innovation
Ranking Engineer Agent (REA): The Autonomous AI Agent Accelerating Meta’s Ads Ranking Innovation Ranking Engineer Agent (REA): The Autonomous AI Agent Accelerating Meta’s Ads Ranking Innovation

Meta’s Ranking Engineer Agent (REA) autonomously executes key steps across the end-to-end machine learning (ML) lifecycle for ads ranking models.

Powering these interactions are highly sophisticated, complex and massively distributed machine learning (ML) models that continuously evolve to serve both advertisers and people who use the platforms.

Optimizing these ML models has traditionally been time-consuming.

To address this, Meta built the Ranking Engineer Agent, an autonomous AI agent designed to drive the end-to-end ML lifecycle and iteratively evolve Meta’s ads ranking models at scale.

ML training jobs run for hours or days, far beyond what any session-bound assistant can manage.

3 months, 3 weeks назад @ engineering.fb.com
Patch Me If You Can: AI Codemods for Secure-by-Default Android Apps
Patch Me If You Can: AI Codemods for Secure-by-Default Android Apps Patch Me If You Can: AI Codemods for Secure-by-Default Android Apps

Nowhere is this more apparent than in mobile security, where a single class of vulnerability can be replicated across hundreds of call sites scattered throughout a sprawling, multi-app codebase serving billions of users.

Meta’s Product Security team has developed a two-pronged strategy to address this:Designing secure-by-default frameworks that wrap potentially unsafe Android OS APIs and make the secure path the easiest path for developers, andLeveraging generative AI to automate the migration of existing code to those frameworks at scale.

The result is a system that can propose, validate, and submit security patches across millions of lines of code with minimal friction for the engineers w…

3 months, 3 weeks назад @ engineering.fb.com
RCCLX: Innovating GPU communications on AMD platforms
RCCLX: Innovating GPU communications on AMD platforms RCCLX: Innovating GPU communications on AMD platforms

RCCLX is fully integrated with Torchcomms and aims to empower researchers and developers to accelerate innovation, regardless of their chosen backend.

We want to iterate on collectives, transports, and novel features quickly on AMD platforms.

With RCCLX, we have integrated CTran to AMD platforms, enabling the AllToAllvDynamic – a GPU-resident collective.

These features provide significant performance improvements on AMD platforms and we are excited to share this with the community.

RCCLX Quick Start GuideInstall Torchcomms with RCCLX backend by following the installation instructions in the Torchcomms repo.

4 months, 1 week назад @ engineering.fb.com
The Death of Traditional Testing: Agentic Development Broke a 50-Year-Old Field, JiTTesting Can Revive It
The Death of Traditional Testing: Agentic Development Broke a 50-Year-Old Field, JiTTesting Can Revive It The Death of Traditional Testing: Agentic Development Broke a 50-Year-Old Field, JiTTesting Can Revive It

A Catching JiTTest focuses specifically on finding regressions introduced by a code change.

Agentic development dramatically increases the pace of code change, straining test development burden and scaling the cost of false positives and test maintenance to breaking point.

And since the JiTTest itself is LLM-generated, it can often infer the plausible intention of a code change and simulate possible faults that may result from it.

With them engineers no longer have to spend time writing, reviewing, and testing complex test code.

READ THE PAPERJust-in-Time Catching Test Generation at Meta

4 months, 3 weeks назад @ engineering.fb.com
Uber Engineering
последний пост None
neptune.ai neptune.ai
последний пост 7 months назад
We are joining OpenAI
We are joining OpenAI We are joining OpenAI

Piotr Niedźwiedź, CEO/CTO and founder of neptune.aiI’m excited to share that we’ve entered into a definitive agreement to be acquired by OpenAI, subject to closing conditions.

We are thrilled to join the OpenAI team and help their AI researchers build better models faster.

Neptune is a metrics dashboard company.”We’ve worked closely with OpenAI to create the metrics dashboard that helps teams building foundation models.

Our future with OpenAINeptune will join OpenAI and continue to support AI researchers with tools to monitor, debug, and evaluate frontier models.

We are looking forward to working with top AI researchers and supporting OpenAI’s mission of ensuring that AGI benefits all of hu…

7 months назад @ neptune.ai
Synthetic Data for LLM Training
Synthetic Data for LLM Training Synthetic Data for LLM Training

For instance, financial data is highly sensitive and protected by very strict regulations, and synthetic data mimics the real data distribution without revealing customer information.

Read more about how leading foundation model teams curate their training data and other topics in the State of Foundation Model Training Report 2025.

Choosing the right synthetic data generation technique depends on the type of data and its complexity.

Synthetic tabular data generation is a promising direction to overcome these challenges by learning the distribution of the tabular data.

Post-processingAs the distribution of tabular data is highly complex, it makes the synthetic tabular data generation very ch…

7 months, 3 weeks назад @ neptune.ai
What are LLM Embeddings: All you Need to Know
What are LLM Embeddings: All you Need to Know What are LLM Embeddings: All you Need to Know

TL;DR LLM embeddings are the numerical, vector representations of text that Large Language Models (LLMs) use to process information.

Unlike their predecessor word embeddings, LLM embeddings are context-aware and dynamically change to capture semantic and syntactic relationships based on the surrounding text.

What are the applications of LLM embeddings?

Word EmbeddingsSparse Word Embeddings One-Hot Vectors 1970s TF-IDF1980s Co-Occurrence MatrixStatic Word Embeddings Word2Vec 2013 GloVe 2014Contextualized word embeddings ELMo 2018 GPT-1 2018 BERT 2018 LLAMA 2023 DeepSeek-V1 2023 GPT-4 2023Static word embeddingsStatic word embeddings, such as word2vec in 2013, marked a significant development.…

8 months назад @ neptune.ai
Detecting and Fixing ‘Dead Neurons’ in Foundation Models
Detecting and Fixing ‘Dead Neurons’ in Foundation Models Detecting and Fixing ‘Dead Neurons’ in Foundation Models

TL;DR Dead neurons silently waste compute and reduce effective model capacity in foundation models.

Dead neurons’ impactRecent studies into dead neurons in the context of foundation models show interesting, albeit worrying, results.

These large reported fractions of dead neurons in foundation models are a concern from a computational perspective.

Before we move on to discuss how to detect and fix dead neurons, let’s touch upon an important distinction between dead neurons and vanishing gradients.

Further reading How to Monitor, Diagnose, and Solve Gradient Issues in Foundation Models Read moreVisualizing activation distributionsIs your foundation model suffering from dead neurons?

8 months, 1 week назад @ neptune.ai
Part 2: Instruction Fine-Tuning: Evaluation and Advanced Techniques for Efficient Training
Part 2: Instruction Fine-Tuning: Evaluation and Advanced Techniques for Efficient Training Part 2: Instruction Fine-Tuning: Evaluation and Advanced Techniques for Efficient Training

In the first part of this series, we covered the fundamentals of instruction fine-tuning (IFT).

def calculate_irs(instruction, output, reference_model): evaluation_prompt = f""" Instruction: {instruction} Model Output: {output} Rate how well the output follows the instruction on these criteria: 1.

| SourceHINT addresses a computational inefficiency in standard instruction fine-tuning: repeatedly reprocessing the same task instruction with every input example.

Read more about foundation model training infrastructure and other topics in Neptune’s 2025 State of Foundation Model Training Report.

First, during initial instruction fine-tuning across multiple diverse tasks, the model learns genera…

8 months, 2 weeks назад @ neptune.ai
How to Optimize LLM Inference
How to Optimize LLM Inference How to Optimize LLM Inference

Large Language Model (LLM) inference at scale is challenging as it involves transferring massive amounts of model parameters and data and performing computations on large tensors.

In the following, we’ll use the Llama model family architecture as a specific example to understand the LLM workload at inference.

For a far more detailed analysis of the LLM workload at inference, see the chapter All About Transformer Inference in the book How to Scale Your Model, published by Google DeepMind.

See also How to Run LLMs Locally Read moreA quick primer on hardware for LLM inferenceA typical LLM inference cluster consists of several nodes, each with a multi-core CPU and multiple accelerator devices, …

8 months, 3 weeks назад @ neptune.ai
A Researcher’s Guide to LLM Grounding
A Researcher’s Guide to LLM Grounding A Researcher’s Guide to LLM Grounding

In this article, we’ll explore the fundamental concepts of LLM grounding as well as strategies for optimally grounding models.

What is LLM grounding?

LLM grounding is analogous.

If relevant knowledge cannot be inferred from the data, then LLM grounding cannot yield more relevant responses.

When grounding LLMs using RAG, consider retaining only a few of the top hits (i.e., top-k) for your retrieval queries.

9 months, 2 weeks назад @ neptune.ai
Instruction Fine-Tuning: Fundamentals, Architecture Modifications, and Loss Functions
Instruction Fine-Tuning: Fundamentals, Architecture Modifications, and Loss Functions Instruction Fine-Tuning: Fundamentals, Architecture Modifications, and Loss Functions

TL;DR Instruction fine-tuning (IFT) refines pre-trained large language models (LLMs) to follow specific task instructions by training on prompt-response pairs.

Instruction fine-tuning in a nutshellIFT tailors LLMs to follow user instructions by bridging their inherent next-word prediction with human-defined objectives.

Related LLM Fine-Tuning and Model Selection Using Neptune and Transformers Read moreParameter-efficient instruction fine-tuningWhile major foundation models like GPT-4 or Llama-2 undergo full parameter instruction fine-tuning during development, parameter-efficient fine-tuning (PEFT) methods have become widely adopted for instruction fine-tuning since the LoRA paper was publi…

9 months, 3 weeks назад @ neptune.ai
▶️ YouTube
Yannic Kilcher Yannic Kilcher
последний пост 4 months назад
I BUILT A FULLY AUTOMATIC MANSPLAINER
I BUILT A FULLY AUTOMATIC MANSPLAINER I BUILT A FULLY AUTOMATIC MANSPLAINER

All information about GTC and the DGX Spark Raffle is here: https://www.ykilcher.com/gtc Links:

Homepage: https://ykilcher.com

Merch: https://ykilcher.com/merch

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://ykilcher.com/discord

LinkedIn: https://www.linkedin.com/in/ykilcher If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):

SubscribeStar: https://www.subscribestar.com/yannickilcher

Patreon: https://www.patreon.com/yannickilcher

Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq

Ethereu…

4 months назад @ youtube.com
Traditional X-Mas Stream
Traditional X-Mas Stream Traditional X-Mas Stream

Letsgooo

6 months, 1 week назад @ youtube.com
Traditional Holiday Live Stream
Traditional Holiday Live Stream Traditional Holiday Live Stream

https://ykilcher.com/discord Links:

TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://discord.gg/4H8xxDF

BitChute: https://www.bitchute.com/channel/yannic-kilcher

Minds: https://www.minds.com/ykilcher

Parler: https://parler.com/profile/YannicKilcher

LinkedIn: https://www.linkedin.com/in/yannic-kilcher-488534136/

BiliBili: https://space.bilibili.com/1824646584 If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):

SubscribeStar: https:/…

6 months, 1 week назад @ youtube.com
TiDAR: Think in Diffusion, Talk in Autoregression (Paper Analysis)
TiDAR: Think in Diffusion, Talk in Autoregression (Paper Analysis) TiDAR: Think in Diffusion, Talk in Autoregression (Paper Analysis)

Paper: https://arxiv.org/abs/2511.08923 Abstract:

Diffusion language models hold the promise of fast parallel generation, while autoregressive (AR) models typically excel in quality due to their causal structure aligning naturally with language modeling. This raises a fundamental question: can we achieve a synergy with high throughput, higher GPU utilization, and AR level quality? Existing methods fail to effectively balance these two aspects, either prioritizing AR using a weaker model for sequential drafting (speculative decoding), leading to lower drafting efficiency, or using some form of left-to-right (AR-like) decoding logic for diffusion, which still suffers from quality degradation …

6 months, 1 week назад @ youtube.com
Titans: Learning to Memorize at Test Time (Paper Analysis)
Titans: Learning to Memorize at Test Time (Paper Analysis) Titans: Learning to Memorize at Test Time (Paper Analysis)

Paper: https://arxiv.org/abs/2501.00663 Abstract:

Over more than a decade there has been an extensive research effort on how to effectively utilize recurrent models and attention. While recurrent models aim to compress the data into a fixed-size memory (called hidden state), attention allows attending to the entire context window, capturing the direct dependencies of all tokens. This more accurate modeling of dependencies, however, comes with a quadratic cost, limiting the model to a fixed-length context. We present a new neural long-term memory module that learns to memorize historical context and helps attention to attend to the current context while utilizing long past information. We sh…

6 months, 3 weeks назад @ youtube.com
[Paper Analysis] The Free Transformer (and some Variational Autoencoder stuff)
[Paper Analysis] The Free Transformer (and some Variational Autoencoder stuff) [Paper Analysis] The Free Transformer (and some Variational Autoencoder stuff)

https://arxiv.org/abs/2510.17558 Abstract:

We propose an extension of the decoder Transformer that conditions its generative process on random latent variables which are learned without supervision thanks to a variational procedure. Experimental evaluations show that allowing such a conditioning translates into substantial improvements on downstream tasks. Author: François Fleuret Links:

Homepage: https://ykilcher.com

Merch: https://ykilcher.com/merch

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://ykilcher.com/discord

LinkedIn: https://www.linkedin.com/in/ykilcher If you want to support me, the best thing to do is to share out the con…

8 months, 1 week назад @ youtube.com
[Video Response] What Cloudflare's code mode misses about MCP and tool calling
[Video Response] What Cloudflare's code mode misses about MCP and tool calling [Video Response] What Cloudflare's code mode misses about MCP and tool calling

Theo's Video: https://www.youtube.com/watch?v=bAYZjVAodoo

Cloudflare article: https://blog.cloudflare.com/code-mode/ Links:

Homepage: https://ykilcher.com

Merch: https://ykilcher.com/merch

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://ykilcher.com/discord

LinkedIn: https://www.linkedin.com/in/ykilcher If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):

SubscribeStar: https://www.subscribestar.com/yannickilcher

Patreon: https://www.patreon.com/yannickilcher

Bitcoin (BTC): bc1q49lsw3q325tr58ygf8…

8 months, 3 weeks назад @ youtube.com
[Paper Analysis] On the Theoretical Limitations of Embedding-Based Retrieval (Warning: Rant)
[Paper Analysis] On the Theoretical Limitations of Embedding-Based Retrieval (Warning: Rant) [Paper Analysis] On the Theoretical Limitations of Embedding-Based Retrieval (Warning: Rant)

Paper: https://arxiv.org/abs/2508.21038 Abstract:

Vector embeddings have been tasked with an ever-increasing set of retrieval tasks over the years, with a nascent rise in using them for reasoning, instruction-following, coding, and more. These new benchmarks push embeddings to work for any query and any notion of relevance that could be given. While prior works have pointed out theoretical limitations of vector embeddings, there is a common assumption that these difficulties are exclusively due to unrealistic queries, and those that are not can be overcome with better training data and larger models. In this work, we demonstrate that we may encounter these theoretical limitations in realist…

8 months, 4 weeks назад @ youtube.com
Henry AI Labs Henry AI Labs
последний пост None
3blue1brown 3blue1brown
последний пост 3 weeks назад
100 random chords, how many intersections?
100 random chords, how many intersections? 100 random chords, how many intersections?

Part of a series of monthly puzzles done in collaboration with MoMath.

3 weeks назад @ youtube.com
Measuring the entropy of English
Measuring the entropy of English Measuring the entropy of English

Full video: https://youtu.be/l6DKRf-fAAM

3 weeks, 4 days назад @ youtube.com
What's the perfect encoding? How do you know?
What's the perfect encoding? How do you know? What's the perfect encoding? How do you know?

Full video: https://youtu.be/l6DKRf-fAAM

3 weeks, 6 days назад @ youtube.com
Reinventing Entropy | Compression & Intelligence Part 1
Reinventing Entropy | Compression & Intelligence Part 1 Reinventing Entropy | Compression & Intelligence Part 1

What is the fundamental compressibility of language?

Check out our virtual career fair: https://3b1b.co/talent

See new projects before they go live: https://3b1b.co/support Animation credit:

Manim scenes by Aaron Gostein and Grant Sanderson

Shannon’s story, as well as those for various pi creatures, by Mitchell Zemil.

Lunar robot and prediction/compression coin by Paul Dancstep

NanoGPT animations by Clayton Rabideau Shannon’s “A Mathematical Theory of Communication”

https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf Shannon’s “Prediction and Entropy of Printed English”

https://www.princeton.edu/~wbialek/rome/refs/shannon_51.pdf Scientific American article that…

1 month назад @ youtube.com
Tie random ends: How many loops?
Tie random ends: How many loops? Tie random ends: How many loops?

Recent puzzle solutions on Patreon:

https://members.3blue1brown.com/posts/158885046?pr=true

1 month, 2 weeks назад @ youtube.com
Covering 10 points, a surprisingly tricky puzzle.
Covering 10 points, a surprisingly tricky puzzle. Covering 10 points, a surprisingly tricky puzzle.

Made as part of a monthly series of puzzles for the 2026 Year of Math.

2 months, 3 weeks назад @ youtube.com
Escher's most mind-bending piece
Escher's most mind-bending piece Escher's most mind-bending piece

On "The Print Gallery", by M.C. Escher

Full video: https://youtu.be/ldxFjLJ3rVY

3 months, 1 week назад @ youtube.com
The subset sum puzzle
The subset sum puzzle The subset sum puzzle

Part of a series of monthly puzzlers. Stay subscribed to see the solution

3 months, 1 week назад @ youtube.com
Escher's most mathematically interesting piece
Escher's most mathematically interesting piece Escher's most mathematically interesting piece

Escher's Print Gallery, and the tour of complex analysis it invites.

Check out our virtual career fair: 3b1b.co/talent

Join channel supporters to see videos early: 3b1b.co/support

An equally valuable form of support is to simply share the videos.

Home page: https://www.3blue1brown.com Original paper by de Smit and Lenstra:

https://pub.math.leidenuniv.nl/~smitbde/papers/2003-de_smit-lenstra-escher.pdf Timestamps: 0:00 - The print gallery

13:04 - Conformal maps from complex analysis

21:41 - The complex exponential

25:56 - The complex logarithm

32:32 - 3b1b Talent

33:14 - Constructing the key function

40:16 - The deeper math behind Escher ------------------ These animations are largely made us…

3 months, 2 weeks назад @ youtube.com
Bacteria Grid Puzzle Solution
Bacteria Grid Puzzle Solution Bacteria Grid Puzzle Solution

Part of a monthly series of puzzlers, in collaboration with MoMath and Peter Winkler

3 months, 2 weeks назад @ youtube.com
The most underappreciated formula | Exploring high-dimensional spheres
The most underappreciated formula | Exploring high-dimensional spheres The most underappreciated formula | Exploring high-dimensional spheres

On the volumes of higher-dimensional spheres

Explore the 3b1b virtual career fair: See https://3b1b.co/talent

Become a supporter for early views of new videos: https://3b1b.co/support

An equally valuable form of support is to simply share the videos.

Home page: https://www.3blue1brown.com Thanks to UC Santa Cruz for letting me film there, and special thanks to Pedro Morales-Almazan for arranging everything. My video on Numberphile with a fun application of this problem: https://youtu.be/6_yU9eJ0NxA Timestamps:

0:00 - Introduction

1:01 - Random puzzle

6:16 - Outside the box

14:35 - Setting up the volume grid

21:14 - Why 4πr^2

25:21 - Archimedes in higher dimensions

36:17 - The general formul…

4 months, 1 week назад @ youtube.com
The lattice bacteria puzzle
The lattice bacteria puzzle The lattice bacteria puzzle

Part of a series of monthly puzzles, done in collaboration with MoMath.

https://momath.org/mindbenders

4 months, 2 weeks назад @ youtube.com
Solution to the ladybug clock puzzle
Solution to the ladybug clock puzzle Solution to the ladybug clock puzzle

Solution to last month's probability puzzle.

4 months, 3 weeks назад @ youtube.com
The Hairy Ball Theorem
The Hairy Ball Theorem The Hairy Ball Theorem

Unexpected applications and a beautiful proof.

Looking for a new career? Check out https://3b1b.co/talent

Supporters get early access to new videos: https://3b1b.co/support

An equally valuable form of support is to simply share the videos.

Home page: https://www.3blue1brown.com Credits:

Senia Sheydvasser: Co-writing and sphere deformation animations

Paul Dancstep: Those lovely fluffy sphere animations Vince Rubinetti: Music Timestamps:

0:00 - To comb a hairy ball

1:24 - Applications

8:46 - The puzzle of one null point

12:12 - The proof outline

16:41 - Defining orientation

21:44 - Why inside-out is impossible

25:59 - 3b1b Talent

27:44 - Final food for thought ------------------ These animati…

5 months, 1 week назад @ youtube.com
The ladybug clock puzzle
The ladybug clock puzzle The ladybug clock puzzle

This is the first in a set of monthly puzzles, curated by Peter Winkler. This one was originally suggested by Richard Stanley. You can sign up to hear his description of the answer at http://momath.org/mindbenders

5 months, 3 weeks назад @ youtube.com
Two Minute Papers Two Minute Papers
последний пост 1 час назад
DeepSeek's New AI Speed Hack Is Amazing
DeepSeek's New AI Speed Hack Is Amazing DeepSeek's New AI Speed Hack Is Amazing

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambda.ai/papers 📝 The DeepSeek paper is available here:

https://arxiv.org/abs/2607.05147v1 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi

1 час назад @ youtube.com
Game Physics Just Got 170 Times Faster
Game Physics Just Got 170 Times Faster Game Physics Just Got 170 Times Faster

❤️ Check out Weights & Biases and sign up for a free demo here: https://wandb.me/papers 📝 The paper is available here:

https://arxiv.org/abs/2506.06494 Sources:

https://www.youtube.com/shorts/Tx7167DXr8U

https://www.youtube.com/watch?v=55F9dY2Y1zc 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi

4 days назад @ youtube.com
This New AI Model Changes Everything
This New AI Model Changes Everything This New AI Model Changes Everything

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambda.ai/papers GLM 5.2: https://z.ai/blog/glm-5.2 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi

6 days, 12 hours назад @ youtube.com
DeepSeek Just Solved AI's Billion Dollar Problem
DeepSeek Just Solved AI's Billion Dollar Problem DeepSeek Just Solved AI's Billion Dollar Problem

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambda.ai/papers 📝 The paper is available here:

https://arxiv.org/abs/2602.21548 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi #deepseek

2 weeks, 1 day назад @ youtube.com
This is OpenClaw On Steroids
This is OpenClaw On Steroids This is OpenClaw On Steroids

❤️ Check out Weights & Biases and sign up for a free demo here: https://wandb.me/papers 📝 The paper is available here:

https://recursivemas.github.io/

https://github.com/RecursiveMAS/RecursiveMAS 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi Thumbnail design: https://felicia.hu

2 weeks, 4 days назад @ youtube.com
Claude AI Knows More Than It Tells You
Claude AI Knows More Than It Tells You Claude AI Knows More Than It Tells You

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambda.ai/papers 📝 The paper is available here:

https://www.anthropic.com/research/natural-language-autoencoders

https://transformer-circuits.pub/2026/nla/index.html 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi My research: https://cg.tuwien.ac.at/~zsolnai/

Thumbnail design: https://felicia.hu

3 weeks назад @ youtube.com
NVIDIA's New Free AI - A Gift To All of Us
NVIDIA's New Free AI - A Gift To All of Us NVIDIA's New Free AI - A Gift To All of Us

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambda.ai/papers 📝 The Nemotron 3 Ultra paper is available here:

https://research.nvidia.com/labs/nemotron/Nemotron-3-Ultra/ Free Rendering course and source code:

https://users.cg.tuwien.ac.at/zsolnai/gfx/rendering-course/ 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi Thumbnail design: https://f…

3 weeks, 2 days назад @ youtube.com
AI Agents as "Games Masters"? 🎮🔥
AI Agents as "Games Masters"? 🎮🔥 AI Agents as "Games Masters"? 🎮🔥

Check the pinned comment for the link to the full interview. Could AI agents eventually become the "Games Master" driving your gaming storylines? We explore the concept of AI assisting players or creating dynamic, non-scripted narratives. Discover how AI is currently being tested inside immersive game environments to change how we play. 🧠 Hashtags: #aiingames #gaming #ai #gamedev #futuretech

1 month назад @ youtube.com
DeepMind’s New AI Found A Strange New Way To Think
DeepMind’s New AI Found A Strange New Way To Think DeepMind’s New AI Found A Strange New Way To Think

❤️ Check out Weights & Biases and sign up for a free demo here: https://wandb.me/papers 📝 The paper is available here:

https://github.com/google-deepmind/alphaproof-nexus-results

https://arxiv.org/html/2605.22763v1 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi My research: https://cg.tuwien.ac.at/~zsolnai/

Thumbnail design: https://felicia.hu

1 month назад @ youtube.com
Meet the AI "Co-Scientist" Changing Everything 🤖🧪 #ai
Meet the AI "Co-Scientist" Changing Everything 🤖🧪 #ai Meet the AI "Co-Scientist" Changing Everything 🤖🧪 #ai 1 month назад @ youtube.com
Claude Opus 4.8: Lying Machine No More
Claude Opus 4.8: Lying Machine No More Claude Opus 4.8: Lying Machine No More

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambda.ai/papers Anthropic's Opus 4.8: https://www.anthropic.com/news/claude-opus-4-8 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi My research: https://cg.tuwien.ac.at/~zsolnai/

Thumbnail design: https://felicia.hu

1 month назад @ youtube.com
A Second Nobel Prize for AlphaFold? 🧬🏆 #alphafold #deepmind #nobelprize #science #ai
A Second Nobel Prize for AlphaFold? 🧬🏆 #alphafold #deepmind #nobelprize #science #ai A Second Nobel Prize for AlphaFold? 🧬🏆 #alphafold #deepmind #nobelprize #science #ai

Check the pinned comment for the link to the full interview. We're discussing whether a "second order Nobel" prize is on the horizon for AI-driven science. With over 3 million researchers already using AlphaFold, the real-world impact is already historic. Hear what the experts think about what comes next for scientific discovery! 🔬

1 month назад @ youtube.com
Google's Jeff Dean On Data Center Fires, And The Future Of AI
Google's Jeff Dean On Data Center Fires, And The Future Of AI Google's Jeff Dean On Data Center Fires, And The Future Of AI

Thank you to Google for the invite! 🙏 I use Lambda GPU Cloud myself to rent NVIDIA GPUs for my projects - I’d really appreciate it if you checked them out! https://lambdalabs.com/papers Our Patreon if you wish to support us: https://www.patreon.com/TwoMinutePapers 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:

Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi My research: https://cg.tuwien.ac.at/~zsolnai/

Thumb…

1 month назад @ youtube.com
Feynman vs. Einstein vs. Newton: Who Wins? 🧠🤔 #physics #ai #science #feynman #research
Feynman vs. Einstein vs. Newton: Who Wins? 🧠🤔 #physics #ai #science #feynman #research Feynman vs. Einstein vs. Newton: Who Wins? 🧠🤔 #physics #ai #science #feynman #research

Check the pinned comment for the link to the full interview. In this quick clip, we explore which legendary scientist ranks higher among the experts. It's a fun debate that leads into an even bigger discussion about AI's role in future scientific breakthroughs. You won't want to miss the full deep dive with Demis Hassabis! ⚡️

1 month назад @ youtube.com
Google DeepMind CEO Likes Hard Questions
Google DeepMind CEO Likes Hard Questions Google DeepMind CEO Likes Hard Questions

Full video: https://youtu.be/huAwz_BR8WM

#shorts

1 month, 1 week назад @ youtube.com
DataFest Video DataFest Video
последний пост None
Семинары JetBrains Research Семинары JetBrains Research
последний пост None
Яндекс. Компьютерные науки Яндекс. Компьютерные науки
последний пост 5 days, 6 hours назад
Омни-модели будущего 🚀
Омни-модели будущего 🚀 Омни-модели будущего 🚀

Что они будут уметь — рассказывает Роман Исаченко, руководитель группы анализа изображений в Яндекс R&D. #искусственныйинтеллект #нейросети #мультимодальность #омнимодель #машинноеобучение #datascience #яндекс #ai #ml #технологии

5 days, 6 hours назад @ youtube.com
Качество модели взлетело... без мультимодального RL?
Качество модели взлетело... без мультимодального RL? Качество модели взлетело... без мультимодального RL?

О росте мультимодального качества рассказал Роман Исаченко, руководитель группы анализа изображений в Яндекс R&D. #искусственныйинтеллект #нейросети #мультимодальность #омнимодель #машинноеобучение #datascience #яндекс #ai #ml #технологии

1 week, 1 day назад @ youtube.com
Работа с данными — это скучно?
Работа с данными — это скучно? Работа с данными — это скучно?

А почему — рассказывает Роман Исаченко, руководитель группы анализа изображений в Яндекс R&D. #искусственныйинтеллект #нейросети #мультимодальность #омнимодель #машинноеобучение #datascience #яндекс #ai #ml #технологии

1 week, 5 days назад @ youtube.com
Как приготовить SFT 🍲
Как приготовить SFT 🍲 Как приготовить SFT 🍲

Рассказывает Роман Исаченко, руководитель группы анализа изображений в Яндекс R&D. #искусственныйинтеллект #нейросети #мультимодальность #омнимодель #машинноеобучение #datascience #яндекс #ai #ml #технологии

2 weeks назад @ youtube.com
Почему мультимодальные модели — это база 🤖
Почему мультимодальные модели — это база 🤖 Почему мультимодальные модели — это база 🤖

Рассказывает Роман Исаченко, руководитель группы анализа изображений в Яндекс R&D. #искусственныйинтеллект #нейросети #мультимодальность #омнимодель #машинноеобучение #datascience #яндекс #ai #ml #технологии

2 weeks, 3 days назад @ youtube.com
Омни-модель: что это за зверь такой
Омни-модель: что это за зверь такой Омни-модель: что это за зверь такой

Рассказывает Роман Исаченко, руководитель группы анализа изображений в Яндекс R&D. #искусственныйинтеллект #нейросети #мультимодальность #омнимодель #машинноеобучение #datascience #яндекс #ai #ml #технологии

2 weeks, 6 days назад @ youtube.com
Borealis — как обучить аудио-LLM по цене MacBook
Borealis — как обучить аудио-LLM по цене MacBook Borealis — как обучить аудио-LLM по цене MacBook

На конференции Data Fest 2026 в Белграде независимый исследователь Александр Николич рассказал практическую историю создания аудиоязыковой модели Borealis с бюджетом, сопоставимым со стоимостью MacBook. Больше контента для разработчиков: https://t.me/+owyCvdge8WIyNTUy #DataFest #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #MultimodalAI

3 weeks, 5 days назад @ youtube.com
Better LLM pre-training in NVFP4
Better LLM pre-training in NVFP4 Better LLM pre-training in NVFP4

At Data Fest 2026 in Belgrade, Andrei Panferov from the Institute of Science and Technology Austria introduced Quartet II, a novel method for NVFP4 pre-training that recovers SOTA accuracy. He outlined the core challenges of low-precision LLM training and presented CUDA kernels tuned for Blackwell GPUs, ready for integration into real training pipelines. Больше материалов для разработчиков: https://t.me/+owyCvdge8WIyNTUy #datafest #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #MultimodalAI

3 weeks, 5 days назад @ youtube.com
Как безопасно выкатывать новые версии продуктовых AI-агентов
Как безопасно выкатывать новые версии продуктовых AI-агентов Как безопасно выкатывать новые версии продуктовых AI-агентов

На Data Fest 2026 в Белграде Дмитрий Коршунов, Team Lead ML в Ecom, показал, как безопасно обновлять продуктовых AI-агентов с помощью системы автометрик. На примере агента Яндекс AI для турецкого рынка он объяснил, как фиксировать регрессии до прода, сравнивать версии и принимать решение о релизе, когда простой «Hello, Agent» уже позади. Больше материалов для разработчиков: https://t.me/+owyCvdge8WIyNTUy #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #MultimodalAI

3 weeks, 5 days назад @ youtube.com
Как решаем оптимизационные задачи Яндекс Лавки с помощью uplift-моделей
Как решаем оптимизационные задачи Яндекс Лавки с помощью uplift-моделей Как решаем оптимизационные задачи Яндекс Лавки с помощью uplift-моделей

На Data Fest 2026 в Белграде Вячеслав Костров, ML-инженер в Яндексе, рассказал, как uplift-модели решают бизнес-задачи Лавки: от персональных скидок до показа продуктовых подборок. Он разобрал постановку uplift-задачи, подбор метрик и построение политик, а также практические приёмы с лагранжианом и uplift-деревьями для баланса ограничений. Всё это — на примере реальных внедрений и с разбором типичных ошибок. Больше материалов для разработчиков: https://t.me/+owyCvdge8WIyNTUy #datafest #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #Mu…

3 weeks, 5 days назад @ youtube.com
HGRPO: Hierarchical Grouped Reward Policy Optimization for Multi-Turn Conversational Agents
HGRPO: Hierarchical Grouped Reward Policy Optimization for Multi-Turn Conversational Agents HGRPO: Hierarchical Grouped Reward Policy Optimization for Multi-Turn Conversational Agents

At Data Fest 2026 in Belgrade, Karina Romanova, Senior LLM Research Engineer, presented HGRPO — a hierarchical modification of GRPO for multi-turn dialogue agents. Applied to a booking agent in Yandex Alice, the method improved truthfulness by 8.0 percentage points and reduced dialogue length by 10.7%. Больше материалов для разработчиков: https://t.me/+owyCvdge8WIyNTUy #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #MultimodalAI

3 weeks, 5 days назад @ youtube.com
Поиск по архивам: как мы переходим к осознанному распознаванию текста
Поиск по архивам: как мы переходим к осознанному распознаванию текста Поиск по архивам: как мы переходим к осознанному распознаванию текста

На Data Fest 2026 в Белграде Дарья Виноградова, лид команды компьютерного зрения, представила два важных майлстоуна архивного поиска: новую архитектуру распознавания текста и выделение смысловых структур. Эти изменения делают поиск человечнее — теперь можно искать не слова среди текста, а человека среди людей. Больше материалов для разработчиков: https://t.me/+owyCvdge8WIyNTUy #DataFest #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #MultimodalAI

3 weeks, 5 days назад @ youtube.com
Hacks and Defenses in Automatic Kernel Generation
Hacks and Defenses in Automatic Kernel Generation Hacks and Defenses in Automatic Kernel Generation

На Data Fest 2026 в Белграде Егор Коновалов, ML-инженер, разобрал хаки, которые находят LLM-агенты, когда генерируют GPU/TPU-код: от тривиального обхода numerical tolerance до изощрённых атак на timing-измерения и эксплуатации дыр в test harness. А ещё Егор показал, какие методы защиты реально работают, а какие создают ложное чувство безопасности. Больше материалов для разработчиков: https://t.me/+owyCvdge8WIyNTUy #datafest #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #MultimodalAI

3 weeks, 5 days назад @ youtube.com
Real-time video generation: where we are and what comes next
Real-time video generation: where we are and what comes next Real-time video generation: where we are and what comes next

At Data Fest 2026 in Belgrade, Andrey Filatov from KREA AI broke down the current state of real-time video generation: which architectures dominate, how they differ, and what challenges arise from compute limits and memory bottlenecks. He also covered production solutions like distillation and caching, and shared his outlook for the next 2–3 years: what will soon become possible and which bottlenecks the industry still overlooks. More content for developers: https://t.me/+owyCvdge8WIyNTUy #datafest #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #Reinforceme…

3 weeks, 5 days назад @ youtube.com
AI-генерация учебного контента и проверка открытых ответов студентов
AI-генерация учебного контента и проверка открытых ответов студентов AI-генерация учебного контента и проверка открытых ответов студентов

Доклад из секции ML & Education конференции Data Fest 2026 в гостях у Яндекса «AI-генерация учебного контента и проверка открытых ответов студентов». Спикер — Денис Королёв, доцент, МИЭМ НИУ ВШЭ. Больше материалов для разработчиков: https://t.me/+owyCvdge8WIyNTUy #datafest #DataFest2026 #AI #ML #LLM #GenAI #MachineLearning #DataScience #MLOps #AIAgents #RAG #ComputerVision #AutonomousDriving #Yandex #Яндекс #TechTalk #Developers #ArtificialIntelligence #ReinforcementLearning #MultimodalAI

3 weeks, 6 days назад @ youtube.com
ML Trainings ML Trainings
последний пост 1 day, 6 hours назад
Страх неизвестности и пропущенные вопросы
Страх неизвестности и пропущенные вопросы Страх неизвестности и пропущенные вопросы 1 day, 6 hours назад @ youtube.com
Папа Римский как китайский агент
Папа Римский как китайский агент Папа Римский как китайский агент 1 day, 6 hours назад @ youtube.com
Новый марксизм и роль нейросетей в обществе
Новый марксизм и роль нейросетей в обществе Новый марксизм и роль нейросетей в обществе 1 day, 6 hours назад @ youtube.com
Искусственный интеллект как новый фактор среды
Искусственный интеллект как новый фактор среды Искусственный интеллект как новый фактор среды 1 day, 7 hours назад @ youtube.com
Высший уровень безопасности достигается не за счёт программных средств
Высший уровень безопасности достигается не за счёт программных средств Высший уровень безопасности достигается не за счёт программных средств 1 day, 7 hours назад @ youtube.com
Автоматизация на войне
Автоматизация на войне Автоматизация на войне 1 day, 7 hours назад @ youtube.com
Капитанский мостик 05.07.2026: Mythos снова доступен | Жадный Palantir | Папа - китайский коммунист
Капитанский мостик 05.07.2026: Mythos снова доступен | Жадный Palantir | Папа - китайский коммунист Капитанский мостик 05.07.2026: Mythos снова доступен | Жадный Palantir | Папа - китайский коммунист

описание: 0:00:00 Начало

0:00:58 Mythos снова доступен

0:10:14 OpenAI и 5% акций

0:16:28 Корея и полтриллиона

0:23:11 Huawei Ascend в Корее

0:25:31 Пентагон внедряет ИИ

0:32:03 DeepSeek и AGI

0:39:15 Китайский суперкомпьютер

0:44:34 Замеряли GPT5.6

0:55:38 Жадный Palantir

1:02:04 Илон Маск и мозг

1:09:27 Британец, суд и ИИ

1:13:04 Папа - китайский коммунист ИИ-саммари: В этом выпуске мы обсуждаем последние новости в области технологий, экономики и бизнеса, включая обновления в области ИИ, развитие индустрии чипов в Южной Корее и стратегические инициативы крупных компаний. Узнайте, как эти события влияют на глобальный рынок и будущее технологий. В этом эпизоде обсуждаются перспективы использ…

2 days, 3 hours назад @ youtube.com
Ян Лекун о тупиковом пути и сладком запахе гниющего капитализма
Ян Лекун о тупиковом пути и сладком запахе гниющего капитализма Ян Лекун о тупиковом пути и сладком запахе гниющего капитализма 1 week, 1 day назад @ youtube.com
Модель Mythos и её способности к взлому и защите
Модель Mythos и её способности к взлому и защите Модель Mythos и её способности к взлому и защите 1 week, 1 day назад @ youtube.com
Mythos закрыли, потому что он взломал Пентагон
Mythos закрыли, потому что он взломал Пентагон Mythos закрыли, потому что он взломал Пентагон 1 week, 1 day назад @ youtube.com
Кто самый кибербезопасник
Кто самый кибербезопасник Кто самый кибербезопасник 1 week, 1 day назад @ youtube.com
Кибербезопасность 2031: Европа беззащитна
Кибербезопасность 2031: Европа беззащитна Кибербезопасность 2031: Европа беззащитна 1 week, 1 day назад @ youtube.com
Валентин Малых говорит о сходстве с Mythos
Валентин Малых говорит о сходстве с Mythos Валентин Малых говорит о сходстве с Mythos 1 week, 1 day назад @ youtube.com
Капитанский мостик 28.06.2026: Sakana Fugu | Трамп заблокировал GPT | роботы заменили людей
Капитанский мостик 28.06.2026: Sakana Fugu | Трамп заблокировал GPT | роботы заменили людей Капитанский мостик 28.06.2026: Sakana Fugu | Трамп заблокировал GPT | роботы заменили людей

описание: 0:00:00 Начало

0:00:40 Sakana Fugu

0:05:08 Трамп заблокировал GPT

0:08:17 Китайцы торгуют Claude

0:12:48 Китайцы лучше Mythos

0:19:57 Microsoft продает OpenAI

0:21:36 Борис Черный и лупы

0:31:50 OpenAI сделали чип

0:35:21 Закон об ИИ в России

0:40:37 Робоферма в Челябинске

0:47:07 Роботы заменили людей

0:52:28 OpenAI патчит опенсорс

0:57:27 Cursor сделал агентов

1:02:34 Маск делает игры

1:06:48 Роботы-попрошайки ИИ-саммари: В этом выпуске обсуждаются важные события в мире технологий, включая предстоящий DataFest в Новосибирске, выход нового продукта Fugu от Sakana, влияние администрации США на развитие моделей ИИ, а также проблемы доступа к токенам в Китае и дистилляцию моделей дл…

1 week, 2 days назад @ youtube.com
Почему Китай выигрывает в гонке образовательных программ
Почему Китай выигрывает в гонке образовательных программ Почему Китай выигрывает в гонке образовательных программ 2 weeks назад @ youtube.com
Primer Primer
последний пост 6 months, 1 week назад
Taking AI Doom Seriously For 62 Minutes
Taking AI Doom Seriously For 62 Minutes Taking AI Doom Seriously For 62 Minutes

Patreon: https://www.patreon.com/primerlearning

80,000 Hours: 80000hours.org/primer https://www.desmos.com/calculator/a5pfjtr4tr Other connections:

Discord: https://discord.gg/NbruaNW

Twitch: https://www.twitch.tv/justin_helps

Store: https://store.dftba.com/collections/primer Reddit: https://www.reddit.com/r/primerlearning/

Bsky: https://bsky.app/profile/justinhelps.bsky.social

Twitter: https://twitter.com/primerlearning Links to other resources:

https://yoshuabengio.org/2024/07/09/reasoning-through-arguments-against-taking-ai-safety-seriously/

https://www.youtube.com/c/robertmilesai

https://www.youtube.com/@Siliconversations

https://www.youtube.com/@Go-Meta

https://www.youtube.com/@Dwarkes…

6 months, 1 week назад @ youtube.com
Simulating a single brain cell
Simulating a single brain cell Simulating a single brain cell

Patreon:

https://www.patreon.com/primerlearning Helpful resources if you want to learn more about neural networks

https://www.youtube.com/@AndrejKarpathy

https://course.fast.ai/

https://www.youtube.com/@WelchLabsVideo

https://www.youtube.com/@3blue1brown Early papers. These probably aren't helpful for understanding the concepts in this video, but if you're interested in history.

The Perceptron – A perceiving and recognizing automaton: https://bpb-us-e2.wpmucdn.com/websites.umass.edu/dist/a/27637/files/2016/03/rosenblatt-1957.pdf

The Perceptron: A probabilistic model for information storage and organization in the brain: https://www.ling.upenn.edu/courses/cogs501/Rosenblatt1958.pdf A Logical…

9 months, 1 week назад @ youtube.com
🎧 Podcasts
Lex Fridman AI Podcast Lex Fridman AI Podcast
последний пост 6 days, 20 hours назад
#498 – Anthony Kaldellis: Roman Empire, Byzantine Empire, Rise & Fall of Empires
#498 – Anthony Kaldellis: Roman Empire, Byzantine Empire, Rise & Fall of Empires #498 – Anthony Kaldellis: Roman Empire, Byzantine Empire, Rise & Fall of Empires

Anthony Kaldellis is a historian of the Roman Empire and author of “The New Roman Empire”, a comprehensive history of the Byzantine Empire (Eastern Roman Empire).

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep498-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://upwork.com/lexFin: AI agent for customer service.

Go to https://fin.ai/lexBetterHelp: Online therapy and counseling.

Go to https://betterhelp.com/lexLMNT: Zero-sugar electrolyte drink mix.

6 days, 20 hours назад @ lexfridman.com
#497 – Biggest Mysteries in Physics: Antimatter, Dark Energy & ToE – Don Lincoln
#497 – Biggest Mysteries in Physics: Antimatter, Dark Energy & ToE – Don Lincoln #497 – Biggest Mysteries in Physics: Antimatter, Dark Energy & ToE – Don Lincoln

Don Lincoln is a particle physicist at Fermilab who has spent decades working at the frontiers of high energy physics.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep497-scSee below for timestamps, and to give feedback, submit questions, contact Lex, etc.

Go to https://upwork.com/lexLarridin: Measure AI adoption in your business.

Go to https://larridin.comFin: AI agent for customer service.

Go to https://fin.ai/lexLMNT: Zero-sugar electrolyte drink mix.

1 month, 1 week назад @ lexfridman.com
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet #496 – FFmpeg: The Incredible Technology Behind Video on the Internet

Jean-Baptiste Kempf is lead developer of VLC and president of VideoLAN.

Kieran Kunhya is a longtime FFmpeg contributor, codec engineer, and the person behind the now-infamous FFmpeg account on X.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep496-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://larridin.comBlitzy: AI agent for large enterprise codebases.

Go to https://perplexity.ai/OUTLINE:(00:00) – Introduction(03:00) – Sponsors, Comments, and Reflections(10:48) – Weirdest things VLC opens(15:12) – How video playback works(24:33) – Video codecs and containers(35:20) – FFmpeg explained(56:20)…

2 months назад @ lexfridman.com
#495 – Vikings, Ragnar, Berserkers, Valhalla & the Warriors of the Viking Age
#495 – Vikings, Ragnar, Berserkers, Valhalla & the Warriors of the Viking Age #495 – Vikings, Ragnar, Berserkers, Valhalla & the Warriors of the Viking Age

Lars Brownworth is a historian, teacher, podcaster, and author specializing in Viking history, medieval Europe, and the Byzantine Empire.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep495-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://larridin.comBetterHelp: Online therapy and counseling.

Go to https://drinkLMNT.com/lexFin: AI agent for customer service.

Go to https://perplexity.ai/OUTLINE:(00:00) – Introduction(01:03) – Sponsors, Comments, and Reflections(08:57) – The start of the Viking Age(18:50) – Viking military strategy, tactics & technology(32:33) – Ragnar Lothbrok(42:00) – The Grea…

2 months, 4 weeks назад @ lexfridman.com
#494 – Jensen Huang: NVIDIA – The $4 Trillion Company & the AI Revolution
#494 – Jensen Huang: NVIDIA – The $4 Trillion Company & the AI Revolution #494 – Jensen Huang: NVIDIA – The $4 Trillion Company & the AI Revolution

Jensen Huang is the co-founder and CEO of NVIDIA, the world’s most valuable company and the engine powering the AI computing revolution.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep494-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://drinkLMNT.com/lexFin: AI agent for customer service.

Go to https://quo.com/lexOUTLINE:(00:00) – Introduction(00:26) – Sponsors, Comments, and Reflections(06:34) – Extreme co-design and rack-scale engineering(09:20) – How Jensen runs NVIDIA(28:41) – AI scaling laws(43:41) – Biggest blockers to AI scaling laws(45:25) – Supply chain(47:20) – Memory(53:25) – Power…

3 months, 2 weeks назад @ lexfridman.com
#493 – Jeff Kaplan: World of Warcraft, Overwatch, Blizzard, and Future of Gaming
#493 – Jeff Kaplan: World of Warcraft, Overwatch, Blizzard, and Future of Gaming #493 – Jeff Kaplan: World of Warcraft, Overwatch, Blizzard, and Future of Gaming

Jeff Kaplan is a legendary Blizzard game designer of World of Warcraft and Overwatch, now preparing to launch a new game, The Legend of California, from his new studio Kintsugiyama – available to wishlist on Steam today, with alpha later in March.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep493-scSee below for timestamps, and to give feedback, submit questions, contact Lex, etc.

Go to https://fin.ai/lexBlitzy: AI agent for large enterprise codebases.

Go to https://blitzy.com/lexBetterHelp: Online therapy and counseling.

Go to https://betterhelp.com/lexShopify: Sell stuff online.

3 months, 3 weeks назад @ lexfridman.com
#492 – Rick Beato: Greatest Guitarists of All Time, History & Future of Music
#492 – Rick Beato: Greatest Guitarists of All Time, History & Future of Music #492 – Rick Beato: Greatest Guitarists of All Time, History & Future of Music

Rick Beato is a music educator, interviewer, producer, songwriter, and a true multi-instrument musician, playing guitar, bass, cello & piano.

His incredible YouTube channel celebrates great musicians & musical ideas, and helps millions of people fall in love with great music all over again.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep492-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://upliftdesk.com/lexBetterHelp: Online therapy and counseling.

Go to https://drinkLMNT.com/lexFin: AI agent for customer service.

4 months, 1 week назад @ lexfridman.com
#491 – OpenClaw: The Viral AI Agent that Broke the Internet – Peter Steinberger
#491 – OpenClaw: The Viral AI Agent that Broke the Internet – Peter Steinberger #491 – OpenClaw: The Viral AI Agent that Broke the Internet – Peter Steinberger

Peter Steinberger is the creator of OpenClaw, an open-source AI agent framework that’s the fastest-growing project in GitHub history.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep491-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://coderabbit.ai/lexFin: AI agent for customer service.

Go to https://fin.ai/lexBlitzy: AI agent for large enterprise codebases.

Go to https://drinkLMNT.com/lexOUTLINE:(00:00) – Introduction(03:51) – Sponsors, Comments, and Reflections(15:29) – OpenClaw origin story(18:48) – Mind-blowing moment(28:15) – Why OpenClaw went viral(32:12) – Self-modifying AI agent(36:57)…

4 months, 3 weeks назад @ lexfridman.com
#490 – State of AI in 2026: LLMs, Coding, Scaling Laws, China, Agents, GPUs, AGI
#490 – State of AI in 2026: LLMs, Coding, Scaling Laws, China, Agents, GPUs, AGI #490 – State of AI in 2026: LLMs, Coding, Scaling Laws, China, Agents, GPUs, AGI

Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators.

Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?

(36:11) – Best AI for coding(43:02) – Open Source vs Closed Source LLMs(54:41) – Transformers: Evolution of LLMs since 2019(1:02:38) – AI Scaling Laws: Are they dead or still holding?

5 months назад @ lexfridman.com
#489 – Paul Rosolie: Uncontacted Tribes in the Amazon Jungle
#489 – Paul Rosolie: Uncontacted Tribes in the Amazon Jungle #489 – Paul Rosolie: Uncontacted Tribes in the Amazon Jungle

Paul Rosolie is a naturalist, explorer, author of a new book titled Junglekeeper, and is someone who has dedicated his life to protecting the Amazon rainforest.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep489-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://perplexity.ai/BetterHelp: Online therapy and counseling.

Go to https://fin.ai/lexMiro: Online collaborative whiteboard platform.

Go to https://miro.com/MasterClass: Online classes from world-class experts.

5 months, 3 weeks назад @ lexfridman.com
#488 – Infinity, Paradoxes that Broke Mathematics, Gödel Incompleteness & the Multiverse – Joel David Hamkins
#488 – Infinity, Paradoxes that Broke Mathematics, Gödel Incompleteness & the Multiverse – Joel David Hamkins #488 – Infinity, Paradoxes that Broke Mathematics, Gödel Incompleteness & the Multiverse – Joel David Hamkins

Joel David Hamkins is a mathematician and philosopher specializing in set theory, the foundations of mathematics, and the nature of infinity, and he’s the #1 highest-rated user on MathOverflow.

He is also the author of several books, including Proof and the Art of Mathematics and Lectures on the Philosophy of Mathematics.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep488-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://masterclass.com/lexpodOUTLINE:(00:00) – Introduction(01:58) – Sponsors, Comments, and Reflections(15:40) – Infinity & paradoxes(1:02:50) – Russell’s paradox(1:15:57) – Gödel’s…

6 months, 1 week назад @ lexfridman.com
#487 – Irving Finkel: Deciphering Secrets of Ancient Civilizations & Flood Myths
#487 – Irving Finkel: Deciphering Secrets of Ancient Civilizations & Flood Myths #487 – Irving Finkel: Deciphering Secrets of Ancient Civilizations & Flood Myths

Irving Finkel is a scholar of ancient languages and a longtime curator at the British Museum, renowned for his expertise in Mesopotamian history and cuneiform writing.

He specializes in reading and interpreting cuneiform inscriptions, including tablets from Sumerian, Akkadian, Babylonian, and Assyrian contexts.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep487-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://shopify.com/lexMiro: Online collaborative whiteboard platform.

Go to https://miro.com/Chevron: Reliable energy for data centers.

6 months, 3 weeks назад @ lexfridman.com
#486 – Michael Levin: Hidden Reality of Alien Intelligence & Biological Life
#486 – Michael Levin: Hidden Reality of Alien Intelligence & Biological Life #486 – Michael Levin: Hidden Reality of Alien Intelligence & Biological Life

Michael Levin is a biologist at Tufts University working on novel ways to understand and control complex pattern formation in biological systems.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep486-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://upliftdesk.com/lexMiro: Online collaborative whiteboard platform.

Go to https://miro.com/MasterClass: Online classes from world-class experts.

(2:42:41) – Mind uploading(3:01:22) – Alien intelligence(3:16:17) – Advice for young people(3:22:46) – Questions for AGI

7 months, 1 week назад @ lexfridman.com
#485 – David Kirtley: Nuclear Fusion, Plasma Physics, and the Future of Energy
#485 – David Kirtley: Nuclear Fusion, Plasma Physics, and the Future of Energy #485 – David Kirtley: Nuclear Fusion, Plasma Physics, and the Future of Energy

David Kirtley is a nuclear fusion engineer and CEO of Helion Energy, a company working on building the world's first commercial fusion power plant by 2028.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep485-sc

See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc. Transcript:

https://lexfridman.com/david-kirtley-transcript CONTACT LEX:

Feedback - give feedback to Lex: https://lexfridman.com/survey

AMA - submit questions, videos or call-in: https://lexfridman.com/ama

Hiring - join our team: https://lexfridman.com/hiring

Other - other ways to get in touch: https://lexfridman.com/contact EPISODE LINKS:

David's X: htt…

7 months, 3 weeks назад @ lexfridman.com
#484 – Dan Houser: GTA, Red Dead Redemption, Rockstar, Absurd & Future of Gaming
#484 – Dan Houser: GTA, Red Dead Redemption, Rockstar, Absurd & Future of Gaming #484 – Dan Houser: GTA, Red Dead Redemption, Rockstar, Absurd & Future of Gaming

Dan Houser is co-founder of Rockstar Games and is a legendary creative mind behind Grand Theft Auto (GTA) and Red Dead Redemption series of video games.

Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep484-scSee below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Go to https://box.com/aiUPLIFT Desk: Standing desks and office ergonomics.

Go to https://drinkLMNT.com/lexOUTLINE:(00:00) – Introduction(01:29) – Sponsors, Comments, and Reflections(11:32) – Greatest films of all time(23:45) – Making video games(26:36) – GTA 3(29:55) – Open world video games(32:42) – Character creation(36:09) – Superintelligent AI in A Bette…

8 months, 1 week назад @ lexfridman.com
Microsoft Research Podcast Microsoft Research Podcast
последний пост 2 months, 2 weeks назад
Can we AI our way to a more sustainable world?
Can we AI our way to a more sustainable world? Can we AI our way to a more sustainable world?

Because I do think there’s a role for AI, a huge role for AI.

BURGER: Right, right.

BURGER: Right, right.

So I think that’s also something quite important here that, you know, AI can help facilitate.

And I think that’s not just applying AI to solve solutions through optimization but also thinking about this in an integrated way.

2 months, 2 weeks назад @ microsoft.com
Ideas: Steering AI toward the work future we want
Ideas: Steering AI toward the work future we want Ideas: Steering AI toward the work future we want

JANSSEN: Yeah, yeah, exactly.

TEEVAN: Yeah, yeah, yeah.

I’m curious what you have found particularly surprising about how people and organizations are leveraging AI right now.

And so I do like to picture a future of work where humans are flourishing with AI and where humans still get to do meaningful work.

And I’m very curious about how we can take advantage of AI and do more without running ourselves into the ground because we’re not AI, right?

2 months, 4 weeks назад @ microsoft.com
Will machines ever be intelligent?
Will machines ever be intelligent? Will machines ever be intelligent?

And the question we’re going to discuss is, are machines intelligent?

No, no, that’s right, that’s right.

I mean, in some sense, you could potentially have a super intelligent system, right, that’s far more intelligent than anything else on the planet.

BURGER: Right, right.

At the same time, I think, you know, transformers are not intelligent in the way that a three-year-old is, right?

3 months, 2 weeks назад @ microsoft.com
Trailer: The Shape of Things to Come
Trailer: The Shape of Things to Come Trailer: The Shape of Things to Come

Join Microsoft’s Doug Burger and guests as they dig into the fundamental truths about AI and how it will reshape the future.

Technical advances are moving at such a rapid pace that it can be challenging to define the tomorrow we’re working toward.

In The Shape of Things to Come, Microsoft research leader Doug Burger and experts from across disciplines tease out the thorniest AI issues facing technologists, policymakers, business decision-makers, and other stakeholders today.

It’s important to understand what the emerging shapes are and how we should respond.” – Doug Burger, Technical Fellow and Corporate Vice President, Microsoft ResearchAbout Doug BurgerDoug Burger is a research leader in …

4 months назад @ microsoft.com
Ideas: Community building, machine learning, and the future of AI
Ideas: Community building, machine learning, and the future of AI Ideas: Community building, machine learning, and the future of AI

This week, machine learning researchers around the world will be attending the annual Conference on Neural Information Processing Systems, or NeurIPS.

In this series, we’ll explore the technologies that are shaping our future and the big ideas that propel them forward.

So around that time when I started my PhD at Penn, I was working in machine learning theory and algorithmic economics.

How had you experienced a lack of community or network of women in machine learning before the founding of WiML?

So particularly when working on topics related to fairness, I’ve ended up focusing a bunch on stuff to do with marginalized groups as part of my responsible AI work.

7 months, 1 week назад @ microsoft.com
Ideas: More AI-resilient biosecurity with the Paraphrase Project
Ideas: More AI-resilient biosecurity with the Paraphrase Project Ideas: More AI-resilient biosecurity with the Paraphrase Project

Today, I’m excited to talk about the Paraphrase Project, an effort I co-led exploring how advances in AI tools for protein design might impact biosecurity.

These “patches,” akin to those in cybersecurity, have now been shared with organizations globally to strengthen biosecurity screening.

The project highlights that the same AI tools capable of incredible good can also be misused, requiring us to be vigilant, thoughtful, and creative so we continue to get the most benefit out of AI tools while working to ensure that we avoid costly misuses.

So things like, how similar is this to that template, wild-type protein structure that we used as our conditioning information?

But I feel like broadly…

9 months назад @ microsoft.com
NLP Highlights NLP Highlights
последний пост None
Data Skeptic
последний пост 5 days, 3 hours назад
News Recommendations
News Recommendations News Recommendations

News recommendation algorithms influence far more than what stories we click—they can shape our understanding of the world. In this episode, Kyle Polich speaks with Andreea Iana about responsible AI, filter bubbles, multilingual news recommendation, and her open-source NewsRecLib framework for evaluating recommender systems. They explore why bigger models aren't always better and how future recommendation systems can balance personalization with diversity and societal impact.

5 days, 3 hours назад @ dataskeptic.com
Give Users the Wheel
Give Users the Wheel Give Users the Wheel

What if you could simply tell a recommendation system what you want instead of relying on likes, dislikes, and watch history? Kyle Polich talks with Fuyuan Lyu about the DPR framework, which combines large language models and traditional recommender systems to give users direct control over recommendations through natural language. Together they explore how conversational interfaces could transform platforms like YouTube, TikTok, and news feeds while preserving the strengths of modern recommendation algorithms.

2 weeks назад @ dataskeptic.com
AutoLike
AutoLike AutoLike

How can researchers audit recommendation systems when the algorithms are hidden from view? Hieu Le joins Kyle Polich to discuss Auto-Like, a reinforcement learning framework that systematically explores how platforms like TikTok personalize content feeds. The conversation covers recommendation transparency, black-box auditing, and the future of platform accountability.

2 weeks, 6 days назад @ dataskeptic.com
Student Spotlight: Aaron Payne, Data Analyst
Student Spotlight: Aaron Payne, Data Analyst Student Spotlight: Aaron Payne, Data Analyst

Aaron Payne, an MBA student at Georgia Tech studying business analytics and a Senior Insights Analyst at Chick-fil-A, joins Kyle Polich to talk about turning analytics into decisions that matter. They unpack a real-world forecasting project with Comfama in Colombia, including messy data realities, interpretability tradeoffs, and why "data science for good" starts with the people impacted.

2 months, 1 week назад @ dataskeptic.com
The Future is Agentic in Recommender Systems
The Future is Agentic in Recommender Systems The Future is Agentic in Recommender Systems

Kyle Polich sits down with Yashar Deldjoo, research scientist and Associate Professor at the Polytechnic University of Bari, to explore how recommender systems have evolved and why trustworthiness matters. They unpack key dimensions of responsible AI, including robustness to adversarial attacks, privacy, explainability, and fairness, and discuss how LLMs introduce new risks like hallucinations. The episode closes with a look at "agentic" recommender systems, where tools and memory shift recommendations from ranked lists to end-to-end task completion.

2 months, 1 week назад @ dataskeptic.com
Book Ratings and Recommendations
Book Ratings and Recommendations Book Ratings and Recommendations

Goodreads star ratings can be misleading as measures of "book quality," and research from Hannes Rosenbusch suggests that for many professionally published books, differences between readers often matter more than differences between books. The episode also explores how to model reader preferences, why reviews often reveal more about the reviewer than the text, and how LLMs can aid computational literary research while still falling short of human editors in creative writing.

3 months, 1 week назад @ dataskeptic.com
Disentanglement and Interpretability in Recommender Systems
Disentanglement and Interpretability in Recommender Systems Disentanglement and Interpretability in Recommender Systems 3 months, 4 weeks назад @ dataskeptic.com
Collective Altruism in Recommender Systems
Collective Altruism in Recommender Systems Collective Altruism in Recommender Systems

Ekaterina (Kat) Filadova from MIT EECS joins us to discuss strategic learning in recommender systems—what happens when users collectively coordinate to game recommendation algorithms. Kat's research reveals surprising findings: algorithmic "protest movements" can paradoxically help platforms by providing clearer preference signals, and the challenge of distinguishing coordinated behavior from bot activity is more complex than it appears. This episode explores the intersection of machine learning and game theory, examining what happens when your training data actively responds to your algorithm.

4 months, 1 week назад @ dataskeptic.com
Niche vs Mainstream
Niche vs Mainstream Niche vs Mainstream

Anas Buhayh discusses multi-stakeholder fairness in recommender systems and the S'mores framework—a simulation allowing users to choose between mainstream and niche algorithms. His research shows specialized recommenders improve utility for niche users while raising questions about filter bubbles and data privacy.

4 months, 2 weeks назад @ dataskeptic.com
Healthy Friction in Job Recommender Systems
Healthy Friction in Job Recommender Systems Healthy Friction in Job Recommender Systems

In this episode, host Kyle Polich speaks with Roan Schellingerhout, a fourth-year PhD student at Maastricht University, about explainable multi-stakeholder recommender systems for job recruitment. Roan discusses his research on creating AI-powered job matching systems that balance the needs of multiple stakeholders—job seekers, recruiters, HR professionals, and companies. The conversation explores different types of explanations for job recommendations, including textual, bar chart, and graph-based formats, with findings showing that lay users strongly prefer simple textual explanations over more technical visualizations. Roan shares insights from his "healthy friction" study, which tested …

5 months назад @ dataskeptic.com
Fairness in PCA-Based Recommenders
Fairness in PCA-Based Recommenders Fairness in PCA-Based Recommenders

In this episode, we explore the fascinating world of recommender systems and algorithmic fairness with David Liu, Assistant Research Professor at Cornell University's Center for Data Science for Enterprise and Society. David shares insights from his research on how machine learning models can inadvertently create unfairness, particularly for minority and niche user groups, even without any malicious intent. We dive deep into his groundbreaking work on Principal Component Analysis (PCA) and collaborative filtering, examining why these fundamental techniques sometimes fail to serve all users equally. David introduces the concept of "power niche users" - highly active users with specialized in…

5 months, 1 week назад @ dataskeptic.com
Video Recommendations in Industry
Video Recommendations in Industry Video Recommendations in Industry

In this episode, Kyle Polich sits down with Cory Zechmann, a content curator working in streaming television with 16 years of experience running the music blog "Silence Nogood." They explore the intersection of human curation and machine learning in content discovery, discussing the concept of "algatorial" curation—where algorithms and editorial expertise work together. Key topics include the cold start problem, why every metric is just a "proxy metric" for what users actually want, the challenge of filter bubbles, and the importance of balancing familiarity with discovery. Cory shares insights on why TikTok's algorithm works so well (clean data and massive interaction volume), the crucial …

6 months, 1 week назад @ dataskeptic.com
Eye Tracking in Recommender Systems
Eye Tracking in Recommender Systems Eye Tracking in Recommender Systems

In this episode, Santiago de Leon takes us deep into the world of eye tracking and its revolutionary applications in recommender systems. As a researcher at the Kempelin Institute and Brno University, Santiago explains the mechanics of eye tracking technology—how it captures gaze data and processes it into fixations and saccades to reveal user browsing patterns. He introduces the groundbreaking RecGaze dataset, the first eye tracking dataset specifically designed for recommender systems research, which opens new possibilities for understanding how users interact with carousel interfaces like Netflix. Through collaboration between psychologists and AI researchers, Santiago's work demonstrate…

6 months, 3 weeks назад @ dataskeptic.com
Cracking the Cold Start Problem
Cracking the Cold Start Problem Cracking the Cold Start Problem

In this episode of Data Skeptic, we dive deep into the technical foundations of building modern recommender systems. Unlike traditional machine learning classification problems where you can simply apply XGBoost to tabular data, recommender systems require sophisticated hybrid approaches that combine multiple techniques. Our guest, Boya Xu, an assistant professor of marketing at Virginia Tech, walks us through a cutting-edge method that integrates three key components: collaborative filtering for dimensionality reduction, embeddings to represent users and items in latent space, and bandit learning to balance exploration and exploitation when deploying new recommendations. Boya shares insigh…

7 months назад @ dataskeptic.com
Designing Recommender Systems for Digital Humanities
Designing Recommender Systems for Digital Humanities Designing Recommender Systems for Digital Humanities

In this episode of Data Skeptic, we explore the fascinating intersection of recommender systems and digital humanities with guest Florian Atzenhofer-Baumgartner, a PhD student at Graz University of Technology. Florian is working on Monasterium.net, Europe's largest online collection of historical charters, containing millions of medieval and early modern documents from across the continent. The conversation delves into why traditional recommender systems fall short in the digital humanities space, where users range from expert historians and genealogists to art historians and linguists, each with unique research needs and information-seeking behaviors. Florian explains the technical challen…

7 months, 2 weeks назад @ dataskeptic.com
SuperDataScience SuperDataScience
последний пост 7 часов назад
1007: How to Find Solid Career Ground in the AI Era, with 80,000 Hours Founder Ben Todd
1007: How to Find Solid Career Ground in the AI Era, with 80,000 Hours Founder Ben Todd 1007: How to Find Solid Career Ground in the AI Era, with 80,000 Hours Founder Ben Todd

Benjamin Todd, co-founder and President of 80,000 Hours and author of the new Penguin Random House book 80,000 Hours: How to Have a Fulfilling Career That Does Good, joins Jon Krohn for a major update on career strategy in the AI era, his first appearance since before ChatGPT existed. Ben explains why “follow your passion” is backwards and why rare, valuable skills used to help others are what actually generate lasting fulfillment, the ABZ framework for planning under deep uncertainty, why the only durable move is to keep shifting onto whatever bottleneck AI can’t yet clear, and how a human-level digital worker becomes superhuman almost immediately. He and Jon also map the risk landscape, p…

7 часов назад @ podtrac.com
1006: In Case You Missed It in June 2026
1006: In Case You Missed It in June 2026 1006: In Case You Missed It in June 2026

In this month's episode of ICYMI, hear from Chip Huyen, Andrey Kurenkov, Frank Basso and Gilbert Eijkelenboom, discussing why moats are shifting toward physical systems and accumulated product intuition, how Astrocade built vibe coding before the term existed, what it's really like inside a deafeningly loud AI data center, why only 15% of people are technically self-aware and whether AGI requires anything like consciousness. Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/1006⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information. In this episode you will learn: (00:00) The Cost of Bu…

4 days, 7 hours назад @ podtrac.com
1005: People Skills for Analytical Thinkers, with Bestselling Author Gilbert Eijkelenboom
1005: People Skills for Analytical Thinkers, with Bestselling Author Gilbert Eijkelenboom 1005: People Skills for Analytical Thinkers, with Bestselling Author Gilbert Eijkelenboom

Gilbert Eijkelenboom, bestselling author of People Skills for Analytical Thinkers and founder of the training firm MindSpeaking joins Jon Krohn to make the case that communication is a core data skill, not an optional extra. Gilbert shares the “And, But, Therefore” framework for turning dense analysis into a story stakeholders act on, the research suggesting only around 15% of people are genuinely self-aware (and how journaling, meditation, and exercise help close that gap), how childhood experiences install behavioral “algorithms” we carry into the workplace and why behavior change precedes attitude change, so doing small, uncomfortable things for 30 days can rewire how you see yourself. A…

1 week назад @ podtrac.com
1004: Recursive Self-Improvement
1004: Recursive Self-Improvement 1004: Recursive Self-Improvement

Could an AI get good enough at AI research to build its own, more capable successor and kick off a compounding loop? That’s recursive self-improvement (RSI) and it surged into the conversation after Anthropic revealed that, as of May 2026, Claude wrote more than 80% of the code merged into its production codebase. In this Five-Minute Friday, Jon Krohn separates today’s AI-assisted coding from true RSI, walks through the accelerating evidence - METR’s shrinking task “time horizon,” Google DeepMind’s AlphaEvolve, Andrej Karpathy’s overnight training-tuner, weighs Jack Clark’s 60% bet that AI builds its own successor by 2028 against the compute, data and “marketing” skeptics. As ever, Jon land…

1 week, 4 days назад @ podtrac.com
1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso
1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso 1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Frank Basso, VP of Infrastructure at Lightning AI, joins Jon Krohn for a rare ground-level tour of the one layer of the AI stack the show had never covered in over a thousand episodes: the physical data center. Frank explains how Lightning AI provisions its 35,000-plus GPUs through hyperscale co-location, why everything new is liquid-to-chip cooled, how GPUs talk to each other over ultra-fast east-west networks, and what it’s actually like to stand inside a 110-decibel AI data hall. He also debunks the most persistent myths about data-center water and electricity use, and makes the case for fuel cells, nuclear power, and 800-volt DC distribution as the path forward. Additional materials: ⁠⁠…

2 weeks назад @ podtrac.com
1002: Fable 5: The Full Story from Capabilities to Drama
1002: Fable 5: The Full Story from Capabilities to Drama 1002: Fable 5: The Full Story from Capabilities to Drama

Anthropic’s Claude Fable 5 was the most capable AI model ever released to the public and it lasted just three days before the US government forced it offline. Jon Krohn unpacks both halves of the story: what makes Fable 5 special, and why it was pulled. Fable 5 and its locked-down sibling Mythos 5 are the same model separated only by safeguards, in a new “Mythos-class” tier above Opus. Jon covers its state-of-the-art benchmarks, premium $10/$50-per-million-token pricing, conservative safety classifiers, and the federal export-control directive, reportedly sparked by an Amazon-flagged “jailbreak” that took it down. Additional materials:⁠ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/100…

2 weeks, 4 days назад @ podtrac.com
1001: How AI Erased My Career Moat, an Episode #1001 Special: Jon Krohn interviewed by Kirill Eremenko
1001: How AI Erased My Career Moat, an Episode #1001 Special: Jon Krohn interviewed by Kirill Eremenko 1001: How AI Erased My Career Moat, an Episode #1001 Special: Jon Krohn interviewed by Kirill Eremenko

For this episode #1001 special, the tables are turned: SuperDataScience founder Kirill Eremenko takes the host’s chair and Jon Krohn is the guest. They trace Jon Krohn’s path from an Oxford neuroscience PhD to a New York hedge fund to founding the AI consulting firm Y Carrot, why he regrets leaving academia and how tools like Claude Code erased his hard-won technical moat and why that makes skilled engineers more valuable than ever. Along the way: whether AI is a bubble, Jevons paradox and the data-center boom, the RICE framework for choosing AI projects, the single biggest reason AI projects fail and how a well-built AI agent could give anyone “Christopher Nolan–like” focus. Additional mat…

3 weeks назад @ podtrac.com
1000: Ten Years of the Super Data Science Podcast, with Jon, Kirill and Special Guests
1000: Ten Years of the Super Data Science Podcast, with Jon, Kirill and Special Guests 1000: Ten Years of the Super Data Science Podcast, with Jon, Kirill and Special Guests

For this landmark 1,000th episode and the show’s 10-year anniversary, host Jon Krohn is joined by SuperDataScience founder Kirill Eremenko, who hosted the podcast for its first 400-plus episodes before handing over the reins. In a first for the show, the episode was recorded live with the audience invited to join on air, alongside surprise appearances from the team, longtime guests, and even Jon’s family. Together, Jon Krohn and Kirill look back on a decade of the podcast and field listener questions on AI’s biggest opportunities, the build-versus-buy dilemma, how to break into the field today, and how to stay grounded amid the relentless pace of AI. Additional materials:⁠ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠…

3 weeks, 4 days назад @ podtrac.com
999: What's Left to Build When Software Is Free, with Chip Huyen
999: What's Left to Build When Software Is Free, with Chip Huyen 999: What's Left to Build When Software Is Free, with Chip Huyen

Chip Huyen joins host Jon Krohn for this milestone episode 999 to talk about her record-breaking book "AI Engineering" the most-read title on the O'Reilly platform last year and how the AI landscape has shifted since her last appearance. Chip breaks down what separates AI engineering from machine learning engineering, makes the case for a "start simple" workflow, gets candid about the real costs of running LLMs in production, and shares why she's now fascinated by physical AI, robotics, and world models and why the durable problems worth solving are increasingly human ones. Jon Krohn guides the conversation from the practical content of the book through to where the field is heading next. A…

4 weeks назад @ podtrac.com
998: In Case You Missed It in May 2026
998: In Case You Missed It in May 2026 998: In Case You Missed It in May 2026

In this month’s episode of ICYMI, Jon Krohn explores how AI agents are simultaneously creating new risks and unlocking powerful new ways of working with data. Hear from Anneka Gupta, Cal Al-Dhubaib, Trevor Manz, Jazmia Henry, Jeremy Mumford, and Jacob Miller, discussing why the old cybersecurity playbook breaks down in the age of Claude Mythos, how the notebook became an AI agent’s working memory, what it really takes to build a foundation model from scratch, and why failing slowly is the most expensive mistake an AI team can make. Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/998⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natali…

1 month назад @ podtrac.com
997: How This AI Startup Hit 20M Users (No Moat)
997: How This AI Startup Hit 20M Users (No Moat) 997: How This AI Startup Hit 20M Users (No Moat)

Dr. Andrey Kurenkov returns to the show to talk about Astrocade's astronomical growth from pre-alpha to over 20 million engaged users, what it actually takes to build a vibe-coding platform that scales, and how the broader AI landscape has shifted since his last appearance. Andrey shares behind-the-scenes lessons from building B2C user-generated content products, why the real moat is community rather than tech, and his current thinking on humanoid robotics, AGI, and the AI risks people actually overlook. Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.superdatascience.com/997⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode…

1 month назад @ podtrac.com
996: TrueFoundry’s Nikunj Bajaj on How to Get $100M Returns on AI Agent Deployments
996: TrueFoundry’s Nikunj Bajaj on How to Get $100M Returns on AI Agent Deployments 996: TrueFoundry’s Nikunj Bajaj on How to Get $100M Returns on AI Agent Deployments

TrueFoundry co-founder and CEO Nikunj Bajaj speaks to Jon Krohn about how enterprises like Nvidia and Siemens are realizing returns of over $100 million from single agent deployments, the AI gateway architecture that makes it possible to connect, observe, and govern agents at scale, and why the familiar advice to “start small” is the wrong way to roll out AI agents inside a large organization. Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/996 Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.⁠⁠⁠ In this episode you will learn: (01:21) What TrueFoundry does and why agents in production nee…

1 month, 1 week назад @ podtrac.com
995: End-to-End Foundation Models for the Energy Industry, with Jazmia Henry
995: End-to-End Foundation Models for the Energy Industry, with Jazmia Henry 995: End-to-End Foundation Models for the Energy Industry, with Jazmia Henry

Jazmia Henry joins Jon Krohn to break down what it actually takes to build end-to-end foundation models for the energy industry. From wrangling decades of handwritten oil-and-gas documents into usable training data, to bespoke tokenizers, reinforcement learning, and inference at scale, Jazmia walks through every stage of the stack. Along the way she explains why reinforcement learning models are "bursty," what reward hacking is and how her Grounded Continuous Evaluation framework fixes it, and revisits the 2023 NeurIPS paper that argued, to widespread skepticism at the time, that scaling bad data degrades model performance. Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠h…

1 month, 1 week назад @ podtrac.com
994: AI’s Putting Recent Grads Out of Work; Here’s How to Get Hired Anyway!
994: AI’s Putting Recent Grads Out of Work; Here’s How to Get Hired Anyway! 994: AI’s Putting Recent Grads Out of Work; Here’s How to Get Hired Anyway!

Unemployment for recent computer-science graduates now rivals rates for fine-arts and anthropology majors, and undergraduate CS enrollment fell 11% in 2025. In this Five-Minute Friday, Jon Krohn walks through the data on both sides of the debate, from Stanford research showing a 13% employment drop for young workers in AI-exposed jobs, to Federal Reserve studies finding no statistically detectable link between AI adoption and reduced hiring. Jon shares his own view on where the truth lies and offers five concrete pieces of advice for graduates and senior professionals alike on how to get hired in 2026. Additional materials:⁠ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/993⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠…

1 month, 2 weeks назад @ podtrac.com
993: How to Build AI-First Organizations, with Jacob Miller and Jeremy Mumford
993: How to Build AI-First Organizations, with Jacob Miller and Jeremy Mumford 993: How to Build AI-First Organizations, with Jacob Miller and Jeremy Mumford

For years, AI content has come in the form of “use this library, use this tool” tutorials that age out within months. Jacob Miller and Jeremy Mumford, co-authors of the brand new Wiley book Architected Intelligence, wanted to write something different, a guide to the higher-level principles of building AI products and AI-first organizations that will still be relevant in five or ten years. In this episode, the two Pattern engineers walk Jon Krohn through the core ideas of their book: why you should design products and processes so they can be executed by a human, an AI agent, or any hybrid combination; why most companies are still treating hallucinations as a model problem when they’re actu…

1 month, 2 weeks назад @ podtrac.com
Data Science at Home Data Science at Home
последний пост 2 weeks назад
AI is the Concorde of our time (Ep. 309)
AI is the Concorde of our time (Ep. 309) AI is the Concorde of our time (Ep. 309)

Global data center investment now surpasses global oil supply spending.

Check outshift.comNEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions.

Send us mail at: [email protected]’t forget to like, subscribe, and hit the 🔔 for updates on the latest in AI and data science!

2 weeks назад @ datascienceathome.com
Recommend and manipulate: the dangers of the attention economy
Recommend and manipulate: the dangers of the attention economy Recommend and manipulate: the dangers of the attention economy

This sort of operation is directly exploiting a core feature of internet social media platforms.

The main purpose of recommender systems is to recommend people the same items similar people show an interest in.

Some of the most common methods to implement recommender systems, use concepts such as cosine/correlation similarity, matrix factorization, neural autoencoders and sequence predictors.

As you say, recommender systems exist because the business model of social media platforms is to monetise attention.

F: So you are saying that this is not an accident: is this the basis of the optimisation of the recommender system?

1 month, 2 weeks назад @ datascienceathome.com
Social media is an ant mill (Internet is a disaster) (Ep. 303)
Social media is an ant mill (Internet is a disaster) (Ep. 303) Social media is an ant mill (Internet is a disaster) (Ep. 303)

Personal newsletter:https://defragzone.substack.com📩 Newsletter: https://datascienceathome.substack.com🎙 Podcast: Available on Spotify, Apple Podcasts, and more.

🐦 Twitter: @DataScienceAtHome📘LinkedIn: https://www.linkedin.com/in/fragadaleta/Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcastDiscord Channel: https://discord.gg/4UNKGf3NEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews…

1 month, 2 weeks назад @ datascienceathome.com
AI and videogames (Ep. 305)
AI and videogames (Ep. 305) AI and videogames (Ep. 305)

What is the state of AI and videogames?

This and much more is covered in this 1st episode of AI and videogames.

Check outshift.comNEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Send us mail at: [email protected]’t forget to like, subscribe, and hit the 🔔 for updates on the latest in AI and data science!

1 month, 2 weeks назад @ datascienceathome.com
AI and videogames: Conversational NPCs (Ep. 306)
AI and videogames: Conversational NPCs (Ep. 306) AI and videogames: Conversational NPCs (Ep. 306)

Can NPCs in videogames leverage new LLM-based tech?

Check outshift.comNEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions.

Send us mail at: [email protected]’t forget to like, subscribe, and hit the 🔔 for updates on the latest in AI and data science!

1 month, 2 weeks назад @ datascienceathome.com
AI tips & tricks (Ep. 307)
AI tips & tricks (Ep. 307) AI tips & tricks (Ep. 307)

🐦 Twitter: @DataScienceAtHome📘LinkedIn: https://www.linkedin.com/in/fragadaleta/Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcastSPONSORSThis episode is brought to you by Outshift, Cisco’s incubation engine.

Check outshift.comNEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions.

Send us mail at: [email protected]’t forget to like, subscribe, and hit the …

1 month, 2 weeks назад @ datascienceathome.com
Europe, wake up! You Can’t Be a Superpower on Someone Else’s Servers (Ep. 304)
Europe, wake up! You Can’t Be a Superpower on Someone Else’s Servers (Ep. 304) Europe, wake up! You Can’t Be a Superpower on Someone Else’s Servers (Ep. 304)

Tech sovereignty takes 3 years and political will.

Check outshift.comNEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions.

Send us mail at: [email protected]’t forget to like, subscribe, and hit the 🔔 for updates on the latest in AI and data science!

2 months, 2 weeks назад @ datascienceathome.com
About Apple’s Privacy (Ep. 302)
About Apple’s Privacy (Ep. 302) About Apple’s Privacy (Ep. 302)

Apple just spent $2B on tech that reads your silent speech.

🐦 Twitter: @DataScienceAtHome📘LinkedIn: https://www.linkedin.com/in/fragadaleta/Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcastDiscord Channel: https://discord.gg/4UNKGf3NEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions.

Send us mail at: [email protected]’t forget to like, subscribe, and hi…

2 months, 2 weeks назад @ datascienceathome.com
Productivity is the new data breach (Ep. 301)
Productivity is the new data breach (Ep. 301) Productivity is the new data breach (Ep. 301)

Personal newsletter:https://defragzone.substack.com📩 Newsletter: https://datascienceathome.substack.com🎙 Podcast: Available on Spotify, Apple Podcasts, and more.

🐦 Twitter: @DataScienceAtHome📘LinkedIn: https://www.linkedin.com/in/fragadaleta/Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcastDiscord Channel: https://discord.gg/4UNKGf3NEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews…

2 months, 2 weeks назад @ datascienceathome.com
Programmable Money: The Cage They’ll Call Convenience (Ep. 300)
Programmable Money: The Cage They’ll Call Convenience (Ep. 300) Programmable Money: The Cage They’ll Call Convenience (Ep. 300)

This episode breaks down programmable money, the technology that turns your wallet into a permission system.

Personal newsletter: https://defragzone.substack.com📩 Newsletter: https://datascienceathome.substack.com🎙 Podcast: Available on Spotify, Apple Podcasts, and more.

🐦 Twitter: @DataScienceAtHome📘LinkedIn: https://www.linkedin.com/in/fragadaleta/Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcastDiscord Channel: https://discord.gg/4UNKGf3NEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Send us mail at: …

2 months, 2 weeks назад @ datascienceathome.com
There Is No AI. There’s a Stateless Function on 10,000 GPUs Pretending to Know You (Ep. 299)
There Is No AI. There’s a Stateless Function on 10,000 GPUs Pretending to Know You (Ep. 299) There Is No AI. There’s a Stateless Function on 10,000 GPUs Pretending to Know You (Ep. 299)

Personal newsletter: https://defragzone.substack.com📩 Newsletter: https://datascienceathome.substack.com🎙 Podcast: Available on Spotify, Apple Podcasts, and more.

🐦 Twitter: @DataScienceAtHome📘 LinkedIn: https://www.linkedin.com/in/fragadaleta/ Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcastDiscord Channel: https://discord.gg/4UNKGf3NEW TO DATA SCIENCE AT HOME?

Data Science at Home explores the latest in AI, data science, and machine learning.

Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, intervi…

4 months назад @ datascienceathome.com
Bias in the machine (edited)
Bias in the machine (edited) Bias in the machine (edited)

The title of today’s episode is Bias in the machineC: Francesco, today we are starting with an infuriating discussion.

The failure of the medical community as a whole to recognise this obvious bias up to the 21st century is an example of how insidious the problem of bias is.

Three: The bias in your training sample: people put training samples together, and people have culture, experience, and prejudice.

These assumptions inform the way AI systems work—and fail—to this day.

When an algorithm is a black box and you can’t look inside, you have no way of analysing its bias.

4 months назад @ datascienceathome.com
What is wrong with reinforcement learning? (Ep. 82)
What is wrong with reinforcement learning? (Ep. 82) What is wrong with reinforcement learning? (Ep. 82)

Join the discussion on our Discord serverAfter reinforcement learning agents doing great at playing Atari video games, Alpha Go, doing financial trading, dealing with language modeling, let me tell you the real story here.In this episode I want to shine some light on reinforcement learning (RL) and the limitations that every practitioner should consider before taking certain directions.

RL seems to work so well!

What is wrong with it?

Are you a listener of Data Science at Home podcast?

Or did you subscribe to the Artificial Intelligence at your fingertips newsletter?

5 months назад @ datascienceathome.com
How to generate very large images with GANs (Ep. 76)
How to generate very large images with GANs (Ep. 76) How to generate very large images with GANs (Ep. 76)

Join the discussion on our Discord serverIn this episode I explain how a research group from the University of Lubeck dominated the curse of dimensionality for the generation of large medical images with GANs.

The problem is not as trivial as it seems.

Many researchers have failed in generating large images with GANs before.

One interesting application of such approach is in medicine for the generation of CT and X-ray images.Enjoy the show!

ReferencesMulti-scale GANs for Memory-efficient Generation of High Resolution Medical Images https://arxiv.org/abs/1907.01376

5 months назад @ datascienceathome.com
Training neural networks faster without GPU [RB] (Ep. 77)
Training neural networks faster without GPU [RB] (Ep. 77) Training neural networks faster without GPU [RB] (Ep. 77)

Join the discussion on our Discord serverTraining neural networks faster usually involves the usage of powerful GPUs.

In this episode I explain an interesting method from a group of researchers from Google Brain, who can train neural networks faster by squeezing the hardware to their needs and making the training pipeline more dense.

Enjoy the show!

ReferencesFaster Neural Network Training with Data Echoinghttps://arxiv.org/abs/1907.05550

5 months назад @ datascienceathome.com