v0.7.0
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
llama.cpp11 min read
Apple ML Research
Stay updated with the latest developments in Artificial Intelligence
Agents on live hardware: reason where you must, engineer everywhere else
CoreWeave Blog10 min read
b11669
llama.cpp1 min read
Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models
Code-switching (CS), the alternation between languages within an utterance, is common in multilingual speech but underrepresented in pretraining corpora. Increasing CS coverage requires finding relevant utterances in large speech collections so that they can be included in training data.
Apple ML Research2 min readThe Design Space of Tri-Modal Masked Diffusion Models
Discrete diffusion models have emerged as strong alternatives to autoregressive language models, with recent work initializing and finetuning a base unimodal model for bi-modal generation.
Apple ML Research2 min readMix, Don't Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings
For most languages of the world, language model pre-training operates in a data-constrained regime where models must repeat their training data many times, degrading generalization.
Apple ML Research3 min readSelf-Compacting Language Model Agents
Long agent traces composed of chains of thought and tool calls accumulate stale content that anchor subsequent generations, and eventually outgrow the context window. Existing scaffolds mitigate it with fixed-interval compaction triggered at a token threshold.
Apple ML Research2 min readMinions: A Dynamic and Distributed Virtual GPU Cloud Built on Idle Apple Silicon Devices
The increasing demand for GPU-accelerated machine learning inference has exposed limitations in centralized GPU infrastructures, including high cost, limited elasticity, and long wait times under resource constraints.
Apple ML Research2 min readLarge Language Models for Machine Translation Quality Annotation: Humans and Models Are Both Challenged
Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to human judgment for Machine Translation (MT) evaluation.
Apple ML Research2 min readNormalizing Trajectory Models
Diffusion-based models decompose sampling into many small Gaussian denoising steps, an assumption that breaks down when generation is compressed to a few coarse transitions.
Apple ML Research2 min readRISED: Rubrics for Agentic Multi-Environment Selection and Self-Distillation
Training a single LLM agent jointly across diverse interactive environments has attracted increasing attention as a route to generalist agents. Existing curriculum and data-selection strategies often allocate training at the environment level or prioritize local reward-based signals, without…
Apple ML Research2 min readNegotiating Ontological Boundaries in User-Authored Personal Sensing Systems
Designed artifacts are ontological, shaping, and at times limiting, what becomes possible or imaginable. One path toward mitigating such foreclosures is giving people power over how systems are designed and built.
Apple ML Research2 min readLanguage Discrimination Improves Linguistic Learning in Multilingual Speech Models
Multilingual self-supervised speech models can benefit from sharing information across languages, but under a matched total pretraining data budget they still fall short of monolingual models.
Apple ML Research2 min readHow Much of a Harness Does a Strong Agent Need for Autonomous ML Engineering?
Recent autonomous machine learning engineering (MLE) agents have made significant progress on public leaderboards. Often motivated by progress stagnation over long-horizon cycles and limited Large Language Model (LLM) primitives, modern MLE agents are deployed on top of increasingly elaborate…
Apple ML Research2 min readOn the Effectiveness-Fluency Trade-Off in LLM Conditioning: A Systematic Study
Controlling the output of Large Language Models (LLMs) is a central challenge for their reliable deployment, yet a clear understanding of the involved trade-offs remains elusive.
Apple ML Research2 min readThe Communication Bottleneck: A Round-Trip Study of Tree-Structured Expression Serialization in Language Models
When language models reason in chain-of-thought or exchange free-text intermediates, they serialize structured information into natural language. How much tree-structured compositional content survives this bottleneck?
Apple ML Research2 min readFaster Rates for Federated Variational Inequalities
In this paper, we study federated optimization for solving stochastic variational inequalities (VIs), a problem that has attracted growing attention in recent years.
Apple ML Research2 min readCompressing Streaming Neural Audio Encoders via Latent-Space Distillation
System-wide Dictation on Apple devices runs entirely on-device, and the speech it transcribes reaches the foundation model through a tokenizer: an encoder that maps short windows of waveform onto the representation the language model reads.
Apple ML Research2 min readA Practical Recipe for Semi-Supervised Federated ASR: Online Pseudo-Labels with Server Update Stabilization
Semi-supervised federated learning (SSFL) trains models on clients’ unlabeled data using a teacher to generate pseudo-labels, with a small labeled seed dataset on the server.
Apple ML Research3 min readHow to Guide Your Language Flow
We introduce a new method to guide flow matching models. Our approach, which we call probe guidance, uses the frozen internal states of an existing diffusion model to construct a guidance signal.
Apple ML Research2 min readDynamically Scaled Activation Steering
Activation steering has emerged as a powerful method for guiding the behavior of generative models towards desired outcomes such as toxicity mitigation. However, most existing methods apply interventions uniformly across all inputs, degrading model performance when steering is unnecessary.
Apple ML Research2 min read
Showing 18 of 22 stories
Load more storiesAiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news from Apple ML Research
Join 15,000+ AI enthusiasts