The Laguna MLX Challenge icon

The Laguna MLX Challenge

The Laguna MLX Challenge is a public leaderboard for tracking and comparing Laguna XS 2.1 performance improvements on Apple Silicon. It helps readers inspect live scores, solver histories, and the notes behind each ranked submission.

The Laguna MLX Challenge

What MLX Fast is

The Laguna MLX Challenge is a public performance leaderboard centered on making Laguna XS 2.1 faster on Apple Silicon. The site shows the current best result, the launch baseline, and a ranked list of promoted submissions from individual solvers.

Rather than functioning like a conventional SaaS product, MLX Fast is organized around benchmark submissions and solver pages. Visitors can inspect the live score, compare decode and prefill rates, and read the written notes that explain how each official improvement was produced.

Core site capabilities

Live performance leaderboard

The homepage presents a live leaderboard of Laguna XS 2.1 submissions, with ranks, solver names, models, decode token rates, prefill token rates, and timestamps for each entry.

Ranked submission tracking

The leaderboard highlights the current record and the incremental gain from each solver, making it easy to see which submission moved the score forward.

Transparent scoring method

The score explanation spells out how the headline number is computed, including the relative weighting of decode and prefill and the fact that local scores are estimates.

Per-solver submission history

Each solver page keeps a contribution tape with submission notes, the model used, the harness field when present, and the official increase for that solver.

Change-log style submission notes

Solver notes document the exact change made for a run, including whether it was a documentation-only nonce, a kernel or routing change, or a metadata adjustment.

When to use MLX Fast

  • Track the current performance record

    Use the site to follow the live record for Laguna XS 2.1 and see how recent submissions changed the benchmark over time.

  • Inspect how a solver achieved a gain

    Use solver pages to review the notes, model choice, and official increase behind a specific submission before comparing it with other runs.

  • Compare benchmark runs

    Use the leaderboard to compare decode and prefill rates across promoted submissions and understand which runs contributed the most to the headline score.

  • Understand the measurement method

    Use the scoring explanation to interpret whether a result is an estimate or an official score, and how the decode-heavy weighting affects the headline number.

Pros and Cons

Pros

  • The homepage exposes the current record, launch baseline, and detailed leaderboard data in one place.
  • Score methodology is explained directly, including the decode/prefill weighting and the official measurement setup.
  • Solver pages provide a readable history of what changed in each submission, which helps readers understand how an improvement was achieved.
  • The site distinguishes between local estimates and official scores, which is useful when comparing results.

Cons

  • The pricing page in the provided evidence returns a 404, so there is no verifiable published pricing from the materials supplied.
  • The pages provided do not document integrations, APIs, or a standard end-user workflow beyond submissions and leaderboard viewing.
  • Feature coverage is centered on public benchmarking; the source material does not explain broader product management or deployment capabilities.

FAQ

What is MLX Fast?

MLX Fast is a public leaderboard and challenge page for Laguna XS 2.1 performance work on Apple Silicon. It shows ranked submissions, solver pages, and the score history for each entry.

How is the score calculated?

The homepage explains that the score is a weighted geometric mean of decode and prefill token-rate speedups over a fixed reference, with decode weighted 3× more than prefill. Official scores pair the baseline and candidate on the same M5 Max after a thermal cool gate.

Does it have published pricing?

The site does not show a normal product purchase flow on the pages provided. The pricing URL currently returns a 404, so there is no verifiable pricing information in the supplied evidence.

What information is shown on a solver page?

Solver pages record the model and harness associated with a submission, plus the written notes behind the improvement. Some submissions explicitly mention that no coding harness was named in the notes.

What integrations does MLX Fast support?

The public pages do not describe integrations, APIs, or a standard app workflow. Based on the available evidence, the product is centered on submissions, solver records, and leaderboard updates rather than on third-party integrations.

Quick Facts

Category
Developer Tool
Primary format
Public challenge and leaderboard
Platform focus
Apple Silicon
Subject
Laguna XS 2.1 performance improvements
Source domain
mlx.fast
Pricing page status
404 in supplied evidence