AETHER · Benchmark & Validation

Fewer tokens.Measured results.

We measure Aether Compress not only by how much it compresses, but also by how much necessary information it preserves while compressing. Our results are evaluated with large-scale local tests and independent model validation.

40,65%
average input reduction
100K+
test scenario
100%
information protection success
3.48ms
average processing time
Authentication Architecture

Two different layers of testing.

Local verification tests for information loss at scale. External model validation is the model generated from the optimized context. It measures whether the answer carries the same information as the original context.

Layer 01
Local Verification
100.000
test scenario
100%
successful
40,65%
average reduction
52,67%
measured maximum
3.48ms
average time
Layer 02
External Model Verification
500 / 500
verified scenario
100%
measured response accuracy
25,13%
reduction in selected cluster
500
completed test
0
failed test
Why are the rates different? 40.65% of a local validation set of 100,000 scenarios is the average. 25.13% are selected for external model verification. It is a measurement of a separate subset of 500 scenarios. Two values are the same test does not represent the group.
Input Reduction

Ortalama40.65% less.

The measured value indicates that the optimized input is equal to the original input. It shows the average decrease in the amount of tokens.

Original Input
100%
After Aether
59,35%
Normal
Optimized
reduced%40,65
Measurement 01
be smallerIt is not success alone.

When evaluating Aether Compress, only token reduction is not measured. The primary success criterion is that the optimized context preserves the necessary information.

Measurement 02
final answeris also verified.

In the external validation layer the same question is valid for both the original and evaluated on the optimized context and It is measured whether the answers retain the necessary information.

Kapsam

A single content typeWe do not measure according to.

The test set has different density, structure and context properties. It consists of scenarios with

01
Direct Information
02
Multiple Information
03
Long Context
04
Query Oriented
05
Structural Content
06
Technical Content
07
Code Context
08
Mixed Content
09
Repetitive Content
10
Low Redundancy
11
High Redundancy
12
Limit States
Metodoloji

Same measurement, repeatable process.

Benchmark process original input, optimized input and measure the verification result separately from each other.

01
Orijinal

The test input is taken as an unchanged reference.

02
Optimize

The same input is processed with Aether Compress.

03
Compare

Token reduction and information preservation are measured separately.

04
verify

Selected tests are also checked via the external model.

Reading the Results

Measurement limits

40.65% is not a guarantee

The reduction rate varies depending on the structure of the input and the amount of unnecessary information it contains.

3.48ms is not universal latency

This value is the average processing time measured in the validation environment. It may vary depending on hardware and workload.

52.67% is the maximum measurement

This value represents the highest throttling observed in the validation set and is not the expected rate for each request.

Accuracy measured

The 100% value in external validation is the result of 500 tested scenarios and does not imply a guarantee for unlimited all possible inputs.

Measure with Your Own Data

More important than the benchmark,your input.

Try Aether Compress for free and see how many tokens you can reduce in your own real context.

Try it for free
No credit card required
1M Free tokens