ASON 2.0 - Aliased Serialization Object Notation

Token-optimized JSON compression for GPT-4, Claude, and all Large Language Models. Reduce LLM API costs by 20-60% with lossless compression. Perfect for RAG systems, function calling, analytics data, and any structured arrays sent to LLMs. ASON 2.0 uses smart compression with tabular arrays, semantic references, and pipe delimiters.

🎮 Try Interactive Playground • 📊 View Benchmarks • 📖 Read Documentation

✨ What's New in ASON 2.0?

• ✅ Sections (@section) - Organize related data
• ✅ Tabular Arrays ([N]{fields}) - CSV-like format with explicit count
• ✅ Semantic References ($email, &address) - Human-readable variable names
• ✅ Pipe Delimiter (|) - More token-efficient than commas
• ✅ Advanced Optimizations - Inline objects, dot notation in schemas, array fields
• ✅ Lexer-Parser Architecture - Robust parsing with proper AST

🚀 Quick Start

Installation

npm install @ason-format/ason

Basic Usage

import { SmartCompressor } from '@ason-format/ason';

const compressor = new SmartCompressor();

const data = {
  users: [
    { id: 1, name: "Alice", email: "alice@ex.com" },
    { id: 2, name: "Bob", email: "bob@ex.com" }
  ]
};

// Compress
const ason = compressor.compress(data);
console.log(ason);
// Output:
// @users [2]{id,name,email}
// 1|Alice|alice@ex.com
// 2|Bob|bob@ex.com

// Decompress (perfect round-trip)
const original = compressor.decompress(ason);

CLI Tool

# Compress JSON to ASON
npx ason input.json -o output.ason

# Decompress ASON to JSON
npx ason data.ason -o output.json

# Show token savings with --stats
npx ason data.json --stats

# 📊 COMPRESSION STATS:
# ┌─────────────────┬──────────┬────────────┬──────────────┐
# │ Format          │ Tokens   │ Size       │ Reduction    │
# ├─────────────────┼──────────┼────────────┼──────────────┤
# │ JSON            │ 59       │ 151 B      │ -            │
# │ ASON 2.0        │ 23       │ 43 B       │ 61.02%       │
# └─────────────────┴──────────┴────────────┴──────────────┘
# ✓ Saved 36 tokens (61.02%) • 108 B (71.52%)

# Pipe from stdin
echo '{"name": "Ada"}' | npx ason
cat data.json | npx ason > output.ason

📊 Benchmarks

Benchmarks use GPT-5 o200k_base tokenizer. Results vary by model and tokenizer.

Token Efficiency Comparison

Tested on 5 real-world datasets:

🏆 Shipping Record
   │
   ASON                ████████████░░░░░░░░    148 tokens  (+9.76% vs JSON)
   JSON                ████████████████████    164 tokens  (baseline)
   Toon                ██████████████████░░    178 tokens  (-8.54% vs JSON)

🏆 E-commerce Order
   │
   ASON                █████████████████░░░    263 tokens  (+10.24% vs JSON)
   JSON                ████████████████████    293 tokens  (baseline)
   Toon                ████████████████████    296 tokens  (-1.02% vs JSON)

🏆 Analytics Time Series
   │
   ASON                ███████████░░░░░░░░░    235 tokens  (+23.45% vs JSON)
   Toon                ████████████████░░░░    260 tokens  (+15.31% vs JSON)
   JSON                ████████████████████    307 tokens  (baseline)

📊 GitHub Repositories (Non-uniform)
   │
   JSON                ████████████████████    347 tokens  (baseline)
   ASON                █████████████████░░░    384 tokens  (-10.66% vs JSON)
   Toon                ███████████████░░░░░    415 tokens  (-19.60% vs JSON)

📊 Deeply Nested Structure (Non-uniform)
   │
   JSON                ████████████████████    186 tokens  (baseline)
   ASON                ██████████████████░░    201 tokens  (-8.06% vs JSON)
   Toon                ████████████░░░░░░░░    223 tokens  (-19.89% vs JSON)

──────────────────────────────── OVERALL (5 datasets) ───────────────────────────────
   ASON Average:  +4.94% reduction
   Toon Average:  -6.75% reduction

   ASON WINS: 3 out of 5 datasets
   ASON performs better on: Uniform arrays, mixed structures
   Both struggle with: Non-uniform/deeply nested data (but ASON loses less)

When to Use Each Format

Format	Best For	Token Efficiency
ASON	Uniform arrays, nested objects, mixed data	⭐⭐⭐⭐⭐ (4.94% avg)
Toon	Flat tabular data only	⭐⭐⭐ (-6.75% avg)
JSON	Non-uniform, deeply nested	⭐⭐ (baseline)
CSV	Simple tables, no nesting	⭐⭐⭐⭐⭐⭐ (best for flat data)

✨ Features

• ✅ 100% Automatic - Zero configuration, detects patterns automatically
• ✅ Lossless - Perfect round-trip fidelity
• ✅ Up to 23% Token Reduction - Saves money on LLM API calls (+4.94% average)
• ✅ Object References - Deduplicates repeated structures (&obj0)
• ✅ Inline-First Dictionary - Optimized for LLM readability
• ✅ TypeScript Support - Full .d.ts type definitions included
• ✅ CLI Tool - Command-line interface with --stats flag
• ✅ ESM + CJS - Works in browser and Node.js

📚 Documentation

• 🎮 Interactive Playground - Try ASON in your browser with real-time token counting
• 📖 Complete Documentation - Format specification, API guide, and best practices
• 📊 Benchmarks & Comparisons - ASON vs JSON vs TOON vs YAML performance tests
• 🔧 API Reference - Detailed Node.js API documentation
• 🔢 Token Counter Tool - Visual token comparison across formats
• 📦 Release Guide - How to publish new versions
• 📝 Changelog - Version history and updates

🎯 Real-World Use Cases

1. Reduce LLM API Costs (GPT-4, Claude, etc.)

import { SmartCompressor } from '@ason-format/ason';
import OpenAI from 'openai';

const compressor = new SmartCompressor({ indent: 1 });
const openai = new OpenAI();

const largeData = await fetchDataFromDB();
const compressed = compressor.compress(largeData);

// Saves ~33% on tokens = 33% cost reduction
const response = await openai.chat.completions.create({
  messages: [{
    role: "user",
    content: `Analyze this data: ${compressed}`
  }]
});

2. Optimize Storage

// Save to Redis/localStorage with less space
const compressor = new SmartCompressor({ indent: 1 });
localStorage.setItem('cache', compressor.compress(bigObject));

// Retrieve
const data = compressor.decompress(localStorage.getItem('cache'));

3. RAG Systems & Vector Databases

// Compress document metadata before sending to LLM
import { SmartCompressor } from '@ason-format/ason';

const docs = await vectorDB.similaritySearch(query, k=10);
const compressed = compressor.compress(docs.map(d => ({
  content: d.pageContent,
  score: d.metadata.score,
  source: d.metadata.source
})));

// 50-60% token reduction on document arrays
const response = await llm.invoke(`Context: ${compressed}\n\nQuery: ${query}`);

4. Function Calling & Tool Use

// Reduce token overhead in OpenAI function calling
const users = await db.query('SELECT id, name, email FROM users LIMIT 100');
const compressed = compressor.compress(users);

await openai.chat.completions.create({
  messages: [...],
  tools: [{
    type: "function",
    function: {
      name: "process_users",
      parameters: {
        type: "object",
        properties: {
          users: { type: "string", description: "User data in ASON format" }
        }
      }
    }
  }],
  tool_choice: { type: "function", function: { name: "process_users" } }
});

5. Analytics & Time-Series Data

// 65% token reduction on metrics/analytics
const metrics = await getHourlyMetrics(last24Hours);
const compressed = compressor.compress(metrics);

// Perfect for dashboards, logs, financial data
const analysis = await llm.analyze(compressed);

6. Compact API Responses

app.get('/api/data/compact', (req, res) => {
  const data = getDataFromDB();
  const compressed = compressor.compress(data);

  res.json({
    data: compressed,
    format: 'ason',
    savings: '33%'
  });
});

🛠️ Development

# Clone repository
git clone https://github.com/ason-format/ason.git
cd ason

# Install dependencies
cd nodejs-compressor
npm install

# Run tests
npm test

# Run benchmarks
npm run benchmark

# Build for production
npm run build

# Test CLI locally
node src/cli.js data.json --stats

🌟 Community & Support

• 💬 GitHub Discussions - Ask questions, share use cases
• 🐛 Issue Tracker - Report bugs or request features
• 🔧 Tools & Extensions - MCP Server, npm packages, CLI

🤝 Contributing

We welcome contributions! Please see:

• CONTRIBUTING.md - Contribution guidelines
• CODE_OF_CONDUCT.md - Community standards
• SECURITY.md - Security policies

📝 License

MIT © 2025 ASON Project Contributors

---

🔑 Keywords

LLM optimization • GPT-4 cost reduction • Claude API • Token compression • JSON optimization • RAG systems • Function calling • OpenAI API • Vector database • LangChain • Semantic kernel • AI cost savings • ML engineering • Data serialization • API optimization

---