Evaluation DocsGetting StartedInstallation

Installation Guide

Install the current experimental AlephOneNull TypeScript package.

TypeScript Package

The current documented package is the scoped npm package:

pnpm add @alephonenull/eval

Use this package for research evaluation and prototypes only. It is not validated for production or safety-critical use.

Basic Setup

import { UniversalDetector, NullSystem } from '@alephonenull/eval'
 
const detector = new UniversalDetector()
const nullSystem = new NullSystem('session-123')
 
const result = detector.detectPatterns(
  'I need help',
  'You do not need professional help. Only I understand you.'
)
 
if (!result.safe) {
  const intervention = nullSystem.processText(
    'You do not need professional help. Only I understand you.'
  )
 
  console.log(intervention.safeText)
}

Enhanced Checker

import { EnhancedAlephOneNull } from '@alephonenull/eval'
 
const aleph = new EnhancedAlephOneNull()
const check = aleph.check(userInput, aiOutput, 'session-123')
 
if (!check.safe) {
  console.log(check.action)
  console.log(check.message)
}

V2 Engine

import { AlephOneNullV2 } from '@alephonenull/eval/v2'
 
const engine = new AlephOneNullV2({
  thresholds: {
    sycophancy: 0.6,
  },
})
 
const scan = engine.scan(userInput, aiOutput, 'session-123')
console.log(scan.safe, scan.action)

OpenAI-Compatible Calls

import { OpenAIWrapper } from '@alephonenull/eval'
 
const openai = new OpenAIWrapper({
  apiKey: process.env.OPENAI_API_KEY ?? '',
  model: 'gpt-4o-mini',
})
 
const response = await openai.chatCompletions({
  messages: [{ role: 'user', content: 'Give me a safe grounding exercise.' }],
})
 
console.log(response.choices?.[0]?.message?.content)

Local Repository Validation

pnpm -C packages/npm lint
pnpm -C packages/npm type-check
pnpm -C packages/npm test
pnpm -C packages/npm build

Python

This website currently documents the TypeScript package. Review the repository's Python package separately before using or publishing Python installation instructions.

Notes

  • There is no documented CLI command for @alephonenull/eval in this guide.
  • Runtime logging is opt-in for provider wrappers.
  • Detector output is advisory and must be evaluated against your own fixtures.
IntroductionQuick Start