SIDERIUSSIDERIUS

How it works

Four pictures of SIDERIUS

Each diagram makes one point. Details live in the linked documentation.

One lap is one research iteration

The SIDERIUS research loopFive stages in a cycle: Propose a model, Implement its code, Validate the implementation, Train and tune it, Interpret the results, then Propose again. In the centre, a deterministic core owns data selection, execution, scoring, Health validity and provenance.Deterministic coreData selectionExecutionScoringHealth validityProvenanceProposeImplementValidateTrain & tuneInterpret
Research loop, planned and judged by LLM agentsDeterministic code: no LLM decides data, scoring or validity
Source: SIDERIUS docs (opens in a new tab)

Any caller, the same typed capabilities

Any caller, same capabilitiesThree kinds of caller, a human expert, a fixed workflow and LLM orchestration, call the same typed capability contracts. The caller owns composition and history; seven capabilities, Interpret, Analyze, Literature, Propose, Implement, Validate and Train and tune, own their reasoning and tools.CALLERSHuman expertFixed workflowLLM orchestrationTyped capability contractsCAPABILITIESInterpretAnalyzeLiteratureProposeImplementValidateTrain & tuneCallers own composition and history; capabilities own their reasoning and tools.

A human, a fixed workflow or an LLM orchestrator chooses the calls; each capability keeps its own reasoning and tools.

Source: SIDERIUS paper (opens in a new tab) Orchestration setup (opens in a new tab)

No single number plays every role

No single number plays every roleThe task package declares separate quantities: a training objective that drives optimization, validation monitoring that tracks learning, scientific selection that orders eligible results by a declared direction, and secondary evidence that informs reasoning but never sets the ranking. Validity is a separate question: scoreability asks whether the declared metric can be computed, and deterministic Health checks record task-applicable model and output checks.TASK DECLARESWHAT EACH NUMBER DOESIS IT VALID?Task packageone manifestTraining objectivedrives optimizationValidation monitoringtracks learningScientific selectionranks eligible resultsSecondary evidenceinforms, never ranksScoreabilitymetric computable?Health checksrecorded per modelvalidity is a separatequestion from quality

Only scientific selection ranks results, and validity is checked separately from quality.

Source: SIDERIUS paper (opens in a new tab) Objectives and metrics (opens in a new tab)

One typed contract for every seat

One typed contract for every seatBecause every stage has a typed contract, a human can advise any agent through the same advice field automated callers use, take any agent's seat, for example writing the proposal and handing it to the implementer, or use a single capability alone, for example handing in their own model to be trained, tuned and scored.Advise any agentProposeValidateImplementTrain & tuneYouTake any seatInterpretYouin the proposer's seatImplementUse one aloneYour modelTrain & tuneTuned + scored

Humans and agents are interchangeable: advise any stage, take its seat, or use one capability alone.

Source: SIDERIUS docs (opens in a new tab)