Operational intelligence · AI learning and evaluation14 min read

AI Needs the
Right Experience.

Before your team relies on AI to review Bitcoin movements, it needs to know which assessments the system can support with evidence. We are building learning examples and repeatable tests from dated balances, earlier payments, and later outcomes. Together, we can define the task and check the answers against your team’s records and policies.

01 · Start with the job

Teach it what your team needs to check.

An exchange funds a wallet used to pay customers’ withdrawals. An AI helping review that payment needs the history around it.

Earlier payments show whether the size, timing, and recipient fit the wallet’s routine. Balances show how much the transfer changes what remains.

Wallet roles add another part of the explanation. Exchanges can use different addresses for deposits, withdrawals, reserves, and activity in different jurisdictions.

Moving funds between those wallets may support customer withdrawals or a security procedure. Your team’s records and policy establish the purpose and required review.

The chain records what moved. Your team supplies the policy and the judgment about what should have happened.

TrackBTC builds balances and connected histories from Bitcoin’s records. We group addresses linked by spending evidence to examine their activity together.

We call these wallet groups. Organization names and wallet roles require separate supporting evidence.

Illustrative learning example · payment reviewA useful example tells the model what to answer and the reviewer how to check it.
  1. The question

    Does this payment fit the wallet’s earlier activity, and what needs review?

  2. The records it may see

    Earlier payments, balances, wallet roles, and the relevant policy available at the review moment.

  3. The answer to check

    An assessment tied to specific records, with the expected review defined by your team.

Later activity can check a forecast or show what followed. An expert judgment defines what a good assessment should have said.

That is what we mean by an experience: a specific situation, a defined task, and the evidence needed to teach or assess it.

Explaining recorded behavior, deciding what needs review, and forecasting later activity require different answers to check.

02 · Real records, proposed exercises

Different histories should lead to different assessments.

Consider two anonymous examples from published monthly reports. One reserve became active. Another wallet retained its Bitcoin.

An AI exercise can ask the model to describe each change and cite the supporting records. The answers can then be checked against measured history.

A reserve starts moving.

An exchange-associated reserve sent no BTC in October 2025. During November, it sent roughly 32,909 BTC.

One exchange-linked reserve · November 2025The balance fell from 35,277 BTC to 2,368 BTC.
Proposed task · review November’s activity

What changed in this reserve?

Give the model the opening balance, closing balance, and transfers during the month.

BTC held at month-end · bars start at zero
31 October 202535,277 BTC
30 November 20252,368 BTC
What a correct answer should showThe reserve sent funds in November and retained a much smaller balance.

Explaining the purpose requires checking receiving wallets and the operator’s records.

The exercise tests whether a model connects payments with the change in reserves. The receiving wallet’s role helps distinguish withdrawal funding, storage changes, and other activity.

A shift toward exchange activity can indicate potential distribution. A transfer alone does not establish a sale.

A treasury keeps what it received.

A treasury-linked wallet received about 26,916 BTC in January 2026. By the end of September, it had sent no Bitcoin across its recorded history.

One treasury-linked wallet · January–September 2026The funds received in January remained in the wallet through September.
Proposed task · review the history through 30 September 2026

Did the funds received in January remain in this wallet?

The model may use all three published observations and the wallet’s recorded outgoing activity through September.

BTC held · three published observations · bars start at zero
Month received

31 January 2026

26,916 BTC
Later balance

30 April 2026

26,916 BTC
Later balance

30 September 2026

26,916 BTC
What a correct answer should show0 BTC sent through September.

The funds remained held. The record does not explain the owner’s reason for keeping them.

The balances and outgoing total are measured history. The question illustrates a retrospective exercise, rather than a measured AI result.

A treasury team could use this task to test whether a model distinguishes funds remaining in storage from funds moving through a wallet.

Both examples ask the model to explain a completed period. Their questions, permitted records, and expected findings are visible.

A forecast made in January would be a different task. September’s records would belong in the later check, outside the model’s January information.

These are separate wallet histories from published reports, verified on 2026-10-19. Small amounts received later round away in the treasury chart. Read the source evidence.

03 · What the AI could know

Do not give a January assessment September’s knowledge.

An organization identified in September may own an address that was active in January. The old transaction does not make that later identification January knowledge.

Two dates matter: when an event happened and when the relevant information became available.

Point-in-time state describes the recorded situation at a chosen moment. A learning example must also establish which facts the model could have known then.

The input cutoff is the latest information allowed into the model’s assessment. For a January review, later discoveries stay outside that input.

Illustrative information boundary · a January assessmentThe model receives the earlier record. Later evidence checks what followed.
Review moment31 January 2026
Available by the review moment

What the AI may use

  • Payments already recorded
  • Balances at the starting date
  • Wallet roles and policies known then
Discovered or recorded afterward

What stays for later review

  • Balances observed months later
  • An organization identified afterward
  • Subsequent transfers and events

Future information belongs in the outcome or later review. It must not make an earlier assessment appear better informed than it could have been.

Using later knowledge in an earlier assessment is called data leakage. It can make a test look more successful than a real decision with limited information.

scikit-learn’s guidance explains how unavailable information can inflate evaluation results.

Our completed-month Operations reports keep month-end address membership fixed across earlier comparison periods. That measures how the same selected addresses behaved over time.

It does not reconstruct which addresses or organization names a reviewer knew earlier. A past-decision task needs a separate check of that knowledge.

Match the example to the information available in practice

The example also needs the relevant policy, permitted actions, and evidence available at its cutoff.

If an operator records what a model actually received, those records help check a later reconstruction.

Google’s Rules of Machine Learning recommends recording the inputs used when a model runs, so training can reflect the same information.

04 · Choose what to practise

Find the situations your team wants the AI to handle.

A large archive includes ordinary activity, significant changes, and difficult cases. The useful selection depends on the question your team wants to answer.

For payment review, include familiar recipients and expected transfers alongside changes in size, timing, and destination.

For reserve monitoring, include funds staying in place alongside funds leaving storage. A model needs examples of both to explain the difference.

Illustrative selection design · AI layer in developmentChoose the question, then find relevant situations in the history.
A payment follows the routineRecover earlier amounts, timing, and recipients.
A reserve becomes activeRecover the earlier balance and inactivity.
A recipient changesCompare the new destination with earlier payments.
A model struggles with a caseReview the mistake and find related situations to practise.
For each selected caseA question, permitted records, and a way to check the answer.

Similar starting situations with different outcomes are also useful. They help reviewers ask which differences the model needs to recognize.

A sender’s share of incoming Bitcoin, for example, may grow across periods. The source payments identify the change; operator records establish what those payments represent.

The AI layer is being designed to find and assemble these situations from the history. Its purpose is to focus review and learning on relevant cases.

Keep ordinary cases in the evaluation. A model that calls every payment unusual can create work without helping a team identify meaningful changes.

05 · What the examples become

Use recorded cases to teach and test an assessment.

The same recorded history can support several kinds of learning. Each format adds something different to the underlying transactions.

These are the outputs we are designing the AI layer to assemble. They require reviewed answers, recorded demonstrations, or a defined test environment.

Planned learning and evaluation formatsChoose the format that fits the job.
Selected history + a defined task

Learn from an expert

Supervised learning

A reviewer demonstrates how to assess a payment’s size, timing, and recipient against the records and policy.

Follow a worked sequence

Agent trajectories

Record the steps: retrieve earlier payments, check balances, consult policy, and prepare an assessment.

Compare possible answers

Preference and RL data

Experts rank candidate assessments. Reinforcement learning, or RL, uses defined rewards to guide which actions the system chooses.

Run the same test again

Evaluation suites

Use fixed routine and unusual cases to compare model versions on evidence use and policy adherence.

Practise difficult cases

Failure curricula

Turn observed mistakes into reviewed lessons. Practise distinguishing transfers within one business from payments to another service.

Repeat the starting conditions

Reproducible environments

Start each trial with the same balances, available tools, permissions, and policy. Define what each permitted action changes.

For teaching, an expert label means a reviewed answer or category attached to an example. The reviewer’s criteria must be explicit.

A worked sequence, or agent trajectory, records what a system saw, which tools it used, its actions, and the results.

Bitcoin transfers do not contain those tool-use steps. They need recorded demonstrations or a test environment that produces them.

Preference data adds judgments about which answer is better. Rewards define what the learning system should favor under the agreed task.

Keep measured outcomes separate from expert judgments about appropriate action.

Levine and colleagues’ offline reinforcement learning tutorial examines learning from previously collected behavior and the challenges it creates.

Replaying recorded events follows the history. Testing an action that was never taken requires a defined environment and validated assumptions about its effects.

The reversible runtime in our state-engine article remains an architecture direction. It would extend how applications revisit earlier states and explore alternatives.

06 · Build confidence through testing

Show your team which answers it can rely on.

Can the model find the relevant payments? Does its assessment follow your policy? How much additional review does it create?

Agree those questions with your team, then compare model versions against the same historical cases.

A treasury team can check whether an assessment explains changing reserves. A security team can check whether it identifies the records needed for review.

An exchange team can check whether it distinguishes movements within its own wallet infrastructure from payments involving other services.

Illustrative payment-review exerciseA model flags a familiar payment. Find the earlier records it missed.
  1. Run the case

    Ask whether the recipient is new to the wallet’s recorded payments.

  2. Check the answer

    A reviewer finds earlier payments to the same recipient.

  3. Practise the distinction

    Use reviewed training examples of familiar and new recipients.

  4. Test the revision

    Repeat this check and assess separate, untouched test cases.

This is the intended process. Improvement must be demonstrated against the agreed criteria.

A known failure can become a regression case: a repeatable check that a later model still handles that situation correctly.

Those checks show whether a specific problem returns. Separate, untouched test cases assess how well the model handles situations excluded from its development.

Keep related versions of the same historical episode together when separating training from testing. Otherwise, a familiar event can appear to be an unfamiliar challenge.

Training and evaluation need deliberate separation. scikit-learn’s guidance explains how test information can otherwise influence model development.

The result should be a record your team can explain: which cases it checked, what the answers established, and where further review remains necessary.

The same approach can serve other recorded workflows.

A payment task connects earlier balances and rules with authorization and settlement. A workflow task connects tools and permissions with an action and its result.

Industrial operations connect commands with the equipment’s changing condition. Each domain needs its own recorded state, task, and outcome definitions.

These are architectural applications of the approach. Bitcoin is our production data foundation.

07 · The work behind the examples

The history is built. The AI layer adds the learning task.

The State Transition Engine constructs dated balances and connected activity. TrackBTC uses that foundation to produce Operational Reports.

We are building the AI-specific layer separately. It adds situation selection, permitted information, reviewed answers, and evaluation criteria.

Responsibilities and development statusKeep the recorded facts, the learning task, and the test distinguishable.
Production foundation

Build the historical record

The state engine constructs balances and connected activity. Reports measure changes and present the supporting evidence.

AI layer under development

Define what the model should learn

Select situations, check information availability, and add tasks, reviewed answers, and later outcomes.

Intended learning and evaluation outputs

Teach and test specific assessments

Produce examples and repeatable exercises with clear inputs and ways to assess the answer.

Building one usable case requires more than collecting transactions. The records must fit the question, observation period, and wallet group being examined.

For a past-decision exercise, the builder must also check when the relevant information became available. Expert answers need review criteria and a record of their source.

The database supplies assembled history for that work. Researchers can begin with dated balances and connected payments, rather than resolving them again for every experiment.

In the 10 September 2026 rebuild, a timed construction phase reached a peak near 16 million internal state-building operations per second.

The count covers records processed during construction. It does not measure agent throughput or model training speed. Read the historical benchmark’s units and scope.

What makes an example reproducible?

Keep the task, source version, observation date, selected addresses, permitted information, and later checking period explicit.

Save the expert review criteria and who supplied the answer. For simulations, retain the environment rules and assumptions about action effects.

These details let another reviewer inspect the same example and repeat the comparison across model versions.

08 · Work with us

Bring a question your team wants the AI to answer.

Choose withdrawal funding, treasury movements, or internal wallet routing. We agree the relevant records, review criteria, and useful results together.

TrackBTC provides reports and public findings. CWOS is our first-party decision platform, with direct access to the complete internal intelligence foundation.

Its AI workflows are in development. An evaluation needs an agreed scope, including any integration or development required.

Ways to work togetherInspect the evidence. Agree a workflow. Review the results with your team.

Start with the history

Explore public findings and supporting records. Contact us about private report access or the AI learning material your workflow needs.

Explore public alerts

Evaluate one workflow

Discuss a six-week pilot combining historical replay with live shadow evaluation. Agree what your team will check and what success means.

Explore a shadow pilot

Transactions, private wallet context, and policies remain in your environment. The pilot leaves transaction authorization with your team.

The final results report documents what your team checked, what the evidence established, and which questions remain open.

That gives the people leading the evaluation a concrete account of their contribution and a basis for deciding what should happen next.