How a Curve Becomes a Model
A congested road can be compressed into a flow-density diagram. The horizontal axis records the number of vehicles per unit length of road, while the vertical axis records the number passing a cross section per unit time. In their macroscopic theory of traffic flow, Lighthill and Whitham summarized the connection with a constitutive relation:
This equation shifts the object of study from the car-following actions of individual vehicles to the continuous traffic flow formed by many vehicles. The previous essay used it to show how a static relation can enter an engineering model chain. Here the question is its mathematical identity.1
Read in isolation, is only a string of characters. A reader still needs the value domains and units of and , along with the class of functions to which belongs. If is measured in vehicles per kilometer and in vehicles per hour, then must at least map a density domain to a flow domain. Once this information is supplied and is interpreted as a particular function, the expression determines the relation
collects the density-flow pairs allowed by the constitutive relation. It contains neither spatial propagation nor future states. Given , computing is one common use, but the relation itself imposes no direction. An engineer may instead infer possible densities from a given flow, test whether an observed pair lies on the relation, or study the extrema of the curve. The available operations depend on the mathematical object assigned to the expression.
Congestion moves along a road. For a short road segment, the change in the number of vehicles equals inflow minus outflow. Letting the segment length tend to zero while retaining gives the conservation law
remains the flow-density function, now in the role of a flux function. The equation constrains a space-time field . The earlier model permits density-flow pairs in a plane; this one permits families of solutions in which density varies over position and time.1
A single partial differential equation still does not select one definite evolution. The road domain, initial density, and boundary inflows must be supplied. If several candidate solutions exist, the model must also state a solution concept and a selection rule. Only after the problem is well posed and the roles of the inputs are clear can an engineer treat it as a single-valued operator from initial and boundary conditions to a solution field.
The constitutive relation and conservation model share the same , but make different mathematical commitments. Their admissible objects have changed from point pairs to space-time evolutions. The same characters also acquire different meanings when placed under different types, units, or interpretation rules.
Probability and optimization appear when we push the inquiry further along the same road. A researcher interested in stochastic demand or unmodeled disturbances asks for the probability that the next state lies in an event . A task that selects ramp flows or speed advisories must also specify feasible controls and an ordering of objectives.
Figure 1. Four modeling objects for the same road preserve, respectively, a static relation, space-time evolution, state-transition probabilities, and a control choice. Click the image to enlarge it.
A formal presentation identifies a mathematical object only within a system of types and interpretation rules. Purpose may also lead a modeler to choose another set of variables and queries. The first essay collected these distinctions inside the semantic model so it could follow the engineering relations around it. This essay asks which rules belong to the modeling language and which content belongs to one particular model.
Taking a Model Apart, Layer by Layer
Let denote a typed signature. It declares sorts of objects, constants or parameters, function and relation symbols, and the types of variables in a presentation. An engineering extension may also record units, time bases, and port roles. A simplified signature for the static traffic relation contains a density domain , a flow domain , and the function symbol
The expression becomes a well-formed presentation under this signature. A conservation model must add types for space, time, and fields, such as . The signature first decides whether a statement can be written at all. It also prevents quantities with incompatible units, time scales, or interface roles from being connected without an explicit conversion.
The signature has not yet assigned concrete mathematical objects to its symbols. Given , a formal structure supplies mathematical interpretations for each carrier, function symbol, and relation symbol. A valuation assigns values to free variables. For a formula , model theory writes
Once selects a particular function in the structure, the valuations satisfying form the relation
Formal interpretation gives the symbols mathematical meaning; satisfaction determines whether a formula holds in a structure under a valuation. If is a set of sentences, its class of admissible structures is
A specification may therefore admit several non-isomorphic structures.2 Satisfaction here remains entirely within mathematics. It does not say that a real stretch of road satisfies the theory.3
Traffic relations, probabilistic programs, optimization problems, and automata do not share one semantic codomain. I use to mark a semantic kind. Relations or solution sets, probability kernels, optimization problems with feasibility and ordering, and systems of admissible executions occupy different semantic domains. Later reasoning must retain their different contents.
For fixed and , let be the set of well-formed presentations and the corresponding semantic domain. The interpretation map is
Relative to a selected modeling formalism, a particular formal specification is
is how the model is written: a set of equations, a graph, a collection of constraints, or a probabilistic program. Its interpretation is
I call the formal specification or formal presentation, and the record that binds it to its corresponding the interpreted model. If is a set of model-theoretic sentences, may be . For another semantic kind, it may instead be a probability kernel, an optimization ordering, or an execution system. The brackets are a generic notation; a model-theoretic satisfaction class is one instance.
This differs from the engineering requirement in the previous essay. The former records the model’s formal presentation; the latter records a requirement the system is expected to meet. Making the notation more explicit prevents a shared letter or everyday word from crossing an object boundary unnoticed.
The signature, well-formed presentations, semantic domains, and interpretation map belong to the shared modeling formalism, rather than to fields repeated inside every model. Institution theory separates signatures, sentences, models, and satisfaction in a more general setting, and requires satisfaction to remain compatible with translation when signatures change. I borrow this layering discipline without claiming that every engineering model belongs to one complete institution.2
Many engineering models come in families. A traffic-flow function may carry capacity or free-flow-speed parameters. Neural-network weights index particular functions, and stochastic-model parameters index a family of measures. Let be the index space:
while a fixed instance is
Fixing selects one model instance. A parameter change usually stays within the same family as long as the signature and semantic kind remain fixed. If an index changes the state space, variable types, or set of ports, a fixed signature is no longer accurate. We then need or a higher-level organization of several signatures. Internal edges can sometimes stay inside , while changes to node types or interface sets often reach the signature.
Model comparison also requires an observation specification and an observation map . I abbreviate the retained behavior as
The meta-level determines what counts as a well-formed expression. A family of presentations acquires semantics through interpretation. The observation specification belongs to the comparison layer and selects what the comparison will preserve.
Figure 2. A model contains a typed formal presentation and a semantic instance. An observation map at the comparison layer extracts the required behavior. The modeling rules belong to the meta-level, while the model’s reference to reality belongs to an external representation relation.
The ocher region at the bottom of the figure only marks a boundary. Formal interpretation explains how symbols acquire mathematical meanings. A model’s ability to refer to a real road depends on another relation. The nearer question concerns identity: can two models still express the same thing after their coordinates, state names, and equations have changed?
State Variables Do Not Define Model Identity
A tank with constant cross-sectional area can be described by two equally natural sets of equations. Let be the area and let and be the inflow and outflow. The first formulation uses liquid level as its state:
The second records the volume of water :
The variables and differential equations differ on the page. One state has units of length, the other volume, and their variable names and numerical values will not match line by line in code. If their initial conditions satisfy and both receive the same flow signals, however, they generate the same liquid-level curve. The map
sends every solution trajectory of the first formulation to one of the second, while the inverse map sends it back. Both satisfy the same relation over their shared external variables:
This correspondence covers the admissible initial conditions and input trajectories and preserves both time evolution and the output relation. It is much stronger than the coincidence of two simulation runs. Liquid level and volume provide two coordinate systems for one dynamic relation. A state variable matters for modeling and computation, but it is not a unique identity card carried by the model.
Many engineering systems lack such an obvious invertible change of state. Users may require only that two objects generate the same trajectories at specified ports, without a componentwise correspondence between internal states. They must first state the observation specification : which quantities are inputs and outputs, their units and time scales, the allowed initial conditions and inputs, and the queries to be asked. In the tank example, treats as inputs and liquid level as the output.
If the models use different signatures or coordinate systems, define separate maps into a common observation space:
Behavioral equivalence relative to is
The observation images of both tank models are the same set of admissible trajectories, so the equality holds. The behavioral approach studies dynamic systems through such exposed trajectories. States can remain internal, while behavior over exposed variables defines the boundary for comparison and interconnection.4
Figure 3. The liquid-level and volume presentations produce the same boundary behavior under their observation maps. Five common identity criteria appear below; the text discusses several more.
In practice, “the same model” can name several nonequivalent judgments:
| Objects compared | What “same” preserves |
|---|---|
| Files or expressions | Identical bytes, parsed equations, graphs, or rules |
| Formal structures | Equality up to renaming or a declared invertible structural transformation |
| Theory class | Both structures satisfy the same axioms or loose specification |
| Exact semantics | The same relation, measure, ordering, or execution system in the declared semantic domain |
| External behavior | Equality of their images under the respective observation maps in a common observation space |
| Approximate models | Sufficient proximity over a declared domain, observed quantities, and error bound |
| Representation case | The model user, model used, real-world target, purpose, and denotation/empirical-interpretation relation remain fixed |
| Application task | Interchangeable conclusions for a specified decision and threshold |
| Computational artifact | The same discretization, code, dependencies, precision, and runtime configuration |
| Governance lineage | Several versions are recorded as one line of development |
These relations do not form a single hierarchy from weaker to stronger, and without additional conditions they cannot replace one another. Two structures may belong to the same theory class without being isomorphic. Equal external behavior can coexist with different hidden states. Task substitutability must be decided again for each task. Before a team says “the model did not change,” it needs to name both the objects under comparison and the preservation relation.
The observation specification must precede the comparison. If we shrink the input domain or delete discrepant outputs after inspecting the result, any two systems can be made “equivalent.” Agreement between two programs on a finite test set establishes a fact about those samples. Behavioral equivalence requires equal observation images across the entire declared domain.
Approximate models also require a distance and a tolerance. For example,
This relation has substantial engineering value, although it is usually not a mathematical equivalence relation. The first and second models may differ by at most , and the second and third may also differ by at most , while the triangle inequality often gives only a bound between the first and third. A claim of substitutability must carry its validity domain, error quantity, and task threshold with it.
The position of the tank area can be identified by the same reasoning. Changing an fixed in the equation changes the admissible liquid-level trajectories, so it belongs to the model instance. Ruler readings and experiment records used to estimate belong to the construction process. An inflow curve supplied for one run is an interface input that selects one trajectory from all those allowed. Nouns such as parameter, data, and input do not assign an item permanently to the inside or outside of a model. Its logical role does.
What Each Semantic Kind Must Preserve
An observation map preserves the result relevant to a present question and deliberately drops other structure. This suggests a tempting unification: reduce every model to an input-output function or a set of possible behaviors. Probability models reveal the first gap. A set of possible outcomes records whether each event can occur, whereas a probability model also assigns weight to every outcome. The optimal-solution set of an optimization problem retains the winners but discards how the objective ranks the alternatives. The observational distribution of a structural causal model records how variables vary together, but not which generating mechanism an intervention should replace.
These three compressions can be written as forgetful maps. Take a finite discrete , and restrict to well-defined models that induce a unique observational distribution:
where is the joint value space of all endogenous variables. These maps are generally not injective. Distinct objects in the native semantic domain can have the same image after information is forgotten.
Consider a Bernoulli model first. For independent and identically distributed binary observations, the outcome space is . With and , both support sets equal all of : every finite binary sequence has positive probability. Yet the probabilities of consecutive successes are and . Identical support can yield risk assessments separated by many orders of magnitude. A trajectory support tells us which paths are possible; a stochastic-process law also assigns probability mass across those paths.5
Optimization reaches the same problem by another route. Suppose the feasible alternatives are only . Two objectives both make the unique optimum while reversing the order of the other alternatives:
Therefore,
If a road closure, actuator saturation, or new constraint removes from the feasible set, the first objective selects and the second selects . The argmin alone does not define an optimization model capable of answering such queries. At minimum, we need to retain the feasible set and the ordering required by the present query. Questions about objective gaps or near-optimality also require numerical structure.6
Here is the objective function inside the optimization model. It also takes the role of an operational criterion in the previous essay’s engineering model chain only when an engineer uses it as a proxy for an engineering requirement.
The information lost from a causal model is harder to discover through ordinary prediction error. Consider two linear Gaussian structural models:
In the first model, are independent and both follow . In the second, and , again independently. Both models give a zero-mean joint Gaussian distribution with covariance matrix
More observational samples only estimate this joint distribution more precisely. They do not record which structural equation an intervention should replace. In , applying gives
In , is generated by its own exogenous variable. Replacing the equation for leaves unchanged, so
The two models have the same observational distribution and give different intervention results. The direction of the structural assignments specifies a mechanism; algebraic rearrangement cannot reverse that semantics.7
All three examples show that a projected result cannot recover the native semantics. Systems that evolve over time must also preserve execution structure. Continuous flows, guards, invariants, and resets jointly generate the admissible executions of a hybrid system. A single simulation path is only one selection from them.8
Figure 4. Six semantic objects display the structure that each must retain: probability weights, optimization orderings, causal queries, executions through time, and agent-environment closed-loop behavior.
The common structure lies at the level of typed presentation and semantics. Once we have identified a model’s native semantic kind, we can ask whether a grid, loss function, or solver approximates that model or rewrites it.
When Does the Solver Enter the Model?
Neural ODEs push the implementation boundary into the training process. The continuous hidden-state dynamics are written as
A training program usually cannot evaluate the exact flow map of this equation, so it uses a numerical integrator. Let be the step size and let collect the algorithm and tolerance configuration. One discrete update can be written as
The loss compares the finite-precision trajectory generated by the solver with observations.
After fixing , reducing the step size or tightening the tolerance may make several admissible algorithms converge to the same continuous solution. In that case, the solver’s bias can be classified as realization error. Training introduces feedback, however. The network can alter its vector field so that parameter error compensates for the integrator’s truncation error, making a particular solver produce a trajectory closer to the data at training times. Zhu and colleagues analyze this phenomenon with an inverse modified differential equation. Under the numerical methods and regularity conditions stated in their paper, learned dynamics may approach the inverse modified differential equation associated with the solver. A good fit between discrete trajectories does not require the learned vector field to equal the target continuous dynamics.9
Changing the training solver may produce a new parameter record , altering both the parameter instance and its construction lineage. The functional identity of the network then depends on a comparison between and . Once training is over, a fixed vector field can exist independently of the training solver. If the deployed object is defined by the discrete trajectories jointly generated by the network and integrator, then belongs to the formal presentation of that larger model.
The first essay compressed this responsibility into a realization relation from semantic model to computational artifact:
Suppose a realization choice produces computational artifact , whose execution semantics is . Model behavior and program output do not normally occupy the same space. Continuous trajectories, floating-point arrays, and timestamped results must first pass through their own observation maps. If is a metric or pseudometric on the shared observation space, a sequence of increasingly refined realizations may be required to satisfy
The observation specification states the input domain, exposed variables, and time base. The choice of must fit the semantic kind: functions may use a norm, while probability models require a distance between distributions. If refinement rather than distance is appropriate, write the relation separately as . Together, these conditions specify the objects being compared when we claim that “the code realizes the model.”
A deletion test offers a practical check. First fix the semantic kind , signature , solution concept, and observation specification. Then replace the solver, grid, or realization configuration. If every admissible refinement path converges to , the variation stays within computational realization . A program that times out, fails to converge, or contains an implementation error is an invalid realization.
If the formal specification omits a necessary solution or event-selection rule, different realizations may fill the gap differently and produce different trajectories. The missing rule must first be written back into before we can ask which realization preserves the semantics. If a project defines the fixed-step update itself as the deployed object, that discrete map is part of the model presentation; the continuous vector field supplies its construction source.
Neural operators move the same check to function representations. Write the target operator as
where both inputs and outputs are functions. A learned operator with fixed weights is . A program can read only a finite grid, point cloud, or vector of basis coefficients, and therefore needs
projects an input function to a discrete representation, computes over that representation, and reconstructs an output function. Let be a distance on or its observation image. Under pointwise convergence, one testable condition for classifying the grid mainly as part of the realization layer is
A stronger claim may demand uniform convergence over the input domain, or convergence relative to an input distribution; the intended mode must be stated. When the parameters stay fixed and the discretization error is controlled, changing the grid changes the computational artifact. Kovachki and colleagues define discretization invariance in function spaces. Architecture and approximation results must establish the property; the label “neural operator” does not confer it by itself.10
Two distinct error relations appear here. Whether preserves is a model-to-artifact realization question. Whether approximates the target operator depends on the training distribution, finite data, and generalization evidence. Grid convergence can support the former and does not establish the latter. In a fixed-grid network, the shapes of weight arrays, positional encodings, or adjacency structures may bind the model to particular discrete points. A grid change can then alter or the entire model family.
PINNs bring target semantics, training criterion, and realization closer together. Consider the target problem
Once the function space, domain, and solution concept have been supplied, these conditions determine a solution set. A training program selects a network and evaluates
Here , the are interior collocation points, and the are boundary collocation points.
A low says that the network has a small empirical residual at the selected finite points under the chosen weighting. The residual over the continuous domain, behavior between collocation points, and distance to a target solution remain separate claims. Experiments by Krishnapriyan and colleagues show how ill-conditioned optimization of the composite loss can leave training at a high-error point. The solution semantics of the target equation does not change with that training failure.11
The boundary condition can occupy different places depending on its presentation. For a Dirichlet condition of this kind, extend the boundary function to a function over the domain and set , where . The boundary structure then enters the model presentation. If the program enforces it only through a penalty at finitely many boundary points, it belongs first to the training criterion. After training, the forward evaluation of fixed no longer reads those collocation points. They are construction data, while new coordinates supplied by a user are runtime inputs.
The claim that “a PINN solved the PDE” compresses at least two claims. The optimization process produced a function , and that function approximates a PDE solution over a chosen validity domain and norm. Training loss participates in the first claim. An error estimate or convergence argument connects the first to the second.
Neural ODEs, neural operators, and PINNs bring us back to the same test: state the semantics promised by the model, then examine whether the algorithm, grid, and training process preserve it under the specified observations. Training feedback, omitted solution-selection rules, or discretization binding can change the resulting semantic instance. Even if the semantics exposed by the chosen observation map remains unchanged, the computational artifact and construction lineage have changed.
An agent selects actions during execution, receives observations or results from an environment, and updates its context. Its admissible behavior is therefore determined jointly by fixed weights, scheduling, tool protocols, and stopping rules.
Where Does an Agent End?
Conway’s Game of Life supplies a closed-loop example that does not depend on language models. In a finite grid window , each cell stores a binary state , and is its neighborhood:
is the number of live neighbors. The local rule can be written as
This expression only specifies how one cell updates. The complete model also says that every cell reads its neighbors at the same time and commits its state for only after all updates have been computed. The local rule thereby induces the synchronous global transition
If a program updates cells according to an ordering of , , later cells read states already overwritten during the current sweep. In general, this gives
The same local rule can generate different space-time patterns under different schedules, so the schedule enters the global transition semantics. The ODD protocol likewise gives “process overview and scheduling” its own category because the timing and order of agent rules can change the model as a whole.12
Where scheduling belongs depends on the observation specification . A fixed-point query may permit it to remain external, while queries about periods, propagation, or complete trajectories make order part of the semantics.
ReAct carries the same issue into an open environment. It uses a history-conditioned policy to select the next action from an expanded action space. Language actions update the context and environment actions trigger new observations. In the paper, search[...] and lookup[...] are tool actions, while finish[...] is a terminating task action.13
To analyze a more general agent, I extend this operational pattern with context updates, an environment kernel, and stopping semantics. Write the raw history before an environment-interaction decision as
Protocol parameters transform that raw history into the context seen by the model, after which the policy provides an action:
Write the formal environment as , where is a distribution over initial observations or states and the transition kernel returns
The formulas record decision points at the environment interface. Thought tokens enter the context through , while processes environment actions. A complete agent also specifies memory updates, action grammar, error handling, and stopping conditions; packages these protocol responsibilities.
Connecting the same base-model weights to a different prompt, memory update, or tool protocol produces a different . A particular client belongs to the computation and integration layer. User input and tool results from one run are runtime inputs. Caches, timeouts, or exception branches enter the agent specification if they change action or termination semantics.
The status of decoding rules also depends on the object under study. If denotes the complete action probability kernel, temperature and top-k or top-p truncation change its probability mass and enter the kernel’s definition. The random-number generator and an algorithm that samples from the specified kernel usually belong to the realization. If the object is defined as a deterministic decoding function, the decoding rule itself enters the presentation. Training data enters the weights and their construction lineage through training; the closed-loop execution reads the policy that training has produced.
When we study the agent itself, environment remains external. When we study the agent-environment loop, the two jointly define the composite object
Its semantics is a history-dependent set or distribution of trajectories. Changing changes closed-loop behavior without turning the environment into an organ inside the agent. The named object has expanded, and its boundary has moved. If scheduling of concurrent tool calls, environment latency, or races between stopping events alter the admissible trajectories, they need a place in the closed-loop specification.
Here is a formal environment model. It may be a finite-state machine, a probability kernel, an abstraction of a simulator interface, or a stipulated rule for tool returns. It is distinct from the referent system in the first essay. Real APIs, online users, and physical roads belong to the runtime system or referent system. An engineer must abstract their transitions before obtaining a formal object that can be written into . A live service also changes over time; treating it as a fixed transition kernel erases version and time conditions.
The closed-loop specification determines the admissible trajectories for given and . Using those trajectories to make claims about a warehouse, road, or population requires the referent system , purpose , and an empirical bridging relation.
How Mathematical Structure Points to the World
In , the signature can require to take nonnegative real values, a structure can interpret , and satisfaction can determine whether a pair of numbers belongs to . These operations give mathematical values to formal variables. An empirical bridging relation identifies the particular motorway, period, and detectors to which they refer.
The measured on a road still requires measurement and aggregation choices. Researchers must state whether they count per lane or over the whole road segment, how long the spatial window is, how timestamps align, and how missed detections are treated. requires a counting interval and unit as well. The raw traffic process passes through sensing, filtering, and aggregation to produce records. Researchers then construct a data model that can be compared with the theoretical object. Experimental records, data models, and theoretical models are distinct objects. Formal satisfaction supplies no reason by itself to accept an empirical claim.3
The formal judgment
says that structure satisfies theory . Applicability to a road also involves a real-world target, operational definitions, a purpose, and error criteria. A numerical program may implement an equation accurately while the equation’s continuum scale remains unsuitable for the safety of one vehicle. Formal error, realization error, and empirical mismatch occur along different relations and should be located separately.
Hughes distinguishes three acts in model representation: denotation, demonstration, and interpretation. A modeler lets a model object denote aspects of a real target, performs mathematical work within the model, then interprets the result back into a claim about the target.14 Denotation in this account occupies a different layer from the formal semantic value . I use DDI as diagnostic grammar. Actual modeling repeatedly revises variables, measurements, and equations.
When a purpose includes empirical testing, write the predicted object obtained from reasoning inside the model as , and the data object produced by sensing, sampling, and processing as . A comparison becomes well defined only after the same empirical bridging relation, denoted below, maps both into a common observation space. Numerical predictions may use an error metric. Set-valued models require coverage or refinement relations. A causal comparison must ensure that both sides answer the same observational or intervention query. Any claim that results are “close” is indexed by observed quantity, scale, and purpose.
Giere adds a model user and a purpose to model and world: ” uses to represent for purposes .” I write the model user as and add a bridge package :
where is an additional record introduced here for denotation, operational definitions, and empirical interpretation. The model user may be a research team or operating organization. The purpose may be to explain congestion waves, estimate travel time, or support ramp control. A change of purpose need not alter the formal model, but it changes the observations to retain and the criteria for adequacy, thereby creating a new representation case.15
cannot be generated from variable names. Calling “density” says nothing about the road or time window. Calling “flow” supplies no counting protocol. Operational definitions connect the model’s continuous fields to comparable sensor records.
“Interpretation” therefore names two different operations here. A formal structure gives mathematical interpretations to the symbols in a signature, and a satisfaction relation or semantic map assigns mathematical content to presentation . The bridge lets a model user connect the model to a referent system for a purpose and interpret model-internal results back into empirical claims.
Figure 5. On the left, denotation and empirical interpretation connect the model to its referent; data and prediction meet in a common observation space. On the right, a formal structure interprets symbols, a semantic map gives the presentation mathematical content, and demonstration proceeds within the model.
Empirical representation must also withstand tests of data quality, error range, validity domain, and purpose-specific thresholds. If the model user, purpose, or operational definitions change, the relation has changed even when the model file and parameters remain fixed.
Lighthill and Whitham’s constitutive relation addresses large numbers of vehicles on sufficiently long congested roads.1 When researchers use it to study macroscopic congestion waves, can connect density, flow, and space-time scales to the observation system. Adding the conservation law then supports an internal demonstration about wave propagation. If the purpose changes to deciding whether one vehicle can brake safely under communication delay, the original signature lacks individual-vehicle state, actuators, and communication processes. The formal model can remain coherent while the empirical claim exceeds the current representation relation.
The reverse variation also occurs. Researchers can build a probabilistic transition kernel for the same road, while a traffic-control team can add a feasible set and objective function to a model of road evolution. These models share a referent system but use different packages to select different aspects of the road. In practice, the questions use different signatures and semantic kinds, so they produce different formal models. Even if the formal model remains fixed, a changed purpose produces a new representation case.
The previous essay followed the engineering chain through data, code, deployment, and qualification. This essay has unpacked that . The two views reconnect at the realization and representation relations: a computational artifact must preserve the declared formal semantics, while an application claim must state how the model refers to reality. Evidence can then attach to particular relations and versions.
What We Must Specify When We Say “the Same Model”
Whenever we call two things “the same model,” we should specify the objects being compared, the preservation relation, and the observation boundary and purpose under which the relation holds. Together, they form a testable claim of model identity.
Footnotes
-
M. J. Lighthill and G. B. Whitham, “On Kinematic Waves II: A Theory of Traffic Flow on Long Crowded Roads,” Proceedings of the Royal Society A 229, 1955, Abstract, Sections 1–2, eqs. (1)–(7); P. I. Richards, “Shock Waves on the Highway,” Operations Research 4(1), 1956, pp. 43–44, eqs. (4)–(6). The former supplies the flow-density hypothesis, its intended scale, and the qualitative empirical comparisons available at the time; the latter states the traffic-conservation PDE directly. ↩ ↩2 ↩3
-
Joseph Goguen and Rod Burstall, “Institutions: Abstract Model Theory for Specification and Programming,” Journal of the ACM 39(1), 1992, pp. 101–103, Definitions 1–2; pp. 112–113. ↩ ↩2
-
Alfred Tarski, “The Semantic Conception of Truth and the Foundations of Semantics,” 1944, p. 345, pp. 361–362; Patrick Suppes, “A Comparison of the Meaning and Uses of Models in Mathematics and the Empirical Sciences,” 1960, pp. 289–291, 297–300. ↩ ↩2
-
Jan C. Willems, “The Behavioral Approach to Open and Interconnected Systems,” IEEE Control Systems Magazine 27(6), 2007, pp. 51–53, 63–64, 70–72. ↩
-
Bob Carpenter et al., “Stan: A Probabilistic Programming Language,” Journal of Statistical Software 76(1), 2017, Section 2.1, pp. 2–3. ↩
-
Stephen Boyd and Lieven Vandenberghe, Convex Optimization, 2004, Section 4.1, eq. (4.1), pp. 127–129; for the distinction between a problem and a solution method, see Section 1.1.2, pp. 4–5. ↩
-
Judea Pearl, “Causal Inference in Statistics: An Overview,” Statistics Surveys 3, 2009, Section 2.2, pp. 98–101; Sections 3.1–3.2.1, pp. 103–108, eqs. (1)–(7); Definition 2, p. 109. ↩
-
Thomas A. Henzinger, “The Theory of Hybrid Automata,” 1996, Section 1.1, Definition 1.1 and Example 1.1; Section 1.2, Definitions 1.2–1.3; Section 1.3, Definitions 1.4–1.5. ↩
-
Aiqing Zhu et al., “On Numerical Integration in Neural Ordinary Differential Equations,” ICML 2022, Abstract, Section 2.1, and Sections 3.1–3.3, especially Theorems 3.1–3.2. ↩
-
Nikola Kovachki et al., “Neural Operator: Learning Maps Between Function Spaces with Applications to PDEs,” Journal of Machine Learning Research 24, 2023, Sections 2.1–2.3, especially Definition 4; for the error decomposition, see Section 3, pp. 11–12. ↩
-
Maziar Raissi, Paris Perdikaris and George Karniadakis, “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” Journal of Computational Physics 378, 2019, Sections 2.1–2.2; Aditi Krishnapriyan et al., “Characterizing Possible Failure Modes in Physics-Informed Neural Networks,” NeurIPS 2021, Sections 3–4.1. ↩
-
Volker Grimm et al., “A Standard Protocol for Describing Individual-Based and Agent-Based Models,” Ecological Modelling 198, 2006, Sections 2.1–2.7, especially Section 2.3, pp. 118–119; Uri Wilensky, “NetLogo Life model,” 1998, HOW IT WORKS. ↩
-
Shunyu Yao et al., “ReAct: Synergizing Reasoning and Acting in Language Models,” ICLR 2023, Section 2, p. 3; Sections 3.1–3.2, pp. 4–5. ↩
-
R. I. G. Hughes, “Models and Representation,” Philosophy of Science 64, 1997, pp. S329, S333, S335. ↩
-
Ronald Giere, “How Models Are Used to Represent Reality,” Philosophy of Science 71, 2004, p. 743, pp. 747–750. ↩