Examining Software Defects Through a Requirements-to-Actual-State Comparison

Technical illustration for Software Defects: Requirements-to-Actual-State Comparison

A technical defect examination compares a defined software state with a documented expected state under reproducible conditions, while keeping the technical deviation separate from its legal consequences.

By Mathias Ellmann English version: 22 October 2026

Software & Source Code

A technical defect examination compares a defined software state with a documented expected state under reproducible conditions, while keeping the technical deviation separate from its legal consequences. The English version preserves the technical distinctions and limitations of the reviewed German V1 source.

Short answer

The technical examination focuses on comparing a versioned expected state with a versioned actual state under reproducible conditions.

The conclusion remains limited by contradictory requirement sources, incomplete reconstruction, oracle limitations and the distinction between a technical deviation and a legal defect and is not a substitute for legal evaluation.

Examination chainFrom the technical question to a bounded, reviewable conclusion
1DefineQuestion, subject and relevant state.
2SecureEvidence, provenance and version context.
3ExamineReproducible checks and counter-tests.
4ReportFinding, interpretation and limitation.

1. Define the subject and comparison question

Scope and technical proposition

The examination begins by fixing the proposition and the concrete state to which it applies. In this article the central task is comparing a versioned expected state with a versioned actual state under reproducible conditions. The system boundary, relevant date and version identifiers are recorded before individual findings are interpreted, because a technically correct result about the wrong state cannot answer the intended question.

The scope also records explicit exclusions and dependencies. This prevents later expansion from a narrow reproduced observation to an entire product, project or historical period. The working question is written so that a knowledgeable reviewer can understand what evidence could support it and what evidence could weaken it.

2. Determine the technical expected state

Evidence and provenance

The examination basis is built from requirements, acceptance criteria, approved changes, repository revision, release, build artefact, configuration, test inputs and observed outputs. Each item is identified with the strongest practical version, provenance and time information available. Originals, exports and working copies remain distinguishable, and transformations or filters are recorded where they can influence the conclusion.

Evidence quality is assessed separately from evidence existence. A file can be intact yet incomplete, a repository can be authentic yet shallow, and a log can be correctly exported yet unsuitable for a proposition outside its retention period. Missing expected evidence is recorded as a limitation rather than silently treated as confirmation.

3. Determine the technical actual state

Reproducible examination

The technical method is to establish the expected state, establish the actual state, define a test oracle and document the comparison step by step. Commands, tools, parameters, thresholds and environment conditions are documented where they materially affect reproducibility. The objective is not merely to obtain a result but to preserve the reasoning path from identified input to technical finding.

Where the procedure contains judgement, the report states which parts are mechanical and which require professional interpretation. A repeated test or independent check is used where it can reveal sensitivity to configuration, tool choice, sample selection or an alternative technical mechanism.

4. Perform the comparison reproducibly

Counter-checking and uncertainty

Counter-checking asks what else could produce the same observation and what result would contradict the preferred explanation. This is especially important because contradictory requirement sources, incomplete reconstruction, oracle limitations and the distinction between a technical deviation and a legal defect. Negative evidence is only given weight when the search space and detection capability are understood.

If several explanations remain compatible with the available material, the conclusion is not forced into a single cause. Instead, the report ranks or describes the support for each explanation and records which additional evidence would be needed to distinguish them.

5. Handle incomplete or conflicting foundations

Reference and interpretation

Interpretation connects the finding to its technical significance, while assessment uses the requirement or technical criterion that was applicable to the examined version and time state. The reference, its version and its applicability are disclosed before the observed state is classified. This allows a reviewer to see whether disagreement concerns the measurement, the interpretation or the chosen criterion.

The assessment remains limited to the technical reference. A standard, specification, project requirement or repository convention may structure the technical comparison without automatically establishing contractual effect, legal responsibility, ownership or regulatory compliance.

6. Separate finding, interpretation and legal evaluation

Synthesis and statement boundary

The final synthesis returns to the original question and states which parts are directly supported by evidence, which depend on interpretation and which remain uncertain because of contradictory requirement sources, incomplete reconstruction, oracle limitations and the distinction between a technical deviation and a legal defect. The wording is calibrated to the evidence rather than to the desired certainty of the dispute.

The statement boundary is therefore an affirmative part of the result. It identifies unexamined states, missing records, unresolved counter-hypotheses and legal or normative questions that require a different assessment. This makes the technical conclusion reviewable and reduces the risk of overclaim.

Examination questions

Is the technical conclusion sufficiently supported?

  • Is the concrete subject and relevant state identified for software defects: requirements-to-actual-state comparison?
  • Are the main evidence sources and their provenance documented?
  • Are versions, dates, configuration and transformations recorded where they affect the result?
  • Is the examination method reproducible enough for independent review?
  • Were plausible counter-hypotheses or alternative explanations tested?
  • Is the technical reference or comparison criterion explicit?
  • Are missing evidence and method limitations stated as uncertainty?
  • Are technical findings kept separate from legal or contractual evaluation?

Constructed example

An acceptance criterion defines a field mapping. The acceptance build is reconstructed from a tag, build record and artefact hash, and the export is repeated with documented sample data, revealing a reproducible mismatch.

The example is entirely constructed and does not describe a real engagement, court appointment or client matter.

Sources and technical basis

  • Scientific specialist source Peer-reviewed or scientific specialist source retained from the reviewed German reference article for method limitations, clone detection or cognitive-bias context. Open source.
  • Technical primary source Official Git documentation for repository objects, revisions, references, working state or related Git semantics. Open source.
  • Normative specialist source International standard information retained from the reviewed German reference article and used only within its stated technical scope. Open source.
  • Normative specialist source International standard information retained from the reviewed German reference article and used only within its stated technical scope. Open source.
  • Author's technical literature Mathias Ellmann, Von Code zu Lösungen im Software Engineering mit Java; technical background on requirements, version control, builds, quality and defect analysis. Open source.
  • Methodological basis Sources & Methodology documents the source hierarchy, counter-hypothesis control and statement boundaries used across the English knowledge base.

Further reading

Critical review and methodological limitation

The evidential strength of this examination depends on requirements, acceptance criteria, approved changes, repository revision, release, build artefact, configuration, test inputs and observed outputs. A precise-looking output cannot compensate for an unidentified version, incomplete provenance or a reference that does not apply to the state under examination.

A robust report therefore exposes the transition from finding to interpretation and shows where contradictory requirement sources, incomplete reconstruction, oracle limitations and the distinction between a technical deviation and a legal defect restrict the conclusion. Alternative explanations are retained when the evidence cannot distinguish them reliably.

  • Identify the subject before interpreting evidence.
  • Use the strongest source appropriate to the proposition.
  • Document counter-evidence and missing evidence.
  • State only what the method and evidence support.
Examination rule: Keep the conclusion tied to the requirement or technical criterion that was applicable to the examined version and time state and to the identified evidence; do not extend it into legal attribution, responsibility or unexamined system states.

Translation and methodological scope

This English article is based on the reviewed German V1 source article. The translation preserves the technical meaning, methodological distinctions, source status and stated limitations. It does not strengthen technical findings into legal conclusions and does not treat technical references as proof of compliance or suitability for a specific system.

Source relationship: The corresponding German article remains the reference baseline during English V1 development. Open the German source article.

Author's technical literature and publications

The following works provide additional technical and methodological context. They do not replace required primary sources, standards, manufacturer documentation or other independent specialist sources. Unpublished manuscripts, drafts and teaching materials are deliberately not presented here as public sources.

Mathias Ellmann, IT expert

Software & Source Code Assessments

Technical assessment of software architecture, source-code quality, maintainability, development evidence and technical risks.

Explore this assessment service