nrslib 2c7bd4834f Faceted Prompting リネーム: stances→policies, report_formats→output_contracts

5つの関心を Persona, Policy, Instruction, Knowledge, Output Contract に統一。
ディレクトリ、YAMLキー、ソースコード、テンプレート、テスト、ドキュメントを全面更新。

2026-02-07 20:04:09 +09:00

2.9 KiB

Raw Blame History

Testing Policy

Every behavior change requires a corresponding test, and every bug fix requires a regression test.

Principles

Principle	Criteria
Given-When-Then	Structure tests in 3 phases
One test, one concept	Do not mix multiple concerns in a single test
Test behavior	Test behavior, not implementation details
Independence	Do not depend on other tests or execution order
Reproducibility	Do not depend on time or randomness. Same result every run

Coverage Criteria

Target	Criteria
New behavior	Test required. REJECT if missing
Bug fix	Regression test required. REJECT if missing
Behavior change	Test update required. REJECT if missing
Edge cases / boundary values	Test recommended (Warning)

Test Priority

Priority	Target
High	Business logic, state transitions
Medium	Edge cases, error handling
Low	Simple CRUD, UI appearance

Test Structure: Given-When-Then

test('should return NotFound error when user does not exist', async () => {
  // Given: A non-existent user ID
  const nonExistentId = 'non-existent-id'

  // When: Attempt to fetch the user
  const result = await getUser(nonExistentId)

  // Then: NotFound error is returned
  expect(result.error).toBe('NOT_FOUND')
})

Test Quality

Aspect	Good	Bad
Independence	No dependency on other tests	Depends on execution order
Reproducibility	Same result every time	Depends on time or randomness
Clarity	Failure cause is obvious	Failure cause is unclear
Focus	One test, one concept	Multiple concerns mixed

Naming

Test names describe expected behavior. Use the should {expected behavior} when {condition} pattern.

Structure

Arrange-Act-Assert pattern (equivalent to Given-When-Then)
Avoid magic numbers and magic strings

Test Strategy

Prefer unit tests for logic, integration tests for boundaries
Do not overuse E2E tests for what unit tests can cover
If new logic only has E2E tests, propose adding unit tests

Test Environment Isolation

Tie test infrastructure configuration to test scenario parameters. Hardcoded assumptions break under different scenarios.

Principle	Criteria
Parameter-driven	Generate fixtures and configuration based on test input parameters
No implicit assumptions	Do not depend on a specific environment (e.g., user's personal settings)
Consistency	Related values within test configuration must not contradict each other

// ❌ Hardcoded assumptions — breaks when testing with a different backend
writeConfig({ backend: 'postgres', connectionPool: 10 })

// ✅ Parameter-driven
const backend = process.env.TEST_BACKEND ?? 'postgres'
writeConfig({ backend, connectionPool: backend === 'sqlite' ? 1 : 10 })

2.9 KiB Raw Blame History