ST Flow Tests

Canonical test harness for Axway SecureTransport Advanced Routing flows.

Purpose

This repo provides:

Fixture files — deterministic test inputs with known content and checksums
Test runner — automated upload → route → verify cycle via SFTP and ST API
Flow specs — declarative YAML definitions of reference AR flows
Machine context — structured metadata for AI agents building/testing flows

Quick Start

# Configure environment
cp env.example .env
# Edit .env with your ST host, credentials, SFTP target, and partner destination

# Install dependencies
pip install -r requirements.txt

# Run full test suite against a configured flow
python scripts/run_tests.py --spec specs/compress-pgp-passthrough.yaml --env .env

Test Suite Structure

fixtures/          # Canonical input files (committed, never regenerated)
  test.txt         # Plain text — expected: compressed to .zip
  test.md          # Markdown — expected: PGP encrypted to .md.pgp
  test.csv         # CSV — expected: pass-through, unchanged
  test.pdf         # PDF stub — expected: pass-through, unchanged
  test.jpg         # JPEG stub — expected: pass-through, unchanged

specs/             # Declarative flow definitions
  compress-pgp-passthrough.yaml   # Reference 3-step flow
  schema.md        # Spec format documentation

scripts/
  run_tests.py     # Main test runner
  st_env_snapshot.py   # Query live ST environment for context injection
  st_deploy.py     # Idempotent deploy from spec YAML

results/           # Test run output (gitignored)
  .gitkeep

Test Matrix

Fixture	Expected Transformation	Verification Method
`test.txt`	Compressed → `test.txt.zip`	Filename suffix + size increase
`test.md`	PGP encrypted → `test.md.pgp`	Filename suffix + binary PGP header `0xC1`
`test.csv`	Pass-through — unchanged	Filename exact match + byte-for-byte size
`test.pdf`	Pass-through — unchanged	Filename exact match + byte-for-byte size
`test.jpg`	Pass-through — unchanged	Filename exact match + byte-for-byte size

Environment Variables

Variable	Description
`ST_HOST`	ST admin host (e.g. `192.168.0.245`)
`ST_ADMIN_PORT`	Admin API port (default `444`)
`ST_ADMIN_USER`	Admin username
`ST_ADMIN_PASS`	Admin password
`ST_SFTP_HOST`	ST SFTP host
`ST_SFTP_PORT`	SFTP port (default `8022`)
`ST_SFTP_USER`	SFTP upload account
`ST_SFTP_PASS`	SFTP upload password
`ST_SFTP_UPLOAD_DIR`	Remote upload directory (e.g. `/skill-test`)
`PARTNER_SSH_HOST`	Partner destination host
`PARTNER_SSH_PORT`	Partner SSH port
`PARTNER_SSH_USER`	Partner SSH user
`PARTNER_SSH_KEY`	Path to partner SSH private key
`PARTNER_DEST_DIR`	Partner destination directory to verify
`ROUTING_TIMEOUT_SEC`	Seconds to wait for routing to complete (default `30`)

Fixture Checksums (SHA-256)

Fixtures are committed with known content. Verify before running:

sha256sum fixtures/*

Expected values are recorded in fixtures/CHECKSUMS.

Adding a New Test Case

Add the fixture file to fixtures/ with deterministic content
Update fixtures/CHECKSUMS
Add a row to the test matrix in MACHINE.md
The runner auto-discovers all fixtures — no code changes needed for new file types

Relation to st-flows Skill

This repo is the validation layer for flows built using the st-flows agent skill. The flow specs in specs/ are the declarative source of truth for what the agent builds. The test runner confirms the built flow behaves as specified.

3.7 KiB Raw Blame History