Skip to content

New test stories added in ci/journey.sh#48

Open
imtiazqa wants to merge 7 commits into
mainfrom
test/automate-manual-tcs
Open

New test stories added in ci/journey.sh#48
imtiazqa wants to merge 7 commits into
mainfrom
test/automate-manual-tcs

Conversation

@imtiazqa

Copy link
Copy Markdown
Collaborator

TC-022 — Verifies that a wrong S3 endpoint causes the archiver to fail at Phase 2 with a clear connection error naming the bad host
TC-024 — Verifies that an empty (0-row) partition completes all six archiver phases cleanly and is dropped from PostgreSQL
TC-040 — Verifies that renaming the hot table triggers the DDL hook to update the registry and rebuild the view, and DML via the view continues to route correctly
TC-052 — Verifies that partitioner set --retention updates partition_config in the database without touching the YAML file
TC-053 — Verifies that a disabled table is silently excluded from archiver runs and re-enabling it restores normal processing
TC-054 — Verifies that partitioner remove deletes the partition_config row while leaving the physical table intact
TC-071 — Verifies that a composite PARTITION BY RANGE (col1, col2) key is rejected by the archiver before any Iceberg or S3 work
TC-118 — Verifies that an archiver.tables block in the YAML config is ignored at runtime; the archiver always drives off partition_config
TC-119 — Verifies that export → delete row → import restores a partition_config entry (backup/restore cycle works correctly)
TC-120 — Verifies that archiver set writes only to partition_config; the YAML config file on disk is not modified

@imtiazqa
imtiazqa requested a review from vyruss as a code owner July 15, 2026 08:36
@coderabbitai

coderabbitai Bot commented Jul 15, 2026

Copy link
Copy Markdown

Review Change Stack

📝 Walkthrough

Walkthrough

Changes

Archiver and partitioner behavior

Layer / File(s) Summary
Configuration and partitioner management coverage
ci/journey.sh
Adds TC-118/119/120 for database-backed configuration, export/import, and YAML immutability, plus TC-040/052/053/054 for hot-table renaming, retention, enablement, and removal.
Tiered archiver execution coverage
ci/journey.sh
Adds TC-022/024/071 for invalid S3 endpoints, empty partitions, and composite RANGE key rejection, and appends the stories to tiered orchestration.

Estimated code review effort: 3 (Moderate) | ~20 minutes

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the main change: new test stories added in ci/journey.sh.
Description check ✅ Passed The description directly matches the added test stories and their behavior coverage.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch test/automate-manual-tcs

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@codacy-production

codacy-production Bot commented Jul 15, 2026

Copy link
Copy Markdown

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.

Comment thread cmd/archiver/main.go Outdated
// cleanupAlreadyArchived is the idempotent cleanup branch: the partition was
// archived in a prior cycle (watermark already past its upper bound), so there
// is no race — just detach + drop the stale PG partition.
// is no race — just drop the stale PG partition. DROP TABLE IF EXISTS detaches

@vyruss vyruss Jul 23, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@imtiazqa Wait, how did this sneak into this PR? This is a regression, it's absolutely wrong to ACCESS EXCLUSIVE lock the entire partitioned table. The whole partMgr.Detach CONCURRENTLY mechanism was built specifically for this.

Muhammad Imtiaz added 7 commits July 24, 2026 12:46
…, hot table rename, cold-tier E2E, retention update, disable/enable, and unregister
…040 INSERT timestamp and restore assertion
… mesh mode

The previous main.go change removed DETACH CONCURRENTLY from
cleanupAlreadyArchived and replaced it with a direct DROP TABLE to work
around TC-024 failing in mesh mode. The failure was in partMgr.Detach
which fans out to Spock peers by connecting to each peer DSN from
spock.node_interface — those hostnames are not resolvable from the
archiver host in the CI mesh environment.

That introduced a locking regression: DROP TABLE on an attached partition
takes ACCESS EXCLUSIVE on the entire parent table, blocking all reads and
writes across all partitions. The DETACH CONCURRENTLY mechanism was
specifically built to avoid this.

The correct fix is scoped to the test: story_partitioner_fk_drop already
skips in mesh mode for the exact same reason. TC-024 follows the same
pattern.
@imtiazqa
imtiazqa force-pushed the test/automate-manual-tcs branch from a900708 to 19885ac Compare July 24, 2026 09:56

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@ci/journey.sh`:
- Around line 2062-2081: Update the TC-119 round-trip flow after the ARCHIVER
export so the import consumes the exported artifact’s cli_events configuration
rather than the hand-written /tmp/journey-roundtrip.yaml entry. Extract the
complete cli_events entry, preserving serialized fields such as
partition_period, hot_period, and enablement, then use that derived artifact for
import while retaining the export validation.
- Around line 2545-2563: The TC-053 archiver invocations must be validated
independently instead of masking failures or reusing prior output. Update both
commands around the disabled and re-enabled checks to write to separate fresh
log files, fail immediately when the archiver exits non-zero, and grep only the
corresponding invocation’s log for the [events] assertion; retain the existing
enable command behavior and messages.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: c713f966-d15f-4a62-88be-86c11dbfa244

📥 Commits

Reviewing files that changed from the base of the PR and between a900708 and 19885ac.

📒 Files selected for processing (1)
  • ci/journey.sh

Comment thread ci/journey.sh
Comment thread ci/journey.sh
@imtiazqa
imtiazqa requested a review from vyruss July 24, 2026 10:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants