-
Notifications
You must be signed in to change notification settings - Fork 0
fix(ci)!: remove GitHub Advanced Security guidance from mirrored agents/skills #5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -1273,8 +1273,7 @@ platform: resolve against the platform's live docs and the CI-pinned tool versio | |
| | CI check | Static validation | | ||
| | --- | --- | | ||
| | ClusterFuzzLite | For each fuzz target declared in workflow: verify file exists at the declared path, has the correct extension (`.py` for Python), and compiles with `python3 -m py_compile {target}` | | ||
| | Dependency Review | Verify the action version pin resolves (check format: `actions/dependency-review-action@vN`) | | ||
| | SARIF upload | If workflow references a SARIF file path, verify the generating step would produce it (check step ordering and output paths) | | ||
| | SARIF-producing scanners (Trivy, Snyk, Scorecard, SBOM) | If workflow references a SARIF file path, verify the generating step would produce it (check step ordering and output paths). SARIF now feeds `actions/upload-artifact`, not `github/codeql-action/upload-sarif`/Security tab ingestion, since GitHub Advanced Security is no longer free; verify the artifact-upload step exists where a scanner's SARIF was its only output. | | ||
| | SonarCloud | Verify `sonar-project.properties` has non-placeholder values for `sonar.organization` and `sonar.projectKey` | | ||
| | Codecov | If `codecov.yml` exists, verify it parses as valid YAML and references existing flag names | | ||
|
|
||
|
|
@@ -1621,11 +1620,16 @@ still serves dangling commits, so use `compare`, not existence. Validate the fix | |
| `if:`). When the failure appeared right after an edit, confirm causation by reverting the | ||
| suspected change on the current base before committing to a fix direction. | ||
|
|
||
| **SARIF / code-scanning orphan checks:** When "Code scanning results / *" checks remain | ||
| in `queued` state indefinitely after a push, check whether the upstream analysis job was | ||
| path-filtered or skipped. Security analysis workflows on config-only or docs-only PRs are | ||
| commonly path-filtered, leaving their SARIF upload result checks permanently pending with | ||
| no source to resolve them. | ||
| **SARIF / code-scanning orphan checks (legacy, pre-2026-09):** GitHub's CodeQL code scanning | ||
| and SARIF ingestion into the Security tab now require paid GitHub Advanced Security (Code | ||
| Security); `codeql.yml` and `github/codeql-action/upload-sarif` steps were removed fleet-wide, | ||
| so "Code scanning results / *" checks should no longer appear on new PRs at all. If one is | ||
| still visible, it is a leftover from before the billing change, not a live analysis: treat it | ||
| as permanently orphaned (not merely path-filtered) and, if it recurs, have the repo owner | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 🎯 Functional Correctness | 🟠 Major | ⚡ Quick win Separate legacy orphan checks from path-filtered SARIF checks. This section says that lingering CodeQL checks are permanently orphaned, not path-filtered. The following rule still labels these checks as 🤖 Prompt for AI Agents |
||
| disable "Code scanning: Default setup" in repo Settings > Code security so GitHub stops | ||
| registering the check context. The pre-2026-09 mechanics below (queued indefinitely because the | ||
| upstream analysis job was path-filtered or skipped on config-only/docs-only PRs) still apply to | ||
| any other SARIF-producing workflow, such as a Trivy or Snyk scan that guards a path filter. | ||
|
|
||
| ```bash | ||
| gh pr view "$PR_NUMBER" --repo "$OWNER/$REPO" --json mergeable,mergeStateStatus \ | ||
|
|
@@ -1657,11 +1661,13 @@ change can clear it. Before treating any single FAILURE as a blocker that warran | |
| Phase C re-fix cycle, run `gh pr view "$PR_NUMBER" --repo "$OWNER/$REPO" --json | ||
| mergeable,mergeStateStatus` and a required-contexts lookup; classify by the merge- | ||
| eligibility API and the required-context list, not by the check's terminal color alone. | ||
| The worked example is a CodeQL default-setup job ("Analyze (javascript-typescript)") | ||
| failing "no source code seen during build" on a repo with zero JS/TS source: it is enabled | ||
| org-wide by the recommended code-security config, is non-required, and merges straight | ||
| through. This is the same advisory logic the queued/PENDING SARIF row applies, extended to | ||
| the hard-FAILED terminal case. | ||
| The worked example (pre-2026-09, when CodeQL default setup was still free) was a CodeQL | ||
| default-setup job ("Analyze (javascript-typescript)") failing "no source code seen during | ||
| build" on a repo with zero JS/TS source: it was enabled org-wide by the recommended | ||
| code-security config, was non-required, and merged straight through. CodeQL now requires | ||
| paid GitHub Advanced Security and no longer runs fleet-wide, so this specific check should | ||
| not reappear; the underlying advisory logic (non-required + `UNSTABLE` + `MERGEABLE` merges | ||
| through regardless of terminal color) still applies to any other non-required check. | ||
|
|
||
| **Green-but-BLOCKED: distinguish the cause before acting.** "All checks green" is | ||
| necessary but not sufficient for mergeability; `mergeStateStatus` is the authoritative | ||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -219,8 +219,10 @@ gh run view {RUN_ID} --repo "$OWNER/$REPO" --log \ | |
| - Log matches an infra signature, or the conclusion is `CANCELLED` (collateral cancel): | ||
| emit `[Critical - likely transient, rerun]` with the matched evidence line. The | ||
| remediation is a re-run, not a code change. A docs-only or config-only diff that | ||
| fails a code-analysis check (CodeQL, security-analysis) is a strong tell for this | ||
| class, since such a diff cannot cause that failure. | ||
| fails a code-analysis check (Bandit, SonarCloud, security-analysis) is a strong tell | ||
| for this class, since such a diff cannot cause that failure. (CodeQL was retired | ||
|
Comment on lines
+222
to
+223
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 🎯 Functional Correctness | 🟠 Major | ⚡ Quick win Do not classify every docs-only or config-only analysis failure as transient. A config-only change can alter Bandit, SonarCloud, or 🤖 Prompt for AI Agents |
||
| fleet-wide 2026-09; it should no longer appear as a check at all, see ci-fix | ||
| guidance on legacy SARIF/code-scanning checks.) | ||
| - No infra signature and the log points at the diff: emit `[Critical - PR-introduced]`; | ||
| the fix is in the PR's diff. | ||
|
|
||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🔒 Security & Privacy | 🟠 Major | ⚡ Quick win
🔎 Supported by static analysis
🏁 Script executed:
Repository: ByronWilliamsCPA/plugin
Length of output: 12260
🌐 Web query:
GitHub Advanced Security CodeQL dependency review public repositories without paid license billing documentation 2026💡 Result:
As of September 2026, both GitHub Advanced Security (GHAS) CodeQL and Dependency Review features are available for public repositories on GitHub.com free of charge, with no requirement for a paid license or billing [1][2][3]. Key details regarding their availability for public repositories: Dependency Review: The dependency review feature and the associated dependency-review-action are available for all public repositories by default [4][1][5]. This allows users to review dependency changes in pull requests for vulnerabilities and license compliance without needing a GHAS license [6][7]. CodeQL and Code Scanning: Code scanning with CodeQL is provided free of charge for public repositories on GitHub.com [8][3]. You can configure this using either the default setup, which simplifies the process significantly, or the advanced setup [9][10]. Additionally, the CodeQL CLI is free to use on public repositories [11]. For private repositories, these features generally require an organization to purchase GitHub Code Security (which is part of the broader GitHub Advanced Security product suite) [2][11][3]. The features are available to all public repositories regardless of the user's plan [1][3].
Citations:
Scope the GHAS retirement to this fleet.
GitHub provides dependency review and CodeQL code scanning at no cost for public repositories. Describe the removals as fleet policy, not as a universal free-tier limitation. Do not suppress
codeql.ymlfindings for public repositories solely because of billing. Apply this correction to the six passages in the cited files.🧰 Tools
🪛 LanguageTool
[style] ~191-~191: The double modal “requires paid” is nonstandard (only accepted in certain dialects). Consider “to be paid”.
Context: ...wide (2026-09): the action now requires paid GitHub Advanced Security (Code Security...
(NEEDS_FIXED)
🪛 SkillSpector (2.9.5)
[warning] 248: [RP1] null: npx commands without a version suffix (e.g.
@1.0.0) create a rug-pull risk if the upstream server is compromised and publishes a malicious update.Remediation: Pin the version: npx
@scope/server@1.2.3(MCP Rug Pull (RP1))
[warning] 245: [RP1] null: uvx/uv tool run commands without ==version create a rug-pull risk.
Remediation: Pin the version: uvx package-name==1.2.3
(MCP Rug Pull (RP1))
📍 Affects 4 files
plugins/wff-chat/skills/ci-fix/SKILL.md#L191-L191(this comment)plugins/wff-code/skills/ci-fix/SKILL.md#L191-L191plugins/wff-code/skills/repo-compliance/SKILL.md#L181-L182plugins/wff-code/skills/repo-compliance/SKILL.md#L288-L290plugins/wff-code/agents/ossf-compliance-auditor.md#L364-L366plugins/wff-code/agents/ossf-compliance-auditor.md#L744-L746🤖 Prompt for AI Agents
Source: MCP tools