Skip to content

[WIP] OIDC Auth provider#2536

Draft
tvi wants to merge 1 commit intomainfrom
t/jwt
Draft

[WIP] OIDC Auth provider#2536
tvi wants to merge 1 commit intomainfrom
t/jwt

Conversation

@tvi
Copy link
Copy Markdown
Contributor

@tvi tvi commented May 1, 2026

Dashboard and API auth were tied to Supabase-specific HMAC JWT configuration
(SUPABASE_JWT_SECRETS) and Supabase-specific headers. That made it hard to
support other auth providers and forced provider-specific settings to spread
across several environment variables.

This change introduces one generic auth-provider JWT verification path that
supports both OIDC-compliant issuers (asymmetric keys, JWKS auto-discovered)
and non-OIDC HMAC-signed JWTs. It keeps the old Supabase headers as
compatibility aliases, while adding provider-neutral bearer token and team
header schemes.

  • Add shared auth-provider JWT verification with OIDC and bearer (HMAC)
    verifier strategies under packages/auth/pkg/auth/.
  • Replace API/dashboard service-level SUPABASE_JWT_SECRETS with one
    structured AUTH_PROVIDER_CONFIG JSON value, defaulted (in Terraform) to
    the existing Supabase JWT secret wrapped in a bearer entry.
  • Support multiple OIDC issuers and multiple bearer-token sources at once,
    useful during migrations and multi-tenant deployments.
  • For OIDC entries, fetch the discovery document at startup, cross-check
    issuer, and resolve jwks_uri from it. JWKS HTTPS is required.
    Lookups/caching/refresh use github.com/MicahParks/keyfunc/v3/jwkset.
    Fail-fast on discovery errors.
  • Per-entry audience matching with MatchAny (default) or MatchAll.
  • Per-entry claimMappings.username.claim (default sub) resolves directly
    to an internal UUID; no email fallback.
  • Wire auth-provider bearer token and X-Team-Id team header in both API
    and dashboard API, while keeping Supabase headers as compatibility aliases.

Example with one OIDC issuer and one bearer source (e.g. during migration or
key rotation):

{
  "jwt": [
    {
      "issuer": {
        "url": "https://issuer.example.com",
        "discoveryURL": "https://issuer.example.com/.well-known/openid-configuration",
        "audiences": ["dashboard-api"],
        "audienceMatchPolicy": "MatchAny"
      },
      "claimMappings": { "username": { "claim": "sub" } },
      "jwksCacheDuration": "5m"
    }
  ],
  "bearer": [
    {
      "hmac": { "secrets": ["legacy-secret"] },
      "claimMappings": { "username": { "claim": "sub" } }
    }
  ]
}

@tvi tvi force-pushed the t/jwt branch 10 times, most recently from 3745f0b to 0b7029c Compare May 2, 2026 20:42
Dashboard and API auth were tied to Supabase-specific HMAC JWT configuration
(`SUPABASE_JWT_SECRETS`) and Supabase-specific headers. That made it hard to
support other auth providers and forced provider-specific settings to spread
across several environment variables.

This change introduces one generic auth-provider JWT verification path that
supports both OIDC-compliant issuers (asymmetric keys, JWKS auto-discovered)
and non-OIDC HMAC-signed JWTs. It keeps the old Supabase headers as
compatibility aliases, while adding provider-neutral bearer token and team
header schemes.

- Add shared auth-provider JWT verification with OIDC and bearer (HMAC)
  verifier strategies under `packages/auth/pkg/auth/`.
- Replace API/dashboard service-level `SUPABASE_JWT_SECRETS` with one
  structured `AUTH_PROVIDER_CONFIG` JSON value, defaulted (in Terraform) to
  the existing Supabase JWT secret wrapped in a `bearer` entry.
- Support multiple OIDC issuers and multiple bearer-token sources at once,
  useful during migrations and multi-tenant deployments.
- For OIDC entries, fetch the discovery document at startup, cross-check
  `issuer`, and resolve `jwks_uri` from it. JWKS HTTPS is required.
  Lookups/caching/refresh use `github.com/MicahParks/keyfunc/v3`/`jwkset`.
  Fail-fast on discovery errors.
- Per-entry audience matching with `MatchAny` (default) or `MatchAll`.
- Per-entry `claimMappings.username.claim` (default `sub`) resolves directly
  to an internal UUID; no email fallback.
- Wire auth-provider bearer token and `X-Team-Id` team header in both API
  and dashboard API, while keeping Supabase headers as compatibility aliases.

Example with one OIDC issuer and one bearer source (e.g. during migration or
key rotation):

```json
{
  "jwt": [
    {
      "issuer": {
        "url": "https://issuer.example.com",
        "discoveryURL": "https://issuer.example.com/.well-known/openid-configuration",
        "audiences": ["dashboard-api"],
        "audienceMatchPolicy": "MatchAny"
      },
      "claimMappings": { "username": { "claim": "sub" } },
      "jwksCacheDuration": "5m"
    }
  ],
  "bearer": [
    {
      "hmac": { "secrets": ["legacy-secret"] },
      "claimMappings": { "username": { "claim": "sub" } }
    }
  ]
}
```

Co-authored-by: Jakub Dobry <dobrac@users.noreply.github.com>
@codecov
Copy link
Copy Markdown

codecov Bot commented May 4, 2026

❌ 80 Tests Failed:

Tests completed Failed Passed Skipped
2287 80 2207 5
View the full list of 80 ❄️ flaky test(s)
::TestMain

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
panic: test timed out after 10m0s
	running tests:
		TestTemplateBuildFuseConfiguration (4m59s)
		TestTemplateTagAssign (4m59s)
		TestTemplateTagAssignFromSourceTag (4m59s)
		TestTemplateTagDeleteLatestNotAllowed (5m0s)

goroutine 5117 [running]:
testing.(*M).startAlarm.func1()
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2682 +0x345
created by time.goFunc
	.../hostedtoolcache/go/1.25.9.../src/time/sleep.go:215 +0x2d

goroutine 1 [chan receive, 5 minutes]:
testing.tRunner.func1()
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1891 +0x451
testing.tRunner(0xc0001988c0, 0xc000247c70)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1940 +0x123
testing.runTests(0xc000013008, {0x19af600, 0x37, 0x37}, {0x7?, 0xc0002ae5c0?, 0x19bde20?})
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2475 +0x4b4
testing.(*M).Run(0xc00026ef00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2337 +0x63a
main.main()
	_testmain.go:153 +0x9b

goroutine 9 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc000198e00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildENV(0xc000198e00)
	.../api/templates/build_template_test.go:173 +0x2a
testing.tRunner(0xc000198e00, 0x107cce0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 10 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc000199180)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildWORKDIR(0xc000199180)
	.../api/templates/build_template_test.go:380 +0x2a
testing.tRunner(0xc000199180, 0x107cd38)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 11 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc000199500)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildCache(0xc000199500)
	.../api/templates/build_template_test.go:435 +0x2a
testing.tRunner(0xc000199500, 0x107ccd8)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 12 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc000199880)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildFromTemplate(0xc000199880)
	.../api/templates/build_template_test.go:471 +0x2a
testing.tRunner(0xc000199880, 0x107cce8)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 13 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc000199c00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildFromTemplateCommandOverride(0xc000199c00)
	.../api/templates/build_template_test.go:531 +0x2a
testing.tRunner(0xc000199c00, 0x107ccf8)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 14 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b0000)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildFromTemplateInheritance(0xc0002b0000)
	.../api/templates/build_template_test.go:601 +0x2a
testing.tRunner(0xc0002b0000, 0x107cd00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 15 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b0380)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildFromTemplateStartCommand(0xc0002b0380)
	.../api/templates/build_template_test.go:662 +0x2a
testing.tRunner(0xc0002b0380, 0x107cd10)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 16 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b0700)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildFromTemplateBaseCommandsInheritance(0xc0002b0700)
	.../api/templates/build_template_test.go:708 +0x2a
testing.tRunner(0xc0002b0700, 0x107ccf0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 18 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b0a80)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildFromTemplateLayered(0xc0002b0a80)
	.../api/templates/build_template_test.go:768 +0x2a
testing.tRunner(0xc0002b0a80, 0x107cd08)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 19 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b0e00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildStartReadyCommandExecution(0xc0002b0e00)
	.../api/templates/build_template_test.go:857 +0x2a
testing.tRunner(0xc0002b0e00, 0x107cd30)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 20 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b1180)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildWithDifferentSourceImages(0xc0002b1180)
	.../api/templates/build_template_test.go:966 +0x2a
testing.tRunner(0xc0002b1180, 0x107cd40)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 21 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b1500)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildInstalledPackagesAvailable(0xc0002b1500)
	.../api/templates/build_template_test.go:1024 +0x2a
testing.tRunner(0xc0002b1500, 0x107cd20)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 22 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002b1880)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildCOPY(0xc0002b1880)
	.../api/templates/build_template_test.go:1128 +0x2a
testing.tRunner(0xc0002b1880, 0x107ccd0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 23 [sleep]:
time.Sleep(0x3b9aca00)
	.../hostedtoolcache/go/1.25.9.../src/runtime/time.go:363 +0x165
github..../tests/api/templates.buildTemplate({0x11b04b0, 0xc0002b1c00}, {0x103c29e, 0x17}, {0xc0007124c5, 0xc0004b6bc0, 0x0, 0x0, 0x0, 0x0, ...}, ...)
	.../api/templates/build_template_test.go:117 +0x6c5
github..../tests/api/templates.TestTemplateBuildFuseConfiguration(0xc0002b1c00)
	.../api/templates/build_template_test.go:1186 +0x2af
testing.tRunner(0xc0002b1c00, 0x107cd18)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 24 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ba000)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestDeleteTemplate(0xc0002ba000)
	.../api/templates/delete_template_test.go:17 +0x2a
testing.tRunner(0xc0002ba000, 0x107cc10)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 25 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ba380)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestDeleteTemplateWithAccessToken(0xc0002ba380)
	.../api/templates/delete_template_test.go:44 +0x27
testing.tRunner(0xc0002ba380, 0x107cc28)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 26 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ba700)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestDeleteTemplateFromAnotherTeamAccessToken(0xc0002ba700)
	.../api/templates/delete_template_test.go:61 +0x27
testing.tRunner(0xc0002ba700, 0x107cc20)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 27 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002baa80)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestDeleteTemplateFromAnotherTeamAPIKey(0xc0002baa80)
	.../api/templates/delete_template_test.go:82 +0x2a
testing.tRunner(0xc0002baa80, 0x107cc18)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 28 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002bae00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestRequestTemplateBuild(0xc0002bae00)
	.../api/templates/request_build_test.go:17 +0x27
testing.tRunner(0xc0002bae00, 0x107cc70)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 29 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002bb180)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestRequestTemplateTooLowCPU(0xc0002bb180)
	.../api/templates/request_build_test.go:29 +0x2a
testing.tRunner(0xc0002bb180, 0x107cc98)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 30 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002bb500)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestRequestTemplateTooLowRAM(0xc0002bb500)
	.../api/templates/request_build_test.go:43 +0x2a
testing.tRunner(0xc0002bb500, 0x107cca0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 31 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002bb880)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestRequestTemplateTooHighCPU(0xc0002bb880)
	.../api/templates/request_build_test.go:57 +0x27
testing.tRunner(0xc0002bb880, 0x107cc88)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 32 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002bbc00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestRequestTemplateOddCPU(0xc0002bbc00)
	.../api/templates/request_build_test.go:71 +0x27
testing.tRunner(0xc0002bbc00, 0x107cc80)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 33 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002d2000)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestRequestTemplateTooHighMemory(0xc0002d2000)
	.../api/templates/request_build_test.go:85 +0x2a
testing.tRunner(0xc0002d2000, 0x107cc90)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 34 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002d2380)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestRequestTemplateMemoryNonDivisibleBy2(0xc0002d2380)
	.../api/templates/request_build_test.go:99 +0x27
testing.tRunner(0xc0002d2380, 0x107cc78)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 35 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002d2700)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestInvalidBuildStatus(0xc0002d2700)
	.../api/templates/status_build_test.go:13 +0x27
testing.tRunner(0xc0002d2700, 0x107cc30)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 42 [sleep]:
time.Sleep(0x3b9aca00)
	.../hostedtoolcache/go/1.25.9.../src/runtime/time.go:363 +0x165
github..../integration/internal/utils.WaitForBuildCompletion({0x11b04b0, 0xc0002de000}, {0x119e5d8, 0xc0004c8770}, {0xc00004e540, 0x14}, {0xc00016e1e0, 0x24}, {0x1033d4e, 0xf}, ...)
	.../internal/utils/template.go:151 +0xe5
github..../integration/internal/utils.BuildTemplate({0x11b04b0, 0xc0002de000}, {{0x1033d4e, 0xf}, 0x0, 0xc000712298, 0xc00071229c, {0x0, 0xc0004b6620, 0x0, ...}, ...})
	.../internal/utils/template.go:85 +0x325
github..../integration/internal/utils.BuildSimpleTemplate({0x11b04b0, 0xc0002de000}, {0x1033d4e, 0xf}, {0xc000122038, 0x1, 0x1})
	.../internal/utils/template.go:236 +0x128
github..../tests/api/templates.TestTemplateTagAssign(0xc0002de000)
	.../api/templates/template_tags_test.go:29 +0x125
testing.tRunner(0xc0002de000, 0x107cd60)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 43 [sleep]:
time.Sleep(0x3b9aca00)
	.../hostedtoolcache/go/1.25.9.../src/runtime/time.go:363 +0x165
github..../integration/internal/utils.WaitForBuildCompletion({0x11b04b0, 0xc0002de380}, {0x119e5d8, 0xc00039a460}, {0xc00004e3d8, 0x14}, {0xc00016e180, 0x24}, {0x1033d5d, 0xf}, ...)
	.../internal/utils/template.go:151 +0xe5
github..../integration/internal/utils.BuildTemplate({0x11b04b0, 0xc0002de380}, {{0x1033d5d, 0xf}, 0x0, 0xc000514130, 0xc000514134, {0x0, 0xc000384280, 0x0, ...}, ...})
	.../internal/utils/template.go:85 +0x325
github..../integration/internal/utils.BuildSimpleTemplate({0x11b04b0, 0xc0002de380}, {0x1033d5d, 0xf}, {0xc000390018, 0x1, 0x1})
	.../internal/utils/template.go:236 +0x128
github..../tests/api/templates.TestTemplateTagAssignFromSourceTag(0xc0002de380)
	.../api/templates/template_tags_test.go:60 +0x125
testing.tRunner(0xc0002de380, 0x107cd68)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 44 [sleep]:
time.Sleep(0x3b9aca00)
	.../hostedtoolcache/go/1.25.9.../src/runtime/time.go:363 +0x165
github..../integration/internal/utils.WaitForBuildCompletion({0x11b04b0, 0xc0002de700}, {0x119e5d8, 0xc0004c8230}, {0xc00031c078, 0x14}, {0xc00004a960, 0x24}, {0x103b0bb, 0x16}, ...)
	.../internal/utils/template.go:151 +0xe5
github..../integration/internal/utils.BuildTemplate({0x11b04b0, 0xc0002de700}, {{0x103b0bb, 0x16}, 0x0, 0xc0007120b0, 0xc0007120b4, {0x0, 0xc0004b6110, 0x0, ...}, ...})
	.../internal/utils/template.go:85 +0x325
github..../integration/internal/utils.BuildSimpleTemplate({0x11b04b0, 0xc0002de700}, {0x103b0bb, 0x16}, {0xc000122008, 0x1, 0x1})
	.../internal/utils/template.go:236 +0x128
github..../tests/api/templates.TestTemplateTagDeleteLatestNotAllowed(0xc0002de700)
	.../api/templates/template_tags_test.go:95 +0x119
testing.tRunner(0xc0002de700, 0x107cd70)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 52 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ec380)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTagReassignment(0xc0002ec380)
	.../api/templates/template_tags_test.go:320 +0x3c
testing.tRunner(0xc0002ec380, 0x107ccc8)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 53 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ec700)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildWithTags(0xc0002ec700)
	.../api/templates/template_tags_test.go:385 +0x3c
testing.tRunner(0xc0002ec700, 0x107cd50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 54 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002eca80)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildWithTagsAndSandboxCreation(0xc0002eca80)
	.../api/templates/template_tags_test.go:424 +0x3c
testing.tRunner(0xc0002eca80, 0x107cd58)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 55 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ece00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestTemplateBuildWithTagInAlias(0xc0002ece00)
	.../api/templates/template_tags_test.go:466 +0x3c
testing.tRunner(0xc0002ece00, 0x107cd48)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 56 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ed180)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestAssignmentOrderingLatestWins(0xc0002ed180)
	.../api/templates/template_tags_test.go:512 +0x3c
testing.tRunner(0xc0002ed180, 0x107cc08)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 57 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ed500)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestAssignmentOrderingAfterTagReassignment(0xc0002ed500)
	.../api/templates/template_tags_test.go:579 +0x3c
testing.tRunner(0xc0002ed500, 0x107cc00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 58 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002ed880)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestUpdateTemplateVisibilityToPublicWithAPIKey(0xc0002ed880)
	.../api/templates/template_update_test.go:17 +0x2a
testing.tRunner(0xc0002ed880, 0x107cda0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 59 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002edc00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestUpdateTemplateVisibilityToPrivateWithAPIKey(0xc0002edc00)
	.../api/templates/template_update_test.go:56 +0x2a
testing.tRunner(0xc0002edc00, 0x107cd98)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 60 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002fa000)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestUpdateTemplateWithInvalidAPIKey(0xc0002fa000)
	.../api/templates/template_update_test.go:106 +0x27
testing.tRunner(0xc0002fa000, 0x107cda8)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 61 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002fa380)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestUpdateNonExistentTemplateWithAPIKey(0xc0002fa380)
	.../api/templates/template_update_test.go:127 +0x27
testing.tRunner(0xc0002fa380, 0x107cd88)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 62 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002fa700)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestUpdateTemplateWithSupabaseToken(0xc0002fa700)
	.../api/templates/template_update_test.go:147 +0x2a
testing.tRunner(0xc0002fa700, 0x107cdb0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 63 [chan receive, 9 minutes]:
testing.(*testState).waitParallel(0xc0001daf50)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2116 +0xaa
testing.(*T).Parallel(0xc0002faa80)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1709 +0x245
github..../tests/api/templates.TestUpdateTemplateNotOwnedByTeam(0xc0002faa80)
	.../api/templates/template_update_test.go:194 +0x2a
testing.tRunner(0xc0002faa80, 0x107cd90)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 5072 [IO wait]:
internal/poll.runtime_pollWait(0x7fe0bf069c00, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000454780?, 0xc0004b9000?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000454780, {0xc0004b9000, 0x1000, 0x1000})
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:165 +0x279
net.(*netFD).Read(0xc000454780, {0xc0004b9000?, 0x40bc34?, 0x0?})
	.../hostedtoolcache/go/1.25.9.../src/net/fd_posix.go:68 +0x25
net.(*conn).Read(0xc000122120, {0xc0004b9000?, 0x40ba13?, 0xc00027f950?})
	.../hostedtoolcache/go/1.25.9.../src/net/net.go:196 +0x45
net/http.(*persistConn).Read(0xc0004b06c0, {0xc0004b9000?, 0x796925?, 0x1190060?})
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc000154cc0)
	.../hostedtoolcache/go/1.25.9.../src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc000154cc0, 0x1)
	.../hostedtoolcache/go/1.25.9.../src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc0004b06c0)
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 5091
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:1947 +0x174f

goroutine 5073 [select]:
net/http.(*persistConn).writeLoop(0xc0004b06c0)
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2600 +0xe7
created by net/http.(*Transport).dialConn in goroutine 5091
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:1948 +0x17a5

goroutine 5158 [IO wait]:
internal/poll.runtime_pollWait(0x7fe0bf069800, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc00033c300?, 0xc00017a000?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00033c300, {0xc00017a000, 0x1000, 0x1000})
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:165 +0x279
net.(*netFD).Read(0xc00033c300, {0xc00017a000?, 0x40bc34?, 0x0?})
	.../hostedtoolcache/go/1.25.9.../src/net/fd_posix.go:68 +0x25
net.(*conn).Read(0xc0001300d0, {0xc00017a000?, 0x40ba13?, 0xc00027f950?})
	.../hostedtoolcache/go/1.25.9.../src/net/net.go:196 +0x45
net/http.(*persistConn).Read(0xc000666120, {0xc00017a000?, 0x796925?, 0x1190060?})
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00046ec00)
	.../hostedtoolcache/go/1.25.9.../src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00046ec00, 0x1)
	.../hostedtoolcache/go/1.25.9.../src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000666120)
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 5146
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:1947 +0x174f

goroutine 5159 [select]:
net/http.(*persistConn).writeLoop(0xc000666120)
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2600 +0xe7
created by net/http.(*Transport).dialConn in goroutine 5146
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:1948 +0x17a5
FAIL	github..../tests/api/templates	600.012s
::TestMain

Flake rate in main: 100.00% (Passed 0 times, Failed 1 times)

Stack Traces | 0s run time
2026/05/04 18:55:21 Using host network cidr cidr 10.11.0.0/16
2026/05/04 18:55:21 Using vrt network cidr 10.12.0.0/16
2026/05/04 18:55:21 Using vrt network cidr 10.12.0.0/16
2026/05/04 18:55:21 Using network slot size: 32766
panic: test timed out after 20m0s
	running tests:
		TestSmokeAllFCVersions (20m0s)
		TestSmokeAllFCVersions/fc-v1.10 (19m54s)

goroutine 1020 [running]:
testing.(*M).startAlarm.func1()
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2682 +0x345
created by time.goFunc
	.../hostedtoolcache/go/1.25.9.../src/time/sleep.go:215 +0x2d

goroutine 1 [chan receive, 20 minutes]:
testing.(*T).Run(0xc000505c00, {0x26add26?, 0xc000093b30?}, 0x275d9e0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2005 +0x485
testing.runTests.func1(0xc000505c00)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2477 +0x37
testing.tRunner(0xc000505c00, 0xc000093c70)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
testing.runTests(0xc00052e6c0, {0x3e2f060, 0x1, 0x1}, {0x7?, 0xc00072e440?, 0x3f940c0?})
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2475 +0x4b4
testing.(*M).Run(0xc0000337c0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2337 +0x63a
main.main()
	_testmain.go:55 +0x9b

goroutine 67 [chan receive, 19 minutes]:
testing.(*T).Run(0xc000505dc0, {0xc000c82320?, 0xc0006d5ef0?}, 0xc000537100)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:2005 +0x485
github..../orchestrator/cmd/smoketest_test.TestSmokeAllFCVersions(0xc000505dc0)
	.../cmd/smoketest/smoke_test.go:74 +0x289
testing.tRunner(0xc000505dc0, 0x275d9e0)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 1
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 1048 [IO wait]:
internal/poll.runtime_pollWait(0x7f1a941d8800, 0x77)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc00101a700?, 0x0?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitWrite(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:93
internal/poll.(*FD).WaitWrite(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:685
net.(*netFD).connect(0xc00101a700, {0x2a69660, 0xc0002ec5b0}, {0x41fab4?, 0x0?}, {0x2a2dc20?, 0xc0002f4dc0?})
	.../hostedtoolcache/go/1.25.9.../src/net/fd_unix.go:130 +0x6b6
net.(*netFD).dial(0xc00101a700, {0x2a69660, 0xc0002ec5b0}, {0x2a776f0?, 0x0?}, {0x2a776f0, 0xc000b8d7d0}, 0x0?)
	.../hostedtoolcache/go/1.25.9.../src/net/sock_posix.go:124 +0x3bc
net.socket({0x2a69660, 0xc0002ec5b0}, {0x268a69b, 0x3}, 0x2, 0x1, 0x0?, 0x0, {0x2a776f0, 0x0}, ...)
	.../hostedtoolcache/go/1.25.9.../src/net/sock_posix.go:70 +0x29b
net.internetSocket({0x2a69660, 0xc0002ec5b0}, {0x268a69b, 0x3}, {0x2a776f0, 0x0}, {0x2a776f0, 0xc000b8d7d0}, 0x1, 0x0, ...)
	.../hostedtoolcache/go/1.25.9.../src/net/ipsock_posix.go:167 +0xf8
net.(*sysDialer).doDialTCPProto(0xc000591080, {0x2a69660, 0xc0002ec5b0}, 0x0, 0xc000b8d7d0, 0x0)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:85 +0xe7
net.(*sysDialer).doDialTCP(...)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:75
net.(*sysDialer).dialTCP(0x4803b9?, {0x2a69660?, 0xc0002ec5b0?}, 0x2078d60?, 0xc0005a5360?)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:71 +0x69
net.(*sysDialer).dialSingle(0xc000591080, {0x2a69660, 0xc0002ec5b0}, {0x2a555d8, 0xc000b8d7d0})
	.../hostedtoolcache/go/1.25.9.../src/net/dial.go:721 +0x3ce
net.(*sysDialer).dialSerial(0xc000591080, {0x2a69660, 0xc0002ec5b0}, {0xc000b611e0?, 0x1, 0x6c08fe?})
	.../hostedtoolcache/go/1.25.9.../src/net/dial.go:686 +0x248
net.(*sysDialer).dialParallel(0x0?, {0x2a69660?, 0xc0002ec5b0?}, {0xc000b611e0?, 0x2259540?, 0x268af34?}, {0x0?, 0x268a69b?, 0x10?})
	.../hostedtoolcache/go/1.25.9.../src/net/dial.go:587 +0x30a
net.(*Dialer).DialContext(0xc00057d320, {0x2a69660, 0xc0002ec5b0}, {0x268a69b, 0x3}, {0xc0024f25a0, 0xf})
	.../hostedtoolcache/go/1.25.9.../src/net/dial.go:578 +0x6a9
github.com/inetaf/tcpproxy.(*DialProxy).HandleConn(0xc0005a59b8, {0x2a7c010, 0xc000c76680})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:382 +0x105
github..../orchestrator/pkg/tcpfirewall.proxy({0x2a69660, 0xc0002c28c0}, {0x2a7c010, 0xc000c76680}, {0xc0024f25a0, 0xf}, 0xc000e98180, {0x268ae20, 0x4})
	.../pkg/tcpfirewall/handlers.go:106 +0x167
github..../orchestrator/pkg/tcpfirewall.domainHandler({0x2a69660, 0xc0002c28c0}, {0x2a7c010, 0xc000c76680}, {0xc0024f2580, 0x10, 0x10}, 0x50, 0x269097c?, 0xc000e000d8, ...)
	.../pkg/tcpfirewall/handlers.go:68 +0x597
github..../orchestrator/pkg/tcpfirewall.(*connectionHandler).HandleConn.func1({0x2a69660?, 0xc0002c28c0?}, {0x2a7c010?, 0xc000c76680?}, {0xc0024f2580?, 0x25df220?, 0xc000c2bcc8?}, 0xc000c2bce0?, 0x7da065?, 0xc000e000d8, ...)
	.../pkg/tcpfirewall/proxy.go:269 +0xe3
github..../orchestrator/pkg/tcpfirewall.(*connectionHandler).HandleConn(0xc0009ec000, {0x2a7c010, 0xc000c76680})
	.../pkg/tcpfirewall/proxy.go:272 +0x8c3
github.com/inetaf/tcpproxy.(*Proxy).serveConn(0xc0003027e0?, {0x2a7bfb8, 0xc006eea100}, {0xc000796020, 0x2, 0x0?})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:237 +0x308
created by github.com/inetaf/tcpproxy.(*Proxy).serveListener in goroutine 146
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:219 +0x65

goroutine 59 [chan receive, 19 minutes]:
github.com/inetaf/tcpproxy.(*Proxy).Wait(...)
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:169
github.com/inetaf/tcpproxy.(*Proxy).Run(...)
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:161
github..../orchestrator/pkg/tcpfirewall.(*Proxy).Start(0xc000442c80, {0x2a69660, 0xc0002c28c0})
	.../pkg/tcpfirewall/proxy.go:120 +0x143e
created by github..../orchestrator/cmd/smoketest_test.newTestInfra in goroutine 67
	.../cmd/smoketest/smoke_test.go:200 +0x765

goroutine 58 [select, 19 minutes]:
github..../pkg/sandbox/nbd.(*DevicePool).Populate(0xc000764900, {0x2a69660, 0xc0002c28c0})
	.../sandbox/nbd/pool.go:159 +0x437
created by github..../orchestrator/cmd/smoketest_test.newTestInfra in goroutine 67
	.../cmd/smoketest/smoke_test.go:193 +0x58e

goroutine 60 [chan send, 19 minutes]:
github..../pkg/sandbox/network.(*Pool).Populate(0xc00017a7e0, {0x2a69660, 0xc0002c28c0})
	.../sandbox/network/pool.go:155 +0x2ec
created by github..../orchestrator/cmd/smoketest_test.newTestInfra in goroutine 67
	.../cmd/smoketest/smoke_test.go:207 +0xaa5

goroutine 61 [select, 19 minutes]:
github........../jellydator/ttlcache/v3.(*Cache[...]).Start(0x2aa07e0)
	.../pkg/mod/github.com....../jellydator/ttlcache/v3@v3.4.0/cache.go:689 +0x1c5
created by github..../pkg/sandbox/build.(*DiffStore).Start in goroutine 67
	.../sandbox/build/cache.go:110 +0xaa

goroutine 62 [select]:
github..../pkg/sandbox/build.(*DiffStore).startDiskSpaceEviction(_, {_, _}, {{0x1, {0x0, 0x0}, 0x2540be400, {0xc00007e6f9, 0x35}, {0x20b2de1, ...}, ...}, ...}, ...)
	.../sandbox/build/cache.go:191 +0x13d
created by github..../pkg/sandbox/build.(*DiffStore).Start in goroutine 67
	.../sandbox/build/cache.go:111 +0x194

goroutine 63 [select, 19 minutes]:
github........../jellydator/ttlcache/v3.(*Cache[...]).Start(0x2aa0ca0)
	.../pkg/mod/github.com....../jellydator/ttlcache/v3@v3.4.0/cache.go:689 +0x1c5
created by github..../pkg/sandbox/template.(*Cache).Start in goroutine 67
	.../sandbox/template/cache.go:118 +0x85

goroutine 64 [IO wait, 19 minutes]:
internal/poll.runtime_pollWait(0x7f1adf049400, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000132400?, 0x4319c5?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000132400)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:613 +0x28c
net.(*netFD).accept(0xc000132400)
	.../hostedtoolcache/go/1.25.9.../src/net/fd_unix.go:161 +0x29
net.(*TCPListener).accept(0xc0003ce300)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc0003ce300)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock.go:380 +0x30
github..../pkg/proxy/tracking.(*Listener).Accept(0xc000c9a138)
	.../proxy/tracking/listener.go:22 +0x22
net/http.(*Server).Serve(0xc0001b79e0, {0x2a66040, 0xc000c9a138})
	.../hostedtoolcache/go/1.25.9.../net/http/server.go:3463 +0x30c
github..../shared/pkg/proxy.(*Proxy).Serve(...)
	.../pkg/proxy/proxy.go:108
github..../shared/pkg/proxy.(*Proxy).ListenAndServe(0xc0001b79e0, {0x2a69660?, 0xc0002c28c0?})
	.../pkg/proxy/proxy.go:104 +0xda
github..../orchestrator/pkg/proxy.(*SandboxProxy).Start(...)
	.../pkg/proxy/proxy.go:170
created by github..../orchestrator/cmd/smoketest_test.newTestInfra in goroutine 67
	.../cmd/smoketest/smoke_test.go:228 +0x1019

goroutine 65 [select, 19 minutes]:
github..../shared/pkg/utils.(*SetOnce[...]).WaitWithContext(0x2a85820, {0x2a695f0, 0xc000668300})
	.../pkg/utils/set_once.go:106 +0x77
github..../shared/pkg/utils.(*ErrorOnce).WaitWithContext(...)
	.../pkg/utils/error_once.go:49
github..../build/phases/base.(*BaseBuilder).provisionSandbox(0xc00047ec08, {0x2a695f0?, 0xc00077b020?}, 0xc0000f6330, 0xc0006802c0, {{0xc000c82351, 0xb}, {0xc000cff200, 0x15}, {0xc000a442d0, ...}, ...}, ...)
	.../phases/base/provision.go:165 +0xadc
github..../build/phases/base.(*BaseBuilder).buildLayerFromOCI(_, {_, _}, _, {0x2, {{0xc000754150, 0x24}, {0x269d3e5, 0xf}, {0x269d9b2, ...}}, ...}, ...)
	.../phases/base/builder.go:216 +0xc09
github..../build/phases/base.(*BaseBuilder).Build(_, {_, _}, _, {_, _}, {{0x0, {{0x0, 0x0}, {0x0, ...}, ...}, ...}, ...}, ...)
	.../phases/base/builder.go:143 +0x3d1
github..../template/build/phases.Run({_, _}, _, _, {{0x1, {0x0, 0x0}, 0x2540be400, {0xc00007e6f9, 0x35}, ...}, ...}, ...)
	.../build/phases/phase.go:122 +0xf68
github..../pkg/template/build.runBuild({_, _}, _, {{0x1, {0x0, 0x0}, 0x2540be400, {0xc00007e6f9, 0x35}, {0x20b2de1, ...}, ...}, ...}, ...)
	.../template/build/builder.go:360 +0x1e1f
github..../pkg/template/build.(*Builder).Build(0xc0004a96c0, {_, _}, {{_, _}}, {{0x268cca1, 0x6}, {0x0, 0x0}, {0xc000c82351, ...}, ...}, ...)
	.../template/build/builder.go:228 +0xdb0
github..../orchestrator/cmd/smoketest_test.TestSmokeAllFCVersions.func1(0xc0004a9880)
	.../cmd/smoketest/smoke_test.go:80 +0x3c8
testing.tRunner(0xc0004a9880, 0xc000537100)
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 67
	.../hostedtoolcache/go/1.25.9.../src/testing/testing.go:1997 +0x465

goroutine 114 [chan receive, 19 minutes]:
github..../orchestrator/pkg/tcpfirewall.(*Proxy).Start.func4()
	.../pkg/tcpfirewall/proxy.go:116 +0x2c
created by github..../orchestrator/pkg/tcpfirewall.(*Proxy).Start in goroutine 59
	.../pkg/tcpfirewall/proxy.go:115 +0x140b

goroutine 146 [IO wait]:
internal/poll.runtime_pollWait(0x7f1adf049800, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000e8a080?, 0x900000036?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000e8a080)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:613 +0x28c
net.(*netFD).accept(0xc000e8a080)
	.../hostedtoolcache/go/1.25.9.../src/net/fd_unix.go:161 +0x29
net.(*TCPListener).accept(0xc00011c000)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00011c000)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock.go:380 +0x30
github..../orchestrator/pkg/tcpfirewall.(*resilientListener).Accept(0xc000b0c030)
	.../pkg/tcpfirewall/listener.go:29 +0x3c
github.com/inetaf/tcpproxy.(*Proxy).serveListener(0xc000328300, 0xc000316070, {0x2a65040, 0xc000b0c030}, {0xc000796020, 0x2, 0x2})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:214 +0x7e
created by github.com/inetaf/tcpproxy.(*Proxy).Start in goroutine 59
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:201 +0x194

goroutine 147 [IO wait, 19 minutes]:
internal/poll.runtime_pollWait(0x7f1a942fd000, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000e8a100?, 0x5167460a45345148?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000e8a100)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:613 +0x28c
net.(*netFD).accept(0xc000e8a100)
	.../hostedtoolcache/go/1.25.9.../src/net/fd_unix.go:161 +0x29
net.(*TCPListener).accept(0xc00011d740)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00011d740)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock.go:380 +0x30
github..../orchestrator/pkg/tcpfirewall.(*resilientListener).Accept(0xc000b0c0f0)
	.../pkg/tcpfirewall/listener.go:29 +0x3c
github.com/inetaf/tcpproxy.(*Proxy).serveListener(0xc000328300, 0xc000316070, {0x2a65040, 0xc000b0c0f0}, {0xc000796060, 0x2, 0x2})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:214 +0x7e
created by github.com/inetaf/tcpproxy.(*Proxy).Start in goroutine 59
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:201 +0x194

goroutine 148 [IO wait, 19 minutes]:
internal/poll.runtime_pollWait(0x7f1a942fce00, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000e8a180?, 0x4851410a44415442?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000e8a180)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:613 +0x28c
net.(*netFD).accept(0xc000e8a180)
	.../hostedtoolcache/go/1.25.9.../src/net/fd_unix.go:161 +0x29
net.(*TCPListener).accept(0xc00011de00)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00011de00)
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock.go:380 +0x30
github..../orchestrator/pkg/tcpfirewall.(*resilientListener).Accept(0xc000b0c1b0)
	.../pkg/tcpfirewall/listener.go:29 +0x3c
github.com/inetaf/tcpproxy.(*Proxy).serveListener(0xc000328300, 0xc000316070, {0x2a65040, 0xc000b0c1b0}, {0xc0005029d0, 0x1, 0x1})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:214 +0x7e
created by github.com/inetaf/tcpproxy.(*Proxy).Start in goroutine 59
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:201 +0x194

goroutine 149 [chan receive, 19 minutes]:
github.com/inetaf/tcpproxy.(*Proxy).awaitFirstError(...)
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:208
created by github.com/inetaf/tcpproxy.(*Proxy).Start in goroutine 59
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:203 +0x3b9

goroutine 824 [syscall, 19 minutes]:
syscall.Syscall6(0xf7, 0x3, 0x22, 0xc000589518, 0x4, 0xc000740240, 0x0)
	.../hostedtoolcache/go/1.25.9.../src/syscall/syscall_linux.go:96 +0x39
internal/syscall/unix.Waitid(0x0?, 0x268ac48?, 0x4?, 0x0?, 0xc0001476c0?)
	.../hostedtoolcache/go/1.25.9.../syscall/unix/waitid_linux.go:18 +0x39
os.(*Process).pidfdWait.func1(...)
	.../hostedtoolcache/go/1.25.9.../src/os/pidfd_linux.go:109
os.ignoringEINTR(...)
	.../hostedtoolcache/go/1.25.9.../src/os/file_posix.go:256
os.(*Process).pidfdWait(0xc001318640)
	.../hostedtoolcache/go/1.25.9.../src/os/pidfd_linux.go:108 +0x1a9
os.(*Process).wait(0x0?)
	.../hostedtoolcache/go/1.25.9.../src/os/exec_unix.go:25 +0x1a
os.(*Process).Wait(...)
	.../hostedtoolcache/go/1.25.9.../src/os/exec.go:340
os/exec.(*Cmd).Wait(0xc00075e600)
	.../hostedtoolcache/go/1.25.9.../os/exec/exec.go:922 +0x45
github..../pkg/sandbox/fc.(*Process).configure.func1()
	.../sandbox/fc/process.go:258 +0xc5
created by github..../pkg/sandbox/fc.(*Process).configure in goroutine 65
	.../sandbox/fc/process.go:254 +0xa6a

goroutine 897 [select]:
github..../pkg/sandbox/fc.(*Process).startMetricsReader.func1()
	.../sandbox/fc/fc_metrics.go:133 +0x10b
created by github..../pkg/sandbox/fc.(*Process).startMetricsReader in goroutine 65
	.../sandbox/fc/fc_metrics.go:128 +0xf8

goroutine 850 [select]:
io.(*pipe).read(0xc000b17b00, {0xc000b8069a, 0x966, 0x5b?})
	.../hostedtoolcache/go/1.25.9.../src/io/pipe.go:57 +0xa5
io.(*PipeReader).Read(0xc000b8063e?, {0xc000b8069a?, 0x9c2?, 0x41f75b?})
	.../hostedtoolcache/go/1.25.9.../src/io/pipe.go:134 +0x1a
bufio.(*Scanner).Scan(0xc000599ee0)
	.../hostedtoolcache/go/1.25.9.../src/bufio/scan.go:219 +0x83e
github..../build/phases/base.(*BaseBuilder).provisionSandbox.func1()
	.../phases/base/provision.go:98 +0x13c
created by github..../build/phases/base.(*BaseBuilder).provisionSandbox in goroutine 65
	.../phases/base/provision.go:91 +0x53b

goroutine 823 [IO wait, 19 minutes]:
internal/poll.runtime_pollWait(0x7f1a941d8e00, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000727e60?, 0xc001200000?, 0x1)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000727e60, {0xc001200000, 0x8000, 0x8000})
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:165 +0x279
os.(*File).read(...)
	.../hostedtoolcache/go/1.25.9.../src/os/file_posix.go:29
os.(*File).Read(0xc006eea1c8, {0xc001200000?, 0x481b3f?, 0x8?})
	.../hostedtoolcache/go/1.25.9.../src/os/file.go:144 +0x4f
io.copyBuffer({0x2a2dae0, 0xc000c9a348}, {0x2a2d880, 0xc001028d28}, {0x0, 0x0, 0x0})
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:429 +0x190
io.Copy(...)
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:388
os.genericWriteTo(0xc006eea1c8?, {0x2a2dae0, 0xc000c9a348})
	.../hostedtoolcache/go/1.25.9.../src/os/file.go:295 +0x4f
os.(*File).WriteTo(0xc006eea1c8, {0x2a2dae0, 0xc000c9a348})
	.../hostedtoolcache/go/1.25.9.../src/os/file.go:273 +0x9c
io.copyBuffer({0x2a2dae0, 0xc000c9a348}, {0x2a2d900, 0xc006eea1c8}, {0x0, 0x0, 0x0})
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:411 +0x9d
io.Copy(...)
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:388
os/exec.(*Cmd).writerDescriptor.func1()
	.../hostedtoolcache/go/1.25.9.../os/exec/exec.go:596 +0x34
os/exec.(*Cmd).Start.func2(0xc000dac000?)
	.../hostedtoolcache/go/1.25.9.../os/exec/exec.go:749 +0x2c
created by os/exec.(*Cmd).Start in goroutine 65
	.../hostedtoolcache/go/1.25.9.../os/exec/exec.go:748 +0x935

goroutine 800 [chan receive]:
github.com/inetaf/tcpproxy.(*DialProxy).HandleConn(0xc0005a19b8, {0x2a7c010, 0xc00072e780})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:411 +0x465
github..../orchestrator/pkg/tcpfirewall.proxy({0x2a69660, 0xc0002c28c0}, {0x2a7c010, 0xc00072e780}, {0xc001010168, 0x11}, 0xc000e98180, {0x268ae20, 0x4})
	.../pkg/tcpfirewall/handlers.go:106 +0x167
github..../orchestrator/pkg/tcpfirewall.domainHandler({0x2a69660, 0xc0002c28c0}, {0x2a7c010, 0xc00072e780}, {0xc006484330, 0x10, 0x10}, 0x50, 0x269097c?, 0xc006eea080, ...)
	.../pkg/tcpfirewall/handlers.go:68 +0x597
github..../orchestrator/pkg/tcpfirewall.(*connectionHandler).HandleConn.func1({0x2a69660?, 0xc0002c28c0?}, {0x2a7c010?, 0xc00072e780?}, {0xc006484330?, 0x25df220?, 0xc000ad2cc8?}, 0xc000ad2ce0?, 0x7da065?, 0xc006eea080, ...)
	.../pkg/tcpfirewall/proxy.go:269 +0xe3
github..../orchestrator/pkg/tcpfirewall.(*connectionHandler).HandleConn(0xc0009ec000, {0x2a7c010, 0xc00072e780})
	.../pkg/tcpfirewall/proxy.go:272 +0x8c3
github.com/inetaf/tcpproxy.(*Proxy).serveConn(0x1baa9b0?, {0x2a7bfb8, 0xc000e00040}, {0xc000796020, 0x2, 0xc006eea060?})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:237 +0x308
created by github.com/inetaf/tcpproxy.(*Proxy).serveListener in goroutine 146
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:219 +0x65

goroutine 933 [select]:
net/http.(*persistConn).writeLoop(0xc001040b40)
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2600 +0xe7
created by net/http.(*Transport).dialConn in goroutine 931
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:1948 +0x17a5

goroutine 932 [IO wait]:
internal/poll.runtime_pollWait(0x7f1a941f6400, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc00101ad80?, 0xc00130e000?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00101ad80, {0xc00130e000, 0x1000, 0x1000})
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:165 +0x279
net.(*netFD).Read(0xc00101ad80, {0xc00130e000?, 0x40c554?, 0x0?})
	.../hostedtoolcache/go/1.25.9.../src/net/fd_posix.go:68 +0x25
net.(*conn).Read(0xc006eea210, {0xc00130e000?, 0x40c345?, 0xc000b0da70?})
	.../hostedtoolcache/go/1.25.9.../src/net/net.go:196 +0x45
net/http.(*persistConn).Read(0xc001040b40, {0xc00130e000?, 0x7f9c05?, 0x2a2d920?})
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc000e94ba0)
	.../hostedtoolcache/go/1.25.9.../src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc000e94ba0, 0x1)
	.../hostedtoolcache/go/1.25.9.../src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc001040b40)
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 931
	.../hostedtoolcache/go/1.25.9.../net/http/transport.go:1947 +0x174f

goroutine 1062 [select]:
net.(*netFD).connect.func2()
	.../hostedtoolcache/go/1.25.9.../src/net/fd_unix.go:107 +0x7a
created by net.(*netFD).connect in goroutine 1048
	.../hostedtoolcache/go/1.25.9.../src/net/fd_unix.go:106 +0x345

goroutine 821 [select]:
github..../orchestrator/pkg/sandbox.(*HostStatsCollector).Start(0xc00075e780, {0x2a695f0, 0xc0006683c0})
	.../pkg/sandbox/hoststats_collector.go:152 +0x51d
created by github..../orchestrator/pkg/sandbox.initializeHostStatsCollector in goroutine 65
	.../pkg/sandbox/hoststats.go:48 +0x525

goroutine 822 [IO wait]:
internal/poll.runtime_pollWait(0x7f1a941d8c00, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000727da0?, 0xc0011ae000?, 0x1)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000727da0, {0xc0011ae000, 0x8000, 0x8000})
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:165 +0x279
os.(*File).read(...)
	.../hostedtoolcache/go/1.25.9.../src/os/file_posix.go:29
os.(*File).Read(0xc006eea1b0, {0xc0011ae000?, 0x7e?, 0x8?})
	.../hostedtoolcache/go/1.25.9.../src/os/file.go:144 +0x4f
io.copyBuffer({0x2a2ec40, 0xc000c9a330}, {0x2a2d880, 0xc001028d20}, {0x0, 0x0, 0x0})
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:429 +0x190
io.Copy(...)
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:388
os.genericWriteTo(0xc006eea1b0?, {0x2a2ec40, 0xc000c9a330})
	.../hostedtoolcache/go/1.25.9.../src/os/file.go:295 +0x4f
os.(*File).WriteTo(0xc006eea1b0, {0x2a2ec40, 0xc000c9a330})
	.../hostedtoolcache/go/1.25.9.../src/os/file.go:273 +0x9c
io.copyBuffer({0x2a2ec40, 0xc000c9a330}, {0x2a2d900, 0xc006eea1b0}, {0x0, 0x0, 0x0})
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:411 +0x9d
io.Copy(...)
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:388
os/exec.(*Cmd).writerDescriptor.func1()
	.../hostedtoolcache/go/1.25.9.../os/exec/exec.go:596 +0x34
os/exec.(*Cmd).Start.func2(0xc000785650?)
	.../hostedtoolcache/go/1.25.9.../os/exec/exec.go:749 +0x2c
created by os/exec.(*Cmd).Start in goroutine 65
	.../hostedtoolcache/go/1.25.9.../os/exec/exec.go:748 +0x935

goroutine 900 [chan receive, 19 minutes]:
github..../pkg/sandbox/fc.(*Process).startMetricsReader.func2.1()
	.../sandbox/fc/fc_metrics.go:178 +0x30
created by github..../pkg/sandbox/fc.(*Process).startMetricsReader.func2 in goroutine 930
	.../sandbox/fc/fc_metrics.go:177 +0x649

goroutine 930 [IO wait]:
internal/poll.runtime_pollWait(0x7f1a941d8400, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000dc44e0?, 0xc001442dba?, 0x1)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000dc44e0, {0xc001442dba, 0xbd246, 0xbd246})
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_unix.go:165 +0x279
os.(*File).read(...)
	.../hostedtoolcache/go/1.25.9.../src/os/file_posix.go:29
os.(*File).Read(0xc001028d58, {0xc001442dba?, 0xc001605cf8?, 0x41fab4?})
	.../hostedtoolcache/go/1.25.9.../src/os/file.go:144 +0x4f
bufio.(*Scanner).Scan(0xc001605f28)
	.../hostedtoolcache/go/1.25.9.../src/bufio/scan.go:219 +0x83e
github..../pkg/sandbox/fc.(*Process).startMetricsReader.func2()
	.../sandbox/fc/fc_metrics.go:185 +0x70c
created by github..../pkg/sandbox/fc.(*Process).startMetricsReader in goroutine 65
	.../sandbox/fc/fc_metrics.go:147 +0x189

goroutine 934 [chan receive, 19 minutes]:
github..../shared/pkg/utils.(*SetOnce[...]).Wait(...)
	.../pkg/utils/set_once.go:83
github..../shared/pkg/utils.(*ErrorOnce).Wait(0x516d66?)
	.../pkg/utils/error_once.go:33 +0x25
github..../orchestrator/pkg/sandbox.(*Factory).CreateSandbox.func6()
	.../pkg/sandbox/sandbox.go:527 +0x10d
created by github..../orchestrator/pkg/sandbox.(*Factory).CreateSandbox in goroutine 65
	.../pkg/sandbox/sandbox.go:520 +0x1f13

goroutine 801 [IO wait]:
internal/poll.runtime_pollWait(0x7f1adf049e00, 0x72)
	.../hostedtoolcache/go/1.25.9.../src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000132980?, 0xc000588b01?, 0x0)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	.../hostedtoolcache/go/1.25.9.../internal/poll/fd_poll_runtime.go:89
internal/poll.spliceDrain(0x2e, 0xc000132980, 0x100000)
	.../hostedtoolcache/go/1.25.9.../internal/poll/splice_linux.go:107 +0x219
internal/poll.Splice(0xc00101a200, 0xc000132980, 0x7fffffffffffffff)
	.../hostedtoolcache/go/1.25.9.../internal/poll/splice_linux.go:45 +0x12d
net.spliceFrom(0xc000e94000?, {0x2a2f7e0?, 0xc006eea090?})
	.../hostedtoolcache/go/1.25.9.../src/net/splice_linux.go:44 +0x126
net.(*TCPConn).readFrom(0xc000e00040, {0x2a2f7e0, 0xc006eea090})
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:48 +0x25
net.(*TCPConn).ReadFrom(0xc000e00040, {0x2a2f7e0?, 0xc006eea090?})
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock.go:165 +0x30
io.copyBuffer({0x7f1a9418a488, 0xc000e00040}, {0x2a2f7e0, 0xc006eea090}, {0x0, 0x0, 0x0})
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:415 +0x151
io.Copy(...)
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:388
net.genericWriteTo(0x7f1a9418a488?, {0x7f1a9418a488, 0xc000e00040})
	.../hostedtoolcache/go/1.25.9.../src/net/net.go:796 +0x4f
net.(*TCPConn).writeTo(0xc000e00048, {0x7f1a9418a488, 0xc000e00040})
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock_posix.go:61 +0x4d
net.(*TCPConn).WriteTo(0xc000e00048, {0x7f1a9418a488?, 0xc000e00040?})
	.../hostedtoolcache/go/1.25.9.../src/net/tcpsock.go:177 +0x30
io.copyBuffer({0x7f1a9418a488, 0xc000e00040}, {0x2a2f7c0, 0xc000e00048}, {0x0, 0x0, 0x0})
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:411 +0x9d
io.Copy(...)
	.../hostedtoolcache/go/1.25.9.../src/io/io.go:388
github.com/inetaf/tcpproxy.proxyCopy(0xc0002ec1c0, {0x2a7c010?, 0xc00072e780?}, {0x2a7bfb8?, 0xc000e00048?})
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:464 +0x27b
created by github.com/inetaf/tcpproxy.(*DialProxy).HandleConn in goroutine 800
	.../pkg/mod/github.com/inetaf/tcpproxy@v0.0.0-20250222171855-c4b9df066048/tcpproxy.go:408 +0x3c8
FAIL	github..../orchestrator/cmd/smoketest	1200.027s
github.com/e2b-dev/infra/packages/orchestrator/cmd/smoketest::TestSmokeAllFCVersions

Flake rate in main: 100.00% (Passed 0 times, Failed 1 times)

Stack Traces | 0s run time
=== RUN   TestSmokeAllFCVersions
    smoke_test.go:57: building envd from .../infra/packages/envd
    smoke_test.go:57: built envd: .../infra/packages/envd/bin/envd
    smoke_test.go:62: downloading https://storage.googleapis..../e2b-prod-public-builds/kernels/vmlinux-6.1.158/vmlinux.bin
    smoke_test.go:64: downloading https://github..../releases/download/v1.10.1_30cbb07/firecracker
    smoke_test.go:64: downloading https://github..../releases/download/v1.12.1_210cbac/firecracker-amd64
    smoke_test.go:64: downloading https://github..../releases/download/v1.14.1_458ca91/firecracker-amd64
=== RUN   TestSmokeAllFCVersions/fc-v1.10
    smoke_test.go:78: creating build 6ef3de39-3db2-45f3-9f92-c5244acab1a2 with FC v1.10.1_30cbb07
->> [stderr] mke2fs 1.47.0 (5-Feb-2023)
->> [stdout] Creating regular file .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build
->> [stdout] 64-bit filesystem support is not enabled.  The larger fields afforded by this feature enable full-strength checksumming.  Pass -O 64bit to rectify.
->> [stdout] Creating filesystem with 6400000 4k blocks and 6400576 inodes
->> [stdout] Filesystem UUID: 60b1fea9-4339-4983-8114-de492c874b16
Superblock backups stored on blocks:
->> [stdout] 32768, 6389760
->> [stdout] 
->> [stdout] Allocating group tables:
->> [stdout] 0/196
->> [stdout] �������
->> [stdout] �������done
->> [stdout] Writing inode tables:   0/196�������
->> [stdout] �������done
->> [stdout] Creating journal (32768 blocks):
->> [stdout] done
->> [stdout] Writing superblocks and filesystem accounting information:
->> [stdout] 0/196
->> [stdout] �������
->> [stdout] 
->> [stdout] �������
->> [stdout] done
->> [stderr] resize2fs 1.47.0 (5-Feb-2023)
->> [stdout] Resizing the filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build to 131072 (4k) blocks.
The filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build is now 131072 (4k) blocks long.
->> [stdout] tune2fs 1.47.0 (5-Feb-2023)
->> [stderr] resize2fs 1.47.0 (5-Feb-2023)
->> [stdout] Resizing the filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build to 202240 (4k) blocks.
The filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build is now 202240 (4k) blocks long.
2026/05/04 18:56:02 tcpproxy: for incoming conn 10.11.0.2:49292, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 18:56:32 tcpproxy: for incoming conn 10.11.0.2:58270, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 18:56:37 tcpproxy: for incoming conn 10.11.0.2:36334, error dialing "91.189.91.81:80": dial tcp 91.189.91.81:80: i/o timeout
2026/05/04 18:57:37 tcpproxy: for incoming conn 10.11.0.2:49324, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 18:58:07 tcpproxy: for incoming conn 10.11.0.2:44526, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 18:59:37 tcpproxy: for incoming conn 10.11.0.2:57656, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:00:07 tcpproxy: for incoming conn 10.11.0.2:35952, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:00:37 tcpproxy: for incoming conn 10.11.0.2:39860, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:01:37 tcpproxy: for incoming conn 10.11.0.2:49612, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:02:07 tcpproxy: for incoming conn 10.11.0.2:42042, error dialing "91.189.91.82:80": dial tcp 91.189.91.82:80: i/o timeout
2026/05/04 19:02:37 tcpproxy: for incoming conn 10.11.0.2:55214, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:03:07 tcpproxy: for incoming conn 10.11.0.2:57730, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:03:37 tcpproxy: for incoming conn 10.11.0.2:43034, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:04:07 tcpproxy: for incoming conn 10.11.0.2:59836, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 19:04:37 tcpproxy: for incoming conn 10.11.0.2:56134, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 19:05:37 tcpproxy: for incoming conn 10.11.0.2:44902, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 19:06:37 tcpproxy: for incoming conn 10.11.0.2:43068, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:07:07 tcpproxy: for incoming conn 10.11.0.2:45860, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:07:37 tcpproxy: for incoming conn 10.11.0.2:46938, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:08:07 tcpproxy: for incoming conn 10.11.0.2:57520, error dialing "91.189.91.82:80": dial tcp 91.189.91.82:80: i/o timeout
2026/05/04 19:09:11 tcpproxy: for incoming conn 10.11.0.2:35684, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:10:11 tcpproxy: for incoming conn 10.11.0.2:59420, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:12:11 tcpproxy: for incoming conn 10.11.0.2:50424, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:13:11 tcpproxy: for incoming conn 10.11.0.2:40236, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:14:57 tcpproxy: for incoming conn 10.11.0.2:57720, error dialing "185.125.190.81:80": dial tcp 185.125.190.81:80: i/o timeout
coverage: [no statements]
github.com/e2b-dev/infra/packages/orchestrator/cmd/smoketest::TestSmokeAllFCVersions/fc-v1.10

Flake rate in main: 100.00% (Passed 0 times, Failed 1 times)

Stack Traces | 0s run time
=== RUN   TestSmokeAllFCVersions/fc-v1.10
    smoke_test.go:78: creating build 6ef3de39-3db2-45f3-9f92-c5244acab1a2 with FC v1.10.1_30cbb07
->> [stderr] mke2fs 1.47.0 (5-Feb-2023)
->> [stdout] Creating regular file .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build
->> [stdout] 64-bit filesystem support is not enabled.  The larger fields afforded by this feature enable full-strength checksumming.  Pass -O 64bit to rectify.
->> [stdout] Creating filesystem with 6400000 4k blocks and 6400576 inodes
->> [stdout] Filesystem UUID: 60b1fea9-4339-4983-8114-de492c874b16
Superblock backups stored on blocks:
->> [stdout] 32768, 6389760
->> [stdout] 
->> [stdout] Allocating group tables:
->> [stdout] 0/196
->> [stdout] �������
->> [stdout] �������done
->> [stdout] Writing inode tables:   0/196�������
->> [stdout] �������done
->> [stdout] Creating journal (32768 blocks):
->> [stdout] done
->> [stdout] Writing superblocks and filesystem accounting information:
->> [stdout] 0/196
->> [stdout] �������
->> [stdout] 
->> [stdout] �������
->> [stdout] done
->> [stderr] resize2fs 1.47.0 (5-Feb-2023)
->> [stdout] Resizing the filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build to 131072 (4k) blocks.
The filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build is now 131072 (4k) blocks long.
->> [stdout] tune2fs 1.47.0 (5-Feb-2023)
->> [stderr] resize2fs 1.47.0 (5-Feb-2023)
->> [stdout] Resizing the filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build to 202240 (4k) blocks.
The filesystem on .../build-templates/5796df1c-9483-4269-a8d3-8d42b051709f/rootfs.filesystem.build is now 202240 (4k) blocks long.
2026/05/04 18:56:02 tcpproxy: for incoming conn 10.11.0.2:49292, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 18:56:32 tcpproxy: for incoming conn 10.11.0.2:58270, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 18:56:37 tcpproxy: for incoming conn 10.11.0.2:36334, error dialing "91.189.91.81:80": dial tcp 91.189.91.81:80: i/o timeout
2026/05/04 18:57:37 tcpproxy: for incoming conn 10.11.0.2:49324, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 18:58:07 tcpproxy: for incoming conn 10.11.0.2:44526, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 18:59:37 tcpproxy: for incoming conn 10.11.0.2:57656, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:00:07 tcpproxy: for incoming conn 10.11.0.2:35952, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:00:37 tcpproxy: for incoming conn 10.11.0.2:39860, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:01:37 tcpproxy: for incoming conn 10.11.0.2:49612, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:02:07 tcpproxy: for incoming conn 10.11.0.2:42042, error dialing "91.189.91.82:80": dial tcp 91.189.91.82:80: i/o timeout
2026/05/04 19:02:37 tcpproxy: for incoming conn 10.11.0.2:55214, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:03:07 tcpproxy: for incoming conn 10.11.0.2:57730, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:03:37 tcpproxy: for incoming conn 10.11.0.2:43034, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:04:07 tcpproxy: for incoming conn 10.11.0.2:59836, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 19:04:37 tcpproxy: for incoming conn 10.11.0.2:56134, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 19:05:37 tcpproxy: for incoming conn 10.11.0.2:44902, error dialing "91.189.92.24:80": dial tcp 91.189.92.24:80: i/o timeout
2026/05/04 19:06:37 tcpproxy: for incoming conn 10.11.0.2:43068, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:07:07 tcpproxy: for incoming conn 10.11.0.2:45860, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:07:37 tcpproxy: for incoming conn 10.11.0.2:46938, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:08:07 tcpproxy: for incoming conn 10.11.0.2:57520, error dialing "91.189.91.82:80": dial tcp 91.189.91.82:80: i/o timeout
2026/05/04 19:09:11 tcpproxy: for incoming conn 10.11.0.2:35684, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:10:11 tcpproxy: for incoming conn 10.11.0.2:59420, error dialing "91.189.92.23:80": dial tcp 91.189.92.23:80: i/o timeout
2026/05/04 19:12:11 tcpproxy: for incoming conn 10.11.0.2:50424, error dialing "185.125.190.82:80": dial tcp 185.125.190.82:80: i/o timeout
2026/05/04 19:13:11 tcpproxy: for incoming conn 10.11.0.2:40236, error dialing "185.125.190.83:80": dial tcp 185.125.190.83:80: i/o timeout
2026/05/04 19:14:57 tcpproxy: for incoming conn 10.11.0.2:57720, error dialing "185.125.190.81:80": dial tcp 185.125.190.81:80: i/o timeout
coverage: [no statements]
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowAll

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowAll
=== PAUSE TestEgressFirewallAllowAll
=== CONT  TestEgressFirewallAllowAll
    sandbox_network_out_test.go:303: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowAll (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowAllDomainsWildcard

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowAllDomainsWildcard
=== PAUSE TestEgressFirewallAllowAllDomainsWildcard
=== CONT  TestEgressFirewallAllowAllDomainsWildcard
    sandbox_network_out_test.go:601: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowAllDomainsWildcard (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowAllDuplicate

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 301s run time
=== RUN   TestEgressFirewallAllowAllDuplicate
=== PAUSE TestEgressFirewallAllowAllDuplicate
=== CONT  TestEgressFirewallAllowAllDuplicate
    sandbox_network_out_test.go:30: Building custom template for network egress tests...
    template.go:44: network-egress-test: [info] Building template mroiihmzh2bku2wm8ptv/f4fb2b13-3686-4775-930a-41490bbb7dd4
    template.go:44: network-egress-test: [info] [base] FROM ubuntu:22.04 [ffd709f131f42dfab282de47a91dd2c139e900c1c11fc574b49b517a05ef0a32]
    template.go:44: network-egress-test: [info] Base Docker image size: 30 MB
    template.go:44: network-egress-test: [info] Creating file system and pulling Docker image
    template.go:44: network-egress-test: [info] Uncompressing layer sha256:f63eb04151bcac21ad049f8d781b97b219aba392c5457907f8f3e88e43eb48ec 30 MB
    template.go:44: network-egress-test: [info] Uncompressing layer sha256:e259c7030f7b45efadb4729482d5823361d9fdddbde944a5e12140598259cfd8 12 MB
    template.go:44: network-egress-test: [info] Uncompressing layer sha256:8c4b1b28875140ed3abacaf16ad0d696f6bef912f52d2148f261a23e3349465b 168 B
    template.go:44: network-egress-test: [info] Layers extracted
    template.go:44: network-egress-test: [info] Root filesystem structure: bin, boot, dev, etc, home, lib, lib32, lib64, libx32, media, mnt, opt, proc, root, run, sbin, srv, sys, tmp, usr, var
    template.go:44: network-egress-test: [info] Provisioning sandbox template
    sandbox_network_out_test.go:32: Build timeout exceeded
--- FAIL: TestEgressFirewallAllowAllDuplicate (300.75s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowAndBlockCombination

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowAndBlockCombination
=== PAUSE TestEgressFirewallAllowAndBlockCombination
=== CONT  TestEgressFirewallAllowAndBlockCombination
    sandbox_network_out_test.go:211: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowAndBlockCombination (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowCIDRRange

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 295s run time
=== RUN   TestEgressFirewallAllowCIDRRange
=== PAUSE TestEgressFirewallAllowCIDRRange
=== CONT  TestEgressFirewallAllowCIDRRange
    sandbox_network_out_test.go:161: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowCIDRRange (295.17s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowDomainAndIP

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowDomainAndIP
=== PAUSE TestEgressFirewallAllowDomainAndIP
=== CONT  TestEgressFirewallAllowDomainAndIP
    sandbox_network_out_test.go:654: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowDomainAndIP (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowDomainThroughBlockedInternet

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowDomainThroughBlockedInternet
=== PAUSE TestEgressFirewallAllowDomainThroughBlockedInternet
=== CONT  TestEgressFirewallAllowDomainThroughBlockedInternet
    sandbox_network_out_test.go:522: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowDomainThroughBlockedInternet (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowOverridesBlock

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowOverridesBlock
=== PAUSE TestEgressFirewallAllowOverridesBlock
=== CONT  TestEgressFirewallAllowOverridesBlock
    sandbox_network_out_test.go:328: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowOverridesBlock (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowSpecificIP

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowSpecificIP
=== PAUSE TestEgressFirewallAllowSpecificIP
=== CONT  TestEgressFirewallAllowSpecificIP
    sandbox_network_out_test.go:110: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowSpecificIP (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallAllowWildcardDomainThroughBlockedInternet

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallAllowWildcardDomainThroughBlockedInternet
=== PAUSE TestEgressFirewallAllowWildcardDomainThroughBlockedInternet
=== CONT  TestEgressFirewallAllowWildcardDomainThroughBlockedInternet
    sandbox_network_out_test.go:548: Network test template was not built successfully
--- FAIL: TestEgressFirewallAllowWildcardDomainThroughBlockedInternet (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallBlockCIDRRange

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallBlockCIDRRange
=== PAUSE TestEgressFirewallBlockCIDRRange
=== CONT  TestEgressFirewallBlockCIDRRange
    sandbox_network_out_test.go:186: Network test template was not built successfully
--- FAIL: TestEgressFirewallBlockCIDRRange (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallBlockSpecificIP

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallBlockSpecificIP
=== PAUSE TestEgressFirewallBlockSpecificIP
=== CONT  TestEgressFirewallBlockSpecificIP
    sandbox_network_out_test.go:136: Network test template was not built successfully
--- FAIL: TestEgressFirewallBlockSpecificIP (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallDNSSpoofingNeutralized

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallDNSSpoofingNeutralized
=== PAUSE TestEgressFirewallDNSSpoofingNeutralized
=== CONT  TestEgressFirewallDNSSpoofingNeutralized
    sandbox_network_out_test.go:846: Network test template was not built successfully
--- FAIL: TestEgressFirewallDNSSpoofingNeutralized (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallDomainCaseInsensitive

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallDomainCaseInsensitive
=== PAUSE TestEgressFirewallDomainCaseInsensitive
=== CONT  TestEgressFirewallDomainCaseInsensitive
    sandbox_network_out_test.go:628: Network test template was not built successfully
--- FAIL: TestEgressFirewallDomainCaseInsensitive (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallDomainPersistsAfterResume

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallDomainPersistsAfterResume
=== PAUSE TestEgressFirewallDomainPersistsAfterResume
=== CONT  TestEgressFirewallDomainPersistsAfterResume
    sandbox_network_out_test.go:710: Network test template was not built successfully
--- FAIL: TestEgressFirewallDomainPersistsAfterResume (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallEmptyConfig

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 294s run time
=== RUN   TestEgressFirewallEmptyConfig
=== PAUSE TestEgressFirewallEmptyConfig
=== CONT  TestEgressFirewallEmptyConfig
    sandbox_network_out_test.go:280: Network test template was not built successfully
--- FAIL: TestEgressFirewallEmptyConfig (294.35s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallExactDomainMatchVsSubdomain

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallExactDomainMatchVsSubdomain
=== PAUSE TestEgressFirewallExactDomainMatchVsSubdomain
=== CONT  TestEgressFirewallExactDomainMatchVsSubdomain
    sandbox_network_out_test.go:575: Network test template was not built successfully
--- FAIL: TestEgressFirewallExactDomainMatchVsSubdomain (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallHTTPDomainFiltering

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallHTTPDomainFiltering
=== PAUSE TestEgressFirewallHTTPDomainFiltering
=== CONT  TestEgressFirewallHTTPDomainFiltering
    sandbox_network_out_test.go:758: Network test template was not built successfully
--- FAIL: TestEgressFirewallHTTPDomainFiltering (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallHTTPSByIPNoHostname

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallHTTPSByIPNoHostname
=== PAUSE TestEgressFirewallHTTPSByIPNoHostname
=== CONT  TestEgressFirewallHTTPSByIPNoHostname
    sandbox_network_out_test.go:683: Network test template was not built successfully
--- FAIL: TestEgressFirewallHTTPSByIPNoHostname (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallMultipleAllowedIPs

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallMultipleAllowedIPs
=== PAUSE TestEgressFirewallMultipleAllowedIPs
=== CONT  TestEgressFirewallMultipleAllowedIPs
    sandbox_network_out_test.go:354: Network test template was not built successfully
--- FAIL: TestEgressFirewallMultipleAllowedIPs (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallPersistsAfterResume

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 293s run time
=== RUN   TestEgressFirewallPersistsAfterResume
=== PAUSE TestEgressFirewallPersistsAfterResume
=== CONT  TestEgressFirewallPersistsAfterResume
    sandbox_network_out_test.go:237: Network test template was not built successfully
--- FAIL: TestEgressFirewallPersistsAfterResume (292.99s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallPrivateIPRangesAlwaysBlocked

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallPrivateIPRangesAlwaysBlocked
=== PAUSE TestEgressFirewallPrivateIPRangesAlwaysBlocked
=== CONT  TestEgressFirewallPrivateIPRangesAlwaysBlocked
    sandbox_network_out_test.go:410: Network test template was not built successfully
--- FAIL: TestEgressFirewallPrivateIPRangesAlwaysBlocked (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallRegularIPThenAllowAll

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallRegularIPThenAllowAll
=== PAUSE TestEgressFirewallRegularIPThenAllowAll
=== CONT  TestEgressFirewallRegularIPThenAllowAll
    sandbox_network_out_test.go:496: Network test template was not built successfully
--- FAIL: TestEgressFirewallRegularIPThenAllowAll (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallUDPAllowedCIDR

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallUDPAllowedCIDR
=== PAUSE TestEgressFirewallUDPAllowedCIDR
=== CONT  TestEgressFirewallUDPAllowedCIDR
    sandbox_network_out_test.go:814: Network test template was not built successfully
--- FAIL: TestEgressFirewallUDPAllowedCIDR (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallUDPAllowedIP

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallUDPAllowedIP
=== PAUSE TestEgressFirewallUDPAllowedIP
=== CONT  TestEgressFirewallUDPAllowedIP
    sandbox_network_out_test.go:788: Network test template was not built successfully
--- FAIL: TestEgressFirewallUDPAllowedIP (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestEgressFirewallWithInternetAccessFalse

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestEgressFirewallWithInternetAccessFalse
=== PAUSE TestEgressFirewallWithInternetAccessFalse
=== CONT  TestEgressFirewallWithInternetAccessFalse
    sandbox_network_out_test.go:381: Network test template was not built successfully
--- FAIL: TestEgressFirewallWithInternetAccessFalse (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestGPGKeyserverWorks

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestGPGKeyserverWorks
=== PAUSE TestGPGKeyserverWorks
=== CONT  TestGPGKeyserverWorks
    sandbox_network_out_test.go:978: Network test template was not built successfully
--- FAIL: TestGPGKeyserverWorks (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestNoNetworkConfig_SSHWorks

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestNoNetworkConfig_SSHWorks
=== PAUSE TestNoNetworkConfig_SSHWorks
=== CONT  TestNoNetworkConfig_SSHWorks
    sandbox_network_out_test.go:900: Network test template was not built successfully
--- FAIL: TestNoNetworkConfig_SSHWorks (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestUpdateNetworkConfig

Flake rate in main: 58.33% (Passed 5 times, Failed 7 times)

Stack Traces | 0s run time
=== RUN   TestUpdateNetworkConfig
=== PAUSE TestUpdateNetworkConfig
=== CONT  TestUpdateNetworkConfig
    sandbox_network_update_test.go:70: Network test template was not built successfully
--- FAIL: TestUpdateNetworkConfig (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/sandboxes::TestWithNetworkConfig_SSHWorks

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestWithNetworkConfig_SSHWorks
=== PAUSE TestWithNetworkConfig_SSHWorks
=== CONT  TestWithNetworkConfig_SSHWorks
    sandbox_network_out_test.go:935: Network test template was not built successfully
--- FAIL: TestWithNetworkConfig_SSHWorks (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestAssignmentOrderingAfterTagReassignment

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestAssignmentOrderingAfterTagReassignment
=== PAUSE TestAssignmentOrderingAfterTagReassignment
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestAssignmentOrderingLatestWins

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestAssignmentOrderingLatestWins
=== PAUSE TestAssignmentOrderingLatestWins
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestDeleteTemplate

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestDeleteTemplate
=== PAUSE TestDeleteTemplate
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestDeleteTemplateFromAnotherTeamAPIKey

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestDeleteTemplateFromAnotherTeamAPIKey
=== PAUSE TestDeleteTemplateFromAnotherTeamAPIKey
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestDeleteTemplateFromAnotherTeamAccessToken

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestDeleteTemplateFromAnotherTeamAccessToken
=== PAUSE TestDeleteTemplateFromAnotherTeamAccessToken
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestDeleteTemplateWithAccessToken

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestDeleteTemplateWithAccessToken
=== PAUSE TestDeleteTemplateWithAccessToken
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestInvalidBuildStatus

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestInvalidBuildStatus
=== PAUSE TestInvalidBuildStatus
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestMultipleTagsOnSameTemplate

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 301s run time
=== RUN   TestMultipleTagsOnSameTemplate
=== PAUSE TestMultipleTagsOnSameTemplate
=== CONT  TestMultipleTagsOnSameTemplate
    template_tags_test.go:286: Build timeout exceeded
--- FAIL: TestMultipleTagsOnSameTemplate (300.71s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestRequestTemplateBuild

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestRequestTemplateBuild
=== PAUSE TestRequestTemplateBuild
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestRequestTemplateMemoryNonDivisibleBy2

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestRequestTemplateMemoryNonDivisibleBy2
=== PAUSE TestRequestTemplateMemoryNonDivisibleBy2
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestRequestTemplateOddCPU

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestRequestTemplateOddCPU
=== PAUSE TestRequestTemplateOddCPU
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestRequestTemplateTooHighCPU

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestRequestTemplateTooHighCPU
=== PAUSE TestRequestTemplateTooHighCPU
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestRequestTemplateTooHighMemory

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestRequestTemplateTooHighMemory
=== PAUSE TestRequestTemplateTooHighMemory
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestRequestTemplateTooLowCPU

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestRequestTemplateTooLowCPU
=== PAUSE TestRequestTemplateTooLowCPU
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestRequestTemplateTooLowRAM

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestRequestTemplateTooLowRAM
=== PAUSE TestRequestTemplateTooLowRAM
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestSandboxCreateWithAliasAndTag

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 301s run time
=== RUN   TestSandboxCreateWithAliasAndTag
=== PAUSE TestSandboxCreateWithAliasAndTag
=== CONT  TestSandboxCreateWithAliasAndTag
    template_tags_test.go:208: Build timeout exceeded
--- FAIL: TestSandboxCreateWithAliasAndTag (300.68s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestSandboxCreateWithTag

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 300s run time
=== RUN   TestSandboxCreateWithTag
=== PAUSE TestSandboxCreateWithTag
=== CONT  TestSandboxCreateWithTag
    template_tags_test.go:116: Build timeout exceeded
--- FAIL: TestSandboxCreateWithTag (300.02s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTagReassignment

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTagReassignment
=== PAUSE TestTagReassignment
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildCOPY

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildCOPY
=== PAUSE TestTemplateBuildCOPY
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildCache

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildCache
=== PAUSE TestTemplateBuildCache
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildENV

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildENV
=== PAUSE TestTemplateBuildENV
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildFromTemplate

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildFromTemplate
=== PAUSE TestTemplateBuildFromTemplate
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildFromTemplateBaseCommandsInheritance

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildFromTemplateBaseCommandsInheritance
=== PAUSE TestTemplateBuildFromTemplateBaseCommandsInheritance
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildFromTemplateCommandOverride

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildFromTemplateCommandOverride
=== PAUSE TestTemplateBuildFromTemplateCommandOverride
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildFromTemplateInheritance

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildFromTemplateInheritance
=== PAUSE TestTemplateBuildFromTemplateInheritance
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildFromTemplateLayered

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildFromTemplateLayered
=== PAUSE TestTemplateBuildFromTemplateLayered
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildFromTemplateStartCommand

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildFromTemplateStartCommand
=== PAUSE TestTemplateBuildFromTemplateStartCommand
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildFuseConfiguration

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildFuseConfiguration
=== PAUSE TestTemplateBuildFuseConfiguration
=== CONT  TestTemplateBuildFuseConfiguration
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Building template nl5r0vuym3r7a1xx2xys/fb766469-bac1-4a29-9159-aec07f250594
    build_template_test.go:134: test-ubuntu-fuse-config: [info] [base] FROM ubuntu:22.04 [ffd709f131f42dfab282de47a91dd2c139e900c1c11fc574b49b517a05ef0a32]
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Base Docker image size: 30 MB
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Creating file system and pulling Docker image
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Uncompressing layer sha256:f63eb04151bcac21ad049f8d781b97b219aba392c5457907f8f3e88e43eb48ec 30 MB
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Uncompressing layer sha256:e259c7030f7b45efadb4729482d5823361d9fdddbde944a5e12140598259cfd8 12 MB
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Uncompressing layer sha256:8c4b1b28875140ed3abacaf16ad0d696f6bef912f52d2148f261a23e3349465b 168 B
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Layers extracted
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Root filesystem structure: bin, boot, dev, etc, home, lib, lib32, lib64, libx32, media, mnt, opt, proc, root, run, sbin, srv, sys, tmp, usr, var
    build_template_test.go:134: test-ubuntu-fuse-config: [info] Provisioning sandbox template
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildInstalledPackagesAvailable

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildInstalledPackagesAvailable
=== PAUSE TestTemplateBuildInstalledPackagesAvailable
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildRUN

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildRUN
=== PAUSE TestTemplateBuildRUN
=== CONT  TestTemplateBuildRUN
--- FAIL: TestTemplateBuildRUN (0.00s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildRUN/Single_RUN_command

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 301s run time
=== RUN   TestTemplateBuildRUN/Single_RUN_command
=== PAUSE TestTemplateBuildRUN/Single_RUN_command
=== CONT  TestTemplateBuildRUN/Single_RUN_command
    build_template_test.go:134: test-ubuntu-run: [info] Building template iwc1h3ij2qy3ujk2875i/54624d7a-4a77-46ba-92a5-c40d4c3ab177
    build_template_test.go:134: test-ubuntu-run: [info] [base] FROM ubuntu:22.04 [ffd709f131f42dfab282de47a91dd2c139e900c1c11fc574b49b517a05ef0a32]
    build_template_test.go:134: test-ubuntu-run: [info] Base Docker image size: 30 MB
    build_template_test.go:134: test-ubuntu-run: [info] Creating file system and pulling Docker image
    build_template_test.go:134: test-ubuntu-run: [info] Uncompressing layer sha256:f63eb04151bcac21ad049f8d781b97b219aba392c5457907f8f3e88e43eb48ec 30 MB
    build_template_test.go:134: test-ubuntu-run: [info] Uncompressing layer sha256:e259c7030f7b45efadb4729482d5823361d9fdddbde944a5e12140598259cfd8 12 MB
    build_template_test.go:134: test-ubuntu-run: [info] Uncompressing layer sha256:8c4b1b28875140ed3abacaf16ad0d696f6bef912f52d2148f261a23e3349465b 168 B
    build_template_test.go:134: test-ubuntu-run: [info] Layers extracted
    build_template_test.go:134: test-ubuntu-run: [info] Root filesystem structure: bin, boot, dev, etc, home, lib, lib32, lib64, libx32, media, mnt, opt, proc, root, run, sbin, srv, sys, tmp, usr, var
    build_template_test.go:134: test-ubuntu-run: [info] Provisioning sandbox template
    build_template_test.go:167: 
        	Error Trace:	.../api/templates/build_template_test.go:97
        	            				.../api/templates/build_template_test.go:167
        	Error:      	Received unexpected error:
        	            	Get "http://localhost:.../builds/54624d7a-4a77-46ba-92a5-c40d4c3ab177/status?level=info&logsOffset=10": context deadline exceeded
        	Test:       	TestTemplateBuildRUN/Single_RUN_command
--- FAIL: TestTemplateBuildRUN/Single_RUN_command (300.71s)
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildStartReadyCommandExecution

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildStartReadyCommandExecution
=== PAUSE TestTemplateBuildStartReadyCommandExecution
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildWORKDIR

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildWORKDIR
=== PAUSE TestTemplateBuildWORKDIR
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildWithDifferentSourceImages

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildWithDifferentSourceImages
=== PAUSE TestTemplateBuildWithDifferentSourceImages
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildWithTagInAlias

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildWithTagInAlias
=== PAUSE TestTemplateBuildWithTagInAlias
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildWithTags

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildWithTags
=== PAUSE TestTemplateBuildWithTags
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateBuildWithTagsAndSandboxCreation

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateBuildWithTagsAndSandboxCreation
=== PAUSE TestTemplateBuildWithTagsAndSandboxCreation
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateTagAssign

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateTagAssign
=== PAUSE TestTemplateTagAssign
=== CONT  TestTemplateTagAssign
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateTagAssignFromSourceTag

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateTagAssignFromSourceTag
=== PAUSE TestTemplateTagAssignFromSourceTag
=== CONT  TestTemplateTagAssignFromSourceTag
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestTemplateTagDeleteLatestNotAllowed

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestTemplateTagDeleteLatestNotAllowed
=== PAUSE TestTemplateTagDeleteLatestNotAllowed
=== CONT  TestTemplateTagDeleteLatestNotAllowed
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestUpdateNonExistentTemplateWithAPIKey

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestUpdateNonExistentTemplateWithAPIKey
=== PAUSE TestUpdateNonExistentTemplateWithAPIKey
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestUpdateTemplateNotOwnedByTeam

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestUpdateTemplateNotOwnedByTeam
=== PAUSE TestUpdateTemplateNotOwnedByTeam
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestUpdateTemplateVisibilityToPrivateWithAPIKey

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestUpdateTemplateVisibilityToPrivateWithAPIKey
=== PAUSE TestUpdateTemplateVisibilityToPrivateWithAPIKey
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestUpdateTemplateVisibilityToPublicWithAPIKey

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestUpdateTemplateVisibilityToPublicWithAPIKey
=== PAUSE TestUpdateTemplateVisibilityToPublicWithAPIKey
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestUpdateTemplateWithInvalidAPIKey

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestUpdateTemplateWithInvalidAPIKey
=== PAUSE TestUpdateTemplateWithInvalidAPIKey
github.com/e2b-dev/infra/tests/integration/internal/tests/api/templates::TestUpdateTemplateWithSupabaseToken

Flake rate in main: 100.00% (Passed 0 times, Failed 2 times)

Stack Traces | 0s run time
=== RUN   TestUpdateTemplateWithSupabaseToken
=== PAUSE TestUpdateTemplateWithSupabaseToken

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants