Commit graph

261 commits

Author SHA1 Message Date
earl-warren
3450de64aa Merge pull request 'Update actions/setup-forgejo action to v2.0.4' (#396) from renovate/actions-setup-forgejo-2.x into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/396
Reviewed-by: earl-warren <earl-warren@noreply.code.forgejo.org>
2024-12-08 07:43:48 +00:00
Renovate Bot
0a782ec58f
Update actions/setup-forgejo action to v2.0.4 2024-12-08 00:01:21 +00:00
Michael Kriese
ec8c704034 Merge pull request 'fix: do not use api.github.com to avoid being rate limited' (#381) from earl-warren/end-to-end:wip-github into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/381
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-12-04 13:28:30 +00:00
Earl Warren
6ce90814b2
fix: do not use api.github.com to avoid being rate limited 2024-12-04 14:11:17 +01:00
earl-warren
b12130646b Merge pull request 'Update actions/setup-forgejo action to v2.0.3' (#372) from renovate/actions-setup-forgejo-2.x into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/372
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
Reviewed-by: earl-warren <earl-warren@noreply.code.forgejo.org>
2024-11-27 12:26:33 +00:00
Renovate Bot
bc7eb2f245
Update actions/setup-forgejo action to v2.0.3 2024-11-27 12:01:13 +00:00
Earl Warren
77e6412295
fix(actions): documentation update matrix needs prepare_dockerd
It runs all actions tests to collect artefacts relevant to the
documentation and has the same dependencies as running the actions
tests in a pull request.
2024-11-27 10:26:17 +00:00
earl-warren
acb860ef24 Merge pull request 'actions: runner [container].docker_host variations' (#370) from earl-warren/end-to-end:wip-actions-docker into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/370
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-11-27 09:55:35 +00:00
Earl Warren
33749f5a5e
actions: runner [container].docker_host variations
* automount
* "" or "-"
* unix:///var/run/docker.sock
* tcp://127.0.0.1:2375
2024-11-27 09:33:08 +00:00
earl-warren
801c760a4e Merge pull request 'Update actions/setup-go action to v5' (#365) from renovate/actions-setup-go-5.x into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/365
2024-11-21 13:31:03 +00:00
Renovate Bot
4f84eefa62
Update actions/setup-go action to v5 2024-11-21 13:01:22 +00:00
Michael Kriese
0cbcd6763f Merge pull request 'Configure Renovate' (#360) from renovate/configure into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/360
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
Reviewed-by: earl-warren <earl-warren@noreply.code.forgejo.org>
2024-11-21 07:37:23 +00:00
Renovate Bot
48f422b903
Add renovate.json 2024-11-21 07:32:07 +00:00
earl-warren
40906683a3 Merge pull request 'actions: fix: wait for the action logs to show up' (#337) from earl-warren/end-to-end:wip-compression into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/337
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-11-13 17:08:12 +00:00
Earl Warren
c4b3c61325
actions: fix: wait for the action logs to show up
The Forgejo instance completed the echo test successfully, there must
be a log at some point. But since Forgejo is still running, it may not
had time to write the logs just yet. Retry instead of giving up
immediately.
2024-11-12 15:40:12 +01:00
earl-warren
60e90f5bc0 Merge pull request 'actions: run echo and compression tests first' (#326) from earl-warren/end-to-end:wip-compression into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/326
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-11-11 08:24:49 +00:00
Earl Warren
8bf5b2c802
actions: run echo and compression tests first 2024-11-11 08:30:01 +01:00
earl-warren
a51b472fef Merge pull request 'fix: update the docs branches' (#322) from earl-warren/end-to-end:wip-docs into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/322
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-11-10 12:06:35 +00:00
Earl Warren
33f3e7eb65
fix: update the docs branches
Closes forgejo/end-to-end#188
2024-11-10 12:09:05 +01:00
earl-warren
946586b807 Merge pull request 'lib: retry longer to allow for slower machines' (#321) from earl-warren/end-to-end:wip-wait into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/321
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-11-10 08:29:18 +00:00
Earl Warren
aca70a3e54
lib: retry longer to allow for slower machines
The end-to-end tests moved to a slower machine recently. When the
daily releases are build, the end-to-end all run simultaneously and
slow down the machine to a point where it will take more than 30
seconds for a Forgejo instance to start.

Be more forgiving and let it retry for a minute.

https://code.forgejo.org/forgejo/end-to-end/actions/runs/1857/jobs/6
2024-11-10 08:37:44 +01:00
earl-warren
49e99f95d4 Merge pull request 'Set runner log level to Debug' (#303) from Kwonunn/end-to-end:runner-loglevel into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/303
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-10-28 14:47:56 +00:00
Kwonunn
3433d6ced2 forgot two of the configs 2024-10-28 14:55:49 +01:00
Kwonunn
6508a9e2ca set runner loglevel to debug 2024-10-28 13:52:33 +00:00
earl-warren
2374e25593 Merge pull request 'fix: attempt to avoid database timeouts due to locking' (#295) from Kwonunn/end-to-end:avoid-db-timeout into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/295
Reviewed-by: earl-warren <earl-warren@noreply.code.forgejo.org>
2024-10-21 06:40:25 +00:00
Kwonunn
3875197a1b fix: attempt to avoid database timeouts due to locking 2024-10-17 11:48:22 +02:00
earl-warren
2db3b373bb Merge pull request 'actions: logs-compression check depends on echo' (#292) from earl-warren/end-to-end:wip-logs-compression into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/292
2024-10-15 12:05:19 +00:00
Earl Warren
f7d1900c5b
actions: logs-compression check depends on echo
There is no guarantee that a test will not reset the actions logs from a
previous test. Since logs-compression depends on the logs from the
echo test, make that dependency explicit.
2024-10-15 13:02:02 +02:00
earl-warren
800cfcc0a8 Merge pull request 'Add test for schedule not being cancelled' (#289) from Kwonunn/end-to-end:schedule-noncancel-test into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/289
Reviewed-by: earl-warren <earl-warren@noreply.code.forgejo.org>
2024-10-14 05:46:12 +00:00
Kwonunn
222313181f Add schedule-noncancel test to 9.0 suite 2024-10-13 13:57:07 +02:00
Kwonunn
c3eb8918b4 implement waiting based on a file 2024-10-13 12:45:19 +02:00
Kwonunn
631055d190 rewrite schedule cancelling test 2024-10-12 15:11:22 +02:00
Kwonunn
f48fa02916 WIP: Add test for schedule not being cancelled 2024-10-09 15:50:17 +02:00
earl-warren
54f810c1df Merge pull request 'README: update local testing instructions' (#288) from earl-warren/end-to-end:wip-readme into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/288
2024-10-06 15:30:39 +00:00
Earl Warren
294ca18400
README: update local testing instructions 2024-10-06 06:22:58 +02:00
earl-warren
09819336a1 Merge pull request 'v10.0 development cycle started' (#282) from earl-warren/end-to-end:wip-10.0 into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/282
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-09-25 15:16:48 +00:00
Earl Warren
94289bc80d
v10.0 development cycle started 2024-09-25 14:12:49 +02:00
earl-warren
26eefbf61b Merge pull request 'lib: reduce GitLab noise' (#267) from limiting-factor/end-to-end:wip-noise into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/267
Reviewed-by: earl-warren <earl-warren@noreply.code.forgejo.org>
2024-09-02 10:20:13 +00:00
limiting-factor
1f2f98fb21 lib: reduce GitLab noise
The absence of the test-gitlab container will display

Error response from daemon: No such container: test-gitlab

which can be mistaken as an actual error where in fact it should be
ignored.
2024-09-02 11:45:26 +02:00
earl-warren
4df9a89f4e Merge pull request 'tests: upgrade setup-forgejo to v2.0.2' (#258) from earl-warren/end-to-end:wip-explicit-version into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/258
2024-08-26 06:47:28 +00:00
Earl Warren
427d9ed267
tests: upgrade setup-forgejo to v2.0.2 2024-08-24 08:23:23 +02:00
earl-warren
d3bce65195 Merge pull request 'actions: feature: compression: do not hardcode the log path' (#259) from earl-warren/end-to-end:wip-compression into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/259
Reviewed-by: Michael Kriese <michael.kriese@gmx.de>
2024-08-23 15:30:37 +00:00
Earl Warren
75503c5396
actions: feature: compression: do not hardcode the log path
The log path depends on the previous actions run and may not always
be 01/1.log.zst. Assuming it is makes this test fragile as it is
influenced by which previous tests are run and what they do.
2024-08-23 16:53:03 +02:00
earl-warren
812385a18c Merge pull request 'actions: verify the log compression feature' (#246) from earl-warren/end-to-end:wip-actions-log into main
Reviewed-on: https://code.forgejo.org/forgejo/end-to-end/pulls/246
2024-08-15 05:15:36 +00:00
Earl Warren
8636471d63
actions: verify the log compression feature
If running Forgejo >= v9.0, verify the logs are compressed by default
2024-08-11 16:47:14 +02:00
earl-warren
5ad828b7a2 Merge pull request 'lib: source build replace the matching release' (#239) from earl-warren/end-to-end:wip-optimize into main
Reviewed-on: https://code.forgejo.org///forgejo/end-to-end/pulls/239
2024-08-08 16:09:23 +00:00
Earl Warren
149c6a545c
lib: source build replace the matching release
Instead of having an explicit vX.Y-dev version to be referenced
explicitly, a binary built from source replaces the matching
version. For instance, if forgejo/build-from-sources contains v9.0,

* the development branch is compiled from source
* the v9.0 artifact is uploaded
* prior to running any test, the artificat is downloaded and used
* the v9.0 binary is not downloaded from
  forgejo/experimental/integration because it is already present

The vX.Y release is built daily and the end-to-end tests run on it. If
a regression is introduced, it will be spotted within 24h.

Compiling from source is used when the Forgejo runs the end-to-end
suite on a specific pull request.
2024-08-08 17:46:04 +02:00
Earl Warren
427c46dbf9
lib: remove RELEASE_NUMBERS_AND_DEV, use RELEASE_NUMBERS
In the lifecycle of vX.Y.Z, all tests are run against vX.Y-test
before it is published, including when the tag is pushed because the
automated release process now runs end-to-end before pushing the
release to forgejo-experimental.

Running end-to-end against vX.Y-dev is therefore redundant with at least
two other runs with exactly the same SHA (the one before the tag is
pushed and the one when the tag is pushed). There would be value in
doing that if it allowed to detect race conditions in Forgejo. But
such races were not found in the past six months and there is a lot
more scrutiny on commits merged in Forgejo which makes it even less
likely than it was before.

Running the tests on vX.Y instead of also including the built version
provide the same coverage and reduces the workload.
2024-08-08 17:46:04 +02:00
earl-warren
996373c707 Merge pull request 'Forgejo v1.21 is EOL & add v9.0' (#238) from earl-warren/end-to-end:wip-9.0 into main
Reviewed-on: https://code.forgejo.org///forgejo/end-to-end/pulls/238
2024-08-08 14:37:12 +00:00
Earl Warren
6224249696
upgrade: test pprof against the two active stable releases 2024-08-07 11:49:17 +02:00