The testing team allows community members to directly get involved in the testing process. When there is a shiny new thing to test, users in the table below will get a notification (usually via mention in pmaports). They can install the change and report back whether everything worked as expected, or whether there is a regression.
Can I join the testing team?
Thank you for considering! Yes, as long as you ...
- ... have familiarized yourself enough with pmOS that you feel comfortable testing changes
- ... make sure you don't lose important data (make backups as needed!)
- You can dramatically help improving the quality of postmarketOS for the device you are using.
- You hold the cool new changes in your hands before everyone else!
To join the testing team, add yourself to the table of members at the bottom of this wiki page.
Consider joining the release-party channel, where testing of releases and bigger changes gets coordinated.
Do I need to have stable or edge installed for testing?
The easiest is to just go with what you already have installed. But if you are considering a new installation just for testing, choose depending on what you want to test:
- Merge requests: having edge installed is best, because almost all merge requests are for edge. (See the branch that a merge request is made against, if it is master, then it is for pmOS edge, otherwise the branch name is the name of the release, e.g. v23.06.)
- Releases: doing a new installation with the upcoming stable release would be best (so we can see if there are any problems with completely fresh installations). But you can also upgrade or downgrade from the previous release / from edge.
- Service packs: to test a service pack, you need to be on the current stable release.
Note that you do not need to be constantly swapping between releases when you are in the testing team. Change the release and help out with testing as often as you feel comfortable, you can also only test new releases ahead of time, or only test some of the edge MRs you are interested in etc.
How to test changes?
Install binary packages from merge request pipelines on your device with mrtest.
Make sure to run
mrtest zap and
apk upgrade -a when done with testing to remove the merge request packages again. Keeping them may cause problems in the future (e.g. conflicts when trying to test another merge request).
- New installation
- Upgrade or downgrade from the previous release / from edge.
Doing a new installation may show different problems (e.g. automatic resize of the filesystem not working) than upgrading or downgrading from another release. Make sure to mention which method you used, and consider using one that wasn't tested yet.
Service packs can be tested via a staging repository before they get released. Wait for the announcement of the staging repository, then follow these steps.
sp1 are examples, adjust them for the service pack you are testing.
- Make sure you are on the stable release (v23.06)
- Edit your
- Run apk upgrade -a
- Verify everything is still working as expected
- Report back in the service pack issue
- Revert the change to
apk upgrade -aagain when done
The staging branch and repository will be deleted after the service pack is merged, so apk will complain about a non-existing repository if you didn't revert the changes in the end.
What about device maintainers?
Typically device maintainers are not part of the testing team. Device maintainers already test on their devices as good as they can, the point of the testing team is to scale testing across many people, so development can be done both faster and with less regressions.
Best practices for editing the table?
- Keep the entries consistent, so they can be easily searched (same spelling for UI names etc).
- What to put in "Notes":
- Revision of your device, if there are multiple ones (e.g. PinePhone revisions)
- The panel of the device if there are multiple ones
- Add-ons you would like to test, such as the PinePhone hardware keyboard
|UIs (or any)
PinePhone hardware keyboard
Poco F1 EBBG
|other UI might also be possible
|postmarketOS is cool :D