Difference between revisions of "Release Process"
(→Windows Executable: 3.7 only: PSD2) |
(→Source preparation: Check the new files from TP for common mistakes) |
||
Line 20: | Line 20: | ||
:<pre> for i in az ca cs da eu fa ja nl rw sk sr sv tr uk zh_CN; do wget -O $i.po http://translationproject.org/PO-files/$i/gnucash-2.6.4.$i.po; done</pre> | :<pre> for i in az ca cs da eu fa ja nl rw sk sr sv tr uk zh_CN; do wget -O $i.po http://translationproject.org/PO-files/$i/gnucash-2.6.4.$i.po; done</pre> | ||
:Substituting the last version of GnuCash for '2.6.4'. This does the same except that the old translations have been msgmerged with the last release's pot file making them appear newer than they are. The safest approach is to look at [http://translationproject.org/latest/gnucash/ TP Latest] and download only the files which have updates since the previous release; for extra confidence examine the "PO Revision Date" header in each file; it should change if there are real translation updates. | :Substituting the last version of GnuCash for '2.6.4'. This does the same except that the old translations have been msgmerged with the last release's pot file making them appear newer than they are. The safest approach is to look at [http://translationproject.org/latest/gnucash/ TP Latest] and download only the files which have updates since the previous release; for extra confidence examine the "PO Revision Date" header in each file; it should change if there are real translation updates. | ||
− | :Next, check syntax and get the statistics | + | :*Next, check syntax and get the statistics: <Syntaxhighlight lang="sh"> |
− | :< | + | cd po |
− | + | for i in *.po; do echo -n "$i:"; msgfmt -c --statistics $i;done</Syntaxhighlight> | |
+ | :*Check the new files from TP for <tt>common mistakes</tt> from [[Translation#Committers]]. | ||
*;Note | *;Note | ||
*:These should probably applied to the oldest branch for which you expect do do releases still which may not be the branch you want to release '''now''' from. If this is the case apply them to the proper branch (eg maint) and merge upwards to your branch (eg master). | *:These should probably applied to the oldest branch for which you expect do do releases still which may not be the branch you want to release '''now''' from. If this is the case apply them to the proper branch (eg maint) and merge upwards to your branch (eg master). | ||
Line 32: | Line 33: | ||
*;Note | *;Note | ||
*: The same check should be performed when releasing from '''maint''' and there is an older '''maint-X.Y''' branch on which commits still happen. | *: The same check should be performed when releasing from '''maint''' and there is an older '''maint-X.Y''' branch on which commits still happen. | ||
− | * Verify that current branch can build a distribution tarball, compile, and test it fine: | + | * Verify that current branch can build a distribution tarball, compile, and test it fine: <Syntaxhighlight lang="sh"> |
− | + | cd .build | |
− | + | cmake .. | |
− | + | make | |
− | + | make distcheck</Syntaxhighlight> | |
:In this step, some files might have been changed such as POTFILES.in, which can then be committed before actually incrementing the version number. However, some of the test data files might also have been changed due to "make check", but those changes should not be committed. | :In this step, some files might have been changed such as POTFILES.in, which can then be committed before actually incrementing the version number. However, some of the test data files might also have been changed due to "make check", but those changes should not be committed. | ||
* Update the version number of the <tt>GNUCASH_(MAJOR|MINOR|MICRO)_VERSION</tt> and the <tt>PACKAGE_VERSION</tt> values as necessary in the root <tt>CMakeLists.txt</tt>. | * Update the version number of the <tt>GNUCASH_(MAJOR|MINOR|MICRO)_VERSION</tt> and the <tt>PACKAGE_VERSION</tt> values as necessary in the root <tt>CMakeLists.txt</tt>. |
Revision as of 13:07, 26 August 2019
Each GnuCash release involves a number of steps for the release manager. This page is intended to gather these steps for the program, while the Documentation Release Process is separated.
Contents
Commit Policy
Check Git#Branching and Merging.
Release Process
Notes
- Where relevant, the process below assumes that the primary git repository is configured as a remote called "upstream". If you have configured it under another name, please adapt the commands below accordingly.
Source preparation
- Check out Git branch you wish to release. Typical candidates are master, maint or any maint-X.Y. For example
git checkout master git pull --rebase
- Check translations at the Translation Project Gnucash page for updates and apply any that haven't been already committed, e.g. as suggested in translationprojects maintainers page.
- The translation project recommends using
rsync -Lrtvz translationproject.org::tp/latest/gnucash/ po
- But that will replace newer translations from direct contributors with old translations no longer supported by the translation project. Another approach is to
for i in az ca cs da eu fa ja nl rw sk sr sv tr uk zh_CN; do wget -O $i.po http://translationproject.org/PO-files/$i/gnucash-2.6.4.$i.po; done
- Substituting the last version of GnuCash for '2.6.4'. This does the same except that the old translations have been msgmerged with the last release's pot file making them appear newer than they are. The safest approach is to look at TP Latest and download only the files which have updates since the previous release; for extra confidence examine the "PO Revision Date" header in each file; it should change if there are real translation updates.
- Next, check syntax and get the statistics:
cd po for i in *.po; do echo -n "$i:"; msgfmt -c --statistics $i;done
- Check the new files from TP for common mistakes from Translation#Committers.
- Next, check syntax and get the statistics:
- Note
- These should probably applied to the oldest branch for which you expect do do releases still which may not be the branch you want to release now from. If this is the case apply them to the proper branch (eg maint) and merge upwards to your branch (eg master).
- If you are about to release from master you should verify that master is a superset of maint. You can do this by running the following command
git log master..maint
This command should not list any commits. If it does, checkout master and merge maint into it.
git checkout master git merge maint
- Note
- The same check should be performed when releasing from maint and there is an older maint-X.Y branch on which commits still happen.
- Verify that current branch can build a distribution tarball, compile, and test it fine:
cd .build cmake .. make make distcheck
- In this step, some files might have been changed such as POTFILES.in, which can then be committed before actually incrementing the version number. However, some of the test data files might also have been changed due to "make check", but those changes should not be committed.
- Update the version number of the GNUCASH_(MAJOR|MINOR|MICRO)_VERSION and the PACKAGE_VERSION values as necessary in the root CMakeLists.txt.
- Run
util/git-release-notes.pl > release.News
- to extract the bugs fixed and other changes. There are plain text and HTML sections for the NEWS file and for the web page, Github, and email announcements. The bug list can be copied in to each as-is, the other section should be copied and then edited to leave only changes that impact users or contributors. Translation updates should be removed and the languages updated listed separately.
- If this is the first release of a calendar year:
- copy ChangeLog to ChangeLog.YYYY with YYYY being the previous year.
- In the root CMakeLists.txt:
- Add ChangeLog.YYYY to the gnucash_DOCS variable,
- Find the rule to generate the ChangeLog, update the "--since" parameter to the start of the current year.
- Run make, which should update the ChangeLog file now.
- If you are building out of tree, copy the updated ChangeLog from your build directory to your source directory.
- Commit changes to NEWS and the ChangeLogs to the git repository. Don't forget to add the new ChangeLogs first if it's the start of a new year.
- Push all your changes to upstream:
git push upstream master:master
- Tag the new release.
For example:
git tag -am "Tag 3.4" 3.4 git push upstream --tags
N.B. In the event that a problem arises that requires a new tag, append a sequential lower case letter to the tag, e.g.:
git tag -am "Re-tag Release 3.4" 3.4a
Source tarballs
- Checkout the release tag from git. Either clone or clean your git repo here to avoid packaging unreleased changes ! For example:
git clone <your-local-up-to-date-git-repo> gnucash-3.0 cd gnucash-3.0 git checkout 3.0
or, while inside your local repo
git clean -fdx
Warning: As Eclipse user do not use the -x flag or all project information will be lost. Or add -e /.project -e /.cproject -e /.autotools -e /.settings/
- Now run
mkdir .build && cd .build cmake .. ninja && ninja distcheck
This should generate two tarballs, one bzip2 compressed and one gzip compressed. Using ninja distcheck performs several checks on the distribution before making the tarballs, then decompresses one of them, builds it, and runs ninja check on the results which ensures that everything is properly packaged for distribution. If you used your regular repo you'll want to clean it again after uploading the tarballs.
N.B. If the build is of a re-tagged release, rename the tarballs to have the same lower-case letter suffix:
gnucash-3.4a.tar.gz
so that the flatpak build mechanism will associate the tarball with the tag and build the right thing.
Documentation
Now make a documentation release using the same version number as you set above for GnuCash. See Documentation Release Process for the procedure.
Windows Executable
- 3.7 only
- Verify aqbanking is stable again. If not contact cstim and Martin Preuss.
- Background
- Mid September FINTS requires changes based on PSD2. The Windows Nightlies habe become an important part of testing to cover a broad range of the different FinTS servers.
The creation of the tag in the first section will automatically trigger the build for the Windows Executable in the next nightly build. The resulting executable can be downloaded the day after from http://code.gnucash.org/builds/win32.
- Perl version
- Check http://strawberryperl.com/ for the recommended version and update strVersion in extra_dist/getperl.vbs.
- From PR#15
- Innosetup version
- Check http://www.jrsoftware.org/isdl.php for updates.
- Can we drop custom language files, because they have become official?
- Are there updates for unofficial translations?
MacOS Executable
This package is usually created by John Ralls using this procedure .
Sourceforge file uploads
All the above build targets should be uploaded to Source Forge.
- Make SHA256 digests of the two tarballs and the three installer packages, e.g.
sha256sum gnucash-*.tar.* > README.sha sha256sum Gnucash*.dmg >> README.sha sha256sum gnucash*.setup.exe >> README.sha
- Log in on the [Source Forge GnuCash website]
- Go to the Project Admin -> File Manager section
- Create a new directory for the release, either under gnucash (stable) or gnucash (unstable). Mark it "staged" in either the creation or the info dialog.
- Upload the files created above to this directory.
- If this release is the latest stable release, edit each file's metadata by clicking on the 'i' button. For each file indicate for which platforms the file is intended (.exe file on Windows, .dmg file on Mac OS X, source tarball on all other targets). Sourceforge will use this additional information to present a direct download link to the latest release on the user's native platform.
- When everything is ready, open the info dialog for the containing directory and clear the staged check-box. Note that if the release runs into problems that take more than 3 days you may need to renew the "staged" flag.
Git housekeeping after a release
All releases
If any changes were committed during the release steps above, merge these upwards to the other upstream branches. For example if you committed something to maint, merge maint into master:
git checkout master git merge maint
Expect merge conflicts here for the changed version number and the different documentation links in README. This is normal and the conflict should be resolved by keeping the version number in master. There may be other merge conflicts. Evaluate them and fix them accordingly.
If the release was from an older maint-X.Y branch, merge these changes into maint and then merge maint into master. Expect the same version number conflict during the merges.
A major release
A major release is the first release to bring new development features to the users. This is shown by a jump in the version number (for example from 2.6.x to 2.8.0), and signifies the start of a new major development cycle.
This means the branches in our repository have to be reshuffled. The release is done from a commit on the master branch. This commit should now become the HEAD commit for the maint branch because maintenance should now happen from there on. At the same time it may be necessary to keep up maintenance to the previous major series, so this should now get its own branch.
In git:
git branch maint-X.Y maint # for example git branch maint-2.6 maint git checkout maint git merge --ff-only master
The first command creates a maintenance branch for the old stable release series. The subsequent commands move maint to where master is now. If the latter command fails there are commits on the maint branch that didn't get merged into master. This should not happen if the earlier steps were followed to verify master is a superset of maint.
GnuCash Website
Note that gnucash-htdocs is a pure git repository. In order to update the website you will hence have to follow the instructions on our Git wiki page to prepare a local gnucash-htdocs repository with commit access to the primary repository on code.gnucash.org. Be sure to follow the committer instructions for pure git repositories on that page !
Adding the announcement text
- Checkout the master branch and make sure it's up to date
cd gnucash-htdocs.git git checkout master git pull upstream
- Go to the news files
cd news
- Copy the last release newsfile. The filename format is usually YYMMDD-<releasenumber>.news. For example:
cp 130430-2.5.1.news 130527-2.5.2.news
- Replace the old release numbers in this file. Note that release announcements usually contain two release numbers: the current release and the previous release. Both of them should obviously be replaced. The order to execute the following commands is important ! For example:
sed -i -e 's/2.5.1/2.5.2/g' 130527-2.5.2.news sed -i -e 's/2.5.0/2.5.1/g' 130527-2.5.2.news
- Open the new file in your favorite editor. Using the NEWS files you created for GnuCash and GnuCash Documentation as a basis, revise the announcement to reflect the changes in this new release. Check for
- Announce of Feature/String Freeze for the next release
- This will help to polish the GUI and review for I18N issues.
- Declare start/continuation of Feature/String Freeze for this release
- This will give translators time to complete.
- Add the new file to revision control
git add 130527-2.5.2.news
Updating the release number for the download pointers
Next, the release number should be added to the website configuration script. This ensures all download links are appropriately updated.
- Edit the file gnucash-htdocs/externals/global_params.php. The first few lines in this script set various release numbers: latest_stable, latest_unstable and variants thereof on Windows and MacOS. Adapt these parameters as needed.
First Release of the Year
Update the copyright end date in externals/footer.html.
New Major Release
- docs.phtml
- needs a new section in $older<n> as long as we do not convert it in a loop with version dependend LANGs.
- viewdoc.phtml
- needs adjustemt in
# Parse requested version
- robots.txt
Disallow: /docs/v<ancestor(5)> /
Commit the changes.
Finally, all these changes to the website should be committed. From the base directory:
git add <changed-files> git commit -m "Update to release x.y.z" git push upstream master:master
The last command will take care of updating the live website.
GitHub
Set up a new release on GitHub:
- Go to The GnuCash releases page and press the "Create New Release" button.
- Enter the release tag in the tag box. It should already exist.
- Type the title "GnuCash <releasenumber>" into the title box, substituting the correct release version.
- Copy the release news file from "The GnuCash Development Team proudly announces" through the Documentation section and paste it into the "write" box. Use the Preview tab to check the result.
- Drag or select the Mac and Windows installers into the binaries box.
- Click the Publish Release button when everything is ready.
N.B.: This may not work on some browsers or with certain security features (NoScript is a suspect). If it fails to upload the files try a different browser.
GnuCash Wiki
Update Release Version
Since 2018-04 we use Templates to maintain the versions. The previous manually updated pages are only mentioned for cross checking:
New Packages
Address | Content | Note |
---|---|---|
Template:MacosPackage | 5.10-1 | based on Template:Version |
Template:MacosFallbackPackage | Template:MacosFallbackPackage | based on Template:FallbackVersion |
New Minor Stable Release
Address | Content | Note |
---|---|---|
Template:Version | 5.10 | based on Template:MainVersion |
New Beta Release
Address | Content | Note |
---|---|---|
Template:BetaVersion | 5.900 | based on Template:MainVersion |
- Note
- Currently it is unused.
- Fixme
- Will it be sufficient or should we have current and next?
New Major Release
Address | Content |
---|---|
Template:MainVersion | 5 |
Template:FallbackVersion | 4.14 |
- Table of Documentation at the beginning of
- De/Referenz#Liste_der_Kursquellen letzte veröffentlichte Version,
- Pt/GnuCash#Documentação tutorial e guia de conceitos do GnuCash,
- documentação de ajuda do GnuCash,
- GnuCash#The Glossary Released,
- Installation#Linux distrowatch.com,
- Using_GnuCash#Introduction links Concepts Guide and GnuCash Manual.
Policy Change
This are constants until we change the policy of versioning.
Address | Content | Note |
---|---|---|
Template:BetaSeries | 5.9xx | based on Template:MainVersion |
Release Schedule
Add the actual release date to Release Schedule.
Translation Status
If the branch for translations switches, adjust Translation Status.
Mailing list announcement
Send the same announcement to the following lists:
- Question
- Should we BCC also the user lists in other languages?
To do so, you have to be subscribed to the mailing lists. Then I found it easiest to copy the release announcement from my web browser into a new mail message (Kmail). In kmail this converts the html in a reasonably clean plain-text message. Some further minor cleanup may be necessary. This works in Apple Mail as well.
The bit at the bottom about downloading from Sourceforge loses the links, so replace it with: "The latest binaries and tarballs can always be downloaded from the upper right corner of http://www.gnucash.org."
The BCCs are to prevent reply-alls from being copied to those lists, though they cause the email to get held for moderation.
Translation Project
Email a link of the release tarball to coordinator@translationproject.org.
IRC
Update the topic of irc://irc.gnome.org/gnucash: /TOPIC #gnucash Free GPL Personal and Small Business Accounting || Please don't ask to ask, just ask and wait! (Possibly a few hours!!) || publicly-logged channel || latest stable: <version> || www.gnucash.org
Bugzilla
After logging in
- Add the new version number and eventually
- add the next milestone
- for at least Gnucash and Documentation.
Promotion
Verify http://freshcode.club/projects/gnucash gets updated or adjust it. The autoupdate section is in the lower part of http://freshcode.club/submit/gnucash. It is also mirrored as https://freshfoss.com/projects/gnucash.
New Major/Minor Version
The culmination of each development cycle is the release of a new series with a new minor, and perhaps a new major, version number. Preparation for this release is typically a six-month alpha/beta release project with some special milestones.
Version Numbers
GnuCash uses a two-part version numbering system because the Major numbers in the three part system changed so rarely as to be useless. The major number will increment with "major" releases, those which include significant new features or incompatible changes. We expect to do major releases every 2-3 years. In between, minor releases will contain bug fixes and minor new features; database schema and exposed API will not change. Unstable releases will use minor numbers beginning with 900.
Before the release of GnuCash 3.0, we used a three-part version number: Major, Minor, and Micro. Major version numbers were changed rarely and only after major architectural changes to GnuCash. Minor versions were changed when preparing a new stable series from the development, or master, branch. Unstable releases were given an odd minor version, stable releases an even minor version number. Micro version numbers were assigned sequentially to each release in a series.
Freezes
In order to allow time for thorough testing and localization, it's important to set aside some development activities during the run up to a stable release. The dates that those activities stop are traditionally called freezes.
- Feature Freeze: No new features or significant architectural changes should be committed after this date to ensure that there's adequate time for the more adventurous users who act as our testers to try everything out and provide feedback.
- String Freeze: No new user-visible strings should be added after this date in order to allow translators time to finish their work by the final release date. The Translation Project requests at least two weeks, but practice suggests that a month or more is better.
- Suggestion
- Announce the string freeze one release in advance. This would allow some GUI cleanup, check for I18n issues, join similar strings ...
- Code Freeze: Slightly misnamed, this means that only code fixing critical bugs and of limited scope, so that it's unlikely to cause regressions in other parts of the program, should be committed.
Release Schedule and Milestones
- Monthly test releases should begin 6 months before the target release date.
- The team should determine dates for feature and string freeze, and publish them on the Release Schedule.
- the Translation Project Coordinators should be notified of the first release after string freeze by emailing a link to the tarball to coordinator@translationproject.org.
- After Code Freeze test release frequency should increase to weekly. The announcements for these releases should inform testers that they are release candidates.