4 <title>release</title>
\r
5 <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
\r
6 <style type="text/css">
\r
7 /* GitHub stylesheet for MarkdownPad (http://markdownpad.com) */
\r
8 /* Author: Nicolas Hery - http://nicolashery.com */
\r
9 /* Version: b13fe65ca28d2e568c6ed5d7f06581183df8f2ff */
\r
10 /* Source: https://github.com/nicolahery/markdownpad-github */
\r
13 =============================================================================*/
\r
15 html, body, div, span, applet, object, iframe, h1, h2, h3, h4, h5, h6, p, blockquote, pre, a, abbr, acronym, address, big, cite, code, del, dfn, em, img, ins, kbd, q, s, samp, small, strike, strong, sub, sup, tt, var, b, u, i, center, dl, dt, dd, ol, ul, li, fieldset, form, label, legend, table, caption, tbody, tfoot, thead, tr, th, td, article, aside, canvas, details, embed, figure, figcaption, footer, header, hgroup, menu, nav, output, ruby, section, summary, time, mark, audio, video {
\r
22 =============================================================================*/
\r
25 font-family: Helvetica, arial, freesans, clean, sans-serif;
\r
29 background-color: #fff;
\r
35 body>*:first-child {
\r
36 margin-top: 0 !important;
\r
40 margin-bottom: 0 !important;
\r
44 =============================================================================*/
\r
46 p, blockquote, ul, ol, dl, table, pre {
\r
51 =============================================================================*/
\r
53 h1, h2, h3, h4, h5, h6 {
\r
54 margin: 20px 0 10px;
\r
57 -webkit-font-smoothing: antialiased;
\r
60 h1 tt, h1 code, h2 tt, h2 code, h3 tt, h3 code, h4 tt, h4 code, h5 tt, h5 code, h6 tt, h6 code {
\r
71 border-bottom: 1px solid #ccc;
\r
92 body>h2:first-child, body>h1:first-child, body>h1:first-child+h2, body>h3:first-child, body>h4:first-child, body>h5:first-child, body>h6:first-child {
\r
97 a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 {
\r
102 h1+p, h2+p, h3+p, h4+p, h5+p, h6+p {
\r
107 =============================================================================*/
\r
111 text-decoration: none;
\r
115 text-decoration: underline;
\r
119 =============================================================================*/
\r
122 padding-left: 30px;
\r
125 ul li > :first-child,
\r
126 ol li > :first-child,
\r
127 ul li ul:first-of-type,
\r
128 ol li ol:first-of-type,
\r
129 ul li ol:first-of-type,
\r
130 ol li ul:first-of-type {
\r
134 ul ul, ul ol, ol ol, ol ul {
\r
145 font-style: italic;
\r
147 margin: 15px 0 5px;
\r
150 dl dt:first-child {
\r
154 dl dt>:first-child {
\r
158 dl dt>:last-child {
\r
159 margin-bottom: 0px;
\r
167 dl dd>:first-child {
\r
171 dl dd>:last-child {
\r
172 margin-bottom: 0px;
\r
176 =============================================================================*/
\r
180 font-family: Consolas, "Liberation Mono", Courier, monospace;
\r
186 white-space: nowrap;
\r
187 border: 1px solid #eaeaea;
\r
188 background-color: #f8f8f8;
\r
189 border-radius: 3px;
\r
197 background: transparent;
\r
201 background-color: #f8f8f8;
\r
202 border: 1px solid #ccc;
\r
207 border-radius: 3px;
\r
211 background-color: transparent;
\r
216 -moz-border-bottom-colors: none;
\r
217 -moz-border-left-colors: none;
\r
218 -moz-border-right-colors: none;
\r
219 -moz-border-top-colors: none;
\r
220 background-color: #DDDDDD;
\r
221 background-image: linear-gradient(#F1F1F1, #DDDDDD);
\r
222 background-repeat: repeat-x;
\r
223 border-color: #DDDDDD #CCCCCC #CCCCCC #DDDDDD;
\r
224 border-image: none;
\r
225 border-radius: 2px 2px 2px 2px;
\r
226 border-style: solid;
\r
228 font-family: "Helvetica Neue",Helvetica,Arial,sans-serif;
\r
234 =============================================================================*/
\r
237 border-left: 4px solid #DDD;
\r
242 blockquote>:first-child {
\r
246 blockquote>:last-child {
\r
247 margin-bottom: 0px;
\r
250 /* HORIZONTAL RULES
\r
251 =============================================================================*/
\r
259 background: transparent;
\r
260 border-bottom: 4px solid #ddd;
\r
265 =============================================================================*/
\r
271 table th, table td {
\r
272 border: 1px solid #ccc;
\r
277 border-top: 1px solid #ccc;
\r
278 background-color: #fff;
\r
281 table tr:nth-child(2n) {
\r
282 background-color: #f8f8f8;
\r
286 =============================================================================*/
\r
294 <h1>Definition of Done for Simantics Platform Releases</h1>
\r
296 <li>All Git repositories that are part of the Simantics release train have a branch called <code>release/x.y.z[.w]</code> and tag called <code>x.y.z[.w]</code>.</li>
\r
297 <li><a href="https://www.simantics.org/redmine/projects/simantics-platform/wiki/ChangeLog">A change log entry</a> is compiled from the issues in this release and made available to the general public separately for the platform and for the open products included in the release train.</li>
\r
298 <li><a href="http://dev.simantics.org/index.php/Roadmap">Roadmap</a> is up-to-date.</li>
\r
299 <li><a href="http://dev.simantics.org/index.php/Tutorials">Tutorials</a> are up-to-date and coherent with the platform.</li>
\r
300 <li>For all new major/minor releases, Wiki documentation is backed up (cloned).</li>
\r
303 <h1>Simantics Platform Release Process</h1>
\r
305 <li>Create <code>release/x.y.z[.w]</code> release stabilisation branch</li>
\r
306 <li>Repeat until stable:
\r
308 <li>Develop, test and document components and test products</li>
\r
311 <li>Tag the release in repository</li>
\r
312 <li>Backup documentation wiki databases</li>
\r
313 <li>Build and publish SDK package with and without sources
\r
315 <li>Does not really require any work</li>
\r
318 <li>Build Simantics open source products and plug-in components which are a part of the release train</li>
\r
319 <li>Update websites to reflect the new release</li>
\r
322 <h1>Released Plug-in Components and Products</h1>
\r
323 <p>There are both plug-in components and products that are part of the <em>Simantics Release Train</em> that shall be released simultaneously to a major or minor Simantics release.</p>
\r
324 <p>Plug-in components are installable features that are deployed online as P2 repositories for general availability. Products are deployed as ZIP files and made available online in designated locations on simantics.org.</p>
\r
325 <p>Core components of the release train:</p>
\r
327 <li>External third party library dependencies required by the platform - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/third-party.git;a=summary">simantics/third-party.git</a></li>
\r
328 <li>The Simantics Platform - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/platform.git;a=summary">simantics/platform.git</a></li>
\r
330 <p>Plug-in components that are part of the release train:</p>
\r
332 <li>Simupedia - <a href="https://gerrit.simantics.org/r/gitweb?p=members/simupedia.git;a=summary">members/simupedia.git</a></li>
\r
333 <li>FMIL - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/fmil.git;a=summary">simantics/fmil.git</a></li>
\r
334 <li>FMI Studio - <a href="https://gerrit.simantics.org/r/gitweb?p=members/fmi.git;a=summary">members/fmi.git</a></li>
\r
335 <li>Interoperability components - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/interop.git;a=summary">simantics/interop.git</a></li>
\r
336 <li>Simantics R binding - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/r.git;a=summary">simantics/r.git</a></li>
\r
337 <li>Matlab SCL binding - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/matlab.git;a=summary">simantics/matlab.git</a></li>
\r
338 <li>Python SCL binding - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/python.git;a=summary">simantics/python.git</a></li>
\r
339 <li>Simantics System Dynamics - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/sysdyn.git;a=summary">simantics/sysdyn.git</a></li>
\r
340 <li>Simantics District modelling components - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/district.git;a=summary">simantics/district.git</a></li>
\r
341 <li>Simantics 3D modelling components - <a href="https://gerrit.simantics.org/r/gitweb?p=simantics/3d.git;a=summary">simantics/3d.git</a></li>
\r
342 <li>Simantics Proteus toolset - <a href="https://gerrit.simantics.org/r/gitweb?p=gold-members/proteus.git;a=summary">gold-members/proteus.git</a></li>
\r
344 <p>Products that are part of the release train:</p>
\r
346 <li>Simantics Desktop</li>
\r
347 <li>Simantics System Dynamics Tool
\r
349 <li>This is Simantics Desktop with Simantics System Dynamics Tool features installed</li>
\r
353 <p>For simplicity, each of these components are versioned accoring to platform versioning, i.e. for Platform SDK 1.26.0 there will be Simantics Desktop 1.26.0, Sysdyn 1.26.0, and so on.</p>
\r
355 <h1>Release Schedule</h1>
\r
357 <li>Releases are branched 4 weeks before the set release date.</li>
\r
358 <li>During this time no more new features are allowed in the release branch and the existing work shall be stabilized. Work must be focused on bug fixes and documentation.</li>
\r
359 <li>Source code changes to release branches are forbidden in the last 2 weeks. Documentation-only changes are still allowed. However, if critical show-stopper problems surface during that time, the changes must be done. After that the release engineering team must decide whether to stick to the original release schedule or whether to delay the release.</li>
\r
362 <h1>Simantics Platform Release - Step by Step</h1>
\r
363 <h2>Create release engineering issue(s) in Gitlab</h2>
\r
364 <p>Ensure that Gitlab has a release engineering issue for the branched release,
\r
365 such as <a href="https://gitlab.simantics.org/simantics/platform/issues/16">Simantics 1.34.0 release engineering</a></p>
\r
367 <li>Make a new release issue with title <code>$version release engineering</code>.</li>
\r
368 <li>Add a link to the previous previous release's issue in the new issue description, e.g. <code>simantics/platform#16</code>.</li>
\r
369 <li>Add labels <code>releng</code> and <code>$version</code> to the new issue</li>
\r
371 <h2>Create release branch from selected commit</h2>
\r
372 <p>When release stabilisation starts, all relevant repositories need to be branched.
\r
373 When creating major/minor releases <code><commit></code> is usually a commit in the <code>master</code> branch.
\r
374 With service releases, branch from an existing <code>release/*</code> branch instead.</p>
\r
375 <p>Instead of doing this clone+branch+push sequence for every SDK repository separately, please use the included <code>release-helper.sh</code> shell script to perform this mechanical work.
\r
376 The script supports many useful basic git commands which all perform the requested operation on all the release train repositories.
\r
377 The operations can be seen from the help text printed by the script when given no arguments:</p>
\r
378 <pre><code>Usage: release-helper.sh <version> <branch-name> <user-name> <command> [<command-arguments>]
\r
381 clone The first thing that needs to be done before anything else
\r
382 Clones all platform repositories under directory <version>
\r
384 Inspection commands:
\r
385 diff [args] Run git diff [args] for each platform repository
\r
386 log [args] Run git log [args] for each platform repository
\r
387 status [args] Run git status [args] for each platform repository
\r
388 list-tags Run git tag -l for each repository
\r
392 branch Run git branch <branch-name> for each platform repository
\r
393 checkout Run git checkout <branch-name> for each repository
\r
395 fetch Run git fetch --all for each repository
\r
396 pull Run git pull --all for each repository
\r
397 push Run git push origin <branch> for each repository
\r
398 push-tags Run git push --tags for each repository
\r
399 remove-tag Run git tag -d v<branch> for each repository
\r
400 reset [args] Run git reset [args] for each repository
\r
401 tag Run git checkout <branch> and
\r
402 git tag -a v<branch> -m "Simantics <branch> simultaneous release"
\r
403 for each repository
\r
405 Compound release commands:
\r
406 prepare-release-branch <from-branch>
\r
407 <from-branch> the name of the branch that the codebase is currently on
\r
409 Top-level release commands:
\r
410 bump-master-version <from-version> <to-version>
\r
411 <from-version> the version string to replace
\r
412 <to-version> the replacing new version string
\r
414 branch-release <from-branch>
\r
415 <from-branch> the branch to create the service branch from
\r
416 e.g. master or release/x.y.z
\r
418 <p>Begin by cloning all the repositories for working on</p>
\r
419 <pre><code>user=<your-git-username>
\r
421 branch=release/x.y.z
\r
422 ./release-helper.sh $version $branch $user clone
\r
424 <p>This will create a directory called <code>x.y.z</code> under the current working directory and clone all the repositories under it.
\r
425 The first <code>version</code> argument is only used for the base working directory <code>x.y.z</code>.
\r
426 The second <code>branch</code> argument tells what branch to specify to some of the available actions, e.g. <code>branch</code>, <code>checkout</code>, etc.</p>
\r
427 <p>Creating the release branch from master and pushing the new branches to remote happens as follows:</p>
\r
428 <pre><code># When the commit messages appear, add references to created
\r
429 # Gitlab release engineering issues by adding this to the commit message:
\r
433 # where xxxx is the release engineering issue for the respective project
\r
434 ./release-helper.sh $version $branch $user branch-release master
\r
435 ./release-helper.sh $version $branch $user push
\r
437 <p>If you're creating a service release <code>x.y.w</code> from <code>x.y.z</code> where <code>w > z</code>, do this:</p>
\r
438 <pre><code>fromBranch=release/x.y.z
\r
439 branch=release/x.y.w
\r
440 ./release-helper.sh $version $branch $user branch-release $fromBranch
\r
441 ./release-helper.sh $version $branch $user push
\r
443 <p>If you branched a new release from <code>master</code>, you should also bump the revision of the master branch right now to start the next release cycle in master.
\r
444 An example of these changes can be seen in <a href="https://gerrit.simantics.org/r/gitweb?p=simantics%2Fplatform.git;a=commit;h=564ac84a2949b19ce5c1c7c838b575527ec42b09">gitweb</a> or in <a href="https://gerrit.simantics.org/r/#/c/1362">review 1362</a>.
\r
445 The changes include:</p>
\r
447 <li>Simantics Desktop splash screen update (version number)</li>
\r
448 <li>Simantics target platform name to state correct development version</li>
\r
449 <li>org.simantics.sdk feature version bump</li>
\r
450 <li>org.simantics.sdk.repository project version bump</li>
\r
452 <p>Perform and push the changes <em>in master</em> by running:</p>
\r
453 <pre><code>branch=master
\r
454 ./release-helper.sh $version $branch $user checkout
\r
455 ./release-helper.sh $version $branch $user bump-master-version x.y.z X.Y.Z
\r
456 ./release-helper.sh $version $branch $user push
\r
458 where <code>x.y.z</code> is the old version number of master and <code>X.Y.Z</code> is the new version number.
\r
459 <h3>Test Release Train build</h3>
\r
460 <p>Trigger an execution of the <a href="https://www.simantics.org/jenkins/job/simantics-release-train/">simantics-release-train</a> Jenkins job with parameters</p>
\r
462 <li>GERRIT_REFNAME: <code>release/x.y.z[.w]</code></li>
\r
463 <li>PUBLISH_ARTIFACTS: <code>true</code></li>
\r
465 <p>to ensure that all components of the release train build fine and to publish first versions of P2 repositories of everything online.</p>
\r
466 <p>The release train build is currently never ran automatically.
\r
467 However, after following all these steps, whenever changes are pushed/merged to <code>release/x.y.z[.w]</code> branch in Gerrit, new Jenkins builds are triggered automatically and they will publish the results (P2 repositories/products) at their designated locations online.</p>
\r
468 <h4>[Optional reading] Release train build details</h4>
\r
469 <p>The release train build does two very important steps as the first things,
\r
470 i.e. build the external dependency P2 repositories for both the
\r
471 Platform SDK and Simupedia:</p>
\r
472 <pre><code>stage('External Dependencies') {
\r
474 build job: 'SDK/Deploy External Components to Web', parameters: params1
\r
475 build job: 'Member Components/Simupedia/fi.semantum.simupedia.build.p2.site', parameters: params1
\r
479 <p>After that it builds the Platform SDK and Simupedia before building anything else:</p>
\r
480 <pre><code>stage('SDK') {
\r
482 build job: 'SDK/Simantics SDK', parameters: params1
\r
483 // Note that Simantics SDK builds simupedia-git as well
\r
487 <h2>Review documentation</h2>
\r
488 <p>Documentation to review:</p>
\r
490 <li><a href="http://dev.simantics.org/">Developer wiki</a></li>
\r
491 <li><a href="https://www.simantics.org/end_user_wiki">End-user wiki</a></li>
\r
492 <li><a href="https://www.simantics.org/members">Member wiki</a></li>
\r
494 <p>For each wiki page:</p>
\r
496 <li>Read through and get authors to fix found problems, such as TODOs or invalid information.</li>
\r
498 <h2>Review tutorials</h2>
\r
501 <p>Ensure tutorial wiki documentation at http://dev.simantics.org/index.php/Tutorials is up-to-date with the released platform</p>
\r
504 <p>Ensure tutorial projects and product build properly</p>
\r
507 <p>com.acme.movie</p>
\r
509 <li>Build with Buckminster, com.acme.movie.product.site.feature</li>
\r
513 <h2>Tag release/* branches</h2>
\r
514 <p>When the release branches are ready for the release, tag them with the tag <code>vx.y.z[.w]</code>:</p>
\r
515 <pre><code>./release-helper.sh x.y.z release/x.y.z your-git-username checkout
\r
516 ./release-helper.sh x.y.z release/x.y.z your-git-username pull
\r
517 ./release-helper.sh x.y.z release/x.y.z your-git-username tag
\r
518 ./release-helper.sh x.y.z release/x.y.z your-git-username push-tags
\r
521 <p>Note: release-helper.sh will supply the -m argument to git tag to create an <a href="https://git-scm.com/book/en/v2/Git-Basics-Tagging">annotated tag</a>.
\r
522 Only annotated or signed tags can be pushed to Gerrit.</p>
\r
524 <h2>Backup documentation wiki databases</h2>
\r
525 <p><strong>NOTE: This step is now deprecated since we are in the process of moving all mediawiki-based documentation into the platform git repository.</strong></p>
\r
526 <p>This step is only necessary for major/minor releases, not for service releases.</p>
\r
527 <p>The wiki databases to be backed up are:</p>
\r
529 <li><a href="http://dev.simantics.org/">Developer wiki</a></li>
\r
530 <li><a href="https://www.simantics.org/end_user_wiki">End-user wiki</a></li>
\r
532 <p>These are MediaWiki installations. The only sane way to "tag" the documentation
\r
533 is to back up the mysql database backing the wiki. Should the wiki be required
\r
534 at a later time for some reason, we'll put the documentation up then in a
\r
535 separate Mediawiki installation.</p>
\r
537 <li>Dump documentation wiki databases using <a href="./dump-wikis.sh">dump-wikis.sh</a> script.</li>
\r
538 <li>Put the generated backup x.y.z.tar.gz at /var/backup/simantics-releases/x.y.z/wiki/</li>
\r
540 <h2>Compile change log entry</h2>
\r
542 <li>Edit the <a href="https://www.simantics.org/redmine/projects/simantics-platform/wiki/ChangeLog">main page</a> and add a a link for release x.y.z[.w].</li>
\r
543 <li>Open the change log page of the previous release, e.g. <a href="https://www.simantics.org/redmine/projects/simantics-platform/wiki/Simantics_1250">1.25.0</a></li>
\r
544 <li>Open the new link in another browser/tab to start editing the new wiki page</li>
\r
545 <li>Edit the previous release's page and copy its wiki source contents over to the new release's page.</li>
\r
546 <li>Fix the content to match the new release:
\r
548 <li>Remove the issue content of the previous release</li>
\r
549 <li>Fix release number, release date, release branch link and the link to all issues closed for the release
\r
551 <li>Save new public issue query that lists all issues closed for the release by <a href="https://www.simantics.org/redmine/projects/simantics-platform/issues?query_id=122">starting from the previous release's query</a></li>
\r
554 <li>Add filter to query: <strong>Release Notes: Any</strong> to only show issues that have some content in their Release Notes field</li>
\r
555 <li>Export closed issue list as CSV with selected columns only. Open the resulting CSV file in Excel.</li>
\r
556 <li>Use <strong>Data -> Text to Columns</strong> with tab column separation to columnize the result</li>
\r
557 <li>Format the list as a table so that there is only one issue / row</li>
\r
558 <li>Remove all other columns besides: Issue #, Tracker, Release Notes</li>
\r
559 <li>Format the data into a Textile table:
\r
561 <li>Copy to table contents as text into <a href="http://www.pspad.com/">PSPad</a></li>
\r
562 <li>Replace (CTRL+H) tabs (<code>\t</code>) with <code>|</code> with <code>Regular Expressions</code> selection checked</li>
\r
563 <li>Use <strong>Insert Text Into Lines..</strong> (ALT-I) to fix line beginnings and ends:
\r
567 <li>At Lines Begin: <code>|#</code></li>
\r
568 <li>At Lines End: <code>|</code></li>
\r
575 <li>Copy the resulting textile table over to the change log page</li>
\r
578 <li>Highlight major issues in the list by changing the text background color of the <strong>Type</strong> column:
\r
580 <li><code>%{background: lightsalmon}Major Bug%</code></li>
\r
581 <li><code>%{background: lightgreen}Major Feature%</code></li>
\r
582 <li><code>%{background: lightgreen}Major Enhancement%</code></li>
\r
586 <h2>Disseminate information about the release</h2>
\r
588 <li><a href="http://dev.simantics.org">Developer Wiki</a>: Update roadmap at <a href="http://dev.simantics.org/index.php/Roadmap">http://dev.simantics.org/index.php/Roadmap</a></li>
\r
589 <li><a href="https://www.simantics.org/redmine/">Redmine</a>: Post news on the developer/user-visible changes here</li>
\r
590 <li><a href="https://www.simantics.org">simantics.org</a>: Post news on the release and a link to the redmine post</li>
\r
591 <li><a href="https://www.simantics.org/members/">Members Wiki</a>: Update frame plan to reflect the realized dates and link to Redmine news</li>
\r
592 <li><a href="mailto:simantics-developers@simantics.org">mailto:simantics-developers@simantics.org</a> Send "newsletter" to `simantics-developers@simantics.org:</li>
\r
594 <p><strong>Newsletter template:</strong></p>
\r
595 <pre><code>Hello everyone,
\r
597 Simantics release x.y.z[.w] has been released. Head over to
\r
598 https://www.simantics.org/redmine/news/<news number>
\r
599 for the release news.
\r
602 Simantics Release Engineering Team
\r
604 <p><strong>Redmine news template:</strong></p>
\r
605 <pre><code>Title: Simantics x.y.z[.w] released
\r
607 Simantics x.y.z[.w] was released on <date>.
\r
608 Please find change log at: [[simantics-platform:Simantics_xyzw|Simantics x.y.z[.w]]]
\r
610 Insert some general thoughts on the release...
\r
615 <li>Incorporate tutorial code in the platform repository as a separate folder to allow platform builds to directly ensure that the tutorial code still builds OK</li>
\r
620 <!-- This document was created with MarkdownPad, the Markdown editor for Windows (http://markdownpad.com) -->
\r