Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-1178

Migrate IGB CI from Jenkins to BitBucket pipelines

    Details

    • Story Points:
      4
    • Sprint:
      Fall 2017

      Attachments

        Issue Links

          Activity

          ann.loraine Ann Loraine created issue -
          ann.loraine Ann Loraine made changes -
          Field Original Value New Value
          Status Open [ 1 ] In Progress [ 3 ]
          ann.loraine Ann Loraine made changes -
          Summary Update Jenkins IGB release process for 9.0.1 release Migrate IGB CI from Jenkins to BitBucket pipelines
          Hide
          ann.loraine Ann Loraine added a comment -
          • Create pipelines.yml, add to top level of IGB directory

          features: uses custom Docker image as build environment; obtains private assets from private repository; uses sed to edit files in build environment as required; signs installers

          • Modify main project pom.xml to include Install4J process
          • Create Dockerfile and Docker container w/ build environment.
          • Docker image contains: Mac, Windows, Linux JRE for packaging with IGB installer (required by Install4J)
          • Build optional plug-ins

          Test:

          • Create fork
          • Configure environment variables (passphrase for jar-signing key, Install4J license key)
          • Download, install, check it runs
          • Deploy on BioViz in new folder named for release (e.g., 9.0.1); test again
          • Check functionality with optional plugins

          Deploy:

          • Update releases symbolic link
          Show
          ann.loraine Ann Loraine added a comment - Create pipelines.yml, add to top level of IGB directory features: uses custom Docker image as build environment; obtains private assets from private repository; uses sed to edit files in build environment as required; signs installers Modify main project pom.xml to include Install4J process Create Dockerfile and Docker container w/ build environment. Docker image contains: Mac, Windows, Linux JRE for packaging with IGB installer (required by Install4J) Deploy as private (for now) docker image at https://hub.docker.com/u/lorainelab/ Build optional plug-ins Test: Create fork Configure environment variables (passphrase for jar-signing key, Install4J license key) Download, install, check it runs Deploy on BioViz in new folder named for release (e.g., 9.0.1); test again Check functionality with optional plugins Deploy: Update releases symbolic link
          ann.loraine Ann Loraine made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          Hide
          mason Mason Meyer (Inactive) added a comment -

          I was able to spend some time testing the IGB Installers deployed by Bitbucket Pipelines and have verified that IGB installs properly on Windows, Mac, and Linux, using the installation files available here: https://bitbucket.org/aloraine/integrated-genome-browser-sanket-patil/downloads/

          When installing IGB on Windows, a warning from the OS does trigger. However, I always see this warning when installing any version of IGB other than the live version (from Bioviz.org). I wanted to mention this, though, because this warning says the publisher is "Unknown" (see attached screenshot). After I select to "Run Anyway" the installer begins, but then another pop-up appears asking me if I'd like to allow the app to make changes to my device. In this pop-up, the publisher listed is "University of North Carolina at Charlotte". The lack of an identified publisher in the first warning may be an issue we want to discuss, but I do not believe this has anything to do with the switch to Pipelines. Also, I believe that users will never see the initial warning, as they do not see it now when installing from Bioviz.org even though I see it when installing the Development branch.

          I also checked to verify that IGB is functioning as expected, and it seems to be, but I would like to continue testing in this area to see if any of IGB's subsystems are affected by the switch to Pipelines. If there is anything else you would like me to look into or focus on during my testing, please let me know.

          Show
          mason Mason Meyer (Inactive) added a comment - I was able to spend some time testing the IGB Installers deployed by Bitbucket Pipelines and have verified that IGB installs properly on Windows, Mac, and Linux, using the installation files available here: https://bitbucket.org/aloraine/integrated-genome-browser-sanket-patil/downloads/ When installing IGB on Windows, a warning from the OS does trigger. However, I always see this warning when installing any version of IGB other than the live version (from Bioviz.org). I wanted to mention this, though, because this warning says the publisher is "Unknown" (see attached screenshot). After I select to "Run Anyway" the installer begins, but then another pop-up appears asking me if I'd like to allow the app to make changes to my device. In this pop-up, the publisher listed is "University of North Carolina at Charlotte". The lack of an identified publisher in the first warning may be an issue we want to discuss, but I do not believe this has anything to do with the switch to Pipelines. Also, I believe that users will never see the initial warning, as they do not see it now when installing from Bioviz.org even though I see it when installing the Development branch. I also checked to verify that IGB is functioning as expected, and it seems to be, but I would like to continue testing in this area to see if any of IGB's subsystems are affected by the switch to Pipelines. If there is anything else you would like me to look into or focus on during my testing, please let me know.
          mason Mason Meyer (Inactive) made changes -
          Attachment UnknownPublisher.png [ 14035 ]
          ann.loraine Ann Loraine made changes -
          Status Needs 1st Level Review [ 10005 ] Reviewing [ 10301 ]
          ann.loraine Ann Loraine made changes -
          Assignee Sanket Patil [ spatil26 ] Ann Loraine [ aloraine ]
          ann.loraine Ann Loraine made changes -
          Status Reviewing [ 10301 ] Ready for Pull Request [ 10304 ]
          Hide
          ann.loraine Ann Loraine added a comment -

          Code review and functional review both pass.
          Please issue pull request to master branch on team repo.

          Show
          ann.loraine Ann Loraine added a comment - Code review and functional review both pass. Please issue pull request to master branch on team repo.
          ann.loraine Ann Loraine made changes -
          Assignee Ann Loraine [ aloraine ] Sanket Patil [ spatil26 ]
          spatil26 Sanket Patil (Inactive) made changes -
          Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
          spatil26 Sanket Patil (Inactive) made changes -
          Assignee Sanket Patil [ spatil26 ] Ann Loraine [ aloraine ]
          Hide
          spatil26 Sanket Patil (Inactive) added a comment -

          Attaching mail conversation related to warning 'Unknown Publisher' for future references.

          Show
          spatil26 Sanket Patil (Inactive) added a comment - Attaching mail conversation related to warning 'Unknown Publisher' for future references.
          spatil26 Sanket Patil (Inactive) made changes -
          Attachment IGBF-1178 Re_ please test.pdf [ 14038 ]
          ann.loraine Ann Loraine made changes -
          Status Pull Request Submitted [ 10101 ] Needs Testing [ 10002 ]
          ann.loraine Ann Loraine made changes -
          Assignee Ann Loraine [ aloraine ] Mason Meyer [ mason ]
          Hide
          mason Mason Meyer (Inactive) added a comment - - edited

          While testing the 9.0.1 release candidate's zip file, I noticed that it contained an unnecessary folder structure when unzipped:

          "opt/atlassian/pipelines/agent/build/content"

          The file structure for the current live version of the IGB zip file (9.0.0) is "IGB/content", which is more user-friendly.

          I am re-assigning this issue to Sanket and moving to the To-Do column so he can take a look.

          Show
          mason Mason Meyer (Inactive) added a comment - - edited While testing the 9.0.1 release candidate's zip file, I noticed that it contained an unnecessary folder structure when unzipped: "opt/atlassian/pipelines/agent/build/content" The file structure for the current live version of the IGB zip file (9.0.0) is "IGB/content", which is more user-friendly. I am re-assigning this issue to Sanket and moving to the To-Do column so he can take a look.
          mason Mason Meyer (Inactive) made changes -
          Assignee Mason Meyer [ mason ] Sanket Patil [ spatil26 ]
          mason Mason Meyer (Inactive) made changes -
          Status Needs Testing [ 10002 ] Open [ 1 ]
          mason Mason Meyer (Inactive) made changes -
          Rank Ranked higher
          Hide
          ann.loraine Ann Loraine added a comment -

          Please note:

          The installers are now being built on the IGB master branch.

          I have not yet made a release candidate fork.

          Mason, do switch to testing installers from:

          https://bitbucket.org/lorainelab/integrated-genome-browser/

          (Click Downloads link to obtain installers built from the master branch.)

          Show
          ann.loraine Ann Loraine added a comment - Please note: The installers are now being built on the IGB master branch. I have not yet made a release candidate fork. Mason, do switch to testing installers from: https://bitbucket.org/lorainelab/integrated-genome-browser/ (Click Downloads link to obtain installers built from the master branch.)
          Hide
          mason Mason Meyer (Inactive) added a comment -

          Hello Ann,

          https://bitbucket.org/lorainelab/integrated-genome-browser/ is where I am testing the installers from.

          I guess I used the term "release candidate" inappropriately. I was just calling this the "release candidate" because I was under the impression that this is what would be released if there were no issues to fix.

          My comment above is actually specific to the IGB.zip file available from Bitbucket Pipelines, here: https://bitbucket.org/lorainelab/integrated-genome-browser/downloads/

          Because of this, I thought we might want to look into why there are so many extra folders now when the IGB.zip file is unarchived.

          Show
          mason Mason Meyer (Inactive) added a comment - Hello Ann, https://bitbucket.org/lorainelab/integrated-genome-browser/ is where I am testing the installers from. I guess I used the term "release candidate" inappropriately. I was just calling this the "release candidate" because I was under the impression that this is what would be released if there were no issues to fix. My comment above is actually specific to the IGB.zip file available from Bitbucket Pipelines, here: https://bitbucket.org/lorainelab/integrated-genome-browser/downloads/ Because of this, I thought we might want to look into why there are so many extra folders now when the IGB.zip file is unarchived.
          spatil26 Sanket Patil (Inactive) made changes -
          Link This issue relates to IGBF-1191 [ IGBF-1191 ]
          spatil26 Sanket Patil (Inactive) made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          spatil26 Sanket Patil (Inactive) made changes -
          Status In Progress [ 3 ] Open [ 1 ]
          spatil26 Sanket Patil (Inactive) made changes -
          Link This issue relates to IGBF-1192 [ IGBF-1192 ]
          Hide
          spatil26 Sanket Patil (Inactive) added a comment -

          Hello Mason and Ann,
          I have created a new issues IGBF-1191 and IGBF-1192.
          IGBF-1191 deals with introducing two new bitbucket pipelines environment variables
          IGBF-1192 deals with igb.zip issue.

          Both issue are linked to IGBF-1178

          Show
          spatil26 Sanket Patil (Inactive) added a comment - Hello Mason and Ann, I have created a new issues IGBF-1191 and IGBF-1192 . IGBF-1191 deals with introducing two new bitbucket pipelines environment variables IGBF-1192 deals with igb.zip issue. Both issue are linked to IGBF-1178
          ann.loraine Ann Loraine made changes -
          Status Open [ 1 ] Needs Testing [ 10002 ]
          ann.loraine Ann Loraine made changes -
          Assignee Sanket Patil [ spatil26 ] Mason Meyer [ mason ]
          Hide
          mason Mason Meyer (Inactive) added a comment -

          With this new change, I can successfully install IGB on Linux, Mac, and Windows using the builds available from Bitbucket Pipelines. The available IGB Zip file contains the correct hierarchy (see IGBF-1192) and the Bitbucket Downloads page contains appropriate files (see screenshot). I have been testing various aspects of IGB to ensure stability after this change and at this point, everything seems to be functioning as expected in relation to the migration of IGB CI from Jenkins to Bitbucket Pipelines. I will continue to monitor this as I perform pre and post-release testing, but as of now I am marking this issue as resolved.

          Show
          mason Mason Meyer (Inactive) added a comment - With this new change, I can successfully install IGB on Linux, Mac, and Windows using the builds available from Bitbucket Pipelines. The available IGB Zip file contains the correct hierarchy (see IGBF-1192 ) and the Bitbucket Downloads page contains appropriate files (see screenshot). I have been testing various aspects of IGB to ensure stability after this change and at this point, everything seems to be functioning as expected in relation to the migration of IGB CI from Jenkins to Bitbucket Pipelines. I will continue to monitor this as I perform pre and post-release testing, but as of now I am marking this issue as resolved.
          mason Mason Meyer (Inactive) made changes -
          Attachment BitbucketDownloads.png [ 14048 ]
          mason Mason Meyer (Inactive) made changes -
          Resolution Done [ 10000 ]
          Status Needs Testing [ 10002 ] Closed [ 6 ]
          ieclabau Ivory Blakley (Inactive) made changes -
          Fix Version/s 9.0.1 Minor Release [ 10500 ]
          ann.loraine Ann Loraine made changes -
          Assignee Mason Meyer [ mason ] Sanket Patil [ spatil26 ]
          ann.loraine Ann Loraine made changes -
          Link This issue relates to IGBF-1472 [ IGBF-1472 ]
          ann.loraine Ann Loraine made changes -
          Workflow Loraine Lab Workflow [ 17840 ] Fall 2019 Workflow Update [ 19811 ]
          ann.loraine Ann Loraine made changes -
          Workflow Fall 2019 Workflow Update [ 19811 ] Revised Fall 2019 Workflow Update [ 21930 ]

            People

            • Assignee:
              spatil26 Sanket Patil (Inactive)
              Reporter:
              ann.loraine Ann Loraine
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: