Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-1866

Enable https, pretty index, add README for maven.bioviz.org

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None
    • Story Points:
      2
    • Sprint:
      Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1, Fall 2019 Sprint 2, Fall 4 : 30 Sep to 11 Oct

      Description

      We are providing access to legacy artifacts using an EC2 that is hosting http://maven.bioviz.org.

      Currently, the site does not support https access. Also, the site is not taking advantage of Apache "pretty index" feature which can show a much nicer view of folder contents than currently is being show.

      For this task, please configure the site to:

      • Support https and set up https redirection from http
      • Enable pretty index display
      • Add README explaining that this is legacy maven repository for the IGB project

      For this task, ask Dr. Loraine for the login credential.
      Certificates required to support https are in ~ec2-user home directory.

        Attachments

          Activity

          ann.loraine Ann Loraine made changes -
          Workflow Fall 2019 Workflow Update [ 19046 ] Revised Fall 2019 Workflow Update [ 22409 ]
          ann.loraine Ann Loraine made changes -
          Assignee Ann Loraine [ aloraine ] Prutha Kulkarni [ prutha ]
          ann.loraine Ann Loraine made changes -
          Resolution Done [ 10000 ]
          Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]
          ann.loraine Ann Loraine made changes -
          Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
          ann.loraine Ann Loraine made changes -
          Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
          ann.loraine Ann Loraine made changes -
          Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
          ann.loraine Ann Loraine made changes -
          Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
          ann.loraine Ann Loraine made changes -
          Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
          ann.loraine Ann Loraine made changes -
          Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
          ann.loraine Ann Loraine made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          Hide
          ann.loraine Ann Loraine added a comment -

          Added some new text explaining what the site is. Copied everything, including styling code, to a dropbox for backup.
          Marking this as done and re-assigning to original developer.

          Show
          ann.loraine Ann Loraine added a comment - Added some new text explaining what the site is. Copied everything, including styling code, to a dropbox for backup. Marking this as done and re-assigning to original developer.
          ann.loraine Ann Loraine made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Status First Level Review in Progress [ 10301 ] To-Do [ 10305 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Assignee Ann Loraine [ aloraine ]
          Hide
          prutha Prutha Kulkarni (Inactive) added a comment -

          Sure Prof. [~aloraine]

          Show
          prutha Prutha Kulkarni (Inactive) added a comment - Sure Prof. [~aloraine]
          Hide
          ann.loraine Ann Loraine added a comment -

          It looks very nice – many thanks!
          For the next steps, I would like make some edits to the documentation (readme file).
          For that, would you assign the ticket to my user and move it back to "To-Do" for me to work on next?
          Prutha Kulkarni

          Show
          ann.loraine Ann Loraine added a comment - It looks very nice – many thanks! For the next steps, I would like make some edits to the documentation (readme file). For that, would you assign the ticket to my user and move it back to "To-Do" for me to work on next? Prutha Kulkarni
          prutha Prutha Kulkarni (Inactive) made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Assignee Prutha Kulkarni [ prutha ]
          Hide
          prutha Prutha Kulkarni (Inactive) added a comment -

          Prof. [~aloraine], I have checked the config file and fixed the fancyindexing issue.
          It's working fine now. I have also changed the documentation accordingly and uploaded the updated one n the same ticket.
          You can check it by accessing following link:
          https://maven.bioviz.org/
          Thanks.

          Show
          prutha Prutha Kulkarni (Inactive) added a comment - Prof. [~aloraine] , I have checked the config file and fixed the fancyindexing issue. It's working fine now. I have also changed the documentation accordingly and uploaded the updated one n the same ticket. You can check it by accessing following link: https://maven.bioviz.org/ Thanks.
          prutha Prutha Kulkarni (Inactive) made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Attachment ConfigurationSteps_MavenRepo.docx [ 14392 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Attachment ConfigurationSteps_MavenRepo.docx [ 14435 ]
          ann.loraine Ann Loraine made changes -
          Sprint Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1, Fall 2019 Sprint 2, Fall 2019 Sprint 3 [ 70, 71, 72, 73, 74 ] Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1, Fall 2019 Sprint 2, Fall 2019 Sprint 4 [ 70, 71, 72, 73, 75 ]
          ann.loraine Ann Loraine made changes -
          Assignee Noor Zahara [ noor91zahara ] Prutha Kulkarni [ prutha ]
          ann.loraine Ann Loraine made changes -
          Status Post-merge Testing In Progress [ 10003 ] To-Do [ 10305 ]
          Hide
          ann.loraine Ann Loraine added a comment -

          HTTPS is working fine but pretty indexing is failing.
          Returning to To-Do and re-assigning to Prutha Kulkarni

          Show
          ann.loraine Ann Loraine added a comment - HTTPS is working fine but pretty indexing is failing. Returning to To-Do and re-assigning to Prutha Kulkarni
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Sprint Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1, Fall 2019 Sprint 2 [ 70, 71, 72, 73 ] Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1, Fall 2019 Sprint 2, Fall 2019 Sprint 4 [ 70, 71, 72, 73, 74 ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Sprint Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1 [ 70, 71, 72 ] Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1, Fall 2019 Sprint 2 [ 70, 71, 72, 73 ]
          ann.loraine Ann Loraine made changes -
          Workflow Loraine Lab Workflow [ 18589 ] Fall 2019 Workflow Update [ 19046 ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Sprint Summer 2019 Sprint 11, Summer 2019 Sprint 12 [ 70, 71 ] Summer 2019 Sprint 11, Summer 2019 Sprint 12, Fall 2019 Sprint 1 [ 70, 71, 72 ]
          noor91zahara Noor Zahara (Inactive) made changes -
          Status Needs Testing [ 10002 ] Testing In Progress [ 10003 ]
          noor91zahara Noor Zahara (Inactive) made changes -
          Assignee Noor Zahara [ noor91zahara ]
          Hide
          ann.loraine Ann Loraine added a comment -

          Sure, yes, that would be great - we should change http to https.
          There are a lot of POMs – could take a while but definitely worth the effort.

          Show
          ann.loraine Ann Loraine added a comment - Sure, yes, that would be great - we should change http to https. There are a lot of POMs – could take a while but definitely worth the effort.
          ann.loraine Ann Loraine made changes -
          Status Needs 1st Level Review [ 10005 ] Needs Testing [ 10002 ]
          Hide
          prutha Prutha Kulkarni (Inactive) added a comment -

          Prof. [~aloraine], I checked it for each repository. The pipeline is building successfully.
          I have uncommented the line in the document also.
          Shall I go ahead and change the repository links in the pom from http to https or the rewrite rule will take care of it?
          Please let me know.

          Show
          prutha Prutha Kulkarni (Inactive) added a comment - Prof. [~aloraine] , I checked it for each repository. The pipeline is building successfully. I have uncommented the line in the document also. Shall I go ahead and change the repository links in the pom from http to https or the rewrite rule will take care of it? Please let me know.
          prutha Prutha Kulkarni (Inactive) made changes -
          Attachment ConfigurationSteps_MavenRepo.docx [ 14392 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Attachment ConfigurationSteps_MavenRepo.docx [ 14391 ]
          Hide
          prutha Prutha Kulkarni (Inactive) added a comment -

          Sure. I will check it for other repositories.
          Thanks.

          Show
          prutha Prutha Kulkarni (Inactive) added a comment - Sure. I will check it for other repositories. Thanks.
          Hide
          ann.loraine Ann Loraine added a comment -

          Follow-up:

          I looked at: ssl.conf
          This line was commented: SSLCertificateChainFile /etc/pki/tls/certs/DigiCertCA.crt
          Next, I re-ran bitbucket pipeline for https://bitbucket.org/lorainelab/protannot/src/master/
          It has passed.

          Prutha Kulkarni - can you check the other pipelines?

          This seems like the fix we need, but it should be checked out for other repositories.

          Show
          ann.loraine Ann Loraine added a comment - Follow-up: I looked at: ssl.conf This line was commented: SSLCertificateChainFile /etc/pki/tls/certs/DigiCertCA.crt Next, I re-ran bitbucket pipeline for https://bitbucket.org/lorainelab/protannot/src/master/ It has passed. Prutha Kulkarni - can you check the other pipelines? This seems like the fix we need, but it should be checked out for other repositories.
          Hide
          ann.loraine Ann Loraine added a comment -

          I have a followup question/concern:

          One thing that confuses me about is that the same certificates are being used to enable SSL for https://nexus.bioviz.org. That site is using also using Apache for hosting, but is configured differently.

          I'll send you a link to some documentation describing how I set up and configured that site.

          Can you read it over and think about how and why that site is working but maven.bioviz.org is not?

          Show
          ann.loraine Ann Loraine added a comment - I have a followup question/concern: One thing that confuses me about is that the same certificates are being used to enable SSL for https://nexus.bioviz.org . That site is using also using Apache for hosting, but is configured differently. I'll send you a link to some documentation describing how I set up and configured that site. Can you read it over and think about how and why that site is working but maven.bioviz.org is not?
          Hide
          prutha Prutha Kulkarni (Inactive) added a comment -

          The reason why mentioned exception was occurring in the bitbucket pipeline is because we've shifted the maven repository to https and when the pipeline is trying to build the project when it encounters the need to import remote dependency, it sends a request to the maven repository server. At this point of time the SSL handshake is happening and the client tries to to find public certificate file in the default java keystore which exists in the lib/security/cacerts of JRE. Since the certificate is no there it is throwing the exception. For local machine, there are some commands which we can use to transfer the valid certificate in the default folder. But, for pipeline we need to change the JRE bundles which the docker image is using so that we can transfer the public certificate in the default directory which would eventually fix the problem.
          For reference:
          https://confluence.atlassian.com/kb/how-to-import-a-public-ssl-certificate-into-a-jvm-867025849.html#HowtoimportapublicSSLcertificateintoaJVM-commandline

          Prof. [~aloraine], please let me know if we could do that or not. If yes, then I would need docker hub credentials.
          Thanks.

          Show
          prutha Prutha Kulkarni (Inactive) added a comment - The reason why mentioned exception was occurring in the bitbucket pipeline is because we've shifted the maven repository to https and when the pipeline is trying to build the project when it encounters the need to import remote dependency, it sends a request to the maven repository server. At this point of time the SSL handshake is happening and the client tries to to find public certificate file in the default java keystore which exists in the lib/security/cacerts of JRE. Since the certificate is no there it is throwing the exception. For local machine, there are some commands which we can use to transfer the valid certificate in the default folder. But, for pipeline we need to change the JRE bundles which the docker image is using so that we can transfer the public certificate in the default directory which would eventually fix the problem. For reference: https://confluence.atlassian.com/kb/how-to-import-a-public-ssl-certificate-into-a-jvm-867025849.html#HowtoimportapublicSSLcertificateintoaJVM-commandline Prof. [~aloraine] , please let me know if we could do that or not. If yes, then I would need docker hub credentials. Thanks.
          Hide
          ann.loraine Ann Loraine added a comment -

          Please take a look at comments for

          There may be a problem with some extant pipelines and poms. Maybe due to how redirected/rewritten URLs are handled in bitbucket pipeline build environment.

          Can you look into it?

          Noor Zahara can show you.

          Show
          ann.loraine Ann Loraine added a comment - Please take a look at comments for https://jira.transvar.org/browse/IGBF-1931 There may be a problem with some extant pipelines and poms. Maybe due to how redirected/rewritten URLs are handled in bitbucket pipeline build environment. Can you look into it? Noor Zahara can show you.
          prutha Prutha Kulkarni (Inactive) made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Assignee Prutha Kulkarni [ prutha ]
          prutha Prutha Kulkarni (Inactive) made changes -
          Attachment ConfigurationSteps_MavenRepo.docx [ 14391 ]
          Hide
          prutha Prutha Kulkarni (Inactive) added a comment -

          Attching a file with the configuration steps which one needs to follow in order to configure https as well as for enabling the pretty indexing and creation of the README.md file.
          Changes are live and can be checked using the following link http://maven.bioviz.org.

          Show
          prutha Prutha Kulkarni (Inactive) added a comment - Attching a file with the configuration steps which one needs to follow in order to configure https as well as for enabling the pretty indexing and creation of the README.md file. Changes are live and can be checked using the following link http://maven.bioviz.org .
          prutha Prutha Kulkarni (Inactive) made changes -
          Story Points 1 2
          prutha Prutha Kulkarni (Inactive) made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Hide
          prutha Prutha Kulkarni (Inactive) added a comment -

          Prof. [~aloraine], could you please email me the login credentials?
          Thanks

          Show
          prutha Prutha Kulkarni (Inactive) added a comment - Prof. [~aloraine] , could you please email me the login credentials? Thanks
          prutha Prutha Kulkarni (Inactive) made changes -
          Assignee Prutha Kulkarni [ prutha ]
          ann.loraine Ann Loraine made changes -
          Description We are providing access to legacy artifacts using an EC2 that is hosting http://maven.bioviz.org.

          Currently, the site does not support https access. Also, the site is not taking advantage of Apache "pretty index" feature which can show a much nicer view of folder contents than currently is being show.

          For this task, please configure the site to:

          * Support https
          * Enable pretty index display
          * Add README explaining that this is legacy maven repository for the IGB project

          For this task, ask Dr. Loraine for the login credential.
          We are providing access to legacy artifacts using an EC2 that is hosting http://maven.bioviz.org.

          Currently, the site does not support https access. Also, the site is not taking advantage of Apache "pretty index" feature which can show a much nicer view of folder contents than currently is being show.

          For this task, please configure the site to:

          * Support https and set up https redirection from http
          * Enable pretty index display
          * Add README explaining that this is legacy maven repository for the IGB project

          For this task, ask Dr. Loraine for the login credential.
          Certificates required to support https are in ~ec2-user home directory.
          ann.loraine Ann Loraine made changes -
          Summary Enable https and pretty index for maven.bioviz.org Enable https, pretty index, add README for maven.bioviz.org
          ann.loraine Ann Loraine made changes -
          Summary Enable https for maven.bioviz.org Enable https and pretty index for maven.bioviz.org
          ann.loraine Ann Loraine made changes -
          Description * Support https
          * Enable pretty index display
          * Add README explaining that this is legacy maven repository for project
          We are providing access to legacy artifacts using an EC2 that is hosting http://maven.bioviz.org.

          Currently, the site does not support https access. Also, the site is not taking advantage of Apache "pretty index" feature which can show a much nicer view of folder contents than currently is being show.

          For this task, please configure the site to:

          * Support https
          * Enable pretty index display
          * Add README explaining that this is legacy maven repository for the IGB project

          For this task, ask Dr. Loraine for the login credential.
          ann.loraine Ann Loraine made changes -
          Summary Improve maven.bioviz.org configuration Enable https for maven.bioviz.org
          ann.loraine Ann Loraine made changes -
          Assignee Ann Loraine [ aloraine ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Sprint Summer 2019 Sprint 11 [ 70 ] Summer 2019 Sprint 11, Summer 2019 Sprint 12 [ 70, 71 ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Field Original Value New Value
          Epic Link IGBF-1531 [ 17617 ]
          ann.loraine Ann Loraine created issue -

            People

            • Assignee:
              prutha Prutha Kulkarni (Inactive)
              Reporter:
              ann.loraine Ann Loraine
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: