Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-3006

Fix broken Bioviz Connect following Nov 2021 CyVerse update

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Blocker
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      BioViz Connect instances are unable to obtain tokens from CyVerse endpoints following the recent updates to CyVerse Tuesday Nov. 2, 2021

        Attachments

          Activity

          ann.loraine Ann Loraine created issue -
          ann.loraine Ann Loraine made changes -
          Field Original Value New Value
          Epic Link IGBF-2376 [ 18533 ]
          ann.loraine Ann Loraine made changes -
          Summary Fix inability to obtain token from CyVerse following Nov 2021 update Fix inability to Bioviz Connect problem following Nov 2021 update
          ann.loraine Ann Loraine made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          ann.loraine Ann Loraine made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          ann.loraine Ann Loraine made changes -
          Summary Fix inability to Bioviz Connect problem following Nov 2021 update Fix broken Bioviz Connect following Nov 2021 update
          ann.loraine Ann Loraine made changes -
          Summary Fix broken Bioviz Connect following Nov 2021 update Fix broken Bioviz Connect following Nov 2021 CyVerse update
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          Hide
          ann.loraine Ann Loraine added a comment - - edited

          [~aloraine] modified the BioViz Connect start page to disallow login while we try to fix the problem.
          When the problem is fixed, don't revert the changes. Instead, uncomment the login button and comment the "sorry it's broken" statement that was shown instead of the login button.

          Show
          ann.loraine Ann Loraine added a comment - - edited [~aloraine] modified the BioViz Connect start page to disallow login while we try to fix the problem. When the problem is fixed, don't revert the changes. Instead, uncomment the login button and comment the "sorry it's broken" statement that was shown instead of the login button.
          Hide
          karthik Karthik Raveendran added a comment -

          Note: connect.bioviz.org is returning 503 response. Terrain APIs are returning 503 response including access token. Tried local system and bvctest6 as well – 503 response everywhere. When the old access token is used in Postman for all the other Terrain APIs, instead of getting Unauthorized 401, the response is 500 server error. It seems like an issue from Cyverse but the Cyverse status page is all operational and Cyverse DE is operational as well

          Show
          karthik Karthik Raveendran added a comment - Note: connect.bioviz.org is returning 503 response. Terrain APIs are returning 503 response including access token. Tried local system and bvctest6 as well – 503 response everywhere. When the old access token is used in Postman for all the other Terrain APIs, instead of getting Unauthorized 401, the response is 500 server error. It seems like an issue from Cyverse but the Cyverse status page is all operational and Cyverse DE is operational as well
          karthik Karthik Raveendran made changes -
          Attachment error log.jpg [ 16841 ]
          Hide
          nfreese Nowlan Freese added a comment -

          From Sriram Srinivasan on the CyVerse team:

          Hi Nowlan
          We did have outage this morning. It should be fixed now.

          Thanks
          Sriram

          Show
          nfreese Nowlan Freese added a comment - From Sriram Srinivasan on the CyVerse team: Hi Nowlan We did have outage this morning. It should be fixed now. Thanks Sriram
          ann.loraine Ann Loraine made changes -
          Assignee Karthik Raveendran [ karthik ] Ann Loraine [ aloraine ]
          Hide
          ann.loraine Ann Loraine added a comment - - edited

          Removed message regarding outage by uncommenting the button and commenting the error message. Added additional comments to the page to show which bits need to be commented and uncommented during an outage. Checked it on bioviztest host first to check that the system is working properly before removing the message on the main production host. I was able to log in and view my files listed properly. Updated production site and changed its "stack" tag back to "Prod".

          Moving to Closed.

          Show
          ann.loraine Ann Loraine added a comment - - edited Removed message regarding outage by uncommenting the button and commenting the error message. Added additional comments to the page to show which bits need to be commented and uncommented during an outage. Checked it on bioviztest host first to check that the system is working properly before removing the message on the main production host. I was able to log in and view my files listed properly. Updated production site and changed its "stack" tag back to "Prod". Moving to Closed.
          ann.loraine Ann Loraine made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          ann.loraine Ann Loraine made changes -
          Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
          ann.loraine Ann Loraine made changes -
          Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
          ann.loraine Ann Loraine made changes -
          Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
          ann.loraine Ann Loraine made changes -
          Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
          ann.loraine Ann Loraine made changes -
          Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
          ann.loraine Ann Loraine made changes -
          Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
          ann.loraine Ann Loraine made changes -
          Resolution Done [ 10000 ]
          Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]
          nfreese Nowlan Freese made changes -
          Attachment apache2accesslog.txt [ 16849 ]
          Attachment apache2errorlog.txt [ 16850 ]
          Hide
          nfreese Nowlan Freese added a comment -

          I added the apache2 access and error logs. It does not appear that the issue was caused by intrusion or denial of service, but there may be a few things in the logs worth taking a look at.

          Show
          nfreese Nowlan Freese added a comment - I added the apache2 access and error logs. It does not appear that the issue was caused by intrusion or denial of service, but there may be a few things in the logs worth taking a look at.

            People

            • Assignee:
              ann.loraine Ann Loraine
              Reporter:
              ann.loraine Ann Loraine
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: