Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-4088

Implement logic to get the GenArk available genomes

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Implement logic to get the GenArk available genomes https://api.genome.ucsc.edu/list/genarkGenomes and load them in a way that makes the search easier and stores the required fields.

        Attachments

          Activity

          jsirigin Jaya Sravani Sirigineedi (Inactive) created issue -
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Field Original Value New Value
          Epic Link IGBF-4086 [ 23382 ]
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Story Points 1 2
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Sprint Spring 3 [ 212 ]
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          Hide
          jsirigin Jaya Sravani Sirigineedi (Inactive) added a comment -

          Implementation is done, when testing found out that the API is returning a different value now for the hubUrlPrefix, which we were planning to use to build the hub.txt url. After discussing with Nowlan Freese, we decided to hardcode the prefix url, which would be the genark hub domain for now, and follow up with the UCSC team for more info.

          Nowlan Freese here is the context:

          The value for the variable hubUrlPrefix in this API (https://api.genome.ucsc.edu/list/genarkGenomes) has been changed from an actual hub domain (https://hgdownload.soe.ucsc.edu/hubs) to some relative path (/gbdb/genark) we were planning to use the original value to build the hub Url for each genome (by adding the hubUrlPrefix to the hubUrl variable present inside the genome object) and use the hub.txt to load the hubs into IGB.

          Example hub.txt url built from the API response:
          Before the changes: https://hgdownload.soe.ucsc.edu/hubs/GCA/000/001/905/GCA_000001905.1/hub.txt
          After the changes: /gbdb/genark/GCA/000/001/905/GCA_000001905.1/hub.txt (this isn’t the actual hub.txt location, which is giving us an issue to load the hub)

          May we know why the change occurred? Is it safe to assume https://hgdownload.soe.ucsc.edu/hubs this would be the domain for the genark genomes in the future as well, so that we can hardcode it on our end? Or else is there any other API that can give us the actual domain for the genark hub?

          Will change the code to use the hardcoded domain and do the testing again.

          Show
          jsirigin Jaya Sravani Sirigineedi (Inactive) added a comment - Implementation is done, when testing found out that the API is returning a different value now for the hubUrlPrefix, which we were planning to use to build the hub.txt url. After discussing with Nowlan Freese , we decided to hardcode the prefix url, which would be the genark hub domain for now, and follow up with the UCSC team for more info. Nowlan Freese here is the context: The value for the variable hubUrlPrefix in this API ( https://api.genome.ucsc.edu/list/genarkGenomes ) has been changed from an actual hub domain ( https://hgdownload.soe.ucsc.edu/hubs ) to some relative path (/gbdb/genark) we were planning to use the original value to build the hub Url for each genome (by adding the hubUrlPrefix to the hubUrl variable present inside the genome object) and use the hub.txt to load the hubs into IGB. Example hub.txt url built from the API response: Before the changes: https://hgdownload.soe.ucsc.edu/hubs/GCA/000/001/905/GCA_000001905.1/hub.txt After the changes: /gbdb/genark/GCA/000/001/905/GCA_000001905.1/hub.txt (this isn’t the actual hub.txt location, which is giving us an issue to load the hub) May we know why the change occurred? Is it safe to assume https://hgdownload.soe.ucsc.edu/hubs this would be the domain for the genark genomes in the future as well, so that we can hardcode it on our end? Or else is there any other API that can give us the actual domain for the genark hub? Will change the code to use the hardcoded domain and do the testing again.
          Hide
          jsirigin Jaya Sravani Sirigineedi (Inactive) added a comment -

          Changes are completed and everything's working as expected. Here's the branch that has updated code: https://bitbucket.org/jaya-sravani/ucsc-genark-data-provider/branch/IGBF-4088. Please review and let me know if there are any issues.

          To test:

          1. Pull the branch in your local and build the ucsc-genark-data-provider service using "mvn clean install"
          2. Run IGB.
          3. Now add the data provider as a plugin in IGB, while choosing the folder choose the generated target folder of the ucsc-genark-data-provider service.
          4. Check whether the genark genomes are getting populated or not. (This is the API https://api.genome.ucsc.edu/list/genarkGenomes from where genomes are retrieved)
          Show
          jsirigin Jaya Sravani Sirigineedi (Inactive) added a comment - Changes are completed and everything's working as expected. Here's the branch that has updated code: https://bitbucket.org/jaya-sravani/ucsc-genark-data-provider/branch/IGBF-4088 . Please review and let me know if there are any issues. To test: Pull the branch in your local and build the ucsc-genark-data-provider service using "mvn clean install" Run IGB. Now add the data provider as a plugin in IGB, while choosing the folder choose the generated target folder of the ucsc-genark-data-provider service. Check whether the genark genomes are getting populated or not. (This is the API https://api.genome.ucsc.edu/list/genarkGenomes from where genomes are retrieved)
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Assignee Jaya Sravani Sirigineedi [ jsirigin ]
          nfreese Nowlan Freese made changes -
          Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
          Hide
          nfreese Nowlan Freese added a comment - - edited

          Tested on Mac using IGB 10.2.0 main branch installer with Sravani's 4088 GenArk branch.

          • App loads successfully in IGB, I am able to see the genomes from UCSC GenArk.
          • Code looks good.

          Ready for pull request.

          Show
          nfreese Nowlan Freese added a comment - - edited Tested on Mac using IGB 10.2.0 main branch installer with Sravani's 4088 GenArk branch. App loads successfully in IGB, I am able to see the genomes from UCSC GenArk. Code looks good. Ready for pull request.
          nfreese Nowlan Freese made changes -
          Assignee Jaya Sravani Sirigineedi [ jsirigin ]
          nfreese Nowlan Freese made changes -
          Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
          ann.loraine Ann Loraine made changes -
          Sprint Spring 3 [ 212 ] Spring 3, Spring 4 [ 212, 213 ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          Hide
          jsirigin Jaya Sravani Sirigineedi (Inactive) added a comment -

          Raised the PR and merged it to main in my workspace. As this is an app, we wouldn't be pushing it to the Loraine lab workspace yet. We will be doing it once everything's developed. Closing the ticket.

          Show
          jsirigin Jaya Sravani Sirigineedi (Inactive) added a comment - Raised the PR and merged it to main in my workspace. As this is an app, we wouldn't be pushing it to the Loraine lab workspace yet. We will be doing it once everything's developed. Closing the ticket.
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
          jsirigin Jaya Sravani Sirigineedi (Inactive) made changes -
          Resolution Done [ 10000 ]
          Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]

            People

            • Assignee:
              jsirigin Jaya Sravani Sirigineedi (Inactive)
              Reporter:
              jsirigin Jaya Sravani Sirigineedi (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: