Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-2869

Investigate adding UCSC JSON API as a new data provider

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Situation: The UCSC DAS data provider has access to a large number of genomes and datasets that are very useful for IGB users. However, the UCSC DAS endpoint can be slow and it is unclear how much longer UCSC will support it as they have created a new JSON API with the same functionality.

      Task: Investigate the feasibility of altering the IGB UCSC DAS logic to add a new JSON API endpoint.

        Attachments

          Issue Links

            Activity

            nfreese Nowlan Freese created issue -
            nfreese Nowlan Freese made changes -
            Field Original Value New Value
            Epic Link IGBF-1765 [ 17855 ]
            nfreese Nowlan Freese made changes -
            Link This issue relates to IGBF-2863 [ IGBF-2863 ]
            nfreese Nowlan Freese made changes -
            Link This issue relates to IGBF-2793 [ IGBF-2793 ]
            nfreese Nowlan Freese made changes -
            Link This issue relates to IGBF-2855 [ IGBF-2855 ]
            nfreese Nowlan Freese made changes -
            Rank Ranked higher
            Hide
            nfreese Nowlan Freese added a comment -
            Show
            nfreese Nowlan Freese added a comment - Current UCSC DAS genomes: https://genome.ucsc.edu/cgi-bin/das/dsn Current UCSC API genomes: https://api.genome.ucsc.edu/list/ucscGenomes
            Show
            nfreese Nowlan Freese added a comment - Some documentation: DAS: https://genome.ucsc.edu/FAQ/FAQdownloads.html#download23 API: https://genome.ucsc.edu/goldenPath/help/api.html
            Hide
            nfreese Nowlan Freese added a comment -

            What would the same query to DAS look like for the API?

            Show
            nfreese Nowlan Freese added a comment - What would the same query to DAS look like for the API?
            ann.loraine Ann Loraine made changes -
            Sprint Spring 5 2021 May 17 - May 28 [ 121 ] Spring 5 2021 May 17 - May 28, Spring 6 2021 May 31 - June 11 [ 121, 122 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Hide
            ann.loraine Ann Loraine added a comment -

            Suggestion: Investigate adding a new data provider that consumes data from the JSON API (without changing the current DAS data provider infrastructure).

            Show
            ann.loraine Ann Loraine added a comment - Suggestion: Investigate adding a new data provider that consumes data from the JSON API (without changing the current DAS data provider infrastructure).
            ann.loraine Ann Loraine made changes -
            Summary Investigate changing UCSC DAS data provider to JSON API Investigate adding UCSCS JSON API as a new data provider
            ann.loraine Ann Loraine made changes -
            Summary Investigate adding UCSCS JSON API as a new data provider Investigate adding UCSC JSON API as a new data provider
            nfreese Nowlan Freese made changes -
            Description Situation: The UCSC DAS data provider has access to a large number of genomes and datasets that are very useful for IGB users. However, the UCSC DAS endpoint can be slow and it is unclear how much longer UCSC will support it as they have created a new JSON API with the same functionality.

            Task: Investigate the feasibility of altering the IGB UCSC DAS logic to instead use the JSON API endpoint.
            Situation: The UCSC DAS data provider has access to a large number of genomes and datasets that are very useful for IGB users. However, the UCSC DAS endpoint can be slow and it is unclear how much longer UCSC will support it as they have created a new JSON API with the same functionality.

            Task: Investigate the feasibility of altering the IGB UCSC DAS logic to add a new JSON API endpoint.
            ann.loraine Ann Loraine made changes -
            Assignee Omkar Marne [ omarne ] Ann Loraine [ aloraine ]
            nfreese Nowlan Freese made changes -
            Assignee Ann Loraine [ aloraine ]
            ann.loraine Ann Loraine made changes -
            Sprint Spring 5 2021 May 17 - May 28, Spring 6 2021 May 31 - June 11 [ 121, 122 ] Spring 5 2021 May 17 - May 28, Spring 6 2021 May 31 - June 11, Summer 1 2021 Jun 14 - Jun 25 [ 121, 122, 123 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Spring 5 2021 May 17 - May 28, Spring 6 2021 May 31 - June 11, Summer 1 2021 Jun 14 - Jun 25 [ 121, 122, 123 ] Spring 5 2021 May 17 - May 28, Spring 6 2021 May 31 - June 11 [ 121, 122 ]
            ann.loraine Ann Loraine made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            ann.loraine Ann Loraine made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            ann.loraine Ann Loraine made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            ann.loraine Ann Loraine made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            ann.loraine Ann Loraine made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            ann.loraine Ann Loraine made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            ann.loraine Ann Loraine made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]
            ann.loraine Ann Loraine made changes -
            Assignee Nowlan Freese [ nfreese ]
            Hide
            ann.loraine Ann Loraine added a comment -

            Nowlan Freese: suggests this could be a good project for a student engineer (1 to 2 months, 15 hours/week, including training?)

            Show
            ann.loraine Ann Loraine added a comment - Nowlan Freese : suggests this could be a good project for a student engineer (1 to 2 months, 15 hours/week, including training?)
            ann.loraine Ann Loraine made changes -
            Link This issue relates to IGBF-3129 [ IGBF-3129 ]
            nfreese Nowlan Freese made changes -
            Epic Link IGBF-1765 [ 17855 ] IGBF-3129 [ 21675 ]
            nfreese Nowlan Freese made changes -
            Link This issue relates to IGBF-3129 [ IGBF-3129 ]

              People

              • Assignee:
                nfreese Nowlan Freese
                Reporter:
                nfreese Nowlan Freese
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: