Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-3129

Enable IGB to directly consume data from UCSC JSON API

        Details

        • Type: Epic
        • Status: To-Do (View Workflow)
        • Priority: Major
        • Resolution: Unresolved
        • Affects Version/s: None
        • Fix Version/s: None
        • Labels:
          None
        • Epic Name:
          Add UCSC REST API to IGB
        • Story Points:
          5

          Description

          See linked tickets.

            Attachments

              Issue Links

              relates to

              Epic - Created by JIRA Software - do not edit or delete. Issue type for a big user story that needs to be broken down. IGBF-3555 Add Ensembl REST API to IGB

              • Major - Major loss of function.
              • To-Do

              Task - A task that needs to be done. IGBF-3601 Investigate microbe genome availability from UCSC

              • Major - Major loss of function.
              • To-Do

                Activity

                Ascending order - Click to sort in descending order
                ann.loraine Ann Loraine created issue -
                ann.loraine Ann Loraine made changes -
                Field Original Value New Value
                Epic Link IGBF-1765 [ 17855 ]
                ann.loraine Ann Loraine made changes -
                Link This issue relates to IGBF-2869 [ IGBF-2869 ]
                ann.loraine Ann Loraine made changes -
                Rank Ranked higher
                ann.loraine Ann Loraine made changes -
                Rank Ranked higher
                ann.loraine Ann Loraine made changes -
                Sprint Fall 5 [ 181 ]
                ann.loraine Ann Loraine made changes -
                Sprint Fall 5 [ 181 ]
                ann.loraine Ann Loraine made changes -
                Rank Ranked lower
                nfreese Nowlan Freese made changes -
                Issue Type Task [ 3 ] Epic [ 10000 ]
                nfreese Nowlan Freese made changes -
                Epic Link IGBF-1765 [ 17855 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-2869 [ 21022 ]
                nfreese Nowlan Freese made changes -
                Epic Name Add UCSC REST API to IGB
                nfreese Nowlan Freese made changes -
                Link This issue relates to IGBF-2869 [ IGBF-2869 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3501 [ 22720 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3502 [ 22721 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3503 [ 22722 ]
                Hide
                Permalink
                nfreese Nowlan Freese added a comment - - edited

                Documentation

                DAS: https://genome.ucsc.edu/FAQ/FAQdownloads.html#download23
                API: https://genome.ucsc.edu/goldenPath/help/api.html

                Show
                nfreese Nowlan Freese added a comment - - edited Documentation DAS: https://genome.ucsc.edu/FAQ/FAQdownloads.html#download23 API: https://genome.ucsc.edu/goldenPath/help/api.html
                Hide
                Permalink
                nfreese Nowlan Freese added a comment -

                The queries below should produce equivalent output
                DAS: https://genome.ucsc.edu/cgi-bin/das/hg38/dna?segment=M:1,16569
                API: https://api.genome.ucsc.edu/getData/sequence?genome=hg38;chrom=chrM

                Show
                nfreese Nowlan Freese added a comment - The queries below should produce equivalent output DAS: https://genome.ucsc.edu/cgi-bin/das/hg38/dna?segment=M:1,16569 API: https://api.genome.ucsc.edu/getData/sequence?genome=hg38;chrom=chrM
                Hide
                Permalink
                nfreese Nowlan Freese added a comment -

                Using the hg38 human genome as an example:
                DAS Types (available files for that genome): https://genome.ucsc.edu/cgi-bin/das/hg38/types
                DAS Entry Points (chromosomes for that genome): https://genome.ucsc.edu/cgi-bin/das/hg38/entry_points

                Show
                nfreese Nowlan Freese added a comment - Using the hg38 human genome as an example: DAS Types (available files for that genome): https://genome.ucsc.edu/cgi-bin/das/hg38/types DAS Entry Points (chromosomes for that genome): https://genome.ucsc.edu/cgi-bin/das/hg38/entry_points
                Hide
                Permalink
                nfreese Nowlan Freese added a comment -

                Current UCSC DAS genomes: https://genome.ucsc.edu/cgi-bin/das/dsn
                Current UCSC API genomes: https://api.genome.ucsc.edu/list/ucscGenomes

                Show
                nfreese Nowlan Freese added a comment - Current UCSC DAS genomes: https://genome.ucsc.edu/cgi-bin/das/dsn Current UCSC API genomes: https://api.genome.ucsc.edu/list/ucscGenomes
                nfreese Nowlan Freese made changes -
                Link This issue relates to IGBF-3555 [ IGBF-3555 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3584 [ 22803 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3599 [ 22818 ]
                nfreese Nowlan Freese made changes -
                Link This issue relates to IGBF-3601 [ IGBF-3601 ]
                Hide
                Permalink
                nfreese Nowlan Freese added a comment - - edited

                Additional API examples:

                • List all of the tracks available for the mm39 mouse genome: 
                  https://api.genome.ucsc.edu/list/tracks?genome=mm39;trackLeavesOnly=1
                • Get the all_mrna track data for the mm39 mouse genome on chromosome 1 from 60380220 to 60429457: 
                  https://api.genome.ucsc.edu/getData/track?genome=mm39;track=all_mrna;chrom=chr1;start=60380220;end=60429457
                • Get the genomic sequence for the specified region on chromosome 1 for the mm39 mouse genome: 
                  https://api.genome.ucsc.edu/getData/sequence?genome=mm39;chrom=chr1;start=60380220;end=60429457
                Show
                nfreese Nowlan Freese added a comment - - edited Additional API examples: List all of the tracks available for the mm39 mouse genome: https: //api.genome.ucsc.edu/list/tracks?genome=mm39;trackLeavesOnly=1 Get the all_mrna track data for the mm39 mouse genome on chromosome 1 from 60380220 to 60429457: https: //api.genome.ucsc.edu/getData/track?genome=mm39;track=all_mrna;chrom=chr1;start=60380220;end=60429457 Get the genomic sequence for the specified region on chromosome 1 for the mm39 mouse genome: https: //api.genome.ucsc.edu/getData/sequence?genome=mm39;chrom=chr1;start=60380220;end=60429457
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3574 [ 22793 ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Attachment Screenshot 2024-02-15 at 2.24.48 PM.png [ 18213 ]
                Hide
                Permalink
                jsirigin Jaya Sravani Sirigineedi added a comment -

                The response for the https://api.genome.ucsc.edu/list/tracks?genome=galGal6 without any additional filter has few parent and children tracks in it, and the parent tracks doesn't have any data in the https://api.genome.ucsc.edu//getData/track?genome=galGal6&track=cons77wayViewelements&chrom=chr1&start=1&end=248956 API, it says in the response to query only for the children and the parent container doesn't have data. Attached a screenshot below. To avoid these tracks to show up in the available tracks list we can use this URL instead https://api.genome.ucsc.edu/list/tracks?genome=galGal6;trackLeavesOnly=1 which has the trackLeavesOnly=1 parameter added to it which filters out the parents and gives us only the children in the response.

                Show
                jsirigin Jaya Sravani Sirigineedi added a comment - The response for the https://api.genome.ucsc.edu/list/tracks?genome=galGal6 without any additional filter has few parent and children tracks in it, and the parent tracks doesn't have any data in the https://api.genome.ucsc.edu//getData/track?genome=galGal6&track=cons77wayViewelements&chrom=chr1&start=1&end=248956 API, it says in the response to query only for the children and the parent container doesn't have data. Attached a screenshot below. To avoid these tracks to show up in the available tracks list we can use this URL instead https://api.genome.ucsc.edu/list/tracks?genome=galGal6;trackLeavesOnly=1 which has the trackLeavesOnly=1 parameter added to it which filters out the parents and gives us only the children in the response.
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3603 [ 22822 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3598 [ 22817 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3625 [ 22844 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3592 [ 22811 ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Epic Child IGBF-3626 [ 22845 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3633 [ 22852 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3655 [ 22874 ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Epic Child IGBF-3656 [ 22875 ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Epic Child IGBF-3657 [ 22876 ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Epic Child IGBF-3658 [ 22877 ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Epic Child IGBF-3659 [ 22878 ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Epic Child IGBF-3689 [ 22908 ]
                nfreese Nowlan Freese made changes -
                Comment [ Tested Sravani's branch on my Mac.

                Available files appear in their respective folders. Able to load data from each folder. No issues in log when building or running.

                Ready for pull request. ]
                jsirigin Jaya Sravani Sirigineedi made changes -
                Epic Child IGBF-3703 [ 22922 ]
                nfreese Nowlan Freese made changes -
                Epic Child IGBF-3722 [ 22941 ]

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    ann.loraine Ann Loraine
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    3 Start watching this issue

                    Dates

                    • Created:
                      Updated: