Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-445

index attribute for file tag in annots.xml

    Details

      Description

      Cloud storage providers like Dropbox typically make it possible for users to create links to files and then share the links. However, paths exposed in links don't correspond to physical storage, which means that IGB can't make assumptions about the location of index files for BAM, tabix, or other indexed, random access formats.

      Let's add a new optional attribute ("index") to the QuickLoad "file" tag where "index" indicates the location of the index file. Same rules about defining file locations should apply.

        Attachments

          Issue Links

            Activity

            aloraine Ann Loraine created issue -
            aloraine Ann Loraine made changes -
            Field Original Value New Value
            Rank Ranked higher
            mason Mason Meyer (Inactive) made changes -
            Rank Ranked lower
            mason Mason Meyer (Inactive) made changes -
            Epic Link IGBF-440 [ 15498 ]
            mason Mason Meyer (Inactive) made changes -
            Rank Ranked lower
            aloraine Ann Loraine made changes -
            Rank Ranked higher
            aloraine Ann Loraine made changes -
            Summary new attribute for file tag index attribute for file tag
            aloraine Ann Loraine made changes -
            Story Points 0.5
            aloraine Ann Loraine made changes -
            Summary index attribute for file tag index attribute for file tag in annots.xml
            aloraine Ann Loraine made changes -
            Sprint Sprint 19 [ 24 ]
            aloraine Ann Loraine made changes -
            Rank Ranked lower
            dcnorris David Norris (Inactive) made changes -
            Sprint Sprint 19 [ 24 ]
            dcnorris David Norris (Inactive) made changes -
            Rank Ranked higher
            aloraine Ann Loraine made changes -
            Rank Ranked higher
            aloraine Ann Loraine made changes -
            Sprint Sprint 27 [ 35 ]
            aloraine Ann Loraine made changes -
            Rank Ranked lower
            jeckstein John Eckstein (Inactive) made changes -
            Assignee David Norris [ dcnorris ] John Eckstein [ jeckstein ]
            jeckstein John Eckstein (Inactive) made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            jeckstein John Eckstein (Inactive) made changes -
            Status In Progress [ 3 ] Needs Testing [ 10002 ]
            jeckstein John Eckstein (Inactive) made changes -
            Assignee John Eckstein [ jeckstein ] Mason Meyer [ mason ]
            Show
            jeckstein John Eckstein (Inactive) added a comment - http://test.bioviz.org/quickload/
            Show
            jeckstein John Eckstein (Inactive) added a comment - http://test.bioviz.org/quickload/A_thaliana_Jun_2009/annots.xml
            mason Mason Meyer (Inactive) made changes -
            Status Needs Testing [ 10002 ] Testing In Progress [ 10003 ]
            Hide
            mason Mason Meyer (Inactive) added a comment - - edited

            Testing for this issue included:

            -Verifying that annots.xml files with an index tag use the index in the specified location (verified on Mac and Windows).
            -Verifying that the index file specified in the index tag overrides any index file in the folder with the file needing indexing.
            -I removed the index attribute for bam files to verify that the bam would not load.
            -I tested loading of bam files with an index file in the same directory and with an index file specified in the annots.xml to test differences and see which one gets used if both are present (annots.xml overrides an index in same directory).

            Show
            mason Mason Meyer (Inactive) added a comment - - edited Testing for this issue included: -Verifying that annots.xml files with an index tag use the index in the specified location (verified on Mac and Windows). -Verifying that the index file specified in the index tag overrides any index file in the folder with the file needing indexing. -I removed the index attribute for bam files to verify that the bam would not load. -I tested loading of bam files with an index file in the same directory and with an index file specified in the annots.xml to test differences and see which one gets used if both are present (annots.xml overrides an index in same directory).
            Hide
            mason Mason Meyer (Inactive) added a comment - - edited

            While testing I noticed that the index attribute in the annots.xml file is being ignored for local Quickloads.

            We should look into this to see if this can be fixed for local Quickloads.

            Reassigning to John to take a look at this issue.

            Show
            mason Mason Meyer (Inactive) added a comment - - edited While testing I noticed that the index attribute in the annots.xml file is being ignored for local Quickloads. We should look into this to see if this can be fixed for local Quickloads. Reassigning to John to take a look at this issue.
            mason Mason Meyer (Inactive) made changes -
            Assignee Mason Meyer [ mason ] John Eckstein [ jeckstein ]
            mason Mason Meyer (Inactive) made changes -
            Status Testing In Progress [ 10003 ] Open [ 1 ]
            Hide
            aloraine Ann Loraine added a comment -

            Yes, we definitely will want to fix this, as people might think they can put indexes in other places besides the same directory as the target (indexed) file.

            Show
            aloraine Ann Loraine added a comment - Yes, we definitely will want to fix this, as people might think they can put indexes in other places besides the same directory as the target (indexed) file.
            dcnorris David Norris (Inactive) made changes -
            Sprint Sprint 27 [ 35 ]
            dcnorris David Norris (Inactive) made changes -
            Sprint Sprint 28 [ 36 ]
            dcnorris David Norris (Inactive) made changes -
            Rank Ranked higher
            jeckstein John Eckstein (Inactive) made changes -
            Assignee John Eckstein [ jeckstein ] Tarun Mall [ tmall ]
            tmall Tarun Mall (Inactive) made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            tmall Tarun Mall (Inactive) made changes -
            Status In Progress [ 3 ] Needs Testing [ 10002 ]
            tmall Tarun Mall (Inactive) made changes -
            Status Needs Testing [ 10002 ] Pull Request Submitted [ 10101 ]
            dcnorris David Norris (Inactive) made changes -
            Sprint Sprint 28 [ 36 ]
            dcnorris David Norris (Inactive) made changes -
            Sprint Sprint 29 [ 37 ]
            dcnorris David Norris (Inactive) made changes -
            Rank Ranked higher
            tmall Tarun Mall (Inactive) made changes -
            Assignee Tarun Mall [ tmall ] John Eckstein [ jeckstein ]
            mason Mason Meyer (Inactive) made changes -
            Status Pull Request Submitted [ 10101 ] Needs Testing [ 10002 ]
            mason Mason Meyer (Inactive) made changes -
            Assignee John Eckstein [ jeckstein ] Mason Meyer [ mason ]
            mason Mason Meyer (Inactive) made changes -
            Status Needs Testing [ 10002 ] Testing In Progress [ 10003 ]
            Hide
            mason Mason Meyer (Inactive) added a comment -

            Testing for this issue included:

            -Verifying that annots.xml files with an index tag use the index in the specified location (verified on Mac and Windows).
            -Verifying that the index file specified in the index tag overrides any index file in the folder with the file needing indexing.
            -I removed the index attribute for bam files to verify that the bam would not load.
            -I tested loading of bam files with an index file in the same directory and with an index file specified in the annots.xml to test differences and see which one gets used if both are present (annots.xml overrides an index in same directory).
            -Verifying that the index attribute in the annots.xml for local Quickloads is not being ignored.
            Since this story is resolved it will now be closed.

            Show
            mason Mason Meyer (Inactive) added a comment - Testing for this issue included: -Verifying that annots.xml files with an index tag use the index in the specified location (verified on Mac and Windows). -Verifying that the index file specified in the index tag overrides any index file in the folder with the file needing indexing. -I removed the index attribute for bam files to verify that the bam would not load. -I tested loading of bam files with an index file in the same directory and with an index file specified in the annots.xml to test differences and see which one gets used if both are present (annots.xml overrides an index in same directory). -Verifying that the index attribute in the annots.xml for local Quickloads is not being ignored. Since this story is resolved it will now be closed.
            mason Mason Meyer (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Testing In Progress [ 10003 ] Closed [ 6 ]
            Hide
            aloraine Ann Loraine added a comment -

            This comment sounds wrong:

            "I removed the index attribute for bam files to verify that the bam would not load."

            If you remove the index attribute, then the file should STILL load if the index is in the same directory as the BAM file.

            The index attribute is optional, not required. If the index file attribute is not present in the annots.xml file, then IGB should attempt to retrieve the index file from the same directory (context root) where the BAM file is located.

            Show
            aloraine Ann Loraine added a comment - This comment sounds wrong: "I removed the index attribute for bam files to verify that the bam would not load." If you remove the index attribute, then the file should STILL load if the index is in the same directory as the BAM file. The index attribute is optional, not required. If the index file attribute is not present in the annots.xml file, then IGB should attempt to retrieve the index file from the same directory (context root) where the BAM file is located.
            mason Mason Meyer (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Closed [ 6 ] Open [ 1 ]
            mason Mason Meyer (Inactive) made changes -
            Fix Version/s 8.5.0 Major Release [ 10003 ]
            mason Mason Meyer (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Open [ 1 ] Closed [ 6 ]
            jeckstein John Eckstein (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Closed [ 6 ] Open [ 1 ]
            jeckstein John Eckstein (Inactive) made changes -
            Labels Data_Provider
            jeckstein John Eckstein (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Open [ 1 ] Closed [ 6 ]
            aloraine Ann Loraine made changes -
            Workflow Loraine Lab Workflow [ 15707 ] Fall 2019 Workflow Update [ 19382 ]
            nfreese Nowlan Freese made changes -
            Link This issue relates to IGBF-2067 [ IGBF-2067 ]
            aloraine Ann Loraine made changes -
            Workflow Fall 2019 Workflow Update [ 19382 ] Revised Fall 2019 Workflow Update [ 21499 ]

              People

              • Assignee:
                mason Mason Meyer (Inactive)
                Reporter:
                aloraine Ann Loraine
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: