Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Blocker
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:

      Description

      Recently a researcher asked about these quickload instructions from the User's Guide:

      He wrote:

      Is this method still the easiest way to upload BAM/BED files to IGB Quickload?

      The last edit to this page was in Jan 2016. The content may be out of date.

      Before we answer the question, we should check that the content is still correct.

      To do this, try to follow the instructions to set up a satellite Quickload site on your computer, using the latest tomato genome currently available in IGB. Make note of any problems you encounter. Your test QL site should include a BED and a BAM file, since this is what the researcher asked about. You can get examples from the RNA-Seq quickload site.

      Make notes in this ticket about any changes or problems you notice as you do the walk-through. Hopefully everything will work properly! But it not, your observations will help us think of some potential solutions.

      If you run into problems, please make a new Jira ticket in the "Teach people to use IGB" epic and link it to this one. Include it in the current sprint.

        Attachments

          Issue Links

            Activity

            ann.loraine Ann Loraine created issue -
            ann.loraine Ann Loraine made changes -
            Field Original Value New Value
            Epic Link IGBF-2424 [ 18604 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Description Recently a researcher who is new to using IGB sent us a question about these quickload instructions from the User's Guide:

            * https://wiki.transvar.org/display/igbman/Create+a+satellite+IGB+QuickLoad+site+for+genomes+that+are+already+supported+in+the+main+IGB+QuickLoad+site

            He wrote:

            {quote}
            Is this method still the easiest way to upload BAM/BED files to IGB Quickload?
            {quote}

            The last edit to this page was in Jan 2016, so it is possible that the content is out of date.

            To check that the content is still correct, let's walk through the instructions. Our goal is to make sure that if someone follows the instructions, they can set up their own "satellite" quickload site.

            For this task, try to set up your own satellite quickload site using the latest tomato genome as a test case.

            Make notes in this ticket about any changes or problems you notice as you do the walk-through. Hopefully everything will work properly! But it not, your observations will help us think of some potential solutions.

            If there are any problems, please make a new Jira ticket in the "Teach people to use IGB" epic and link it to this one. Included it in the current sprint.
            Recently a researcher who is new to using IGB about about these quickload instructions from the User's Guide:

            * https://wiki.transvar.org/display/igbman/Create+a+satellite+IGB+QuickLoad+site+for+genomes+that+are+already+supported+in+the+main+IGB+QuickLoad+site

            He wrote:

            {quote}
            Is this method still the easiest way to upload BAM/BED files to IGB Quickload?
            {quote}

            The last edit to this page was in Jan 2016, so it is possible that the content is out of date.

            To check that the content is still correct, let's walk through the instructions. Our goal is to make sure that if someone follows the instructions, they can set up their own "satellite" quickload site.

            For this task, try to set up your own satellite quickload site using the latest tomato genome as a test case.

            Make notes in this ticket about any changes or problems you notice as you do the walk-through. Hopefully everything will work properly! But it not, your observations will help us think of some potential solutions.

            If there are any problems, please make a new Jira ticket in the "Teach people to use IGB" epic and link it to this one. Included it in the current sprint.
            ann.loraine Ann Loraine made changes -
            Description Recently a researcher who is new to using IGB about about these quickload instructions from the User's Guide:

            * https://wiki.transvar.org/display/igbman/Create+a+satellite+IGB+QuickLoad+site+for+genomes+that+are+already+supported+in+the+main+IGB+QuickLoad+site

            He wrote:

            {quote}
            Is this method still the easiest way to upload BAM/BED files to IGB Quickload?
            {quote}

            The last edit to this page was in Jan 2016, so it is possible that the content is out of date.

            To check that the content is still correct, let's walk through the instructions. Our goal is to make sure that if someone follows the instructions, they can set up their own "satellite" quickload site.

            For this task, try to set up your own satellite quickload site using the latest tomato genome as a test case.

            Make notes in this ticket about any changes or problems you notice as you do the walk-through. Hopefully everything will work properly! But it not, your observations will help us think of some potential solutions.

            If there are any problems, please make a new Jira ticket in the "Teach people to use IGB" epic and link it to this one. Included it in the current sprint.
            Recently a researcher asked about these quickload instructions from the User's Guide:

            * https://wiki.transvar.org/display/igbman/Create+a+satellite+IGB+QuickLoad+site+for+genomes+that+are+already+supported+in+the+main+IGB+QuickLoad+site

            He wrote:

            {quote}
            Is this method still the easiest way to upload BAM/BED files to IGB Quickload?
            {quote}

            The last edit to this page was in Jan 2016. The content may be out of date.

            Before we answer the question, we should check that the content is still correct.

            To do this, try to follow the instructions to set up a satellite Quickload site on your computer, using the latest tomato genome currently available in IGB. Make note of any problems you encounter. Your test QL site should include a BED and a BAM file, since this is what the researcher asked about. You can get examples from the RNA-Seq quickload site.

            Make notes in this ticket about any changes or problems you notice as you do the walk-through. Hopefully everything will work properly! But it not, your observations will help us think of some potential solutions.

            If you run into problems, please make a new Jira ticket in the "Teach people to use IGB" epic and link it to this one. Included it in the current sprint.
            ann.loraine Ann Loraine made changes -
            Labels Beginner Intern
            ann.loraine Ann Loraine made changes -
            Description Recently a researcher asked about these quickload instructions from the User's Guide:

            * https://wiki.transvar.org/display/igbman/Create+a+satellite+IGB+QuickLoad+site+for+genomes+that+are+already+supported+in+the+main+IGB+QuickLoad+site

            He wrote:

            {quote}
            Is this method still the easiest way to upload BAM/BED files to IGB Quickload?
            {quote}

            The last edit to this page was in Jan 2016. The content may be out of date.

            Before we answer the question, we should check that the content is still correct.

            To do this, try to follow the instructions to set up a satellite Quickload site on your computer, using the latest tomato genome currently available in IGB. Make note of any problems you encounter. Your test QL site should include a BED and a BAM file, since this is what the researcher asked about. You can get examples from the RNA-Seq quickload site.

            Make notes in this ticket about any changes or problems you notice as you do the walk-through. Hopefully everything will work properly! But it not, your observations will help us think of some potential solutions.

            If you run into problems, please make a new Jira ticket in the "Teach people to use IGB" epic and link it to this one. Included it in the current sprint.
            Recently a researcher asked about these quickload instructions from the User's Guide:

            * https://wiki.transvar.org/display/igbman/Create+a+satellite+IGB+QuickLoad+site+for+genomes+that+are+already+supported+in+the+main+IGB+QuickLoad+site

            He wrote:

            {quote}
            Is this method still the easiest way to upload BAM/BED files to IGB Quickload?
            {quote}

            The last edit to this page was in Jan 2016. The content may be out of date.

            Before we answer the question, we should check that the content is still correct.

            To do this, try to follow the instructions to set up a satellite Quickload site on your computer, using the latest tomato genome currently available in IGB. Make note of any problems you encounter. Your test QL site should include a BED and a BAM file, since this is what the researcher asked about. You can get examples from the RNA-Seq quickload site.

            Make notes in this ticket about any changes or problems you notice as you do the walk-through. Hopefully everything will work properly! But it not, your observations will help us think of some potential solutions.

            If you run into problems, please make a new Jira ticket in the "Teach people to use IGB" epic and link it to this one. Include it in the current sprint.
            Hide
            ann.loraine Ann Loraine added a comment -

            btw I asked him to also post this question to the new google group since it's a very good question!

            Show
            ann.loraine Ann Loraine added a comment - btw I asked him to also post this question to the new google group since it's a very good question! https://groups.google.com/forum/#!forum/integrated-genome-browser-help-desk
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Assignee Rachel Weidenhammer [ rweidenh ]
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Story Points 0.5 1
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Story Points 1 2
            ann.loraine Ann Loraine made changes -
            Sprint Summer 1: 8 Jun - 19 Jun [ 96 ] Summer 1: 8 Jun - 19 Jun, Summer 2: 22 Jun - 3 July [ 96, 97 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Summary Check that quickload instructions Check quickload instructions
            Hide
            rweidenh Logan Weidenhammer (Inactive) added a comment - - edited
            • I was able to add a local server and load BED file types of the tomato genome with IGB.
            • I attempted to load BAM files. The row for the data changed from grey to white, indicating that the file had been loaded, but no data appeared on-screen.
            • Dr. Freese suggested that I may be looking at a point where no data was present to be displayed and gave the location: SL4.0ch01:32,433,077-32,602,167 where data is known to be present.
            • I went to those coordinates in IGB for the tomato genome and loaded the comparable BAM file (H1-C.bam) from IGB's RNA-Seq quickload; I was able to see the data at that location.
            • I attempted to open a local copy of that first H1-C.bam file from my server I had added to IGB quickload. The computer locked up and I had to hard restart.
            • From then on opening IGB results in a complete lock up, sometimes even when the program is only opened and given no tasks, sometimes a few tasks can be completed.
            • I tried clearing the cache per the transvar guide: https://wiki.transvar.org/pages/viewpage.action?pageId=19005897
            • I uninstalled IGB and removed all IGB associated files from the computer.
            • I redownloaded IGB from Bioviz.org and reinstalled, but the computer will still lock up shortly after launch of IGB.

            For reference, the locations of the files I used in this testing:
            S_lycopersicum_Sep_2019 Solanum lycopersicum (Sep 2019) tomato (SL4.0)
            BAM files: http://lorainelab-quickload.scidas.org/rnaseq/S_lycopersicum_Sep_2019/PGRP1939255/
            BED files:
            http://www.igbquickload.org/quickload/S_lycopersicum_Sep_2019/

            Show
            rweidenh Logan Weidenhammer (Inactive) added a comment - - edited I was able to add a local server and load BED file types of the tomato genome with IGB. I attempted to load BAM files. The row for the data changed from grey to white, indicating that the file had been loaded, but no data appeared on-screen. Dr. Freese suggested that I may be looking at a point where no data was present to be displayed and gave the location: SL4.0ch01:32,433,077-32,602,167 where data is known to be present. I went to those coordinates in IGB for the tomato genome and loaded the comparable BAM file (H1-C.bam) from IGB's RNA-Seq quickload; I was able to see the data at that location. I attempted to open a local copy of that first H1-C.bam file from my server I had added to IGB quickload. The computer locked up and I had to hard restart. From then on opening IGB results in a complete lock up, sometimes even when the program is only opened and given no tasks, sometimes a few tasks can be completed. I tried clearing the cache per the transvar guide: https://wiki.transvar.org/pages/viewpage.action?pageId=19005897 I uninstalled IGB and removed all IGB associated files from the computer. I redownloaded IGB from Bioviz.org and reinstalled, but the computer will still lock up shortly after launch of IGB. For reference, the locations of the files I used in this testing: S_lycopersicum_Sep_2019 Solanum lycopersicum (Sep 2019) tomato (SL4.0) BAM files: http://lorainelab-quickload.scidas.org/rnaseq/S_lycopersicum_Sep_2019/PGRP1939255/ BED files: http://www.igbquickload.org/quickload/S_lycopersicum_Sep_2019/
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Status In Progress [ 3 ] To-Do [ 10305 ]
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Assignee Rachel Weidenhammer [ rweidenh ]
            Hide
            ann.loraine Ann Loraine added a comment -

            Quick followup:

            • Please attached the annots.xml file you created, if any.

            cc: Logan Weidenhammer

            Show
            ann.loraine Ann Loraine added a comment - Quick followup: Please attached the annots.xml file you created, if any. cc: Logan Weidenhammer
            Hide
            rweidenh Logan Weidenhammer (Inactive) added a comment - - edited

            The original had been deleted. I believe the the annots.xml file only contained the following while testing the BAM file.

            <files>
            <file
            name="PGRP1939255/H1-C.bam"
            title="Pollen Tube PGRP1939255/Reads/H.C.1 - Heinz control replicate 1 alignments"
            description="read alignments"
            url="S_lycopersicum_Sep_2019/PGRP1939255"
            background="ffffff"
            foreground="00C5CD"
            max_depth="10"
            show2tracks="false"
            direction_type="arrow"
            />
            </files>

            And this while testing the BED file:

            <files>
            <file
            name="S_lycopersicum_Sep_2019.bed.gz"
            title="ITAG4.0"
            description="ITAG4.0 gene models, 4.0 genome assembly"
            url="S_lycopersicum_Sep_2019"
            foreground="000000"
            name_size="14"
            direction_type="arrow"
            label_field="id"
            background="FFFFFF"
            load_hint="Whole Sequence"
            show2tracks="true"
            />
            </files>

            Show
            rweidenh Logan Weidenhammer (Inactive) added a comment - - edited The original had been deleted. I believe the the annots.xml file only contained the following while testing the BAM file. <files> <file name="PGRP1939255/H1-C.bam" title="Pollen Tube PGRP1939255/Reads/H.C.1 - Heinz control replicate 1 alignments" description="read alignments" url="S_lycopersicum_Sep_2019/PGRP1939255" background="ffffff" foreground="00C5CD" max_depth="10" show2tracks="false" direction_type="arrow" /> </files> And this while testing the BED file: <files> <file name="S_lycopersicum_Sep_2019.bed.gz" title="ITAG4.0" description="ITAG4.0 gene models, 4.0 genome assembly" url="S_lycopersicum_Sep_2019" foreground="000000" name_size="14" direction_type="arrow" label_field="id" background="FFFFFF" load_hint="Whole Sequence" show2tracks="true" /> </files>
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Assignee Rachel Weidenhammer [ rweidenh ]
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Hide
            rweidenh Logan Weidenhammer (Inactive) added a comment - - edited

            The current instructions on the “Create a satellite IGB QuickLoad site” page are up to date and accurate to the current version of IGB.

            Dr. Freese and I identified the reason the BAM file was not working originally. It looks like the http://www.igbquickload.org/quickload/ site where I was getting my test files does not allow internet browsers to download these large BAM files. We tested a smaller BAM file for the tomato genome and it worked normally.

            Observations:

            I had trouble at first finding the location of the Data Sources window. I think it would be useful to add a link to the page https://wiki.transvar.org/display/igbman/Data+Sources+Tab or a copy of the “Introduction” section on that page to the page https://wiki.transvar.org/display/igbman/Adding+and+Managing+Data+Source+Servers.

            I also had trouble with refreshing my data source server on IGB after making changes to the files on my local machine. Selecting the ‘refresh server’ icon on the left does not load any new files added to the source. The user must remove the server from “Data Sources” and add it again. This instruction could also be added to the page: https://wiki.transvar.org/display/igbman/Adding+and+Managing+Data+Source+Servers

            I will make a ticket about implementing these changes.

            Show
            rweidenh Logan Weidenhammer (Inactive) added a comment - - edited The current instructions on the “Create a satellite IGB QuickLoad site” page are up to date and accurate to the current version of IGB. Dr. Freese and I identified the reason the BAM file was not working originally. It looks like the http://www.igbquickload.org/quickload/ site where I was getting my test files does not allow internet browsers to download these large BAM files. We tested a smaller BAM file for the tomato genome and it worked normally. Observations: I had trouble at first finding the location of the Data Sources window. I think it would be useful to add a link to the page https://wiki.transvar.org/display/igbman/Data+Sources+Tab or a copy of the “Introduction” section on that page to the page https://wiki.transvar.org/display/igbman/Adding+and+Managing+Data+Source+Servers . I also had trouble with refreshing my data source server on IGB after making changes to the files on my local machine. Selecting the ‘refresh server’ icon on the left does not load any new files added to the source. The user must remove the server from “Data Sources” and add it again. This instruction could also be added to the page: https://wiki.transvar.org/display/igbman/Adding+and+Managing+Data+Source+Servers I will make a ticket about implementing these changes.
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Assignee Rachel Weidenhammer [ rweidenh ]
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Link This issue relates to IGBF-2454 [ IGBF-2454 ]
            Hide
            rweidenh Logan Weidenhammer (Inactive) added a comment -

            IGBF-2454 created.

            Show
            rweidenh Logan Weidenhammer (Inactive) added a comment - IGBF-2454 created.
            Hide
            ann.loraine Ann Loraine added a comment -

            Thanks for the detailed notes Logan Weidenhammer and Nowlan Freese !

            Show
            ann.loraine Ann Loraine added a comment - Thanks for the detailed notes Logan Weidenhammer and Nowlan Freese !
            rweidenh Logan Weidenhammer (Inactive) made changes -
            Comment [ Do we want to investigate the http://www.igbquickload.org/quickload/ large-file download problem? ]
            Hide
            rweidenh Logan Weidenhammer (Inactive) added a comment -

            [~aloraine] Do we want to investigate the http://www.igbquickload.org/quickload/ large-file download problem?

            Show
            rweidenh Logan Weidenhammer (Inactive) added a comment - [~aloraine] Do we want to investigate the http://www.igbquickload.org/quickload/ large-file download problem?
            Hide
            nfreese Nowlan Freese added a comment -

            The issue I ran into was on the scidas server: http://lorainelab-quickload.scidas.org/rnaseq/S_lycopersicum_Sep_2019/PGRP1939255/

            The scidas data load in IGB and I can curl the data on my laptop, but clicking on the file and trying to download through the browser appears to be blocked.

            Show
            nfreese Nowlan Freese added a comment - The issue I ran into was on the scidas server: http://lorainelab-quickload.scidas.org/rnaseq/S_lycopersicum_Sep_2019/PGRP1939255/ The scidas data load in IGB and I can curl the data on my laptop, but clicking on the file and trying to download through the browser appears to be blocked.
            Hide
            ann.loraine Ann Loraine added a comment -

            I am OK with this as it could protect people from accidentally try to download a multi-Gb sized file.

            Moving to closed.

            Show
            ann.loraine Ann Loraine added a comment - I am OK with this as it could protect people from accidentally try to download a multi-Gb sized file. Moving to closed.
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            ann.loraine Ann Loraine made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            ann.loraine Ann Loraine made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            ann.loraine Ann Loraine made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            ann.loraine Ann Loraine made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            ann.loraine Ann Loraine made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]

              People

              • Assignee:
                Unassigned
                Reporter:
                ann.loraine Ann Loraine
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: