Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-3699

Document the experience of processing data in Galaxy

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Uploading and processing data with Galaxy has proved to be less than straightforward, but even if it was a simple process, documenting the user experience (especially that of a first-time Galaxy user) will prove incredibly valuable.

      Task: Thoroughly document the experience of uploading, aligning, and exporting data in Galaxy. Take notes of what worked, what didn't work, and what solutions I tried when things didn't work. Include pictures of the process as you go to better illustrate each step.

      This narrative will provide a good outline for a future slide deck aimed at training users how to process their data in Galaxy and then visualize it in IGB.

        Attachments

          Issue Links

            Activity

            pkulzer Paige Kulzer created issue -
            pkulzer Paige Kulzer made changes -
            Field Original Value New Value
            Epic Link IGBF-2809 [ 19325 ]
            pkulzer Paige Kulzer made changes -
            Link This issue relates to IGBF-3695 [ IGBF-3695 ]
            pkulzer Paige Kulzer made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Hide
            pkulzer Paige Kulzer added a comment -

            Here is a link to the narrative that I created about running a data processing pipeline in Galaxy with tardigrade RNA-Seq data.

            For review, please give it a read through! Are there any spots that are difficult to understand that might benefit from the addition of an image? Did I miss any key steps of the pipeline? Are all of the images readable and do they add to the narrative?

            Show
            pkulzer Paige Kulzer added a comment - Here is a link to the narrative that I created about running a data processing pipeline in Galaxy with tardigrade RNA-Seq data. For review, please give it a read through! Are there any spots that are difficult to understand that might benefit from the addition of an image? Did I miss any key steps of the pipeline? Are all of the images readable and do they add to the narrative?
            pkulzer Paige Kulzer made changes -
            Story Points 1 2
            pkulzer Paige Kulzer made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            pkulzer Paige Kulzer made changes -
            Assignee Paige Kulzer [ pkulzer ]
            pkulzer Paige Kulzer made changes -
            Assignee Ann Loraine [ aloraine ]
            ann.loraine Ann Loraine made changes -
            Sprint Spring 8 [ 192 ] Spring 8, Spring 9 [ 192, 193 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Hide
            ann.loraine Ann Loraine added a comment -

            Thanks a lot! It was easy to follow what you did and understand the problems you encountered.

            Comment:

            • It seemed like the problem you had getting the tool for importing / downloading SRR "fastq" data files from NCBI was solved by using a different version of the tool. Do you know why the non-working version of the tool was given to you as the default? That seems a little weird I guess. I guess probably they did not know that this particular tool has this problem? It really shows how important it is to have access to the user community when using a tool like this so that if you run into a problem, you can get help quickly. This might be something to mention when reporting on these experiences to others.

            Question:

            • In the narrative, you turned to using the "download script" for the ENA instead of returning to using the "get from NCBI" tool. Why is that? Did it seem easier, more cool, more accessible? Did you like the idea of getting the files onto your personal computer as a kind of intermediate step? Let's talk about it in person - no need to write more!

            For the next step, Please save the document as a Word document and put into the Dropbox IGB folder:

            • IGB/ Outreach / Using Galaxy with IGB
            Show
            ann.loraine Ann Loraine added a comment - Thanks a lot! It was easy to follow what you did and understand the problems you encountered. Comment: It seemed like the problem you had getting the tool for importing / downloading SRR "fastq" data files from NCBI was solved by using a different version of the tool. Do you know why the non-working version of the tool was given to you as the default? That seems a little weird I guess. I guess probably they did not know that this particular tool has this problem? It really shows how important it is to have access to the user community when using a tool like this so that if you run into a problem, you can get help quickly. This might be something to mention when reporting on these experiences to others. Question: In the narrative, you turned to using the "download script" for the ENA instead of returning to using the "get from NCBI" tool. Why is that? Did it seem easier, more cool, more accessible? Did you like the idea of getting the files onto your personal computer as a kind of intermediate step? Let's talk about it in person - no need to write more! For the next step, Please save the document as a Word document and put into the Dropbox IGB folder: IGB/ Outreach / Using Galaxy with IGB
            Hide
            ann.loraine Ann Loraine added a comment -

            Thanks a lot! It was easy to follow what you did and understand the problems you encountered.

            Comment:

            • It seemed like the problem you had getting the tool for importing / downloading SRR "fastq" data files from NCBI was solved by using a different version of the tool. Do you know why the non-working version of the tool was given to you as the default? That seems a little weird I guess. I guess probably they did not know that this particular tool has this problem? It really shows how important it is to have access to the user community when using a tool like this so that if you run into a problem, you can get help quickly. This might be something to mention when reporting on these experiences to others.

            Question:

            • In the narrative, you turned to using the "download script" for the ENA instead of returning to using the "get from NCBI" tool. Why is that? Did it seem easier, more cool, more accessible? Did you like the idea of getting the files onto your personal computer as a kind of intermediate step? Let's talk about it in person - no need to write more!

            For the next step, Please save the document as a Word document and put into the Dropbox IGB folder:

            • IGB/ Outreach / Using Galaxy with IGB

            Put it there as a "Word" doc, check that it can open in Word (just in case!), and if all is good, move to Done.

            Show
            ann.loraine Ann Loraine added a comment - Thanks a lot! It was easy to follow what you did and understand the problems you encountered. Comment: It seemed like the problem you had getting the tool for importing / downloading SRR "fastq" data files from NCBI was solved by using a different version of the tool. Do you know why the non-working version of the tool was given to you as the default? That seems a little weird I guess. I guess probably they did not know that this particular tool has this problem? It really shows how important it is to have access to the user community when using a tool like this so that if you run into a problem, you can get help quickly. This might be something to mention when reporting on these experiences to others. Question: In the narrative, you turned to using the "download script" for the ENA instead of returning to using the "get from NCBI" tool. Why is that? Did it seem easier, more cool, more accessible? Did you like the idea of getting the files onto your personal computer as a kind of intermediate step? Let's talk about it in person - no need to write more! For the next step, Please save the document as a Word document and put into the Dropbox IGB folder: IGB/ Outreach / Using Galaxy with IGB Put it there as a "Word" doc, check that it can open in Word (just in case!), and if all is good, move to Done.
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ] Paige Kulzer [ pkulzer ]
            Hide
            pkulzer Paige Kulzer added a comment -

            Galaxy's “Download and Extract Reads in FASTQ format from NCBI SRA” had just undergone an update the day prior which contained a configuration problem, so it was a relatively new issue that hadn't been brought to their attention yet. And, to answer your question, I even had trouble getting the previous version of that tool to work for a day or so, so in the interest of time I decided to explore other options for uploading data. The up side of this is that I now feel like I have a good grasp on all the different ways a user can upload their data!

            I've saved a copy of the narrative to the IGB/Outreach/Using Galaxy with IGB Dropbox folder as a Word document and confirmed that it can be opened in Word. Closing this ticket.

            Show
            pkulzer Paige Kulzer added a comment - Galaxy's “Download and Extract Reads in FASTQ format from NCBI SRA” had just undergone an update the day prior which contained a configuration problem, so it was a relatively new issue that hadn't been brought to their attention yet. And, to answer your question, I even had trouble getting the previous version of that tool to work for a day or so, so in the interest of time I decided to explore other options for uploading data. The up side of this is that I now feel like I have a good grasp on all the different ways a user can upload their data! I've saved a copy of the narrative to the IGB/Outreach/Using Galaxy with IGB Dropbox folder as a Word document and confirmed that it can be opened in Word. Closing this ticket.
            pkulzer Paige Kulzer made changes -
            Attachment GalaxyPipelineNarrative.docx [ 18357 ]
            pkulzer Paige Kulzer made changes -
            Attachment GalaxyPipelineNarrative.pdf [ 18358 ]
            pkulzer Paige Kulzer made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            pkulzer Paige Kulzer made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            pkulzer Paige Kulzer made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            pkulzer Paige Kulzer made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            pkulzer Paige Kulzer made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]
            pkulzer Paige Kulzer made changes -
            Link This issue relates to IGBF-3724 [ IGBF-3724 ]
            pkulzer Paige Kulzer made changes -
            Link This issue relates to IGBF-3724 [ IGBF-3724 ]
            Hide
            ann.loraine Ann Loraine added a comment -

            Please note:

            I moved the narrative document to:

            Dropbox / IGB / Outreach / Conferences / 2024-GCC

            cc:

            Paige Kulzer

            Show
            ann.loraine Ann Loraine added a comment - Please note: I moved the narrative document to: Dropbox / IGB / Outreach / Conferences / 2024-GCC cc: Paige Kulzer

              People

              • Assignee:
                pkulzer Paige Kulzer
                Reporter:
                pkulzer Paige Kulzer
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: