Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-3622

Create a Draft 1 Pipeline Document

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Now that we have used the pipeline multiple times successfully, it is time to write a paper about every step in detail. This is to ensure that methods are documented and not forgotten. The pipeline would include submitting data to SRA, using the data from SRA, running the data through nextflow nfcore, sanity check the data with original data, submit data to IGB quick load.

        Attachments

          Issue Links

            Activity

            Mdavis4290 Molly Davis created issue -
            Mdavis4290 Molly Davis made changes -
            Field Original Value New Value
            Epic Link IGBF-2993 [ 21429 ]
            Mdavis4290 Molly Davis made changes -
            Rank Ranked higher
            Mdavis4290 Molly Davis made changes -
            Summary Create a document that describes the pipeline Create a pipeline document
            Mdavis4290 Molly Davis made changes -
            Summary Create a pipeline document Create a Pipeline Document
            Mdavis4290 Molly Davis made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Show
            Mdavis4290 Molly Davis added a comment - Google Document : https://docs.google.com/document/d/1ig9ET-ykXF5nAX3P487cXWmZDGUlQpcwrvFXpbyP5vw/edit?usp=sharing
            ann.loraine Ann Loraine made changes -
            Sprint Spring 4 [ 188 ] Spring 4, Spring 5 [ 188, 189 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Mdavis4290 Molly Davis made changes -
            Summary Create a Pipeline Document Create a Draft Pipeline Document
            Hide
            Mdavis4290 Molly Davis added a comment -

            Try to finish draft by the end of March 15th (Thursday)

            Show
            Mdavis4290 Molly Davis added a comment - Try to finish draft by the end of March 15th (Thursday)
            Hide
            robofjoy Robert Reid added a comment -

            I brushed up the SRA section and made it cleaner.

            Show
            robofjoy Robert Reid added a comment - I brushed up the SRA section and made it cleaner.
            Mdavis4290 Molly Davis made changes -
            Rank Ranked higher
            Mdavis4290 Molly Davis made changes -
            Summary Create a Draft Pipeline Document Create a Draft 1 Pipeline Document
            Hide
            Mdavis4290 Molly Davis added a comment - - edited

            Moving ticket to first level review:

            • Check for grammar and spelling
            • Add comments and ideas for others
            • Make sure there is formal writing, no "we's" or "I's"
            • Past tense
            • Make sure sections flow together and are connected
            • See if there is anything else you would like to add to the next draft

            Note: This review is for all writers. Once finished reviewing comment that you are finished.

            Submit data to IGB Quickload Note: I created a list of tasks to perform for the IGB quick load section of the document but need to confirm with Dr. Loraine that these steps are correct before moving forward.

            Show
            Mdavis4290 Molly Davis added a comment - - edited Moving ticket to first level review : Check for grammar and spelling Add comments and ideas for others Make sure there is formal writing, no "we's" or "I's" Past tense Make sure sections flow together and are connected See if there is anything else you would like to add to the next draft Note: This review is for all writers. Once finished reviewing comment that you are finished. Submit data to IGB Quickload Note: I created a list of tasks to perform for the IGB quick load section of the document but need to confirm with Dr. Loraine that these steps are correct before moving forward.
            Mdavis4290 Molly Davis made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ]
            ann.loraine Ann Loraine made changes -
            Sprint Spring 4, Spring 5 [ 188, 189 ] Spring 4, Spring 5, Spring 6 [ 188, 189, 190 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Mdavis4290 Molly Davis made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ]
            Mdavis4290 Molly Davis made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            Mdavis4290 Molly Davis made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ] Ann Loraine [ aloraine ]
            ann.loraine Ann Loraine made changes -
            Sprint Spring 4, Spring 5, Spring 6 [ 188, 189, 190 ] Spring 4, Spring 5, Spring 6, Spring 7 [ 188, 189, 190, 191 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Hide
            ann.loraine Ann Loraine added a comment -

            Thanks Molly Davis and Robert Reid for this!

            I have a couple of minor editing requests that I think can be done as part of this first draft.

            Kicking it back to "To-Do" for Molly to take a look.

            If you address a comment and are pretty confident that your change takes care of it, it's fine to delete or "resolve" the comments. Once you're happy with the edits, please move the ticket all the way to "Needs testing" for one last read-through (by me and/or Robert Reid) and we'll hopefully close it out this first draft!

            Show
            ann.loraine Ann Loraine added a comment - Thanks Molly Davis and Robert Reid for this! I have a couple of minor editing requests that I think can be done as part of this first draft. Kicking it back to "To-Do" for Molly to take a look. If you address a comment and are pretty confident that your change takes care of it, it's fine to delete or "resolve" the comments. Once you're happy with the edits, please move the ticket all the way to "Needs testing" for one last read-through (by me and/or Robert Reid ) and we'll hopefully close it out this first draft!
            ann.loraine Ann Loraine made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            ann.loraine Ann Loraine made changes -
            Status Reviewing Pull Request [ 10303 ] To-Do [ 10305 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ] Molly Davis [ molly ]
            Mdavis4290 Molly Davis made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Mdavis4290 Molly Davis made changes -
            Rank Ranked higher
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ] Robert Reid [ robertreid ]
            Mdavis4290 Molly Davis made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Assignee Robert Reid [ robertreid ] Ann Loraine [ aloraine ]
            Hide
            ann.loraine Ann Loraine added a comment - - edited

            Thanks Molly Davis for addressing my last batch of comments.
            I have some new questions now. Please take a look when you get a chance! Thank you !

            Also, just to let you know: I've been using the document to run a new set of samples from tardigrade and it's been super helpful. Thank you for making this easy!

            Show
            ann.loraine Ann Loraine added a comment - - edited Thanks Molly Davis for addressing my last batch of comments. I have some new questions now. Please take a look when you get a chance! Thank you ! Also, just to let you know: I've been using the document to run a new set of samples from tardigrade and it's been super helpful. Thank you for making this easy!
            ann.loraine Ann Loraine made changes -
            Sprint Spring 4, Spring 5, Spring 6, Spring 7 [ 188, 189, 190, 191 ] Spring 4, Spring 5, Spring 6, Spring 7, Spring 8 [ 188, 189, 190, 191, 192 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] Needs 1st Level Review [ 10005 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ] Robert Reid [ robertreid ]
            Hide
            robofjoy Robert Reid added a comment -

            One idea related to this.

            I am mid editing and reviewing of the document now.

            I came across the following site for protocols:

            https://www.protocols.io/

            Let's chat whether we want to submit this to such a place?

            Show
            robofjoy Robert Reid added a comment - One idea related to this. I am mid editing and reviewing of the document now. I came across the following site for protocols: https://www.protocols.io/ Let's chat whether we want to submit this to such a place?
            Hide
            Mdavis4290 Molly Davis added a comment -

            Here is an example of how we could add our pipeline document to protocols website:

            https://www.protocols.io/view/a-bioinformatics-pipeline-for-processing-and-analy-kxygxp77wl8j/v1

            Show
            Mdavis4290 Molly Davis added a comment - Here is an example of how we could add our pipeline document to protocols website : https://www.protocols.io/view/a-bioinformatics-pipeline-for-processing-and-analy-kxygxp77wl8j/v1
            Hide
            robofjoy Robert Reid added a comment -

            I am going to have Brandon the Masters student join me this summer via other funds.

            I think it would be a good thing to see if he, with a more limited experience in bioinformatics can walk through this protocol on the cluster.

            He will officially start after exams. But I will get him started now getting accustomed to navigating the cluster.
            It will be a good way to see where in the doc, we need more clarity!

            Rob

            Show
            robofjoy Robert Reid added a comment - I am going to have Brandon the Masters student join me this summer via other funds. I think it would be a good thing to see if he, with a more limited experience in bioinformatics can walk through this protocol on the cluster. He will officially start after exams. But I will get him started now getting accustomed to navigating the cluster. It will be a good way to see where in the doc, we need more clarity! Rob
            Hide
            robofjoy Robert Reid added a comment -

            Submit data to IGB Quickload:

            I wonder if this section should be its own public protocol?

            Show
            robofjoy Robert Reid added a comment - Submit data to IGB Quickload: I wonder if this section should be its own public protocol?
            robofjoy Robert Reid made changes -
            Assignee Robert Reid [ robertreid ] Molly Davis [ molly ]
            Hide
            robofjoy Robert Reid added a comment -

            All done with review.
            We should gather and chat how we want to proceed, aka protocols.io, etc.....

            R

            Show
            robofjoy Robert Reid added a comment - All done with review. We should gather and chat how we want to proceed, aka protocols.io, etc..... R
            Mdavis4290 Molly Davis made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            Mdavis4290 Molly Davis made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            Hide
            Mdavis4290 Molly Davis added a comment -

            Format the draft in another document that would work with protocols. Use the protocols example above to understand formatting. Then move this ticket to testing for Brandon to test Draft 1 pipeline document.

            Show
            Mdavis4290 Molly Davis added a comment - Format the draft in another document that would work with protocols. Use the protocols example above to understand formatting. Then move this ticket to testing for Brandon to test Draft 1 pipeline document.
            Hide
            ann.loraine Ann Loraine added a comment -

            A request for Molly Davis:

            Could you take a look at the new comments I added regarding the "prefetch" code? It looks to me like the script can only work if the user doesn't try to run an interactive session.

            Show
            ann.loraine Ann Loraine added a comment - A request for Molly Davis : Could you take a look at the new comments I added regarding the "prefetch" code? It looks to me like the script can only work if the user doesn't try to run an interactive session.
            Hide
            Mdavis4290 Molly Davis added a comment -

            Moving this ticket to done and making a Draft 2 ticket with new requests!

            Show
            Mdavis4290 Molly Davis added a comment - Moving this ticket to done and making a Draft 2 ticket with new requests!
            Mdavis4290 Molly Davis made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            Mdavis4290 Molly Davis made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            Mdavis4290 Molly Davis made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            Mdavis4290 Molly Davis made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            Mdavis4290 Molly Davis made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]
            Mdavis4290 Molly Davis made changes -
            Link This issue relates to IGBF-3709 [ IGBF-3709 ]

              People

              • Assignee:
                Mdavis4290 Molly Davis
                Reporter:
                Mdavis4290 Molly Davis
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: