Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-3342

Create scaled counts file for Muday analysis

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Create a new Markdown that uses 72_F3H_PollenTube/results/muday-144-SL5_counts-salmon.txt as input and outputs the same exact file except that the values are scaled using the EdgeR "cpm" function.

      The Markdown should answer the question: Did the scaling "work" ? That is, do the observed differences in expression (e.g., scaled numeric values per gene per sample) reflect actual biological variation and not sequencing depth variation.
      Identify control genes that you don't expect to exhibit changes in expression in response to the treatments being tested.
      Ask the Muday lab (Gloria) for some examples.

      Make barcharts that show before and after scaling for a set of genes you do not expect to change in response to time or treatment. If the scaling worked, then all the samples should have the same height, or all samples within the same time duration should have the same height.

      Name it: MakeScaledCountsFile.Rmd and save the output to "results"
      Name the output the same thing as the input but with "scaled" in the name.

        Attachments

          Issue Links

            Activity

            robofjoy Robert Reid created issue -
            robofjoy Robert Reid made changes -
            Field Original Value New Value
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Mdavis4290 Molly Davis made changes -
            Epic Link IGBF-3277 [ 22158 ]
            Mdavis4290 Molly Davis made changes -
            Sprint Summer 1 2023 May 15 [ 170 ]
            Mdavis4290 Molly Davis made changes -
            Status In Progress [ 3 ] To-Do [ 10305 ]
            Mdavis4290 Molly Davis made changes -
            Summary Create Normalized Counts Table for Gloria's Data Create normalized counts file for Muday analysis
            Mdavis4290 Molly Davis made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ]
            Mdavis4290 Molly Davis made changes -
            Link This issue relates to IGBF-3339 [ IGBF-3339 ]
            ann.loraine Ann Loraine made changes -
            Description Gloria has requested a Normalized Count Table. Create a new Markdown that uses 72_F3H_PollenTube/results/muday-144-SL5_counts-salmon.txt as input and outputs the same exact file except that the values are scaled using the EdgeR "cpm" function.

            The Markdown should answer the question:

            * What is the expression level of the F3H gene in all samples in the data set? We expect similar results to what we observed in Markdown ARE-120min-analysis/F3H.Rmd. (Look at and read this Markdown before creating this new one)

            ann.loraine Ann Loraine made changes -
            Description Create a new Markdown that uses 72_F3H_PollenTube/results/muday-144-SL5_counts-salmon.txt as input and outputs the same exact file except that the values are scaled using the EdgeR "cpm" function.

            The Markdown should answer the question:

            * What is the expression level of the F3H gene in all samples in the data set? We expect similar results to what we observed in Markdown ARE-120min-analysis/F3H.Rmd. (Look at and read this Markdown before creating this new one)

            Create a new Markdown that uses 72_F3H_PollenTube/results/muday-144-SL5_counts-salmon.txt as input and outputs the same exact file except that the values are scaled using the EdgeR "cpm" function.

            The Markdown should answer the question: Did the scaling "work" ? That is, do the observed differences in expression (e.g., scaled numeric values per gene per sample) reflect actual biological variation and not sequencing depth variation.
            Identify control genes that you don't expect to exhibit changes in expression in response to the treatments being tested.
            Ask the Muday lab (Gloria) for some examples.

            Make barcharts that show before and after scaling for a set of genes you do not expect to change in response to time or treatment. If the scaling worked, then all the samples should have the same height, or all samples within the same time duration should have the same height.


            ann.loraine Ann Loraine made changes -
            Description Create a new Markdown that uses 72_F3H_PollenTube/results/muday-144-SL5_counts-salmon.txt as input and outputs the same exact file except that the values are scaled using the EdgeR "cpm" function.

            The Markdown should answer the question: Did the scaling "work" ? That is, do the observed differences in expression (e.g., scaled numeric values per gene per sample) reflect actual biological variation and not sequencing depth variation.
            Identify control genes that you don't expect to exhibit changes in expression in response to the treatments being tested.
            Ask the Muday lab (Gloria) for some examples.

            Make barcharts that show before and after scaling for a set of genes you do not expect to change in response to time or treatment. If the scaling worked, then all the samples should have the same height, or all samples within the same time duration should have the same height.


            Create a new Markdown that uses 72_F3H_PollenTube/results/muday-144-SL5_counts-salmon.txt as input and outputs the same exact file except that the values are scaled using the EdgeR "cpm" function.

            The Markdown should answer the question: Did the scaling "work" ? That is, do the observed differences in expression (e.g., scaled numeric values per gene per sample) reflect actual biological variation and not sequencing depth variation.
            Identify control genes that you don't expect to exhibit changes in expression in response to the treatments being tested.
            Ask the Muday lab (Gloria) for some examples.

            Make barcharts that show before and after scaling for a set of genes you do not expect to change in response to time or treatment. If the scaling worked, then all the samples should have the same height, or all samples within the same time duration should have the same height.

            Name it: MakeScaledCountsFile.Rmd and save the output to "results"
            Name the output the same thing as the input but with "scaled" in the name.

            ann.loraine Ann Loraine made changes -
            Story Points 1 1.5
            ann.loraine Ann Loraine made changes -
            Sprint Summer 1 2023 May 15 [ 170 ] Summer 2 2023 May 29 [ 171 ]
            ann.loraine Ann Loraine made changes -
            Status In Progress [ 3 ] To-Do [ 10305 ]
            ann.loraine Ann Loraine made changes -
            Summary Create normalized counts file for Muday analysis Create scaled counts file for Muday analysis
            Mdavis4290 Molly Davis made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Mdavis4290 Molly Davis made changes -
            Story Points 1.5 3
            Show
            Mdavis4290 Molly Davis added a comment - - edited Resource for using cpm() function: https://bitbucket.org/mdavis4290/molly-flavonoid-rnaseq/src/main/72_F3H_PollenTube/FindDifferentiallyExpressedGenes.pdf Resource for barplots: https://bitbucket.org/mdavis4290/molly-flavonoid-rnaseq/src/main/72_F3H_PollenTube/MakeMdsPlots.pdf
            Hide
            Mdavis4290 Molly Davis added a comment -

            Waiting on email response from muday lab to know which control genes to use.

            Show
            Mdavis4290 Molly Davis added a comment - Waiting on email response from muday lab to know which control genes to use.
            Mdavis4290 Molly Davis made changes -
            Status In Progress [ 3 ] To-Do [ 10305 ]
            Hide
            Mdavis4290 Molly Davis added a comment - - edited

            Gloria Email Response:

            List of control genes.pdf

            Show
            Mdavis4290 Molly Davis added a comment - - edited Gloria Email Response: List of control genes.pdf
            Mdavis4290 Molly Davis made changes -
            Attachment List of control genes.pdf [ 17891 ]
            Mdavis4290 Molly Davis made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Mdavis4290 Molly Davis made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ]
            Hide
            ann.loraine Ann Loraine added a comment - - edited

            We needed a list of gene names for genes that never vary from Muday lab, but they are not able to provide such a list due to not enough being known about pollen tube gene expression.

            Previously, we found no over-expression of F3H gene in the over-expression lines in the the older, two-hour gene expression data set. See: Markdown report titled "Assessing flavanone 3 beta-hydroxylase (F3H) expression."

            For this new Markdown, let's examine RNA-Seq count levels of F3H pre- and post-scaling.
            The question to answer in the Markdown could be: "Did scaling via the cpm function reduce variance between replicates?"

            Show
            ann.loraine Ann Loraine added a comment - - edited We needed a list of gene names for genes that never vary from Muday lab, but they are not able to provide such a list due to not enough being known about pollen tube gene expression. Previously, we found no over-expression of F3H gene in the over-expression lines in the the older, two-hour gene expression data set. See: Markdown report titled "Assessing flavanone 3 beta-hydroxylase (F3H) expression." For this new Markdown, let's examine RNA-Seq count levels of F3H pre- and post-scaling. The question to answer in the Markdown could be: "Did scaling via the cpm function reduce variance between replicates?"
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ]
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] To-Do [ 10305 ]
            ann.loraine Ann Loraine made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            ann.loraine Ann Loraine made changes -
            Sprint Summer 2 2023 May 29 [ 171 ] Summer 2 2023 May 29, Summer 3 2023 June 12 [ 171, 172 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            ann.loraine Ann Loraine made changes -
            Link This issue relates to IGBF-3356 [ IGBF-3356 ]
            Hide
            ann.loraine Ann Loraine added a comment -

            Decided to not bother with assessing scaled vs unscaled counts. Instead, focused on the F3H gene.
            Added new files to the repository folder 72_F3H_PollenTube:

            • InvestigateF3H-and-MakeScaledCounts.Rmd
            • InvestigateF3H-and-MakeScaledCounts.pdf
            • results/muday-144-SL5_counts-salmon_scaled.txt

            Please review using the same review protocol as for linked issue IGBF-3356.

            Show
            ann.loraine Ann Loraine added a comment - Decided to not bother with assessing scaled vs unscaled counts. Instead, focused on the F3H gene. Added new files to the repository folder 72_F3H_PollenTube: InvestigateF3H-and-MakeScaledCounts.Rmd InvestigateF3H-and-MakeScaledCounts.pdf results/muday-144-SL5_counts-salmon_scaled.txt Please review using the same review protocol as for linked issue IGBF-3356 .
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            ann.loraine Ann Loraine made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            ann.loraine Ann Loraine made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            ann.loraine Ann Loraine made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ] Molly Davis [ molly ]
            Hide
            Mdavis4290 Molly Davis added a comment -

            I do not see these file in the bitbucket repo and I do not see that you have a fork made. Could I have some help finding these new files you added?

            Attn: [~aloraine]

            Show
            Mdavis4290 Molly Davis added a comment - I do not see these file in the bitbucket repo and I do not see that you have a fork made. Could I have some help finding these new files you added? Attn: [~aloraine]
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ] Ann Loraine [ aloraine ]
            Mdavis4290 Molly Davis made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            Mdavis4290 Molly Davis made changes -
            Status Post-merge Testing In Progress [ 10003 ] To-Do [ 10305 ]
            Mdavis4290 Molly Davis made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Mdavis4290 Molly Davis made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            Mdavis4290 Molly Davis made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            Mdavis4290 Molly Davis made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            Mdavis4290 Molly Davis made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            Mdavis4290 Molly Davis made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            Mdavis4290 Molly Davis made changes -
            Status Reviewing Pull Request [ 10303 ] To-Do [ 10305 ]
            Hide
            ann.loraine Ann Loraine added a comment -

            Sorry for the confusion. I broke protocol and pushed the changes to the main branch directly to the team repository. The files can be found here:

            Show
            ann.loraine Ann Loraine added a comment - Sorry for the confusion. I broke protocol and pushed the changes to the main branch directly to the team repository. The files can be found here: https://bitbucket.org/hotpollen/flavonoid-rnaseq/src/main/72_F3H_PollenTube/
            ann.loraine Ann Loraine made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            ann.loraine Ann Loraine made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            ann.loraine Ann Loraine made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            ann.loraine Ann Loraine made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            ann.loraine Ann Loraine made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ]
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ]
            Mdavis4290 Molly Davis made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            Hide
            Mdavis4290 Molly Davis added a comment - - edited

            Testing:
            Proof-read knitted .PDF: Everything on the knitted pdf looks great!
            Read .Rmd file: The date isn't "`r Sys.Date()`" but that's ok.
            Check in-line R code: All in-line code is knitted properly.
            Attempt to knit .Rmd file: I knitted the markdown from my machine and everything came out correctly and the same.
            Open the new output file: Output file is accurate and useful.

            Nice job!

            Moving ticket to done!

            Show
            Mdavis4290 Molly Davis added a comment - - edited Testing : Proof-read knitted .PDF : Everything on the knitted pdf looks great! Read .Rmd file : The date isn't "`r Sys.Date()`" but that's ok. Check in-line R code : All in-line code is knitted properly. Attempt to knit .Rmd file : I knitted the markdown from my machine and everything came out correctly and the same. Open the new output file : Output file is accurate and useful. Nice job! Moving ticket to done!
            Mdavis4290 Molly Davis made changes -
            Assignee Molly Davis [ molly ] Ann Loraine [ aloraine ]
            Mdavis4290 Molly Davis made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]

              People

              • Assignee:
                ann.loraine Ann Loraine
                Reporter:
                robofjoy Robert Reid
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: