Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-2998

Deploy alignments data to Quickload site

    Details

    • Type: Improvement
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None
    • Story Points:
      1.5
    • Sprint:
      Fall 9 2021 Dec 13 - Dec 24, Spring 1 2022 Jan 3 - Jan 14, Spring 2 2022 Jan 18 - Jan 28

      Description

      For this task, deploy data files to a quickload site. Create annots.xml for all the files.

        Attachments

          Activity

          ann.loraine Ann Loraine created issue -
          ann.loraine Ann Loraine made changes -
          Field Original Value New Value
          Epic Link IGBF-2993 [ 21429 ]
          ann.loraine Ann Loraine made changes -
          Link This issue is blocked by IGBF-2971 [ IGBF-2971 ]
          ann.loraine Ann Loraine made changes -
          Sprint Fall 8 2021 Nov 22 - Dec 3 [ 134 ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Sprint Fall 8 2021 Nov 29 - Dec 10 [ 134 ] Fall 9 2021 Dec 13 - Dec 24 [ 135 ]
          ann.loraine Ann Loraine made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          ann.loraine Ann Loraine made changes -
          Status In Progress [ 3 ] To-Do [ 10305 ]
          ann.loraine Ann Loraine made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          ann.loraine Ann Loraine made changes -
          Status In Progress [ 3 ] To-Do [ 10305 ]
          ann.loraine Ann Loraine made changes -
          Sprint Fall 9 2021 Dec 13 - Dec 24 [ 135 ] Fall 9 2021 Dec 13 - Dec 24, Spring 1 2022 Jan 3 - Jan 14 [ 135, 136 ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          ann.loraine Ann Loraine made changes -
          Description For this task, deploy data files to a quickload site. Create annots.xml for all the files.
          Hide
          ann.loraine Ann Loraine added a comment -

          Copied makeAnnotsXml.py from rna-seq project in "hotpollen" workgroup (bitbucket) into src directory. Need to modify it to work with this project.

          Moving back to To-Do for the moment while I work on a couple of other things.

          Show
          ann.loraine Ann Loraine added a comment - Copied makeAnnotsXml.py from rna-seq project in "hotpollen" workgroup (bitbucket) into src directory. Need to modify it to work with this project. Moving back to To-Do for the moment while I work on a couple of other things.
          ann.loraine Ann Loraine made changes -
          Status In Progress [ 3 ] To-Do [ 10305 ]
          ann.loraine Ann Loraine made changes -
          Sprint Fall 9 2021 Dec 13 - Dec 24, Spring 1 2022 Jan 3 - Jan 14 [ 135, 136 ] Fall 9 2021 Dec 13 - Dec 24, Spring 1 2022 Jan 3 - Jan 14, Spring 2 2022 Jan 18 - Jan 28 [ 135, 136, 137 ]
          ann.loraine Ann Loraine made changes -
          Rank Ranked higher
          ann.loraine Ann Loraine made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          Hide
          ann.loraine Ann Loraine added a comment - - edited

          Added code and file "the_colors.txt" needed to use color scheme defined in the repository R code. See new method in Common.R:

          # For each value in ExternalDataSets/samples.csv, used to run
          # Nextflow's rna-seq pipeline, write out a data sheet mapping
          # sample names to hexadecimal color codes, used by makeAnnotsXml.py 
          # to configure colors for displaying bam, bedgraph, etc. data files
          # in IGB
          outputColorsForAnnotsXml = function(fname="../ExternalDataSets/the_colors.txt") {
            the_colors = getSampleColors(hex=T)
            df = data.frame(sample=names(the_colors),
                            the_colors=the_colors)
            write.table(df,file=fname,quote=F,sep="\t",row.names = F)
            return(df)
          }
          

          Note: there's a weird inconsistency between the header values in the counts data file and the bam files and samples.csv file provided to Nextflow nf-core/rnaseq pipeline. For some reason, the hyphen characters got replaced with period characters in the counts header. I'm not sure why this happened or if it means the files are somehow out of sync with each other.

          Show
          ann.loraine Ann Loraine added a comment - - edited Added code and file "the_colors.txt" needed to use color scheme defined in the repository R code. See new method in Common.R: # For each value in ExternalDataSets/samples.csv, used to run # Nextflow's rna-seq pipeline, write out a data sheet mapping # sample names to hexadecimal color codes, used by makeAnnotsXml.py # to configure colors for displaying bam, bedgraph, etc. data files # in IGB outputColorsForAnnotsXml = function(fname= "../ExternalDataSets/the_colors.txt" ) { the_colors = getSampleColors(hex=T) df = data.frame(sample=names(the_colors), the_colors=the_colors) write.table(df,file=fname,quote=F,sep= "\t" ,row.names = F) return (df) } Note : there's a weird inconsistency between the header values in the counts data file and the bam files and samples.csv file provided to Nextflow nf-core/rnaseq pipeline. For some reason, the hyphen characters got replaced with period characters in the counts header. I'm not sure why this happened or if it means the files are somehow out of sync with each other.
          Hide
          ann.loraine Ann Loraine added a comment -

          To test:

          1. Add this new Quickload site to IGB: http://lorainelab-quickload.scidas.org/hotpollen, call it "Hot Pollen" (or whatever you want)
          2. Open the latest tomato genome by clicking the tomato image on the IGB home screen
          3. Observe that the tomato gene models load
          4. Observe that the Quickload you added appears as a folder in the "Available Data" section of the Data Access panel in IGB
          5. Open the folder - you should see a subfolder named "ARE PGRP1939255"
          6. Open the above folder - you should see two sub-folders called "Reads" and "Graph - Scaled"
          7. Open the "Reads" folder and check that you can load some data from every data set shown
          8. Open the "Graph -Scaled" folder and check that you can load some data from every data set shown

          If the above tests work, then move the ticket to "Done" and re-assign it to [~aloraine].....

          Show
          ann.loraine Ann Loraine added a comment - To test: Add this new Quickload site to IGB: http://lorainelab-quickload.scidas.org/hotpollen , call it "Hot Pollen" (or whatever you want) Open the latest tomato genome by clicking the tomato image on the IGB home screen Observe that the tomato gene models load Observe that the Quickload you added appears as a folder in the "Available Data" section of the Data Access panel in IGB Open the folder - you should see a subfolder named "ARE PGRP1939255" Open the above folder - you should see two sub-folders called "Reads" and "Graph - Scaled" Open the "Reads" folder and check that you can load some data from every data set shown Open the "Graph -Scaled" folder and check that you can load some data from every data set shown If the above tests work, then move the ticket to "Done" and re-assign it to [~aloraine] .....
          ann.loraine Ann Loraine made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          ann.loraine Ann Loraine made changes -
          Assignee Ann Loraine [ aloraine ]
          ann.loraine Ann Loraine made changes -
          Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
          ann.loraine Ann Loraine made changes -
          Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
          ann.loraine Ann Loraine made changes -
          Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
          ann.loraine Ann Loraine made changes -
          Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
          ann.loraine Ann Loraine made changes -
          Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
          ann.loraine Ann Loraine made changes -
          Attachment scaledcoveragegraphs2.png [ 17073 ]
          Attachment scaledcoveragegraphs.png [ 17074 ]
          Hide
          ann.loraine Ann Loraine added a comment -

          Added two files showing scaled coverage graphs.

          Show
          ann.loraine Ann Loraine added a comment - Added two files showing scaled coverage graphs.
          omarne Omkar Marne (Inactive) made changes -
          Assignee Omkar Marne [ omarne ]
          Hide
          omarne Omkar Marne (Inactive) added a comment -

          Test results:

          • I added IGB: http://lorainelab-quickload.scidas.org/hotpollen and named it Hot Pollen.
          • After opening the data source in IGB, clicking tomato gene, and opening folder and subfolders of the data source, data got loaded as expected.
          • Reads and Graphs folder loaded some data of every data set shown.

          Closing the ticket.

          Show
          omarne Omkar Marne (Inactive) added a comment - Test results: I added IGB: http://lorainelab-quickload.scidas.org/hotpollen and named it Hot Pollen. After opening the data source in IGB, clicking tomato gene, and opening folder and subfolders of the data source, data got loaded as expected. Reads and Graphs folder loaded some data of every data set shown. Closing the ticket.
          omarne Omkar Marne (Inactive) made changes -
          Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
          omarne Omkar Marne (Inactive) made changes -
          Assignee Omkar Marne [ omarne ] Ann Loraine [ aloraine ]
          omarne Omkar Marne (Inactive) made changes -
          Resolution Done [ 10000 ]
          Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]
          omarne Omkar Marne (Inactive) made changes -
          Resolution Done [ 10000 ]
          Status Closed [ 6 ] To-Do [ 10305 ]
          omarne Omkar Marne (Inactive) made changes -
          Status To-Do [ 10305 ] In Progress [ 3 ]
          omarne Omkar Marne (Inactive) made changes -
          Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
          omarne Omkar Marne (Inactive) made changes -
          Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
          omarne Omkar Marne (Inactive) made changes -
          Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
          omarne Omkar Marne (Inactive) made changes -
          Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
          omarne Omkar Marne (Inactive) made changes -
          Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
          omarne Omkar Marne (Inactive) made changes -
          Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
          omarne Omkar Marne (Inactive) made changes -
          Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
          omarne Omkar Marne (Inactive) made changes -
          Resolution Done [ 10000 ]
          Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]

            People

            • Assignee:
              ann.loraine Ann Loraine
              Reporter:
              ann.loraine Ann Loraine
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: