Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-1441

Fix Depth Graph (Start) Soft-clip coordinates

    Details

    • Story Points:
      2
    • Sprint:
      Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1, Winter 2018 Sprint 2, Winter 2018 Sprint 3, Spring 2019 Sprint 1

      Description

      Depth graph track operations are used to add up the amount of read depth from bam/sam files. The soft-clipped portion of a read should not count towards either Depth Graph (Start) or Depth Graph (All).

      Currently Depth Graph (All) does not include the soft-clipped portion (correct). However, Depth Graph (Start) does count the soft-clipped portion (bug).

      Example soft-clip files can be found in Dropbox > IGB > Jira Issues > IGBF-1291 Soft-Clip > exampleFiles

      Potential classes worth investigating:
      SeqSymSummarizer > getSpanStartSummary
      Delegate - getRegion

        Attachments

        1. example.bed
          0.1 kB
        2. GFF3_example_1_EDITED_negative.gff3
          0.8 kB
        3. GFF3_example_1_EDITED.gff3
          0.8 kB
        4. IGBF1441_Review_Screenshot.PNG
          IGBF1441_Review_Screenshot.PNG
          205 kB
        5. IGBF1441_Testing.docx
          603 kB
        6. onlyMatchesNegativeShifted.sam
          0.1 kB
        7. onlyMatchesShifted-2.sam
          0.2 kB
        8. softClip-depthGraphStart.png
          softClip-depthGraphStart.png
          79 kB
        9. softClip-DepthGraphStart-CORRECT.png
          softClip-DepthGraphStart-CORRECT.png
          109 kB
        10. softClipShifted2.sam
          0.2 kB
        11. soft-match-deletion-match-insertion-match-soft.sam
          0.1 kB
        12. VCF_HomoSapien_EDITED.vcf
          1 kB

          Issue Links

            Activity

            nfreese Nowlan Freese created issue -
            nfreese Nowlan Freese made changes -
            Field Original Value New Value
            Link This issue blocks IGBF-1291 [ IGBF-1291 ]
            nfreese Nowlan Freese made changes -
            Link This issue relates to IGBF-1291 [ IGBF-1291 ]
            nfreese Nowlan Freese made changes -
            Link This issue blocks IGBF-1291 [ IGBF-1291 ]
            nfreese Nowlan Freese made changes -
            Attachment softClipShifted2.sam [ 14173 ]
            nfreese Nowlan Freese made changes -
            Assignee Pranav Sanjay Tambvekar [ ptambvek ]
            nfreese Nowlan Freese made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            nfreese Nowlan Freese made changes -
            Attachment onlyMatchesNegativeShifted.sam [ 14177 ]
            Attachment onlyMatchesShifted-2.sam [ 14178 ]
            ptambvek Pranav Sanjay Tambvekar (Inactive) made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            ptambvek Pranav Sanjay Tambvekar (Inactive) made changes -
            Assignee Pranav Sanjay Tambvekar [ ptambvek ]
            nfreese Nowlan Freese made changes -
            Status Needs 1st Level Review [ 10005 ] Ready for Pull Request [ 10304 ]
            nfreese Nowlan Freese made changes -
            Assignee Pranav Sanjay Tambvekar [ ptambvek ]
            Show
            ptambvek Pranav Sanjay Tambvekar (Inactive) added a comment - Made changes at the branch: https://bitbucket.org/ptambvekar/igb-pranav-fork/src/IGBF-1441-fix-depth-graph-soft-clip/
            ptambvek Pranav Sanjay Tambvekar (Inactive) made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            Hide
            nfreese Nowlan Freese added a comment -

            From what we can tell, the StartDepthOperator is only used by the track operation > Depth Graph (Start). The edits made to StartDepthOperator do not seem to affect other track operations, however, a more thorough examination/testing may be needed.

            Show
            nfreese Nowlan Freese added a comment - From what we can tell, the StartDepthOperator is only used by the track operation > Depth Graph (Start). The edits made to StartDepthOperator do not seem to affect other track operations, however, a more thorough examination/testing may be needed.
            nfreese Nowlan Freese made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing [ 10301 ]
            Hide
            nfreese Nowlan Freese added a comment - - edited

            We need to consider how this will work with bed files. Bed files will have multiple sym leafs, and each will have its own start. This is also an issue with BAM files where the matching section is split by a deletion, creating two leafs.

            Show
            nfreese Nowlan Freese added a comment - - edited We need to consider how this will work with bed files. Bed files will have multiple sym leafs, and each will have its own start. This is also an issue with BAM files where the matching section is split by a deletion, creating two leafs.
            nfreese Nowlan Freese made changes -
            Attachment example.bed [ 14182 ]
            Attachment soft-match-deletion-match-insertion-match-soft.sam [ 14183 ]
            nfreese Nowlan Freese made changes -
            Attachment VCF_HomoSapien_EDITED.vcf [ 14184 ]
            Show
            ptambvek Pranav Sanjay Tambvekar (Inactive) added a comment - Updated the logic. Please review https://bitbucket.org/ptambvekar/igb-pranav-fork/commits/branch/IGBF-1441-fix-depth-graph-soft-clip
            ptambvek Pranav Sanjay Tambvekar (Inactive) made changes -
            Status Reviewing [ 10301 ] Needs 1st Level Review [ 10005 ]
            ptambvek Pranav Sanjay Tambvekar (Inactive) made changes -
            Assignee Pranav Sanjay Tambvekar [ ptambvek ]
            nfreese Nowlan Freese made changes -
            Status Needs 1st Level Review [ 10005 ] Reviewing [ 10301 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            nfreese Nowlan Freese made changes -
            Status Reviewing [ 10301 ] Ready for Pull Request [ 10304 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ] Pranav Sanjay Tambvekar [ ptambvek ]
            ptambvek Pranav Sanjay Tambvekar (Inactive) made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            nfreese Nowlan Freese made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing [ 10301 ]
            nfreese Nowlan Freese made changes -
            Attachment GFF3_example_1_EDITED.gff3 [ 14185 ]
            nfreese Nowlan Freese made changes -
            Hide
            nfreese Nowlan Freese added a comment -

            Dr. Loraine pointed out that GFF files do not have to be positionally sorted. Thus, the first index position of the sym object does not necessarily contain the beginning of the annotation for GFF files. We need to identify the child sym with the correct start before adding it as a leaf.

            Show
            nfreese Nowlan Freese added a comment - Dr. Loraine pointed out that GFF files do not have to be positionally sorted. Thus, the first index position of the sym object does not necessarily contain the beginning of the annotation for GFF files. We need to identify the child sym with the correct start before adding it as a leaf.
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 2018 Sprint 4 [ 54 ] Fall 2018 Sprint 4, Fall 2018 Sprint 5 [ 54, 55 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Fix Version/s 9.1.0 Major Release [ 10601 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 2018 Sprint 4, Fall 2018 Sprint 5 [ 54, 55 ] Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1 [ 54, 55, 56 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Status Reviewing [ 10301 ] Needs Testing [ 10002 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1 [ 54, 55, 56 ] Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1, Winter 2018 Sprint 2 [ 54, 55, 56, 57 ]
            Hide
            ann.loraine Ann Loraine added a comment -

            Expect to spend probably 2 full days on this.

            Show
            ann.loraine Ann Loraine added a comment - Expect to spend probably 2 full days on this.
            ann.loraine Ann Loraine made changes -
            Assignee Pranav Sanjay Tambvekar [ ptambvek ] Srishtee Marotkar [ srishtee ]
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Status Needs Testing [ 10002 ] Testing In Progress [ 10003 ]
            Hide
            ann.loraine Ann Loraine added a comment -
            Show
            ann.loraine Ann Loraine added a comment - Link to dropbox folder with files: https://www.dropbox.com/sh/wxzhideujatu6ct/AAB3OafXzmTAXuu3eZTGYcGBa?dl=0
            Hide
            ann.loraine Ann Loraine added a comment -
            Show
            ann.loraine Ann Loraine added a comment - Explanation of CIGAR string: http://bioinformatics.cvr.ac.uk/blog/tag/cigar-string/
            Hide
            srishteeM Srishtee Marotkar (Inactive) added a comment - - edited

            Working:
            1. Depth Graph (Start) for not considering soft-clip works fine for Bam and Sam files on https://www.dropbox.com/sh/wxzhideujatu6ct/AAA4s1PZVa9JjYkN4Bpi1rHba/exampleFiles?dl=0&subfolder_nav_tracking=1, also for attached bam,sam files
            2. Behavior for All the file format available in Smoke Test data at (http://igbquickload.org/smokeTestingQuickload/) except for GFF3 is in sync with Relase 9.0.2

            Not Working:
            1. Please refer attached 'IGBF1441_Testing' document for failure test case details. Depth Graph(Start) for GFF3 files are not generating any graphs. This can be checked against IGB with Release 9.0.2 . (Data Used is smoke testing data as mentioned in point 2 above)

            Show
            srishteeM Srishtee Marotkar (Inactive) added a comment - - edited Working: 1. Depth Graph (Start) for not considering soft-clip works fine for Bam and Sam files on https://www.dropbox.com/sh/wxzhideujatu6ct/AAA4s1PZVa9JjYkN4Bpi1rHba/exampleFiles?dl=0&subfolder_nav_tracking=1 , also for attached bam,sam files 2. Behavior for All the file format available in Smoke Test data at ( http://igbquickload.org/smokeTestingQuickload/ ) except for GFF3 is in sync with Relase 9.0.2 Not Working: 1. Please refer attached 'IGBF1441_Testing' document for failure test case details. Depth Graph(Start) for GFF3 files are not generating any graphs. This can be checked against IGB with Release 9.0.2 . (Data Used is smoke testing data as mentioned in point 2 above)
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Attachment IGBF1441_Testing.docx [ 14202 ]
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Comment [ Details for Failed Test Cases ]
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Status Testing In Progress [ 10003 ] Open [ 1 ]
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Assignee Srishtee Marotkar [ srishtee ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1, Winter 2018 Sprint 2 [ 54, 55, 56, 57 ] Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1, Winter 2018 Sprint 2, Winter 2018 Sprint 3 [ 54, 55, 56, 57, 58 ]
            nfreese Nowlan Freese made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            Hide
            nfreese Nowlan Freese added a comment -

            Need testing on my current branch to see if the GFF3 files are now working correctly.

            Show
            nfreese Nowlan Freese added a comment - Need testing on my current branch to see if the GFF3 files are now working correctly.
            nfreese Nowlan Freese made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            nfreese Nowlan Freese made changes -
            Assignee Srishtee Marotkar [ srishteem ]
            Hide
            srishteeM Srishtee Marotkar (Inactive) added a comment - - edited

            Please Check 'IGBF1441_Review_Screenshot' attached file.

            Downloaded installer from https://bitbucket.org/nfreese/nowlanfork-igb/downloads/ with name 'IGB-IGBF-1441-SoftclipDepthGraphStartBug-x64.exe' and it is now showing Depth Graph(Start) for GFF3 files loaded from smoking test data

            Show
            srishteeM Srishtee Marotkar (Inactive) added a comment - - edited Please Check 'IGBF1441_Review_Screenshot' attached file. Downloaded installer from https://bitbucket.org/nfreese/nowlanfork-igb/downloads/ with name 'IGB- IGBF-1441 -SoftclipDepthGraphStartBug-x64.exe' and it is now showing Depth Graph(Start) for GFF3 files loaded from smoking test data
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Attachment IGBF1441_Review_Screenshot.PNG [ 14204 ]
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Status Needs 1st Level Review [ 10005 ] Ready for Pull Request [ 10304 ]
            srishteeM Srishtee Marotkar (Inactive) made changes -
            Assignee Srishtee Marotkar [ srishteem ] Nowlan Freese [ nfreese ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1, Winter 2018 Sprint 2, Winter 2018 Sprint 3 [ 54, 55, 56, 57, 58 ] Fall 2018 Sprint 4, Fall 2018 Sprint 5, Winter 2018 Sprint 1, Winter 2018 Sprint 2, Winter 2018 Sprint 3, Spring 2019 Sprint 1 [ 54, 55, 56, 57, 58, 59 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ] Kiran Korey [ kkorey ]
            nfreese Nowlan Freese made changes -
            Assignee Kiran Korey [ kkorey ] Nowlan Freese [ nfreese ]
            nfreese Nowlan Freese made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            nfreese Nowlan Freese made changes -
            ann.loraine Ann Loraine made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            ann.loraine Ann Loraine made changes -
            Assignee Nowlan Freese [ nfreese ] Ann Loraine [ aloraine ]
            ann.loraine Ann Loraine made changes -
            Status Reviewing Pull Request [ 10303 ] Needs Testing [ 10002 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ]
            Hide
            nfreese Nowlan Freese added a comment -

            Testing Mac: Working Correctly

            Show
            nfreese Nowlan Freese added a comment - Testing Mac: Working Correctly
            Hide
            svallapu Sai Charan Reddy Vallapureddy (Inactive) added a comment -

            Linux testing successful

            Show
            svallapu Sai Charan Reddy Vallapureddy (Inactive) added a comment - Linux testing successful
            Hide
            svallapu Sai Charan Reddy Vallapureddy (Inactive) added a comment -

            Testing Windows: Working Correctly

            Show
            svallapu Sai Charan Reddy Vallapureddy (Inactive) added a comment - Testing Windows: Working Correctly
            svallapu Sai Charan Reddy Vallapureddy (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Needs Testing [ 10002 ] Closed [ 6 ]
            nfreese Nowlan Freese made changes -
            Assignee Pranav Sanjay Tambvekar [ ptambvek ]
            svallapu Sai Charan Reddy Vallapureddy (Inactive) made changes -
            Assignee Pranav Sanjay Tambvekar [ ptambvek ] Srishtee Marotkar [ srishteem ]
            ann.loraine Ann Loraine made changes -
            Workflow Loraine Lab Workflow [ 18147 ] Fall 2019 Workflow Update [ 19967 ]
            ann.loraine Ann Loraine made changes -
            Workflow Fall 2019 Workflow Update [ 19967 ] Revised Fall 2019 Workflow Update [ 22088 ]
            nfreese Nowlan Freese made changes -
            Assignee Srishtee Marotkar [ srishteem ] Nowlan Freese [ nfreese ]

              People

              • Assignee:
                nfreese Nowlan Freese
                Reporter:
                nfreese Nowlan Freese
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: