Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-2583

Investigate ProtAnnot fail to load Lotmaria passim genes

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
    • Story Points:
      1
    • Sprint:
      Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22, Winter 3 Jan 25 - Feb 5, Winter 4 Feb 8 - Feb 19, Winter 5 Feb 22 - Mar 5

      Description

      Situation: ProtAnnot fails to load the Lotmaria passim genes. There is an error in the console (see below).

      Task: Investigate why this error is occurring.

      Note: The Lotmaria passim was previously called Crithidia. There may be issues with the annotation files themselves - this may not be a ProtAnnot issue.

      12:17:36.184 INFO c.a.igb.view.load.GeneralLoadUtils - All residues in range are already loaded on sequence Contig_1
      ERROR: Sequence string passed to DNAUtils.translate() is empty
      12:17:36.186 ERROR c.a.genometry.thread.CThreadWorker - com.affymetrix.genometry.span.SimpleSeqSpan cannot be cast to com.affymetrix.genometry.MutableSeqSpan
      java.lang.ClassCastException: com.affymetrix.genometry.span.SimpleSeqSpan cannot be cast to com.affymetrix.genometry.MutableSeqSpan
      at com.affymetrix.genometry.util.SeqUtils.transformLeafSymmetry(SeqUtils.java:785) ~[na:na]
      at com.affymetrix.genometry.util.SeqUtils.transformSymmetry(SeqUtils.java:668) ~[na:na]
      at com.affymetrix.genometry.util.SeqUtils.transformSymmetry(SeqUtils.java:602) ~[na:na]
      at org.lorainelab.igb.protannot.model.ProtannotParser.processCDS(ProtannotParser.java:572) ~[na:na]
      at org.lorainelab.igb.protannot.model.ProtannotParser.processMRNA(ProtannotParser.java:525) ~[na:na]
      at org.lorainelab.igb.protannot.model.ProtannotParser.processDNASeq(ProtannotParser.java:399) ~[na:na]
      at org.lorainelab.igb.protannot.model.ProtannotParser.parse(ProtannotParser.java:232) ~[na:na]
      at org.lorainelab.igb.protannot.ProtAnnotAction.load(ProtAnnotAction.java:731) ~[na:na]
      at org.lorainelab.igb.protannot.ProtAnnotAction$2.runInBackground(ProtAnnotAction.java:262) ~[na:na]
      at com.affymetrix.genometry.thread.CThreadWorker.doInBackground(CThreadWorker.java:73) ~[na:na]
      at javax.swing.SwingWorker$1.call(SwingWorker.java:295) [na:1.8.0_241]
      at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_241]
      at javax.swing.SwingWorker.run(SwingWorker.java:334) [na:1.8.0_241]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_241]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_241]
      at java.lang.Thread.run(Thread.java:748) [na:1.8.0_241]

        Attachments

          Issue Links

            Activity

            nfreese Nowlan Freese created issue -
            nfreese Nowlan Freese made changes -
            Field Original Value New Value
            Epic Link IGBF-1765 [ 17855 ]
            nfreese Nowlan Freese made changes -
            Link This issue relates to IGBF-1360 [ IGBF-1360 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6 [ 107 ]
            Labels Beginner
            nfreese Nowlan Freese made changes -
            Summary Investigate Protannot fail to load Lotmaria passim genes Investigate ProtAnnot fail to load Lotmaria passim genes
            Hide
            nfreese Nowlan Freese added a comment -

            To replicate the issue in IGB:
            1) Select the Lotmaria passim genome in the Species menu and the L_passim_Apr_2014 Genome Version.
            2) Navigate to Contig_1:81,219-95,810
            3) Install ProtAnnot: Plug-ins > Launch App Manager > ProtAnnot > click Install
            4) In IGB, select the gene in view.
            5) Select Tools > Start ProtAnnot

            Show
            nfreese Nowlan Freese added a comment - To replicate the issue in IGB: 1) Select the Lotmaria passim genome in the Species menu and the L_passim_Apr_2014 Genome Version. 2) Navigate to Contig_1:81,219-95,810 3) Install ProtAnnot: Plug-ins > Launch App Manager > ProtAnnot > click Install 4) In IGB, select the gene in view. 5) Select Tools > Start ProtAnnot
            ssegu Sai Supreeth Segu (Inactive) made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            ssegu Sai Supreeth Segu (Inactive) made changes -
            Assignee Sai Supreeth Segu [ ssegu ]
            Hide
            nfreese Nowlan Freese added a comment -

            This issue is due to the Lotmaria passim annotation bed files being improperly formatted (missing or incorrect columns). Supreeth is in the process of correcting all of the annotation files and then we will need to update them on the Quickload.

            Show
            nfreese Nowlan Freese added a comment - This issue is due to the Lotmaria passim annotation bed files being improperly formatted (missing or incorrect columns). Supreeth is in the process of correcting all of the annotation files and then we will need to update them on the Quickload.
            ssegu Sai Supreeth Segu (Inactive) made changes -
            Status In Progress [ 3 ] To-Do [ 10305 ]
            Hide
            nfreese Nowlan Freese added a comment -

            Supreeth has fixed the various annotation files and sent them to me. I need to test them, gzip/tabix index, and then push them to the Quickload.

            Show
            nfreese Nowlan Freese added a comment - Supreeth has fixed the various annotation files and sent them to me. I need to test them, gzip/tabix index, and then push them to the Quickload.
            nfreese Nowlan Freese made changes -
            Assignee Sai Supreeth Segu [ ssegu ] Nowlan Freese [ nfreese ]
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6 [ 107 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20 [ 107, 108 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            nfreese Nowlan Freese made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            nfreese Nowlan Freese made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            nfreese Nowlan Freese made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            nfreese Nowlan Freese made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            nfreese Nowlan Freese made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            nfreese Nowlan Freese made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            nfreese Nowlan Freese made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            Hide
            nfreese Nowlan Freese added a comment -

            Files have been pushed to subversion repository.

            See IGBF-1617 for notes on how to test.

            Show
            nfreese Nowlan Freese added a comment - Files have been pushed to subversion repository . See IGBF-1617 for notes on how to test.
            noor91zahara Noor Zahara (Inactive) made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            noor91zahara Noor Zahara (Inactive) made changes -
            Assignee Noor Zahara [ noor91zahara ]
            noor91zahara Noor Zahara (Inactive) made changes -
            Status Post-merge Testing In Progress [ 10003 ] Merged Needs Testing [ 10002 ]
            noor91zahara Noor Zahara (Inactive) made changes -
            Assignee Noor Zahara [ noor91zahara ]
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20 [ 107, 108 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 23 - Dec 4 [ 107, 108, 109 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11 [ 107, 108, 109 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23 [ 107, 108, 109, 110 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23 [ 107, 108, 109, 110 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8 [ 107, 108, 109, 110, 111 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8 [ 107, 108, 109, 110, 111 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22 [ 107, 108, 109, 110, 111, 112 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22 [ 107, 108, 109, 110, 111, 112 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22, Winter 3 Jan 25 - Feb 5 [ 107, 108, 109, 110, 111, 112, 113 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Hide
            ann.loraine Ann Loraine added a comment -

            Irvin Naylor - please check that the functionality mentioned above is correctly implemented in IGB 9.1.6, the released version of IGB. Please make a note of any problems you may observe.

            Show
            ann.loraine Ann Loraine added a comment - Irvin Naylor - please check that the functionality mentioned above is correctly implemented in IGB 9.1.6, the released version of IGB. Please make a note of any problems you may observe.
            ann.loraine Ann Loraine made changes -
            Assignee Irvin Naylor [ inaylor ]
            Hide
            inaylor Irvin Naylor (Inactive) added a comment -

            Followed the steps in IGB 9.1.6 and can confirm that functionality is working correctly. The console is showing no errors.

            Attached is the console log. From my understanding, everything looks fine but I'll attach just in case

            Show
            inaylor Irvin Naylor (Inactive) added a comment - Followed the steps in IGB 9.1.6 and can confirm that functionality is working correctly. The console is showing no errors. Attached is the console log. From my understanding, everything looks fine but I'll attach just in case
            inaylor Irvin Naylor (Inactive) made changes -
            Attachment console1.PNG [ 15134 ]
            inaylor Irvin Naylor (Inactive) made changes -
            Assignee Irvin Naylor [ inaylor ]
            nfreese Nowlan Freese made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            Hide
            nfreese Nowlan Freese added a comment -

            I can confirm that the functionality is working, but I am concerned by what I'm seeing in the log. I will investigate to see what is going on.

            Show
            nfreese Nowlan Freese added a comment - I can confirm that the functionality is working, but I am concerned by what I'm seeing in the log. I will investigate to see what is going on.
            Hide
            nfreese Nowlan Freese added a comment -

            The log warnings are caused by an off by one error. I am working to correct the error in all of the files.

            Show
            nfreese Nowlan Freese added a comment - The log warnings are caused by an off by one error. I am working to correct the error in all of the files.
            nfreese Nowlan Freese made changes -
            Status Post-merge Testing In Progress [ 10003 ] To-Do [ 10305 ]
            nfreese Nowlan Freese made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Hide
            nfreese Nowlan Freese added a comment -

            [~aloraine] - I have committed the updated annotation files to the subversion repository following testing on my local machine.

            I no longer receive the console log referring to "lengths disagree" that was seen in Irvin's logs for the example above. However, while I have corrected the off by one error and so most annotations should now be correctly divisible by 3, there is still a subset of the annotations that is not. I double-checked with the original data from geneious and this is not a mistake, but possibly just poor annotation. It looks like several methods/tools were used to generate the annotations and one of them was more prone to create annotations that were not divisible by 3.

            The other warning that Irvin saw in his logs refers to the name field being too long. I think this warning can be ignored as it does not seem to have any impact.

            Show
            nfreese Nowlan Freese added a comment - [~aloraine] - I have committed the updated annotation files to the subversion repository following testing on my local machine. I no longer receive the console log referring to "lengths disagree" that was seen in Irvin's logs for the example above. However, while I have corrected the off by one error and so most annotations should now be correctly divisible by 3, there is still a subset of the annotations that is not. I double-checked with the original data from geneious and this is not a mistake, but possibly just poor annotation. It looks like several methods/tools were used to generate the annotations and one of them was more prone to create annotations that were not divisible by 3. The other warning that Irvin saw in his logs refers to the name field being too long. I think this warning can be ignored as it does not seem to have any impact.
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            nfreese Nowlan Freese made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22, Winter 3 Jan 25 - Feb 5 [ 107, 108, 109, 110, 111, 112, 113 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22, Winter 3 Jan 25 - Feb 5, Winter 4 Feb 8 - Feb 19 [ 107, 108, 109, 110, 111, 112, 113, 114 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Hide
            nfreese Nowlan Freese added a comment -

            Current task - Quickloads need to be uploaded to reflect the changes to the Lotmaria passim files in the SVN repository.

            Show
            nfreese Nowlan Freese added a comment - Current task - Quickloads need to be uploaded to reflect the changes to the Lotmaria passim files in the SVN repository.
            Hide
            nfreese Nowlan Freese added a comment -

            Tested using lorainelab-quickload.scidas.org
            The off by one error is no longer present.

            [~aloraine] - igbquickload.org still has the older version of the annotation. Can I close this issue or wait until igbquickload.org has also been updated?

            Show
            nfreese Nowlan Freese added a comment - Tested using lorainelab-quickload.scidas.org The off by one error is no longer present. [~aloraine] - igbquickload.org still has the older version of the annotation. Can I close this issue or wait until igbquickload.org has also been updated?
            nfreese Nowlan Freese made changes -
            Assignee Ann Loraine [ aloraine ]
            ann.loraine Ann Loraine made changes -
            Sprint Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22, Winter 3 Jan 25 - Feb 5, Winter 4 Feb 8 - Feb 19 [ 107, 108, 109, 110, 111, 112, 113, 114 ] Fall 4 Oct 26 - Nov 6, Fall 5 Nov 9 - Nov 20, Fall 6 Nov 30 - Dec 11, Fall 7 Dec 14 - Dec 23, Winter 1 Dec 28 - Jan 8, Winter 2 Jan 11 - Jan 22, Winter 3 Jan 25 - Feb 5, Winter 4 Feb 8 - Feb 19, Winter 5 Feb 22 - Mar 5 [ 107, 108, 109, 110, 111, 112, 113, 114, 115 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            Hide
            ann.loraine Ann Loraine added a comment -

            Updated igbquicload.org:

            [aloraine@cci-vm12 quickload]$ svn up
            U    L_passim_Apr_2014/CDS_Crithidia.bed.gz.tbi
            U    L_passim_Apr_2014/Exon_Crithidia.bed.gz.tbi
            U    L_passim_Apr_2014/gene_Crithidia.bed.gz.tbi
            U    L_passim_Apr_2014/match_Crithidia.bed.gz
            U    L_passim_Apr_2014/Protein_match_Crithidia.bed.gz
            U    L_passim_Apr_2014/mRNA_Crithidia.bed.gz
            U    L_passim_Apr_2014/Expressed_sequence_match_Crithidia.bed.gz
            U    L_passim_Apr_2014/CDS_Crithidia.bed.gz
            U    L_passim_Apr_2014/Exon_Crithidia.bed.gz
            U    L_passim_Apr_2014/Protein_match_Crithidia.bed.gz.tbi
            U    L_passim_Apr_2014/match_Crithidia.bed.gz.tbi
            U    L_passim_Apr_2014/mRNA_Crithidia.bed.gz.tbi
            U    L_passim_Apr_2014/gene_Crithidia.bed.gz
            U    L_passim_Apr_2014/Expressed_sequence_match_Crithidia.bed.gz.tbi
            Updated to revision 148.
            

            Same at "renci" quickload.

            Show
            ann.loraine Ann Loraine added a comment - Updated igbquicload.org: [aloraine@cci-vm12 quickload]$ svn up U L_passim_Apr_2014/CDS_Crithidia.bed.gz.tbi U L_passim_Apr_2014/Exon_Crithidia.bed.gz.tbi U L_passim_Apr_2014/gene_Crithidia.bed.gz.tbi U L_passim_Apr_2014/match_Crithidia.bed.gz U L_passim_Apr_2014/Protein_match_Crithidia.bed.gz U L_passim_Apr_2014/mRNA_Crithidia.bed.gz U L_passim_Apr_2014/Expressed_sequence_match_Crithidia.bed.gz U L_passim_Apr_2014/CDS_Crithidia.bed.gz U L_passim_Apr_2014/Exon_Crithidia.bed.gz U L_passim_Apr_2014/Protein_match_Crithidia.bed.gz.tbi U L_passim_Apr_2014/match_Crithidia.bed.gz.tbi U L_passim_Apr_2014/mRNA_Crithidia.bed.gz.tbi U L_passim_Apr_2014/gene_Crithidia.bed.gz U L_passim_Apr_2014/Expressed_sequence_match_Crithidia.bed.gz.tbi Updated to revision 148. Same at "renci" quickload.
            Hide
            ann.loraine Ann Loraine added a comment -

            Updated. Moving to "Needs Testing"

            Show
            ann.loraine Ann Loraine added a comment - Updated. Moving to "Needs Testing"
            ann.loraine Ann Loraine made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            ann.loraine Ann Loraine made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            ann.loraine Ann Loraine made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            ann.loraine Ann Loraine made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ]
            pbadzuh Philip Badzuh (Inactive) made changes -
            Assignee Philip Badzuh [ pbadzuh ]
            pbadzuh Philip Badzuh (Inactive) made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            Hide
            pbadzuh Philip Badzuh (Inactive) added a comment -

            I am able to open and run ProtAnnot without the reported errors. Tested on macOS.

            Show
            pbadzuh Philip Badzuh (Inactive) added a comment - I am able to open and run ProtAnnot without the reported errors. Tested on macOS.
            pbadzuh Philip Badzuh (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]
            pbadzuh Philip Badzuh (Inactive) made changes -
            Assignee Philip Badzuh [ pbadzuh ] Nowlan Freese [ nfreese ]

              People

              • Assignee:
                nfreese Nowlan Freese
                Reporter:
                nfreese Nowlan Freese
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: