Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-4166

Collect VCF files and test new vcf parsing

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None
    • Story Points:
      4
    • Sprint:
      Spring 3, Spring 5, Spring 6, Spring 8, Summer 1

      Description

      Situation: Collect vcf files for testing changes

      Task: Gather and test vcf files

        Attachments

          Issue Links

            Activity

            sjagarap saideepthi jagarapu (Inactive) created issue -
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Field Original Value New Value
            Epic Link IGBF-3836 [ 23135 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Link This issue clones IGBF-4153 [ IGBF-4153 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Description Situation: loaders depends on LineProcessor for parsing and loading genomic regions

            Task: Investigate how we could eliminate the LineProcessor dependency completely, streamlining the parsing process and displaying region.
            Situation: Collect vcf files for testing changes

            Task: Gather vcf files
            nfreese Nowlan Freese made changes -
            Attachment vcf_sample_files.zip [ 18661 ]
            Hide
            nfreese Nowlan Freese added a comment - - edited

            I took the two files that we had found earlier and subset the larger file to just APOL1. Note that one sample vcf is for the 2013 human genome and the other is for the 2009 human genome (see the respective readme.txt files). I also created multiple indexes for the files using tabix, bcftools, or igvtools. The files themselves are either raw or bgzipped.

            There are also two bcf files, but I could not get them to load in either IGB or IGV, so something seems wrong with them (based on this comment it does not appear that IGV supports BCF files, so the attached BCF files are probably valid).

            Show
            nfreese Nowlan Freese added a comment - - edited I took the two files that we had found earlier and subset the larger file to just APOL1. Note that one sample vcf is for the 2013 human genome and the other is for the 2009 human genome (see the respective readme.txt files). I also created multiple indexes for the files using tabix, bcftools, or igvtools. The files themselves are either raw or bgzipped. There are also two bcf files, but I could not get them to load in either IGB or IGV, so something seems wrong with them (based on this comment it does not appear that IGV supports BCF files, so the attached BCF files are probably valid).
            ann.loraine Ann Loraine made changes -
            Sprint Spring 3, Spring 5 [ 212, 214 ] Spring 3, Spring 5, Spring 6 [ 212, 214, 215 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            Hide
            nfreese Nowlan Freese added a comment - - edited

            Note: It seems like there are an array of different indexes being used with vcf/bcf files. For example, Genome in a Bottle has a gzipped vcf with a .tbi index. If using bcftools you can specify --write-index which will output either a "tbi" or "csi" depending on output file format.

            Show
            nfreese Nowlan Freese added a comment - - edited Note: It seems like there are an array of different indexes being used with vcf/bcf files. For example, Genome in a Bottle has a gzipped vcf with a .tbi index. If using bcftools you can specify --write-index which will output either a "tbi" or "csi" depending on output file format.
            nfreese Nowlan Freese made changes -
            Summary Collect VCF files for testing changes Collect VCF files and test new vcf parsing
            nfreese Nowlan Freese made changes -
            Description Situation: Collect vcf files for testing changes

            Task: Gather vcf files
            Situation: Collect vcf files for testing changes

            Task: Gather and test vcf files
            Hide
            sjagarap saideepthi jagarapu (Inactive) added a comment -
            Show
            sjagarap saideepthi jagarapu (Inactive) added a comment - Testing all other file formats: https://wiki.bioviz.org/confluence/display/ITD/File+Formats
            nfreese Nowlan Freese made changes -
            Sprint Spring 3, Spring 5, Spring 6 [ 212, 214, 215 ] Spring 3, Spring 5, Spring 6, Spring 7 [ 212, 214, 215, 216 ]
            nfreese Nowlan Freese made changes -
            Rank Ranked higher
            Hide
            sjagarap saideepthi jagarapu (Inactive) added a comment -

            Current implementation is failing when trying to load VCF from Quickload

            Issue eloboration:
            New implementation has VCFFileReader, which can process only local files not any kind of URL (http)

            Show
            sjagarap saideepthi jagarapu (Inactive) added a comment - Current implementation is failing when trying to load VCF from Quickload Issue eloboration: New implementation has VCFFileReader, which can process only local files not any kind of URL (http)
            nfreese Nowlan Freese made changes -
            Sprint Spring 3, Spring 5, Spring 6, Spring 7 [ 212, 214, 215, 216 ] Spring 3, Spring 5, Spring 6, Spring 8 [ 212, 214, 215, 217 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Link This issue is cloned by IGBF-4219 [ IGBF-4219 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Status First Level Review in Progress [ 10301 ] Needs 1st Level Review [ 10005 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Link This issue relates to IGBF-4219 [ IGBF-4219 ]
            sjagarap saideepthi jagarapu (Inactive) made changes -
            Link This issue is cloned by IGBF-4219 [ IGBF-4219 ]
            ann.loraine Ann Loraine made changes -
            Sprint Spring 3, Spring 5, Spring 6, Spring 8 [ 212, 214, 215, 217 ] Spring 3, Spring 5, Spring 6, Spring 8, Summer 1 [ 212, 214, 215, 217, 218 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            nfreese Nowlan Freese made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            nfreese Nowlan Freese made changes -
            Status First Level Review in Progress [ 10301 ] To-Do [ 10305 ]
            Hide
            nfreese Nowlan Freese added a comment -

            This ticket can be considered complete as we have collected VCF files and tested them. The primary issue that was identified is that the current implementation is not working to load files from the web (http/https for example). IGBF-4219 was created to fix this issue.

            Closing ticket.

            Show
            nfreese Nowlan Freese added a comment - This ticket can be considered complete as we have collected VCF files and tested them. The primary issue that was identified is that the current implementation is not working to load files from the web (http/https for example). IGBF-4219 was created to fix this issue. Closing ticket.
            nfreese Nowlan Freese made changes -
            Status To-Do [ 10305 ] Pull Request Submitted [ 10101 ]
            nfreese Nowlan Freese made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            nfreese Nowlan Freese made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            nfreese Nowlan Freese made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            nfreese Nowlan Freese made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]

              People

              • Assignee:
                sjagarap saideepthi jagarapu (Inactive)
                Reporter:
                sjagarap saideepthi jagarapu (Inactive)
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: