Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-2909

Determine if and how we can use Nextflow on UNCC HPC cluster

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None
    • Story Points:
      3
    • Sprint:
      Fall 1 2021 Aug 16 - Aug 27, Fall 2 2021 Aug 30 - Sep10, Fall 3 2021 Sep 13 - Sep 24

      Description

      Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.

      For this task, we need to:

      • Get familiar with the UNC Charlotte compute cluster environment and job schedular
      • Understand how various software packages are configured and installed - how can we get Nextflow onto the cluster
      • Communicate with support personnnel to ask for new software to be installed, as required

        Attachments

          Issue Links

            Activity

            ann.loraine Ann Loraine created issue -
            ann.loraine Ann Loraine made changes -
            Field Original Value New Value
            Epic Link IGBF-2883 [ 21320 ]
            ann.loraine Ann Loraine made changes -
            Sprint Fall 1 2021 Aug 16 - Aug 27 [ 127 ] Fall 1 2021 Aug 16 - Aug 27, Fall 2 2021 Aug 30 - Aug 10 [ 127, 128 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            ann.loraine Ann Loraine made changes -
            Summary Deploy rice salt stress and strain data to RNA-Seq quickload Deploy rice salt stress and strain data
            ann.loraine Ann Loraine made changes -
            Summary Deploy rice salt stress and strain data Re-align rice salt stress RNA-Seq data using hisat
            ann.loraine Ann Loraine made changes -
            Summary Re-align rice salt stress RNA-Seq data using hisat Determine if we can use Nextflow to align RNA-Seq data on cluster
            ann.loraine Ann Loraine made changes -
            Description Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            ann.loraine Ann Loraine made changes -
            Description Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schelular
            * Understand how various software packages are configured and installed
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for alignment RNA-seq data onto a reference genome
            ann.loraine Ann Loraine made changes -
            Description Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schelular
            * Understand how various software packages are configured and installed
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for alignment RNA-seq data onto a reference genome
            Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schedular
            * Understand how various software packages are configured and installed
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for alignment RNA-seq data onto a reference genome
            ann.loraine Ann Loraine made changes -
            Summary Determine if we can use Nextflow to align RNA-Seq data on cluster Determine if and how we can use Nextflow to align RNA-Seq data on cluster
            ann.loraine Ann Loraine made changes -
            Description Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schedular
            * Understand how various software packages are configured and installed
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for alignment RNA-seq data onto a reference genome
            Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schedular
            * Understand how various software packages are configured and installed - how can we get Nextflow onto the cluster
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for alignment RNA-seq data onto a reference genome
            ann.loraine Ann Loraine made changes -
            Description Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schedular
            * Understand how various software packages are configured and installed - how can we get Nextflow onto the cluster
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for alignment RNA-seq data onto a reference genome
            Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schedular
            * Understand how various software packages are configured and installed - how can we get Nextflow onto the cluster
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for aligning RNA-seq data onto a reference genome
            nfreese Nowlan Freese made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            ann.loraine Ann Loraine made changes -
            Link This issue relates to IGBF-2935 [ IGBF-2935 ]
            ann.loraine Ann Loraine made changes -
            Comment [ Nextflow scripts can run in lots of different environments, using diverse schedulers. I ran a script on the UNCC HPC queue "Orion" by creating a file named "nextflow.config" in the same directory as my nextflow script.

            nextflow.config:
            {code}
            process {
              executor='slurm'
              queue = 'Orion'
              time = '5m'
            }
            {code}
            I first tried it without the time parameter, but I got an error message. I think you can specify the time variable in the Nextflow script itself. ]
            ann.loraine Ann Loraine made changes -
            Sprint Fall 1 2021 Aug 16 - Aug 27, Fall 2 2021 Aug 30 - Sep10 [ 127, 128 ] Fall 1 2021 Aug 16 - Aug 27, Fall 2 2021 Aug 30 - Sep10, Fall 3 2021Sep 13 - Sep 24 [ 127, 128, 129 ]
            ann.loraine Ann Loraine made changes -
            Rank Ranked higher
            nfreese Nowlan Freese made changes -
            Status In Progress [ 3 ] To-Do [ 10305 ]
            ann.loraine Ann Loraine made changes -
            Status To-Do [ 10305 ] In Progress [ 3 ]
            ann.loraine Ann Loraine made changes -
            Assignee Nowlan Freese [ nfreese ] Ann Loraine [ aloraine ]
            ann.loraine Ann Loraine made changes -
            Status In Progress [ 3 ] Needs 1st Level Review [ 10005 ]
            ann.loraine Ann Loraine made changes -
            Assignee Ann Loraine [ aloraine ] Nowlan Freese [ nfreese ]
            ann.loraine Ann Loraine made changes -
            Description Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.
            If the environment does not support it for some reason, we can use AWS instead.
            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schedular
            * Understand how various software packages are configured and installed - how can we get Nextflow onto the cluster
            * Communicate with support personnnel to ask for new software to be installed, as required
            * Investigate Nextflow workflows others have published for aligning RNA-seq data onto a reference genome
            Determine if we can use Nextflow workflow management software on the UNC Charlotte compute cluster.

            For this task, we need to:

            * Get familiar with the UNC Charlotte compute cluster environment and job schedular
            * Understand how various software packages are configured and installed - how can we get Nextflow onto the cluster
            * Communicate with support personnnel to ask for new software to be installed, as required
            ann.loraine Ann Loraine made changes -
            Summary Determine if and how we can use Nextflow to align RNA-Seq data on cluster Determine if and how we can use Nextflow on UNCC HPC cluster
            nfreese Nowlan Freese made changes -
            Status Needs 1st Level Review [ 10005 ] First Level Review in Progress [ 10301 ]
            ann.loraine Ann Loraine made changes -
            Link This issue relates to IGBF-2945 [ IGBF-2945 ]
            nfreese Nowlan Freese made changes -
            Status First Level Review in Progress [ 10301 ] Ready for Pull Request [ 10304 ]
            nfreese Nowlan Freese made changes -
            Status Ready for Pull Request [ 10304 ] Pull Request Submitted [ 10101 ]
            nfreese Nowlan Freese made changes -
            Status Pull Request Submitted [ 10101 ] Reviewing Pull Request [ 10303 ]
            nfreese Nowlan Freese made changes -
            Status Reviewing Pull Request [ 10303 ] Merged Needs Testing [ 10002 ]
            nfreese Nowlan Freese made changes -
            Assignee Nowlan Freese [ nfreese ]
            nfreese Nowlan Freese made changes -
            Assignee Ann Loraine [ aloraine ]
            nfreese Nowlan Freese made changes -
            Status Merged Needs Testing [ 10002 ] Post-merge Testing In Progress [ 10003 ]
            nfreese Nowlan Freese made changes -
            Resolution Done [ 10000 ]
            Status Post-merge Testing In Progress [ 10003 ] Closed [ 6 ]

              People

              • Assignee:
                ann.loraine Ann Loraine
                Reporter:
                ann.loraine Ann Loraine
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: