Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-3757

Investigate with Charlotte OneIT: Quickload web sites unreachable on University networks

    Details

    • Type: Improvement
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Situation: In IGBF-3621 we found there to be consistent issues when connecting to igbquickload.org/quickload and https://data.bioviz.org/ when using a University managed computer. After speaking with Steven Blanchard he suggested there might be an issue with a VPN tunnel that the University uses on University managed laptops.

      Task: Run the following commands on a University managed laptop and a non-University managed laptop, then report the results to UNC Charlotte.

      cat /etc/resolv.conf
      

      The above should output nameserver ##.##.#.##
      You will need the ##.##.#.## for the next two commands.

      dig data.bioviz.org @##.##.#.##
      dig igbquickload.org/quickload @##.##.#.##
      

        Attachments

          Issue Links

            Activity

            Hide
            nfreese Nowlan Freese added a comment - - edited

            Nowlan non-University managed laptop on eduroam:

            nowlan-mbp-2017:~ lorainelab$ cat /etc/resolv.conf
            #
            # macOS Notice
            #
            # This file is not consulted for DNS hostname resolution, address
            # resolution, or the DNS query routing mechanism used by most
            # processes on this system.
            #
            # To view the DNS configuration used by this system, use:
            #   scutil --dns
            #
            # SEE ALSO
            #   dns-sd(1), scutil(8)
            #
            # This file is automatically generated.
            #
            search uncc.edu its.uncc.edu dyn.uncc.edu charlotte.edu
            nameserver 10.23.0.30
            nameserver 10.23.0.20
            nowlan-mbp-2017:~ lorainelab$ dig data.bioviz.org @10.23.0.30
            
            ; <<>> DiG 9.10.6 <<>> data.bioviz.org @10.23.0.30
            ;; global options: +cmd
            ;; Got answer:
            ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 36398
            ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1
            
            ;; OPT PSEUDOSECTION:
            ; EDNS: version: 0, flags:; udp: 1220
            ;; QUESTION SECTION:
            ;data.bioviz.org.		IN	A
            
            ;; ANSWER SECTION:
            data.bioviz.org.	7024	IN	CNAME	entry_for_mapping_data_bioviz_cname.uncc.edu.
            entry_for_mapping_data_bioviz_cname.uncc.edu. 30 IN A 10.16.57.232
            
            ;; Query time: 5 msec
            ;; SERVER: 10.23.0.30#53(10.23.0.30)
            ;; WHEN: Thu May 23 13:55:01 EDT 2024
            ;; MSG SIZE  rcvd: 118
            
            nowlan-mbp-2017:~ lorainelab$ 
            
            
            nowlan-mbp-2017:~ lorainelab$ dig igbquickload.org/quickload @10.23.0.30
            
            ; <<>> DiG 9.10.6 <<>> igbquickload.org/quickload @10.23.0.30
            ;; global options: +cmd
            ;; Got answer:
            ;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 50541
            ;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 1
            
            ;; OPT PSEUDOSECTION:
            ; EDNS: version: 0, flags:; udp: 1220
            ;; QUESTION SECTION:
            ;igbquickload.org/quickload.	IN	A
            
            ;; AUTHORITY SECTION:
            .			3600	IN	SOA	a.root-servers.net. nstld.verisign-grs.com. 2024052801 1800 900 604800 86400
            
            ;; Query time: 24 msec
            ;; SERVER: 10.23.0.30#53(10.23.0.30)
            ;; WHEN: Tue May 28 14:44:54 EDT 2024
            ;; MSG SIZE  rcvd: 130
            
            
            Show
            nfreese Nowlan Freese added a comment - - edited Nowlan non-University managed laptop on eduroam: nowlan-mbp-2017:~ lorainelab$ cat /etc/resolv.conf # # macOS Notice # # This file is not consulted for DNS hostname resolution, address # resolution, or the DNS query routing mechanism used by most # processes on this system. # # To view the DNS configuration used by this system, use: # scutil --dns # # SEE ALSO # dns-sd(1), scutil(8) # # This file is automatically generated. # search uncc.edu its.uncc.edu dyn.uncc.edu charlotte.edu nameserver 10.23.0.30 nameserver 10.23.0.20 nowlan-mbp-2017:~ lorainelab$ dig data.bioviz.org @10.23.0.30 ; <<>> DiG 9.10.6 <<>> data.bioviz.org @10.23.0.30 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 36398 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1 ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1220 ;; QUESTION SECTION: ;data.bioviz.org. IN A ;; ANSWER SECTION: data.bioviz.org. 7024 IN CNAME entry_for_mapping_data_bioviz_cname.uncc.edu. entry_for_mapping_data_bioviz_cname.uncc.edu. 30 IN A 10.16.57.232 ;; Query time: 5 msec ;; SERVER: 10.23.0.30#53(10.23.0.30) ;; WHEN: Thu May 23 13:55:01 EDT 2024 ;; MSG SIZE rcvd: 118 nowlan-mbp-2017:~ lorainelab$ nowlan-mbp-2017:~ lorainelab$ dig igbquickload.org/quickload @10.23.0.30 ; <<>> DiG 9.10.6 <<>> igbquickload.org/quickload @10.23.0.30 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 50541 ;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 1 ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1220 ;; QUESTION SECTION: ;igbquickload.org/quickload. IN A ;; AUTHORITY SECTION: . 3600 IN SOA a.root-servers.net. nstld.verisign-grs.com. 2024052801 1800 900 604800 86400 ;; Query time: 24 msec ;; SERVER: 10.23.0.30#53(10.23.0.30) ;; WHEN: Tue May 28 14:44:54 EDT 2024 ;; MSG SIZE rcvd: 130
            Hide
            nfreese Nowlan Freese added a comment -

            Paige University managed laptop on eduroam:

            pkulzer@CCI9N5793XALT ~ % cat /etc/resolv.conf
            #
            # macOS Notice
            #
            # This file is not consulted for DNS hostname resolution, address
            # resolution, or the DNS query routing mechanism used by most
            # processes on this system.
            #
            # To view the DNS configuration used by this system, use:
            #   scutil --dns
            #
            # SEE ALSO
            #   dns-sd(1), scutil(8)
            #
            # This file is automatically generated.
            #
            search its.uncc.edu uncc.edu dyn.uncc.edu
            nameserver 10.23.0.30
            nameserver 10.23.0.20
            pkulzer@CCI9N5793XALT ~ % dig data.bioviz.org @10.23.0.30 
            
            ; <<>> DiG 9.10.6 <<>> data.bioviz.org @10.23.0.30
            ;; global options: +cmd
            ;; Got answer:
            ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 44053
            ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1
            
            ;; OPT PSEUDOSECTION:
            ; EDNS: version: 0, flags:; udp: 1410
            ;; QUESTION SECTION:
            ;data.bioviz.org.        IN    A
            
            ;; ANSWER SECTION:
            data.bioviz.org.    7200    IN    CNAME    entry_for_mapping_data_bioviz_cname.uncc.edu.
            entry_for_mapping_data_bioviz_cname.uncc.edu. 20 IN A 152.15.236.217
            
            ;; Query time: 161 msec
            ;; SERVER: 10.23.0.30#53(10.23.0.30)
            ;; WHEN: Tue May 28 14:52:40 EDT 2024
            ;; MSG SIZE  rcvd: 118
            
            pkulzer@CCI9N5793XALT ~ % dig igbquickload.org/quickload/ @10.23.0.30
            
            ; <<>> DiG 9.10.6 <<>> igbquickload.org/quickload/ @10.23.0.30
            ;; global options: +cmd
            ;; Got answer:
            ;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 41133
            ;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 1
            
            ;; OPT PSEUDOSECTION:
            ; EDNS: version: 0, flags:; udp: 1220
            ;; QUESTION SECTION:
            ;igbquickload.org/quickload/.    IN    A
            
            ;; AUTHORITY SECTION:
            .            3600    IN    SOA    a.root-servers.net. nstld.verisign-grs.com. 2024052801 1800 900 604800 86400
            
            ;; Query time: 114 msec
            ;; SERVER: 10.23.0.30#53(10.23.0.30)
            ;; WHEN: Tue May 28 14:53:34 EDT 2024
            ;; MSG SIZE  rcvd: 131
            
            Show
            nfreese Nowlan Freese added a comment - Paige University managed laptop on eduroam: pkulzer@CCI9N5793XALT ~ % cat /etc/resolv.conf # # macOS Notice # # This file is not consulted for DNS hostname resolution, address # resolution, or the DNS query routing mechanism used by most # processes on this system. # # To view the DNS configuration used by this system, use: # scutil --dns # # SEE ALSO # dns-sd(1), scutil(8) # # This file is automatically generated. # search its.uncc.edu uncc.edu dyn.uncc.edu nameserver 10.23.0.30 nameserver 10.23.0.20 pkulzer@CCI9N5793XALT ~ % dig data.bioviz.org @10.23.0.30 ; <<>> DiG 9.10.6 <<>> data.bioviz.org @10.23.0.30 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 44053 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1 ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1410 ;; QUESTION SECTION: ;data.bioviz.org. IN A ;; ANSWER SECTION: data.bioviz.org. 7200 IN CNAME entry_for_mapping_data_bioviz_cname.uncc.edu. entry_for_mapping_data_bioviz_cname.uncc.edu. 20 IN A 152.15.236.217 ;; Query time: 161 msec ;; SERVER: 10.23.0.30#53(10.23.0.30) ;; WHEN: Tue May 28 14:52:40 EDT 2024 ;; MSG SIZE rcvd: 118 pkulzer@CCI9N5793XALT ~ % dig igbquickload.org/quickload/ @10.23.0.30 ; <<>> DiG 9.10.6 <<>> igbquickload.org/quickload/ @10.23.0.30 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 41133 ;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 1 ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1220 ;; QUESTION SECTION: ;igbquickload.org/quickload/. IN A ;; AUTHORITY SECTION: . 3600 IN SOA a.root-servers.net. nstld.verisign-grs.com. 2024052801 1800 900 604800 86400 ;; Query time: 114 msec ;; SERVER: 10.23.0.30#53(10.23.0.30) ;; WHEN: Tue May 28 14:53:34 EDT 2024 ;; MSG SIZE rcvd: 131
            Hide
            pkulzer Paige Kulzer added a comment - - edited

            We've contacted a system administrator from the OneIT - CCI Technology Solutions Office (TSO) named Benjamin Stalcup (benjamins@charlotte.edu) about this issue. He and his colleague Brandon have helped us make some changes to igbquickload.org (though Ann Loraine can do a better job of documenting exactly what those changes are), so this ticket is ready for testing.

            TESTING
            I propose the following testing, but please feel free to modify this if there's a better way forward:

            1. Check if you can reach each of the Quickload sites on the following networks:

            • Home internet
            • VPN
            • EduRoam (Kannapolis)
            • EduRoam (Main Campus)
            • Ninerwifi-guest (Kannapolis)
            • Ninerwifi-guest (Main Campus)
            • NCRC Guest (Kannapolis)

            List of Quickloads:

            2. Repeat the first step on either a non-university managed computer or a university-managed computer, whichever you did not use to complete step 1.
            3. Make note of which sites, if any, are still causing issues.

            Show
            pkulzer Paige Kulzer added a comment - - edited We've contacted a system administrator from the OneIT - CCI Technology Solutions Office (TSO) named Benjamin Stalcup (benjamins@charlotte.edu) about this issue. He and his colleague Brandon have helped us make some changes to igbquickload.org (though Ann Loraine can do a better job of documenting exactly what those changes are), so this ticket is ready for testing. TESTING I propose the following testing, but please feel free to modify this if there's a better way forward: 1. Check if you can reach each of the Quickload sites on the following networks: Home internet VPN EduRoam (Kannapolis) EduRoam (Main Campus) Ninerwifi-guest (Kannapolis) Ninerwifi-guest (Main Campus) NCRC Guest (Kannapolis) List of Quickloads: https://data.bioviz.org/quickload/ http://igbquickload.org/quickload/ http://lorainelab-quickload.scidas.org/quickload/ https://quickload.bioviz.org/quickload/ 2. Repeat the first step on either a non-university managed computer or a university-managed computer, whichever you did not use to complete step 1. 3. Make note of which sites, if any, are still causing issues.
            Hide
            pkulzer Paige Kulzer added a comment - - edited

            University-managed laptop:
            Home internet
            VPN OK
            EduRoam (Kannapolis) data.bioviz.org not loading
            EduRoam (Main Campus)
            Ninerwifi-guest (Kannapolis) OK
            Ninerwifi-guest (Main Campus)
            NCRC Guest (Kannapolis) OK

            Non-University managed laptop:
            Home internet
            VPN OK
            EduRoam (Kannapolis) OK
            EduRoam (Main Campus)
            Ninerwifi-guest (Kannapolis) OK
            Ninerwifi-guest (Main Campus)
            NCRC Guest (Kannapolis) OK

            Show
            pkulzer Paige Kulzer added a comment - - edited University-managed laptop: Home internet VPN OK EduRoam (Kannapolis) data.bioviz.org not loading EduRoam (Main Campus) Ninerwifi-guest (Kannapolis) OK Ninerwifi-guest (Main Campus) NCRC Guest (Kannapolis) OK Non-University managed laptop: Home internet VPN OK EduRoam (Kannapolis) OK EduRoam (Main Campus) Ninerwifi-guest (Kannapolis) OK Ninerwifi-guest (Main Campus) NCRC Guest (Kannapolis) OK
            Hide
            pkulzer Paige Kulzer added a comment -

            See attached for a .pdf copy of the email correspondence between Dr. Loraine and OneIT about this issue. I've sent an email back to them summarizing the findings of this most recent round of testing that I reported above:

            Hello all,

            I'll be heading the testing for this issue and have been working on getting that up and running today. I still need to head to main campus sometime next week to test igbquickload.org on the various networks and computers there, but I do have some results to share with you from the testing I did on the research campus today.

            igbquickload.org/quickload is now working on all WiFi networks on university-managed and non-university managed laptops alike. This was the website that we were having the most trouble with when we initially reached out to you folks at OneIT, so it's great we've got that working! Like I said, I'll head to main campus next week and make sure that's the case there, too.

            However, we are still having issues with another website only while using a university-managed laptop on the eduroam network. That website is https://data.bioviz.org/quickload/. We were able to load this intermittently on eduroam when we first reached out to you, but I haven't been able to load it at all today. Would you be able to help us with this website next?

            All the best,
            Paige

            Show
            pkulzer Paige Kulzer added a comment - See attached for a .pdf copy of the email correspondence between Dr. Loraine and OneIT about this issue. I've sent an email back to them summarizing the findings of this most recent round of testing that I reported above: Hello all, I'll be heading the testing for this issue and have been working on getting that up and running today. I still need to head to main campus sometime next week to test igbquickload.org on the various networks and computers there, but I do have some results to share with you from the testing I did on the research campus today. igbquickload.org/quickload is now working on all WiFi networks on university-managed and non-university managed laptops alike. This was the website that we were having the most trouble with when we initially reached out to you folks at OneIT, so it's great we've got that working! Like I said, I'll head to main campus next week and make sure that's the case there, too. However, we are still having issues with another website only while using a university-managed laptop on the eduroam network. That website is https://data.bioviz.org/quickload/ . We were able to load this intermittently on eduroam when we first reached out to you, but I haven't been able to load it at all today. Would you be able to help us with this website next? All the best, Paige
            Hide
            ann.loraine Ann Loraine added a comment - - edited

            Comment from Ann regarding how to systematically test all the new network configuration:

            I recommend doing this - test all the variables in all their combinations, and record / report the outcome.

            There could be more variables, but these seem to the three most important ones: domain, computer, wifi network:

            1) domain - igbquickload.org or data.bioviz.org (2 variables)
            2) computer - University-managed (running "Umbrella") or not University-managed (no "Umbrella") (2 variables)
            3) wifi network - UNC Charlotte VPN, eduroam in Kannapolis, eduroam on main campus, completely external network (e.g., your home internet wifi), Niner Guest on the main campus, and ???? (5 variables, at least)

            For testing, we should check and report the outcome for all combinations of the three variables, e.g.,

            domain: computer: network:
            igbquickload.org. University-managed (running "Umbrella") UNC Charlotte VPN
            igbquickload.org not University-managed (no "Umbrella"). UNC Charlotte VPN
            igbquickload.org University-managed (running "Umbrella") eduroam in Kannapolis
            ... etc.

            and record the outcome.

            Possible outcomes we've observed thus far include:

            1) Web browser "spins and spins" and never shows a page
            2) Web browser shows the content

            Above quote copied from email sent Wed Aug 28 3:06 pm by Ann, subject heading: "Re: problem with igbquickload.org even using new IP address, was: Re: cci-vm12.uncc.edu down until the morning"

            Show
            ann.loraine Ann Loraine added a comment - - edited Comment from Ann regarding how to systematically test all the new network configuration: I recommend doing this - test all the variables in all their combinations, and record / report the outcome. There could be more variables, but these seem to the three most important ones: domain, computer, wifi network: 1) domain - igbquickload.org or data.bioviz.org (2 variables) 2) computer - University-managed (running "Umbrella") or not University-managed (no "Umbrella") (2 variables) 3) wifi network - UNC Charlotte VPN, eduroam in Kannapolis, eduroam on main campus, completely external network (e.g., your home internet wifi), Niner Guest on the main campus, and ???? (5 variables, at least) For testing, we should check and report the outcome for all combinations of the three variables, e.g., domain: computer: network: igbquickload.org. University-managed (running "Umbrella") UNC Charlotte VPN igbquickload.org not University-managed (no "Umbrella"). UNC Charlotte VPN igbquickload.org University-managed (running "Umbrella") eduroam in Kannapolis ... etc. and record the outcome. Possible outcomes we've observed thus far include: 1) Web browser "spins and spins" and never shows a page 2) Web browser shows the content Above quote copied from email sent Wed Aug 28 3:06 pm by Ann, subject heading: "Re: problem with igbquickload.org even using new IP address, was: Re: cci-vm12.uncc.edu down until the morning"
            Hide
            pkulzer Paige Kulzer added a comment -

            This issue has been resolved and the OneIT ticket submitted by Ann about this issue has been closed. Here's a brief summary of what Brandon Chap from OneIT did that resolved this issue: He added a Hairpin NAT for the wireless networks we've been testing (i.e., eduroam, NCRC guest, NinerWIFi-Guest, etc) since OneIT doesn't own the domains for these websites.

            We did a lot of testing of this fix on the call:

            • Both websites (data.bioviz.org and igbquickload.org) work on my university-managed computer on eduroam, NCRC guest, and the VPN.
            • Both websites work on my non-university managed computer on eduroam.
            • Nowlan saw the same results as above on his own computers.
            • On a Windows machine on campus, OneIT was able to confirm that both websites work on eduroam.

            Closing this ticket now that we've investigated this issue with OneIT and have it working consistently.

            Show
            pkulzer Paige Kulzer added a comment - This issue has been resolved and the OneIT ticket submitted by Ann about this issue has been closed. Here's a brief summary of what Brandon Chap from OneIT did that resolved this issue: He added a Hairpin NAT for the wireless networks we've been testing (i.e., eduroam, NCRC guest, NinerWIFi-Guest, etc) since OneIT doesn't own the domains for these websites. We did a lot of testing of this fix on the call: Both websites (data.bioviz.org and igbquickload.org) work on my university-managed computer on eduroam, NCRC guest, and the VPN. Both websites work on my non-university managed computer on eduroam. Nowlan saw the same results as above on his own computers. On a Windows machine on campus, OneIT was able to confirm that both websites work on eduroam. Closing this ticket now that we've investigated this issue with OneIT and have it working consistently.

              People

              • Assignee:
                pkulzer Paige Kulzer
                Reporter:
                nfreese Nowlan Freese
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: