Changed the for loop to use multi-threading, only working for two ensembl divisions, right now working on adding the ensembl species to the species.txt file the logic which was included as part of IGBF-3780 only removes the genome versions of a species that are already present but if ensembl has another version then it's getting added.

Fixed the issues that were found while testing, now user is able to see all the species from Ensembl which aren't loaded by other provider. Changing the for loop to use a parallel stream in the loadSupportedGenomeVersions method didn't optimize anything, I think the underneath methods don't support multi-threading which makes the parallel stream work like a normal loop. Four out of Six divisions are being loaded without any issue without any optimization. Below is the screenshot of the species that are loaded from Ensembl.

As discussed with Nowlan Freese, will deep-dive into the code and see if there is any part of the code that can be optimized.

Tried different optimizations and changed the way the code is written as part of IGBF-3780, now all the divisions species from Ensembl are being loaded within 30 seconds. But the list of species is so long, as discussed with Nowlan Freese will be treating each division as a separate data provider and enable only EnsemblVertebrates, EnsemblPlants, and EnsemblMetazoa these data providers by default and the rest three would be disabled. This will allow the user to enable the other categories if required. Will be creating tickets for this.

Next task - Check all the optimization changes that are done and see which changes are useful and whether they are impacting any other part of IGB.

The optimization changes that are done in the Ensembl code are working correctly and effectively reducing the loading time but the multi-threading changes which also reduced the load time, are impacting other parts of the code, so reverted those changes. Will push the changes as part of the IGBF-3780 ticket. Closing this ticket.

This ticket investigated optimizing the IGB load time, but we decided not to include any of the changes as they had other effects.