After the correction of the authorities population when using API Token, it seems that the code to retrieve the granted authorities is very slow.
The authorities retrieval for GitHub access token is done in 2 requests (1 for my orgs and 1 for my teams). But for the retrieval in case of API Token, using the stored access token, there are as many requests as your organizations have teams (even if don't belong to them).
The result is frequent timeout when using CLI and somewhat not usable system.
The code seems to be unused before that modification since there was an implicit team.toString() in the authorities that show some internal reference.