Function setTokensProvider

setTokensProvider(
    languageId: string,
    provider:
        | TokensProvider
        | EncodedTokensProvider
        | Thenable<TokensProvider | EncodedTokensProvider>,
): IDisposable

Set the tokens provider for a language (manual implementation). This tokenizer will be exclusive with a tokenizer created using setMonarchTokensProvider, or with registerTokensProviderFactory, but will work together with a tokens provider set using registerDocumentSemanticTokensProvider or registerDocumentRangeSemanticTokensProvider.