Back to the room

Pass 3 of 3 · Deep dive of PHAROSPass 1 · OverviewPass 2 · How it works

Code Observatory / method

_load

codeintel.embeddings.OnnxEmbedder._load

PINNED SOURCE Source and edges from the index at this commit. An execution appears only where one was recorded.

PHAROS at 975a38dMIT license

Around this symbol

Search all symbols

Loading

Calls (1)
SymbolFileResolved by
EmbeddingUnavailableembeddings.pysame file
Inside (1)
SymbolFileResolved by
OnnxEmbedderembeddings.pysame file
codeintel.embeddings.OnnxEmbedder._loadbackend/app/codeintel/embeddings.py, lines 312–336Open source
    def _load(self):        if self._session is not None:            return        with self._lock:            if self._session is not None:                return            try:                import onnxruntime as ort                from tokenizers import Tokenizer            except ImportError as exc:                raise EmbeddingUnavailable(                    "onnx backend needs onnxruntime and tokenizers (pip install -r requirements-onnx.txt)"                ) from exc            model_path = os.path.join(self.model_dir, self.onnx_file)            tok_path = os.path.join(self.model_dir, "tokenizer.json")            if not (os.path.isfile(model_path) and os.path.isfile(tok_path)):                raise EmbeddingUnavailable(f"{self.model_dir} must contain {self.onnx_file} and tokenizer.json")            tokenizer = Tokenizer.from_file(tok_path)            tokenizer.enable_truncation(max_length=self.max_length)            tokenizer.enable_padding()            opts = ort.SessionOptions()            opts.intra_op_num_threads = int(os.getenv("EMBEDDING_ONNX_THREADS", "0")) or os.cpu_count() or 1            self._session = ort.InferenceSession(model_path, opts, providers=["CPUExecutionProvider"])            self._input_names = {i.name for i in self._session.get_inputs()}            self._tokenizer = tokenizer

What the index recorded

Signature
def _load(self):
File
backend/app/codeintel/embeddings.py
Lines
312–336
Parser
python-ast
Git blob
df7f8202f23ca6ad2c57aca5f09b435eb6486d79
Call sites
12 named, 1 resolved, 11 left unlinked

Read it on GitHub at this commit