Pass 3 of 3 · Deep dive of PHAROSPass 1 · OverviewPass 2 · How it works
Code Observatory / method
_load
codeintel.embeddings.OnnxEmbedder._load
PINNED SOURCE Source and edges from the index at this commit. An execution appears only where one was recorded.
PHAROS at 975a38dMIT license
Around this symbol
Search all symbolsLoading
| Symbol | File | Resolved by |
|---|---|---|
| EmbeddingUnavailable | embeddings.py | same file |
| Symbol | File | Resolved by |
|---|---|---|
| OnnxEmbedder | embeddings.py | same file |
codeintel.embeddings.OnnxEmbedder._loadbackend/app/codeintel/embeddings.py, lines 312–336Open source
def _load(self): if self._session is not None: return with self._lock: if self._session is not None: return try: import onnxruntime as ort from tokenizers import Tokenizer except ImportError as exc: raise EmbeddingUnavailable( "onnx backend needs onnxruntime and tokenizers (pip install -r requirements-onnx.txt)" ) from exc model_path = os.path.join(self.model_dir, self.onnx_file) tok_path = os.path.join(self.model_dir, "tokenizer.json") if not (os.path.isfile(model_path) and os.path.isfile(tok_path)): raise EmbeddingUnavailable(f"{self.model_dir} must contain {self.onnx_file} and tokenizer.json") tokenizer = Tokenizer.from_file(tok_path) tokenizer.enable_truncation(max_length=self.max_length) tokenizer.enable_padding() opts = ort.SessionOptions() opts.intra_op_num_threads = int(os.getenv("EMBEDDING_ONNX_THREADS", "0")) or os.cpu_count() or 1 self._session = ort.InferenceSession(model_path, opts, providers=["CPUExecutionProvider"]) self._input_names = {i.name for i in self._session.get_inputs()} self._tokenizer = tokenizerWhat the index recorded
- Signature
def _load(self):- File
backend/app/codeintel/embeddings.py- Lines
- 312–336
- Parser
- python-ast
- Git blob
df7f8202f23ca6ad2c57aca5f09b435eb6486d79- Call sites
- 12 named, 1 resolved, 11 left unlinked
