Skip to content

Commit 3ca062a

Browse files
author
mike dupont
committed
adding the readme and manifest
1 parent c54535c commit 3ca062a

File tree

3 files changed

+4306
-0
lines changed

3 files changed

+4306
-0
lines changed

README.md

+8
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,11 @@
1+
#
2+
```
3+
aws ecr get-login-password --region us-east-2 | docker login --username AWS --password-stdin 767503528736.dkr.ecr.us-east-2.amazonaws.com
4+
docker pull 767503528736.dkr.ecr.us-east-2.amazonaws.com/nodemodules/tokenizer:latest
5+
docker tag 767503528736.dkr.ecr.us-east-2.amazonaws.com/nodemodules/tokenizer:latest h4ckermike/arm64-tokenizers:latest
6+
docker push h4ckermike/arm64-tokenizers:latest
7+
```
8+
19
# @anush008/tokenizers
210

311
The official Node bindings are in a jinx with limited support for Node versions and architectures. This package offers multi-arch bindings for [@huggingface/tokenizers](https://github.com/huggingface/tokenizers) with Node v20.x supported.

error.txt

+45
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
> eliza@ start /app
2+
> pnpm --filter "@elizaos/agent" start --isRoot "--characters=characters/eliza.character.json"
3+
4+
. |  WARN  Unsupported engine: wanted: {"node":"23.3.0"} (current: {"node":"v23.6.0","pnpm":"9.14.4"})
5+
6+
> @elizaos/agent@0.1.7 start /app/agent
7+
> node --loader ts-node/esm src/index.ts "--isRoot" "--characters=characters/eliza.character.json"
8+
9+
(node:31) ExperimentalWarning: `--experimental-loader` may be removed in the future; instead use `register()`:
10+
--import 'data:text/javascript,import { register } from "node:module"; import { pathToFileURL } from "node:url"; register("ts-node/esm", pathToFileURL("./"));'
11+
(Use `node --trace-warnings ...` to show where the warning was created)
12+
(node:31) [DEP0180] DeprecationWarning: fs.Stats constructor is deprecated.
13+
(Use `node --trace-deprecation ...` to show where the warning was created)
14+
node:internal/modules/cjs/loader:1409
15+
const err = new Error(message);
16+
^
17+
18+
Error: Cannot find module '@anush008/tokenizers-linux-arm64-gnu'
19+
Require stack:
20+
- /app/node_modules/fastembed/node_modules/.pnpm/@anush008+tokenizers@https+++codeload.github.com+meta-introspector+arm64-tokenizers+tar.gz+98_s2457qj3pe4ojcbckddasgzfvu/node_modules/@anush008/tokenizers/index.js
21+
- /app/node_modules/fastembed/lib/cjs/fastembed.js
22+
- /app/node_modules/fastembed/lib/cjs/index.js
23+
at Function._resolveFilename (node:internal/modules/cjs/loader:1409:15)
24+
at defaultResolveImpl (node:internal/modules/cjs/loader:1060:19)
25+
at resolveForCJSWithHooks (node:internal/modules/cjs/loader:1065:22)
26+
at Function._load (node:internal/modules/cjs/loader:1214:37)
27+
at TracingChannel.traceSync (node:diagnostics_channel:322:14)
28+
at wrapModuleLoad (node:internal/modules/cjs/loader:234:24)
29+
at Module.require (node:internal/modules/cjs/loader:1495:12)
30+
at require (node:internal/modules/helpers:135:16)
31+
at Object.<anonymous> (/app/node_modules/fastembed/node_modules/.pnpm/@anush008+tokenizers@https+++codeload.github.com+meta-introspector+arm64-tokenizers+tar.gz+98_s2457qj3pe4ojcbckddasgzfvu/node_modules/@anush008/tokenizers/index.js:219:31)
32+
at Module._compile (node:internal/modules/cjs/loader:1739:14) {
33+
code: 'MODULE_NOT_FOUND',
34+
requireStack: [
35+
'/app/node_modules/fastembed/node_modules/.pnpm/@anush008+tokenizers@https+++codeload.github.com+meta-introspector+arm64-tokenizers+tar.gz+98_s2457qj3pe4ojcbckddasgzfvu/node_modules/@anush008/tokenizers/index.js',
36+
'/app/node_modules/fastembed/lib/cjs/fastembed.js',
37+
'/app/node_modules/fastembed/lib/cjs/index.js'
38+
]
39+
}
40+
41+
Node.js v23.6.0
42+
/app/agent:
43+
 ERR_PNPM_RECURSIVE_RUN_FIRST_FAIL  @elizaos/agent@0.1.7 start: `node --loader ts-node/esm src/index.ts "--isRoot" "--characters=characters/eliza.character.json"`
44+
Exit status 1
45+
 ELIFECYCLE  Command failed with exit code 1.

0 commit comments

Comments
 (0)