Skip to content

Kinesis error handling and more robust server restart script #8

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 248 commits into from
Feb 24, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
248 commits
Select commit Hold shift + click to select a range
7a9a193
chore(mu): add tests for cron, worker #747
jfrain99 Aug 22, 2024
a1ea58d
feat(dev-cli): auto-set memory-limit flag based on module requirement…
PeterFarber Aug 28, 2024
44f2d48
feat(mu): add mu metrics for size of each database
jfrain99 Sep 3, 2024
f8ebcfc
chore(dev-cli): update config memory defaults
PeterFarber Sep 4, 2024
1f56f2e
docs(cu): correct default for WASM_EVALUATION_MAX_WORKERS in README
TillaTheHun0 Sep 16, 2024
711c6a6
chore(ur): make surUrl configuration required
TillaTheHun0 Sep 16, 2024
54fecc5
chore(ur): bump deps
TillaTheHun0 Sep 16, 2024
c038a31
chore(cu): re-adjust dry-run default max age to be 100ms #984
TillaTheHun0 Sep 17, 2024
03f6424
feat(mu): create dal - buildtx
jfrain99 Aug 27, 2024
9ca273b
feat(mu): finish mu dal
jfrain99 Aug 28, 2024
fdff44e
fix(mu): fix processSpawn test
VinceJuliano Sep 20, 2024
20aec3b
Merge pull request #982 from permaweb/jfrain99/create-mu-dal
jfrain99 Sep 20, 2024
75d0388
Merge pull request #972 from permaweb/jfrain99/add-tests-for-cron-wor…
jfrain99 Sep 20, 2024
cb58bb4
chore(mu): removed old logs
jfrain99 Sep 20, 2024
9ed6347
Merge pull request #1018 from permaweb/jfrain99/remove-logs
jfrain99 Sep 20, 2024
10d6d63
feat(mu): combine both db metrics into one gauge
jfrain99 Sep 20, 2024
ab31154
chore: re-compile lua with generic WASM and add 32-bit support #990
PeterFarber Aug 15, 2024
52ef8ee
chore(dev-cli): fix merge conflicts
PeterFarber Sep 26, 2024
411661f
Merge pull request #983 from permaweb/peterfarber/devcli-memory-limit…
PeterFarber Sep 26, 2024
76f05f4
chore(loader): update dependencies and add wasm-metering #1016
PeterFarber Sep 24, 2024
0eaa1f1
fix(mu): delete old tasks that leak into db
jfrain99 Sep 26, 2024
dceb3b7
feat(dev-cli): added a gasused function to aolibc thats exposed to lua
PeterFarber Sep 26, 2024
3d40367
chore(loader): release 0.0.37
twilson63 Sep 26, 2024
a22e088
chore(dev-cli): bump version dev-cli image
twilson63 Sep 26, 2024
ef50eb9
Merge pull request #1022 from permaweb/twilson63/bump-ao-cli
twilson63 Sep 26, 2024
baf8b06
chore(dev-cli): bump version and update txMappings
twilson63 Sep 26, 2024
d4025e4
fix(dev-cli): removing hostArgs import as it was replaced with bundle…
PeterFarber Sep 26, 2024
4dd83e3
Merge pull request #1023 from permaweb/peterfarber/dev-cli-fixes
twilson63 Sep 26, 2024
ecf28f8
chore(dev-cli): bump version and update txMappings
twilson63 Sep 26, 2024
9269dae
feat: add initial dockerfile
bredamatt Sep 30, 2024
f2b8cc1
Merge branch 'main' of github.com:permaweb/ao into feat/fix-image-pip…
bredamatt Sep 30, 2024
1b3314e
fix: Add arch specific images due to dynamic linking
bredamatt Sep 30, 2024
9abd962
fix: Change runner image to ubuntu:22.04
bredamatt Sep 30, 2024
bc654ac
fix: Adjust path for libc deps
bredamatt Sep 30, 2024
e72dfdc
fix: Update arm64 Dockerfile paths for aarch64-linux-gnu
bredamatt Sep 30, 2024
191e043
fix: add missing / to lib paths
bredamatt Sep 30, 2024
44079cd
fix: remove target during build
bredamatt Sep 30, 2024
4ef0c74
fix: libpq5 in stead of libpq-dev
bredamatt Sep 30, 2024
f96d040
fix: specify platform in dockerfiles
bredamatt Sep 30, 2024
e48ca07
fix: correct CMD for su image
bredamatt Sep 30, 2024
78b6025
chore(cu): update ao-loader and weavedrive dependencies to newest ver…
PeterFarber Oct 1, 2024
3c6fe76
Merge pull request #1024 from permaweb/peterfarber/update-cu-oackages
twilson63 Oct 1, 2024
47ecd04
Merge pull request #1021 from permaweb/jfrain99/delete-old-tasks
jfrain99 Oct 2, 2024
e9c9673
Merge pull request #993 from permaweb/jfrain99/add-db-size-metrics
jfrain99 Oct 2, 2024
0b52cf1
chore(loader): disable metering
twilson63 Oct 3, 2024
cc4cc22
Merge pull request #1026 from permaweb/twilson63/chore-disable-metering
twilson63 Oct 3, 2024
a1116b4
chore(loader): release 0.0.38
twilson63 Oct 3, 2024
ec8c57f
fix: make sure runner image has openssl and ca-certificates and sleep…
bredamatt Oct 3, 2024
784e4ae
chore(cu): update loader to v38
twilson63 Oct 4, 2024
5e24009
Merge pull request #1027 from permaweb/twilson63/chore-update-cu-load…
twilson63 Oct 4, 2024
5d1612f
fix: add directories to cu
bredamatt Oct 9, 2024
dbb1782
fix: add prototype (unfiinished) github action
bredamatt Oct 10, 2024
222f9a8
fix: add mu Dockerfile that works in k8s
bredamatt Oct 10, 2024
9958e50
fix: add workflow
bredamatt Oct 11, 2024
d917f69
Merge branch 'main' of github.com:permaweb/ao into feat/fix-image-pip…
bredamatt Oct 11, 2024
d338769
fix: only trigger on PRs in servers/*
bredamatt Oct 11, 2024
681135b
fix: remove redundant workflow
bredamatt Oct 11, 2024
abeae97
fix: update workflow name
bredamatt Oct 11, 2024
62d2326
fix: test login once and use outputs
bredamatt Oct 11, 2024
44d7547
fix: trigger on change to workflow
bredamatt Oct 11, 2024
ccb8119
fix: trigger on all changes
bredamatt Oct 11, 2024
405f7df
Revert "fix: remove redundant workflow"
bredamatt Oct 11, 2024
0db60d2
revert: go back to working
bredamatt Oct 11, 2024
02d887c
fix: see if only account ID is necessary
bredamatt Oct 11, 2024
1787cde
chore(loader): override the WebAssembly.compileStreaming to apply the…
PeterFarber Oct 11, 2024
2400740
chore(cu): pass moduleOptions to compileStreaming so loader can deter…
PeterFarber Oct 11, 2024
76ac46d
fix(loader): check to make sure its a supported format before applyin…
PeterFarber Oct 11, 2024
86ec2dd
fix(cu): fixed typo in DEFAULT_PROCESS_WASM_MODULE_FORMATS #1034
PeterFarber Oct 11, 2024
c763232
fix(loader): changed options to importObject inside of compileStreaming
PeterFarber Oct 11, 2024
5d1f2e3
fix(loader): updated test cases to pass format
PeterFarber Oct 11, 2024
e14677f
Merge pull request #1035 from permaweb/peterfarber/wasm-metering
twilson63 Oct 11, 2024
8c40d91
chore(loader): release 0.0.39
twilson63 Oct 11, 2024
dd3a1ca
fix: delete unnecessary pipeline
bredamatt Oct 14, 2024
a8b9f74
fix: add automatic commit to charts repo to update commi
bredamatt Oct 14, 2024
35c3c6d
fix: typos in action
bredamatt Oct 14, 2024
8da05fc
fix: try with username
bredamatt Oct 14, 2024
7da2b17
fix: typo in push command
bredamatt Oct 14, 2024
7022e69
fix: make sure commit sha is extracted in update-devnet-image-tags
bredamatt Oct 14, 2024
5a2b095
Merge branch 'main' of github.com:permaweb/ao into feat/fix-image-pip…
bredamatt Oct 14, 2024
9abc184
chore(su): add back in dockerfile and fix test toolchain
VinceJuliano Oct 14, 2024
8a7a671
chore(su): remove rust tests from yml
VinceJuliano Oct 14, 2024
b30ec6c
fix(dev-cli): fixed issue with setting memory limit tag during ao-pub…
PeterFarber Oct 8, 2024
16f59af
fix(mu): add retries to iswallet to help with mistaken wallets
jfrain99 Oct 14, 2024
2a755ce
chore(cu): correct startup log for trusted checkpoint owners
TillaTheHun0 Oct 14, 2024
1097b85
fix(cu): circuit breaker should wrap each single page load, not all t…
TillaTheHun0 Oct 14, 2024
ec01fed
Merge pull request #1033 from permaweb/feat/fix-image-pipelines
bredamatt Oct 15, 2024
e208844
Merge pull request #1037 from permaweb/jfrain99/add-wallet-retries
jfrain99 Oct 15, 2024
9ed3a74
fix: action trigger on push to main
bredamatt Oct 15, 2024
8c19a17
perf(su): new database impl partially complete #987
VinceJuliano Sep 20, 2024
c3e67ec
perf(su): new database impl partially complete
VinceJuliano Sep 20, 2024
df82ae6
feat(su): rocksdb impl changes #987
VinceJuliano Sep 30, 2024
ffae9eb
perf(su): data migration working for RocksDB upgrade #987
VinceJuliano Oct 4, 2024
5949457
perf(su): fully working rocksdb impl with unit tests #987
VinceJuliano Oct 14, 2024
50f4e15
chore(su): readme change for local store #987
VinceJuliano Oct 15, 2024
4a48039
VinceJuliano/su-rocksdb-987
VinceJuliano Oct 15, 2024
4a7f406
chore(cu): bump deps
TillaTheHun0 Oct 15, 2024
4fdcbc4
feat(cu): add flag to disable/enable wasm metering and apply #1040
TillaTheHun0 Oct 15, 2024
4989613
chore(loader): introduced an argument to determine if metering is app…
PeterFarber Oct 15, 2024
996feb2
chore(loader): release 0.0.40
PeterFarber Oct 16, 2024
669333f
chore(cu): bump ao-loader and weavedrive to latest
TillaTheHun0 Oct 16, 2024
258e733
chore(cu): bump weavedrive to latest
TillaTheHun0 Oct 16, 2024
82658f4
feat(cu): remove metering flag, as this is instead controlled by modu…
TillaTheHun0 Oct 16, 2024
ac404af
chore(loader): introducing new formats for metering
PeterFarber Oct 16, 2024
81219f0
chore(loader): release 0.0.41
TillaTheHun0 Oct 16, 2024
096c507
chore(cu): bump ao-loader to latest #1040
TillaTheHun0 Oct 16, 2024
61c2b9a
Merge branch 'main' of github.com:permaweb/ao into fix/adjust-image-b…
bredamatt Oct 17, 2024
ea04986
Merge pull request #1038 from permaweb/fix/adjust-image-build-to-push…
bredamatt Oct 17, 2024
4d846f7
chore(dev-cli): bump version and update txMappings
TillaTheHun0 Oct 17, 2024
7d90d64
build(dev-cli): bump deps in module used to deploy to ArNS
TillaTheHun0 Oct 17, 2024
b5c0a77
chore(cu): bump weavedrive to latest
TillaTheHun0 Oct 17, 2024
9518d7d
fix(cu): handle edge case where no memory is produced from evaluation…
TillaTheHun0 Oct 17, 2024
a74ca3b
chore(loader): fix to support new metering formats + test cases
PeterFarber Oct 17, 2024
9a40941
chore(loader): release 0.0.42
PeterFarber Oct 18, 2024
ba4cdb8
chore(cu): bump ao-loader to latest
TillaTheHun0 Oct 18, 2024
4b625d2
fix(dev-cli): remove lua metering until solution is found for backwar…
PeterFarber Oct 18, 2024
38d717c
build(dev-cli): bump image to latest
TillaTheHun0 Oct 18, 2024
b19223c
ci(dev-cli): extend timeout of release job to 30 minutes
TillaTheHun0 Oct 18, 2024
8cc0f5f
chore(dev-cli): bump version and update txMappings
TillaTheHun0 Oct 18, 2024
6fb2985
chore(cu): bump weavedrive to latest
TillaTheHun0 Oct 18, 2024
3a57459
feat(cu): add metered module formats to default supported formats
TillaTheHun0 Oct 18, 2024
f7dd714
feat(loader): set blockHeight in handler, based on current message #1055
TillaTheHun0 Oct 23, 2024
d7fd58c
chore(loader): release 0.0.43
TillaTheHun0 Oct 28, 2024
a83cc87
chore(cu): bump deps to latest
TillaTheHun0 Oct 29, 2024
2b8aa67
feat(data-protocols): implement ANS-115 association utils #1059
TillaTheHun0 Oct 30, 2024
5194b49
ci(data-protocols): add for testing and publishing #1059
TillaTheHun0 Oct 31, 2024
187fe6c
refactor(protocol-tag-utils): rename module #1059
TillaTheHun0 Oct 31, 2024
4023693
chore(protocol-tag-utils): prepare to publish
TillaTheHun0 Oct 31, 2024
e563123
chore(protocol-tag-utils): release 0.0.1
TillaTheHun0 Oct 31, 2024
ea9c8f4
fix(connect): properly add protocol tags on message and spawn #1059
TillaTheHun0 Oct 31, 2024
aa81fda
chore(connect): release 0.0.60
TillaTheHun0 Oct 31, 2024
56f5adf
docs(protocol-tag-utils): add solution section in README #1059
TillaTheHun0 Oct 31, 2024
6c756ec
fix(protocol-tag-utils): remove protocol if all tags are removed by n…
TillaTheHun0 Oct 31, 2024
eb0edf6
chore(protocol-tag-utils): release 0.0.2
TillaTheHun0 Oct 31, 2024
04cb0d7
ci(repo): only build images if servers or CI changes
TillaTheHun0 Oct 31, 2024
5905ab5
chore(connect): bump deps
TillaTheHun0 Oct 31, 2024
cb375c7
chore(connect): release 0.0.61
TillaTheHun0 Oct 31, 2024
e56e6a5
docs(protocol-tag-utils): add install section in README
TillaTheHun0 Nov 1, 2024
677e9ee
chore(cu): bump deps
TillaTheHun0 Nov 6, 2024
0f5369c
perf(cu): pass multiple arweave urls to WeaveDrive to leverage its fa…
TillaTheHun0 Nov 6, 2024
eaf1173
chore(cu): bump weavedrive 0.0.15
jfrain99 Nov 7, 2024
3010a86
Merge pull request #1065 from permaweb/jfrain99/bump-weavedrive
jfrain99 Nov 7, 2024
76a6187
chore(cu): add grace window to chaining logic to allow for more perfo…
TillaTheHun0 Nov 15, 2024
9db9d10
chore(cu): bump weavedrive to 0.0.15
jfrain99 Nov 21, 2024
e2a563d
Merge pull request #1069 from permaweb/jfrain99/bump-cu-weavedrive
jfrain99 Nov 21, 2024
840317e
chore(scheduler-utils): eagerly check su-router for process, before l…
TillaTheHun0 Nov 22, 2024
ae0b058
chore(scheduler-utils): release 0.0.25
TillaTheHun0 Nov 22, 2024
b62558f
chore(connect): bump deps
TillaTheHun0 Nov 22, 2024
452c1cc
chore(connect): release 0.0.62
TillaTheHun0 Nov 22, 2024
9a9145c
chore(su): remove pg dependency when booting db
VinceJuliano Nov 25, 2024
cd5b991
feat(su): routing config #1070
VinceJuliano Nov 26, 2024
baa6696
feat(sur): routing by wallet #1070
VinceJuliano Nov 27, 2024
4f1cc24
build(sur): su binary for #1070
VinceJuliano Nov 27, 2024
234ad0e
feat(mu): add exponential backoff to the mu worker thread to allow lo…
jfrain99 Dec 3, 2024
354c4e5
Merge pull request #1074 from permaweb/jfrain99/add-exponential-backo…
jfrain99 Dec 3, 2024
242e1ff
fix(mu): use positiveIntSchema for config
VinceJuliano Dec 4, 2024
4f7885d
chore(cu): bump weavedrive to 0.0.16
jfrain99 Dec 4, 2024
aa05953
Merge pull request #1075 from permaweb/jfrain99/bump-weavedrive-cu
jfrain99 Dec 4, 2024
efe21d9
chore(cu): bump cu scheduler utils
jfrain99 Dec 4, 2024
6ec9e06
Merge pull request #1076 from permaweb/jfrain99/update-scheduler-utils
jfrain99 Dec 4, 2024
1d41e8f
Revert "chore(cu): bump cu scheduler utils"
jfrain99 Dec 4, 2024
b26404c
Merge pull request #1077 from permaweb/revert-1076-jfrain99/update-sc…
jfrain99 Dec 4, 2024
7da9cbe
chore(cu): bump ao scheduler utils to 0.0.25
jfrain99 Dec 4, 2024
79cca9f
chore(mu): bump ao scheduler utils to 0.0.25
jfrain99 Dec 4, 2024
25b5fd1
Merge pull request #1078 from permaweb/jfrain99/bump-cu-scheduler-utils
jfrain99 Dec 4, 2024
c9659f1
Merge pull request #1079 from permaweb/jfrain99/bump-mu-ao-scheduler-…
jfrain99 Dec 4, 2024
ef21bb7
chore(su): add more logs, remove analytics #1048
VinceJuliano Dec 11, 2024
00fdb7a
perf(su): optimize query for spawn #1082
VinceJuliano Dec 11, 2024
864767e
chore(su): reimplement app level metrics
VinceJuliano Dec 12, 2024
5c378d0
feat(loader): on drive error, send halt to CU
jfrain99 Dec 12, 2024
f861ae1
Merge pull request #1087 from permaweb/jfrain99/halt-on-drive-error
jfrain99 Dec 17, 2024
67d35a4
chore(loader): release 0.0.44
jfrain99 Dec 17, 2024
a28dea3
chore(dev-cli): bump image version
TillaTheHun0 Dec 17, 2024
98e9f13
chore(cu): bump weavedrive to 0.0.17, loader to 0.0.44/
jfrain99 Dec 18, 2024
8e7915c
Merge pull request #1089 from permaweb/jfrain99/bump-drive-loader-cu
jfrain99 Dec 18, 2024
9216bc2
chore(cu): bump weavedrive to 0.0.18
jfrain99 Dec 18, 2024
4fcd87f
Merge pull request #1092 from permaweb/jfrain99/bump-cu-weavedrive-0018
jfrain99 Dec 18, 2024
5cdd258
feat(mu): result pushing endpoint #1093
VinceJuliano Dec 20, 2024
7a11e5e
feat(mu): modify push endpoint #1093
VinceJuliano Dec 20, 2024
1d14e9b
feat(mu): modify push endpoint to go by blockheight after config #1093
VinceJuliano Dec 20, 2024
5b45302
chore(cu): bump deps
TillaTheHun0 Dec 20, 2024
0d3f519
chore(cu): remove unused config
TillaTheHun0 Dec 20, 2024
29d5d53
feat(cu): support using postgres as db #588
TillaTheHun0 Dec 20, 2024
7eab3ca
perf(cu): do not cache process data, and instead fetch once on cold s…
TillaTheHun0 Dec 23, 2024
bf69887
feat(cu): require cu mode for /result, /results, /cron, /state endpoints
TillaTheHun0 Dec 23, 2024
ac3837f
feat(cu): add config to enable/disable evaluation cache
TillaTheHun0 Dec 23, 2024
67bbbf7
fix(mu): fix pushing endpoint to use node.block
VinceJuliano Dec 30, 2024
859af1e
Merge pull request #1096 from permaweb/tillathehun0/ru-mode
TillaTheHun0 Jan 6, 2025
730fe8e
chore(loader): added _free ptr to ccall
twilson63 Jan 6, 2025
b22737b
feat(mu): add message recovery for non-pushed results
jfrain99 Jan 6, 2025
ed84031
fix(mu): adds comments and readme
jfrain99 Jan 6, 2025
1621e5d
fix(mu): only add / remove message from db on success / failure
jfrain99 Jan 8, 2025
0f5b3de
Merge pull request #1099 from permaweb/jfrain99/add-message-result-re…
jfrain99 Jan 8, 2025
fab4b9b
fix(cu): pg ru should connect via ssl
twilson63 Jan 9, 2025
284a0df
Merge pull request #1104 from permaweb/twilson63/fix-allow-encrypted-…
twilson63 Jan 9, 2025
75dc847
feat(cu): add option for multiple gql urls for loadblockmeta
jfrain99 Jan 10, 2025
42b33b1
fix(cu): select cached messages with correct seq where clause
jfrain99 Jan 7, 2025
e37e8f2
fix(cu): optimize query for postgres
jfrain99 Jan 13, 2025
0a7c374
fix(cu): add tests for new postgres queries
jfrain99 Jan 13, 2025
1fd0bff
Merge pull request #1102 from permaweb/jfrain99/cu-fix-where-seq-clause
jfrain99 Jan 14, 2025
c7ed484
Merge pull request #1106 from permaweb/jfrain99/cu-multiple-gql-urls
jfrain99 Jan 14, 2025
754167e
fix(cu): increase ao block backoff, rename graphql_urls
jfrain99 Jan 14, 2025
266e239
Merge pull request #1109 from permaweb/jfrain99/increase-ao-block-bac…
jfrain99 Jan 14, 2025
b1e846a
fix(connect): support spawn data ArrayBuffer type
burnto Jan 14, 2025
a11dbbf
Merge pull request #1110 from basejump-xyz/fix-aoconnect-spawn-data-type
twilson63 Jan 15, 2025
1921867
chore(connect): release 0.0.63
twilson63 Jan 15, 2025
a87db6a
feat(cu): implement hash chain validation on messages received from S…
TillaTheHun0 Jan 16, 2025
c8979d6
feat(cu): save, and pass around hashchain/assignment id between eval …
TillaTheHun0 Jan 17, 2025
3c6a3bd
chore(cu): bump deps
TillaTheHun0 Jan 17, 2025
6ed6695
feat(cu): perform hash chain validation on scheduled messages #1112
TillaTheHun0 Jan 17, 2025
d951aeb
chore(cu): enable hash chain validation #1112
TillaTheHun0 Jan 17, 2025
2a663ca
Merge pull request #1100 from permaweb/twilson63/free-ptr-from-ccall-…
twilson63 Jan 18, 2025
d3562c5
chore(loader): release 0.0.45
twilson63 Jan 18, 2025
5a9b31a
feat(ur): enable config to route From-Module
twilson63 Jan 18, 2025
53f7f68
feat(su): deep hash checking for ongoing messages per process
VinceJuliano Jan 17, 2025
ea0fd72
fix(su): fix accidental signature type mod from deep hash commit
VinceJuliano Jan 17, 2025
003661c
feat(su): deduplicate deep hash fixes, and message retrieval fixes
VinceJuliano Jan 18, 2025
10bc366
build(su): new su binary #1111
VinceJuliano Jan 18, 2025
003e975
fixed root_dir
RyanKung Jan 18, 2025
33d2d3e
build(su): new su binary
VinceJuliano Jan 18, 2025
7fb2e99
perf(cu): calculate hash chains on a thread pool to prevent blocking …
TillaTheHun0 Jan 18, 2025
43b701f
refactor(cu): eval step uses pipeline and async generator transform
TillaTheHun0 Jan 20, 2025
a001fd0
fix(cu): prevent streams from stalling out by hacking stream destroy …
TillaTheHun0 Jan 20, 2025
be93939
Merge pull request #1120 from permaweb/twilson63/feat-ur-route-from-m…
twilson63 Jan 20, 2025
a9a717c
chore(cu): improve checkpoint logging. simulateError flag in su for q…
TillaTheHun0 Jan 20, 2025
601d6aa
Merge pull request #1114 from permaweb/tillathehun0/cu-hashchain-vali…
TillaTheHun0 Jan 20, 2025
d9b8144
fix(su): revert to pre dedupe
VinceJuliano Jan 21, 2025
247e2f1
Revert "fix(su): revert to pre dedupe"
VinceJuliano Jan 21, 2025
f06ed81
fix(su): fix process returning incorrectly
VinceJuliano Jan 21, 2025
8200a5d
feat(cu): add event vacuum to eval to siphon well-formatted event log…
Sep 13, 2024
5f3b4ab
feat(cu): add a Honeycomb event log transport that dedups events by n…
Sep 15, 2024
a20be68
refactor(cu): move tarnsports into their own file PE-6706
Sep 15, 2024
ea8c525
feat(cu): make event vacuuming opt in via env var PE-6706
Sep 16, 2024
7d33393
feat(cu): memoize largest nonces PE-6706
Sep 16, 2024
346513c
feat(cu): use winston logger in transport classes PE-6706
Sep 16, 2024
673e040
feat(cu): memoize frequently used prepared sqlite statement PE-6706
Sep 17, 2024
a676fb0
chore(cu): logs cleanup PE-6706
Sep 17, 2024
04207bb
chore(cu): use destructured object constructor for HoneycombTransport…
Sep 17, 2024
bfa168e
feat(cu): normalize timestamps to ISO strings PE-6706
Sep 18, 2024
d763910
feat(cu): add a kinesis transport PE-6818
Sep 30, 2024
115cc76
feat(cu): set largest nonces correctly PE-6818
Oct 1, 2024
1a3b873
feat(cu): load largest nonces correctly PE-6818
Nov 20, 2024
1230ea1
feat(cu): catch and retry 1x for kinesis signing errs that happen on …
Jan 24, 2025
7451318
chore(cu): restart script ensuring full collection of ar.io network p…
Jan 24, 2025
efec6c5
chore(cu): add block retrieval script PE-6818
Jan 24, 2025
911b561
chore(cu): update lockfile PE-6818
Jan 24, 2025
ba73ae2
chore(cu): update restart server process ids
Feb 24, 2025
b2bdca6
Merge branch 'main' into PE-6818_kinesis_rebase
Feb 24, 2025
cfde1ed
Merge branch 'main' into PE-6818_kinesis_rebase
arielmelendez Feb 24, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/dev-cli.yml
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ jobs:
# Releases are performed via a workflow dispatch
if: github.event_name == 'workflow_dispatch'
runs-on: ubuntu-latest
timeout-minutes: 5
timeout-minutes: 30
concurrency:
group: release
steps:
Expand Down
138 changes: 138 additions & 0 deletions .github/workflows/devnet-ecr-push.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,138 @@
name: 🏗️ Build and Push Docker images to devnet ECR

on:
push:
branches:
- 'main'
paths:
- "servers/**"
- ".github/workflows/devnet-ecr-push.yml"

jobs:
build-and-push-cu:
runs-on: ubuntu-latest
env:
REPOSITORY: devnet-ecr
steps:
- name: Checkout code
uses: actions/checkout@v2

- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v1

- name: Extract shortened commit hash
id: vars
run: echo "COMMIT_HASH=$(echo $GITHUB_SHA | cut -c1-7)" >> $GITHUB_ENV

- name: Log in to Amazon ECR
id: login-devnet-ecr
uses: aws-actions/amazon-ecr-login@v1
with:
mask-password: true
skip-logout: true
registry-type: private
registries: ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}
env:
AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_AO_DEVNET }}
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY_AO_DEVNET }}
AWS_REGION: ${{ secrets.AWS_REGION_AO_DEVNET }}

- name: Build and push CU Docker image
run: |
docker build -t ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}.dkr.ecr.${{ secrets.AWS_REGION_AO_DEVNET }}.amazonaws.com/$REPOSITORY:ao-cu-$COMMIT_HASH -f servers/cu/Dockerfile servers/cu/
docker push ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}.dkr.ecr.${{ secrets.AWS_REGION_AO_DEVNET }}.amazonaws.com/$REPOSITORY:ao-cu-$COMMIT_HASH

build-and-push-mu:
env:
REPOSITORY: devnet-ecr
runs-on: ubuntu-latest
steps:
- name: Checkout code
uses: actions/checkout@v2

- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v1

- name: Extract shortened commit hash
id: vars
run: echo "COMMIT_HASH=$(echo $GITHUB_SHA | cut -c1-7)" >> $GITHUB_ENV

- name: Log in to Amazon ECR
id: login-devnet-ecr
uses: aws-actions/amazon-ecr-login@v1
with:
mask-password: true
skip-logout: true
registry-type: private
registries: ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}
env:
AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_AO_DEVNET }}
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY_AO_DEVNET }}
AWS_REGION: ${{ secrets.AWS_REGION_AO_DEVNET }}

- name: Build and push MU Docker image
run: |
docker build -t ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}.dkr.ecr.${{ secrets.AWS_REGION_AO_DEVNET }}.amazonaws.com/$REPOSITORY:ao-mu-$COMMIT_HASH -f servers/mu/Dockerfile servers/mu/
docker push ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}.dkr.ecr.${{ secrets.AWS_REGION_AO_DEVNET }}.amazonaws.com/$REPOSITORY:ao-mu-$COMMIT_HASH

build-and-push-su:
env:
REPOSITORY: devnet-ecr
runs-on: ubuntu-latest
steps:
- name: Checkout code
uses: actions/checkout@v2

- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v1

- name: Extract shortened commit hash
id: vars
run: echo "COMMIT_HASH=$(echo $GITHUB_SHA | cut -c1-7)" >> $GITHUB_ENV

- name: Log in to Amazon ECR
id: login-devnet-ecr
uses: aws-actions/amazon-ecr-login@v1
with:
mask-password: true
skip-logout: true
registry-type: private
registries: ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}
env:
AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_AO_DEVNET }}
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY_AO_DEVNET }}
AWS_REGION: ${{ secrets.AWS_REGION_AO_DEVNET }}

- name: Build and push SU Docker image
run: |
docker build -t ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}.dkr.ecr.${{ secrets.AWS_REGION_AO_DEVNET }}.amazonaws.com/$REPOSITORY:ao-su-$COMMIT_HASH -f servers/su/Dockerfile.x86 servers/su/
docker push ${{ secrets.AWS_ACCOUNT_ID_AO_DEVNET }}.dkr.ecr.${{ secrets.AWS_REGION_AO_DEVNET }}.amazonaws.com/$REPOSITORY:ao-su-$COMMIT_HASH

update-devnet-image-tags:
runs-on: ubuntu-latest
needs:
- build-and-push-cu
- build-and-push-mu
- build-and-push-su

steps:
- name: Checkout Helmfile Repository
run: |
git clone https://$GITHUB_USERNAME:${{ secrets.AO_TO_CHARTS_PAT }}@github.com/permaweb/charts.git
env:
GITHUB_USERNAME: bredamatt

- name: Extract shortened commit hash
id: vars
run: echo "COMMIT_HASH=$(echo $GITHUB_SHA | cut -c1-7)" >> $GITHUB_ENV

- name: Update commit-sha.yaml
env:
TRUNCATED_SHA: ${{ env.COMMIT_HASH }}
run: |
cd charts
sed -i "s/commitSHA: \".*\"/commitSHA: \"${TRUNCATED_SHA}\"/" helmfile/devnet/commit-sha.yaml
git config user.name "github-actions[bot]"
git config user.email "github-actions[bot]@users.noreply.github.com"
git commit -am "fix: from ao-repo - update commit-sha to ${TRUNCATED_SHA} for syncing latest image tags"
git push https://${{ secrets.AO_TO_CHARTS_PAT }}@github.com/permaweb/charts.git main
108 changes: 108 additions & 0 deletions .github/workflows/protocol-tag-utils.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,108 @@
name: 🔖🛠 Test & Deploy Protocol Tag Utils

on:
pull_request:
branches:
- main
paths:
- "protocol-tag-utils/**"
push:
branches:
- main
paths:
- "protocol-tag-utils/**"

# Perform a release using a workflow dispatch
workflow_dispatch:
inputs:
version:
description: "semver version to bump to"
required: true

defaults:
run:
shell: bash

jobs:

test:
if: github.event_name != 'workflow_dispatch'
runs-on: ubuntu-latest
steps:
- name: ⬇️ Checkout repo
uses: actions/checkout@v4

- name: ⎔ Setup node
uses: actions/setup-node@v4
with:
node-version: 20

- name: 📥 Download deps
working-directory: protocol-tag-utils
run: |
npm i

- name: ⚡ Run Tests
working-directory: protocol-tag-utils
run: |
npm test
env:
CI: true

release:
# Releases are performed via a workflow dispatch
if: github.event_name == 'workflow_dispatch'
runs-on: ubuntu-latest
concurrency:
group: release
steps:
- name: ⬇️ Checkout repo
uses: actions/checkout@v4
with:
fetch-depth: 0
ref: main

- name: ⎔ Setup node
uses: actions/setup-node@v4
with:
node-version: 20
registry-url: "https://registry.npmjs.org"

- name: 👀 Env
run: |
echo "Event name: ${{ github.event_name }}"
echo "Git ref: ${{ github.ref }}"
echo "GH actor: ${{ github.actor }}"
echo "SHA: ${{ github.sha }}"
VER=`node --version`; echo "Node ver: $VER"
VER=`npm --version`; echo "npm ver: $VER"

- name: 🤓 Set Git User
run: |
git config --global user.name "${{ github.actor }}"
git config --global user.email "${{ github.actor }}@users.noreply.github.com"

- name: ✊ Bump
id: bump
uses: hyper63/[email protected]
with:
bump-to: ${{ github.event.inputs.version }}
package: protocol-tag-utils

- name: ⬆️ Push
run: |
git push
git push --tags

- name: 📥 Download deps
working-directory: protocol-tag-utils
run: |
npm i

- name: 🦠 Publish to NPM
working-directory: protocol-tag-utils
run: |
npm run build
npm publish --access=public
env:
NODE_AUTH_TOKEN: ${{ secrets.NPM_TOKEN }}
24 changes: 12 additions & 12 deletions .github/workflows/su.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,20 +18,20 @@ defaults:

jobs:

test:
runs-on: ubuntu-latest
steps:
- name: ⬇️ Checkout repo
uses: actions/checkout@v4
# test:
# runs-on: ubuntu-latest
# steps:
# - name: ⬇️ Checkout repo
# uses: actions/checkout@v4

- name: ⎔ Setup Rust
uses: actions-rs/toolchain@v1
with:
toolchain: stable
# - name: ⎔ Setup Rust
# uses: actions-rs/toolchain@v1
# with:
# toolchain: 1.75.0

- name: Run Tests
working-directory: servers/su
run: cargo test
# - name: Run Tests
# working-directory: servers/su
# run: cargo test


publish:
Expand Down
18 changes: 18 additions & 0 deletions connect/CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,24 @@

All notable changes to this project will be documented in this file. See [commit-and-tag-version](https://github.com/absolute-version/commit-and-tag-version) for commit guidelines.

## [0.0.63](https://github.com/permaweb/ao/compare/[email protected]@v0.0.63) (2025-01-15)


### Bug Fixes

* **connect:** support spawn data ArrayBuffer type ([b1e846a](https://github.com/permaweb/ao/commit/b1e846afa5f3071aef3971940c9e3c9472df7fbc))

## [0.0.62](https://github.com/permaweb/ao/compare/[email protected]@v0.0.62) (2024-11-22)

## [0.0.61](https://github.com/permaweb/ao/compare/[email protected]@v0.0.61) (2024-10-31)

## [0.0.60](https://github.com/permaweb/ao/compare/[email protected]@v0.0.60) (2024-10-31)


### Bug Fixes

* **connect:** properly add protocol tags on message and spawn [#1059](https://github.com/permaweb/ao/issues/1059) ([ea9c8f4](https://github.com/permaweb/ao/commit/ea9c8f4cbe457f104c47fb9ad7a4cc0501721fb8))

## [0.0.59](https://github.com/permaweb/ao/compare/[email protected]@v0.0.59) (2024-08-19)


Expand Down
Loading
Loading