v2.31 (#789)

* Rename blocks table

* Break everything

* Turn reorg checkpoints into general checkpoints

* Load relevant reorg checkpoints on restart

* Move a lot of logic to the Batch module

* Make tests compile

* Merge branch 'main' of github.com:enviodev/hyperindex into dz/track-blocks

* Rename last block scanned hashes to reorg detection module

* Fix next progress block number calculation

* Turn batch module into a single array

* Include reorg checkpoints to the batch

* Fix a few e2e tests

* Restore commited checkpoint id from the db

* Store checkpoint in the db

* Return back old prunning logic for checkpoints

* Make rollback logic work again

* Fix tests

* Fix tests

* Fix erc20 tests

* Fix coderabbit comments

* Find reorg depth concurrently

* Track safe checkpoint and optimize pruning

* Correctly rollback chains progress

* Correctly rollback checkpoints from db

* Pass checkpointId to every entity identifier

* Fix items iteration

* Move event identifier to internal

* Finish rollback on reorg rewrite

* Final touches and test fixes

* Merge main

* Multiple reorg&rollback fixes, tests and improvements

* Fix review comments and fuel tests

* Fix #786

* Fix [BigInt!]! precision loss in Hasura

* Fix #749

* Try to add hasura service for tests pipeline

* Add Effect cache load prom metrics

* Remove processing prom metrics and add envio_progress_batches_count

* Validate effect cache when loading it from db

* Improve batch processing log

* Sync chains

* Fix chains order

Author: DZakh

.cursor/rules/navigation.mdc

@@ -4,6 +4,13 @@ globs: ""
 alwaysApply: true
 ---
 
+# Always
+
+- Sacrifice grammar for the sake of concision
+- List any unresolved questions at the end, if any
+
+## Navigation
+
 - The Rust CLI lives in `codegenerator/cli`.
   - Entry point: `codegenerator/cli/src/lib.rs`.
   - Command dispatcher: `codegenerator/cli/src/commands.rs`.

.github/workflows/build_and_test.yml

@@ -37,6 +37,20 @@ jobs:
           # Maps tcp port 5432 on service container to the host port of 5433 which envio will use.
           - 5433:5432
 
+      hasura:
+        image: hasura/graphql-engine:v2.43.0
+        env:
+          HASURA_GRAPHQL_DATABASE_URL: postgres://postgres:testing@postgres:5432/envio-dev
+          HASURA_GRAPHQL_ENABLE_CONSOLE: "true"
+          HASURA_GRAPHQL_ENABLED_LOG_TYPES: startup, http-log, webhook-log, websocket-log, query-log
+          HASURA_GRAPHQL_NO_OF_RETRIES: 10
+          HASURA_GRAPHQL_ADMIN_SECRET: testing
+          HASURA_GRAPHQL_STRINGIFY_NUMERIC_TYPES: "true"
+          HASURA_GRAPHQL_UNAUTHORIZED_ROLE: public
+          PORT: 8080
+        ports:
+          - 8080:8080
+
     steps:
       - uses: actions/checkout@v4
       - uses: dorny/paths-filter@v3
@@ -122,6 +136,15 @@ jobs:
           pnpm hardhat compile --verbose
           pnpm res:build
 
+      - name: Wait for Hasura
+        if: steps.changes.outputs.testChanges == 'true'
+        shell: bash
+        run: |
+          for i in {1..60}; do
+            if curl -sSf http://localhost:8080/healthz >/dev/null; then
+              echo "Hasura is up"; exit 0; fi; sleep 1; done
+          echo "Hasura did not become ready in time"; exit 1
+
       - name: test_codegen test
         if: steps.changes.outputs.testChanges == 'true'
         working-directory: scenarios/test_codegen