Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qryn -> gigapipe #622

Open
wants to merge 45 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
f4e00aa
v4.0.0-beta init
akvlad Mar 5, 2025
8319002
Update build_release.yml
lmangani Mar 5, 2025
d92dcda
Update build_release.yml
lmangani Mar 5, 2025
b93ed49
configurable pyroscope client for gigapipe; fix cpu usage
akvlad Mar 7, 2025
8814aa9
Update build_release.yml
lmangani Mar 7, 2025
99824e7
Update build_release.yml
lmangani Mar 7, 2025
522d6ea
Update README.md
lmangani Mar 9, 2025
bae768d
Update README.md
lmangani Mar 9, 2025
58e87fb
Update codeql-analysis.yml
lmangani Mar 9, 2025
fd15d41
Potential fix for code scanning alert no. 145: Incorrect conversion b…
akvlad Mar 11, 2025
f7513a0
Potential fix for code scanning alert no. 142: Reflected cross-site s…
akvlad Mar 11, 2025
fe2970b
possible fixes for codeQL
akvlad Mar 11, 2025
79293df
Potential fix for code scanning alert no. 148: Incorrect conversion b…
akvlad Mar 11, 2025
153e7eb
possible fixes for codeQL
akvlad Mar 11, 2025
355fe8e
possible fixes for codeQL
akvlad Mar 11, 2025
e89b334
possible fixes for codeQL
akvlad Mar 11, 2025
c58314a
possible fixes for codeQL
akvlad Mar 11, 2025
0b1d6b1
Update README.md
lmangani Mar 11, 2025
7306133
Update FUNDING.yml
lmangani Mar 11, 2025
f94ec67
json-iterator
afzal-qxip Mar 12, 2025
758bd0c
Delete json file
afzal-qxip Mar 12, 2025
ea52d66
Resolved merge conflicts
afzal-qxip Mar 12, 2025
7c5d28b
json-iterator
afzal-qxip Mar 12, 2025
2444917
json-iterator
afzal-qxip Mar 12, 2025
e97d516
resolved PR comments
afzal-qxip Mar 13, 2025
d88b8d5
PR comments resolved
afzal-qxip Mar 13, 2025
c49efde
resolved PR comments
afzal-qxip Mar 13, 2025
7ef1b37
PR comments resolved
afzal-qxip Mar 13, 2025
319ca18
json-iterator
afzal-qxip Mar 13, 2025
daca535
json-iterator
afzal-qxip Mar 13, 2025
443b239
Create Dockerfile
lmangani Mar 14, 2025
48a0a66
Update build_release.yml
lmangani Mar 14, 2025
6cadaeb
Merge pull request #624 from afzal-qxip/json-iterator
akvlad Mar 17, 2025
456a095
debug e2e tests
akvlad Mar 17, 2025
21245e4
improve the test workflow
akvlad Mar 17, 2025
fd8d1e6
Merge pull request #626 from metrico/chore/json-iterator-building
akvlad Mar 17, 2025
6d72a6c
Update actions/upload-artifact
lmangani Mar 17, 2025
0443b02
Update node-clickhouse-cluster.js.yml
lmangani Mar 17, 2025
b48e295
fix
akvlad Mar 19, 2025
cb64c57
Update k6_test.yml
lmangani Mar 19, 2025
b567d58
silly commit
akvlad Mar 19, 2025
0149939
Merge branch 'gigapipe' into fix/627-double-dist-join
lmangani Mar 19, 2025
f9ca630
Merge pull request #628 from metrico/fix/627-double-dist-join
akvlad Mar 20, 2025
444fb34
gzip compression fix
akvlad Mar 21, 2025
f1203f2
Merge pull request #629 from metrico/fix/otel-collector-encoding
akvlad Mar 21, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
20 changes: 0 additions & 20 deletions .eslintrc.json

This file was deleted.

4 changes: 2 additions & 2 deletions .github/FUNDING.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# These are supported funding model platforms

custom: ['https://qryn.cloud']
github: [qxip]
custom: ['https://gigapipe.com']
github: [qxip, gigapipehq]
3 changes: 1 addition & 2 deletions .github/actions/get-view/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,6 @@ runs:
using: "composite"
steps:
- run: |
pwd && mkdir -p view && cd view && \
wget https://github.com/metrico/qryn-view/releases/download/$TAG/dist.zip && \
unzip -o dist.zip && rm dist.zip
unzip -d view/dist -o dist.zip && rm dist.zip
shell: bash
201 changes: 29 additions & 172 deletions .github/workflows/build_release.yml
Original file line number Diff line number Diff line change
@@ -1,201 +1,58 @@
name: 'CI+CD'
name: 'CI+CD Gigapipe'

on:
release:
types: [published]
workflow_dispatch:
inputs:
TAG_NAME:
description: 'Release Version Tag (0.0.0)'
ref_name:
description: Release Version
required: true
branch:
description: Release Branch
type: string
default: 'main'
required: true
release:
required: true
type: boolean
release:
types: [created]

jobs:
build:
name: 'Build & Publish'
runs-on: ubuntu-latest
steps:
- uses: actions/[email protected]
with:
ref: ${{ github.ref }}
- name: Update Package to Release version
uses: technote-space/[email protected]
- name: Check NPM secret presence
id: checksecrets
shell: bash
run: |
if [ "$SECRET" == "" ]; then
echo "secretspresent=false" >> $GITHUB_OUTPUT
else
echo "secretspresent=true" >> $GITHUB_OUTPUT
fi
env:
SECRET: ${{ secrets.NPM_TOKEN }}
- uses: actions/[email protected]
if: ${{ steps.checksecrets.outputs.secretspresent }}
with:
node-version: 18
- name: build qryn-view
uses: ./.github/actions/get-view
env:
TAG: v3.3.2
- name: Publish to NPM
if: ${{ steps.checksecrets.outputs.secretspresent }}
continue-on-error: true
run: |
npm config set //registry.npmjs.org/:_authToken ${NPM_TOKEN}
npm install
npm publish --access public
env:
NPM_TOKEN: ${{ secrets.NPM_TOKEN }}

node:
name: 'Build & Publish Node'
runs-on: ubuntu-latest
needs: build
strategy:
matrix:
os: [ubuntu-latest]
runs-on: ${{ matrix.os }}
name: 'Build & Publish'
steps:
- uses: actions/[email protected]
with:
ref: ${{ github.ref }}
- name: Update Package to Release version
uses: technote-space/[email protected]
- name: Check Docker secret presence
id: checkdocker
shell: bash
run: |
if [ "$SECRET" == "" ]; then
echo "secretspresent=false" >> $GITHUB_OUTPUT
else
echo "secretspresent=true" >> $GITHUB_OUTPUT
fi
env:
SECRET: ${{ secrets.DOCKERHUB_TOKEN }}
ref: ${{ (github.event_name == 'workflow_dispatch') && github.event.inputs.branch || github.ref }}
- name: build qryn-view
uses: ./.github/actions/get-view
env:
TAG: v3.3.2
- name: Set up Docker QEMU
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/[email protected]
with:
platforms: amd64, arm64
- name: Set up Docker Buildx
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/[email protected]

- name: Login to DockerHub
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/[email protected]
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}
- name: Build and push to Docker Hub
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/build-push-action@v6
with:
context: "."
platforms: linux/amd64, linux/arm64
push: true
tags: |
qxip/qryn:latest
qxip/qryn:${{ github.event.inputs.TAG_NAME || github.event.release.tag_name }}
qxip/cloki:latest
qxip/cloki:${{ github.event.inputs.TAG_NAME || github.event.release.tag_name }}
labels: |
dev.qryn.image.title=qryn
dev.qryn.image.type=nodejs
dev.qryn.image.version={{github.event.inputs.TAG_NAME || github.event.release.tag_name }}
- run: bash -c 'pwd && ls view/dist'
- name: Log in to the GHCR registry
uses: docker/[email protected]
with:
registry: ghcr.io
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3

- name: Build and push to GHCR
uses: docker/build-push-action@v6
with:
platforms: linux/amd64, linux/arm64
context: "."
build-args: |
VIEW=1
file: ./Dockerfile
push: true
platforms: linux/amd64,linux/arm64,linux/arm/v7
tags: |
ghcr.io/metrico/qryn:latest
ghcr.io/metrico/qryn:${{ github.event.inputs.TAG_NAME || github.event.release.tag_name }}
labels: |
dev.qryn.image.title=qryn
dev.qryn.image.type=nodejs
dev.qryn.image.version={{github.event.inputs.TAG_NAME || github.event.release.tag_name }}

bun:
name: 'Build & Publish Bun'
runs-on: ubuntu-latest
needs: build
steps:
- uses: actions/[email protected]
with:
ref: ${{ github.ref }}
- name: Update Package to Release version
uses: technote-space/[email protected]
- name: Check Docker secret presence
id: checkdocker
shell: bash
run: |
if [ "$SECRET" == "" ]; then
echo "secretspresent=false" >> $GITHUB_OUTPUT
else
echo "secretspresent=true" >> $GITHUB_OUTPUT
fi
env:
SECRET: ${{ secrets.DOCKERHUB_TOKEN }}
- name: build qryn-view
uses: ./.github/actions/get-view
env:
TAG: v3.3.2
- name: Set up Docker QEMU
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/[email protected]
with:
platforms: amd64, arm64
- name: Set up Docker Buildx
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/[email protected]
- name: Login to DockerHub
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/[email protected]
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}
- name: Build and push to Docker Hub (bun)
if: ${{ steps.checkdocker.outputs.secretspresent }}
uses: docker/build-push-action@v6
with:
context: "."
platforms: linux/amd64, linux/arm64
file: ./Dockerfile_bun
push: true
tags: |
qxip/qryn:bun
qxip/qryn:${{ github.event.inputs.TAG_NAME || github.event.release.tag_name }}-bun
labels: |
dev.qryn.image.title=qryn
dev.qryn.image.type=bun
dev.qryn.image.version={{github.event.inputs.TAG_NAME || github.event.release.tag_name }}
- name: Log in to the GHCR registry
uses: docker/[email protected]
with:
registry: ghcr.io
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Build and push to GHCR (bun)
uses: docker/build-push-action@v6
with:
context: "."
platforms: linux/amd64, linux/arm64
file: ./Dockerfile_bun
push: true
tags: |
ghcr.io/metrico/qryn:bun
ghcr.io/metrico/qryn:${{ github.event.inputs.TAG_NAME || github.event.release.tag_name }}-bun
ghcr.io/metrico/gigapipe:latest
ghcr.io/metrico/gigapipe:${{ (github.event_name == 'workflow_dispatch') && github.event.inputs.ref_name || github.ref_name }}
labels: |
dev.qryn.image.title=qryn
dev.qryn.image.type=bun
dev.qryn.image.version={{github.event.inputs.TAG_NAME || github.event.release.tag_name }}
dev.qryn.image.title=gigapipe
44 changes: 0 additions & 44 deletions .github/workflows/bun-clickhouse.js.yml

This file was deleted.

11 changes: 6 additions & 5 deletions .github/workflows/codeql-analysis.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
# TODO: Check if it works for new version
# For most projects, this workflow file will not need changing; you simply need
# to commit it to your repository.
#
Expand Down Expand Up @@ -36,18 +37,18 @@ jobs:
strategy:
fail-fast: false
matrix:
language: [ 'javascript' ]
language: [ 'go', 'javascript' ]
# CodeQL supports [ 'cpp', 'csharp', 'go', 'java', 'javascript', 'python' ]
# Learn more:
# https://docs.github.com/en/free-pro-team@latest/github/finding-security-vulnerabilities-and-errors-in-your-code/configuring-code-scanning#changing-the-languages-that-are-analyzed

steps:
- name: Checkout repository
uses: actions/checkout@v2
uses: actions/checkout@v4

# Initializes the CodeQL tools for scanning.
- name: Initialize CodeQL
uses: github/codeql-action/init@v2
uses: github/codeql-action/init@v3
with:
languages: ${{ matrix.language }}
# If you wish to specify custom queries, you can do so here or in a config file.
Expand All @@ -58,7 +59,7 @@ jobs:
# Autobuild attempts to build any compiled languages (C/C++, C#, or Java).
# If this step fails, then you should remove it and run the build manually (see below)
- name: Autobuild
uses: github/codeql-action/autobuild@v2
uses: github/codeql-action/autobuild@v3

# ℹ️ Command-line programs to run using the OS shell.
# 📚 https://git.io/JvXDl
Expand All @@ -72,4 +73,4 @@ jobs:
# make release

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v2
uses: github/codeql-action/analyze@v3
3 changes: 2 additions & 1 deletion .github/workflows/k6_test.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
# TODO! Change the way qryn runs
name: K6 Test qxip/qryn
on:
push:
Expand Down Expand Up @@ -117,7 +118,7 @@ jobs:
run: |
sed -i 's/[^[:print:]]/*/' *_summary.txt
sed -i 's/[\d128-\d255]//g' *_summary.txt
- uses: actions/upload-artifact@v3
- uses: actions/upload-artifact@v4.6.2
with:
name: results
path: |
Expand Down
Loading
Loading