Skip to content

[wip](E2E)Update Doris E2E Test Container to Use Latest Version #575

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 10 commits into
base: master
Choose a base branch
from

Conversation

vinlee19
Copy link
Contributor

@vinlee19 vinlee19 commented Mar 13, 2025

Proposed changes

This PR includes several enhancements:

Docker Image Update

  • Updated Doris Docker image to yagagaga/doris-standalone:2.1.7. The Docker image yagagagaga/doris-standalone:2.1.7 is maintained by @yagagagaga, who is an active contributor to the Apache Doris community.

Workflow Optimizations

  1. Implemented Maven repository caching to accelerate test execution
  2. Added conditional workflow triggering to prevent duplicate runs:
    github.event_name == 'pull_request' && github.event.pull_request.head.repo.full_name == github.repository
  3. Enhanced Doris container initialization with service detection for both Frontend and Backend, ensuring complete startup before tests begin
  4. Updated GitHub Actions components to latest versions for improved stability and features

Problem Summary:

Describe the overview of changes.

Checklist(Required)

  1. Does it affect the original behavior: (Yes/No/I Don't know)
  2. Has unit tests been added: (Yes/No/No Need)
  3. Has document been added or modified: (Yes/No/No Need)
  4. Does it need to update dependencies: (Yes/No)
  5. Are there any changes that cannot be rolled back: (Yes/No)

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@vinlee19 vinlee19 changed the title Update e2e doris version [E2E]Update Doris E2E Test Container to Use Latest Version Mar 13, 2025
@vinlee19 vinlee19 force-pushed the update_e2e_doris_version branch 3 times, most recently from 809b36c to e028aff Compare March 17, 2025 05:08
Comment on lines 65 to 67
tEnv.getConfig()
.getConfiguration()
.setString("table.local-time-zone", ZoneId.systemDefault().getId());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't we need to add other reads itcase?

Comment on lines +88 to +90
"sh",
"-c",
"chmod -R 644 /root/be/conf/be.conf /root/fe/conf/fe.conf && chmod -R 755 /root/be/conf /root/fe/conf && chown -R root:root /root/be/conf /root/fe/conf")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does this action mainly do?

@@ -19,13 +19,13 @@ CUR_DATE=`date +%Y%m%d-%H%M%S`

PPROF_TMPDIR="$DORIS_HOME/log/"

JAVA_OPTS="-Xmx1024m -DlogPath=$DORIS_HOME/log/jni.log -Xloggc:$DORIS_HOME/log/be.gc.log.$CUR_DATE -Djavax.security.auth.useSubjectCredsOnly=false -Dsun.security.krb5.debug=true -Dsun.java.command=DorisBE -XX:-CriticalJNINatives"
JAVA_OPTS="-Xmx2048m -DlogPath=$DORIS_HOME/log/jni.log -Xloggc:$DORIS_HOME/log/be.gc.log.$CUR_DATE -Djavax.security.auth.useSubjectCredsOnly=false -Dsun.security.krb5.debug=true -Dsun.java.command=DorisBE -XX:-CriticalJNINatives"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this container need more memory?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2048m is default configuration for Apache Doris 2.1.x

Comment on lines 190 to 215
private void waitForContainerRunning() {
LOG.info("Waiting for Doris services to be accessible...");

try {
Awaitility.await("FE HTTP Service")
.atMost(5, TimeUnit.MINUTES)
.pollInterval(1, TimeUnit.SECONDS)
.until(
() -> {
try {
ExecResult result =
dorisContainer.execInContainer(
"curl",
"-s",
"-o",
"/dev/null",
"-w",
"%{http_code}",
"-m",
"2",
"http://localhost:" + FE.HTTP_PORT);
boolean ready = result.getStdout().equals("200");
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can directly use the verification method in DorisContaier.startContainer

fix timezone

format code

modify workflow images

modify fe.conf to avoid oom

modify flight port

modify workflow

modify workflow

modify workflow

modify workflow

modify workflow

modify workflow

update workflow
@vinlee19 vinlee19 force-pushed the update_e2e_doris_version branch from e028aff to fc3b4e1 Compare March 19, 2025 08:30
@vinlee19 vinlee19 force-pushed the update_e2e_doris_version branch from 37a3514 to 0337399 Compare March 19, 2025 13:22
@vinlee19 vinlee19 changed the title [E2E]Update Doris E2E Test Container to Use Latest Version [wip](E2E)Update Doris E2E Test Container to Use Latest Version Mar 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants