[DT-2541] Support Elasticsearch 5 and OpenSearch 3 simultaneously

[fboulnois]

Addresses

https://broadworkbench.atlassian.net/browse/DT-2541

Summary

This replaces the PR in #2755 . This allows OpenSearch 3 and Elasticsearch 5 to be supported simultaneously. I duplicated the Elasticsearch resources and then cleaned up the code . The following section is required in the docker-compose.yml:

  opensearch:
    image: opensearchproject/opensearch:3
    ports:
      - "9201:9200"
    container_name: opensearch
    volumes:
      - ./osdata:/usr/share/opensearch/data
    environment:
      - DISABLE_SECURITY_PLUGIN=true
      - discovery.type=single-node
      - cluster.routing.allocation.disk.threshold_enabled=false

---

Have you read CONTRIBUTING.md lately? If not, do that first.

• Label PR with a Jira ticket number and include a link to the ticket
• Label PR with a security risk modifier [no, low, medium, high]
• PR describes scope of changes
• Get a minimum of one thumbs worth of review, preferably two if enough team members are available
• Get PO sign-off for all non-trivial UI or workflow changes
• Verify all tests go green
• Test this change deployed correctly and works on dev environment after deployment

[fboulnois]

We use openSearch for the V2 endpoint.

[fboulnois]

Quality Gate passed

Issues 19 New issues

These are mainly preexisting issues.

[kevinmarete]

Looks good, a few nit comments!

[sonarqubecloud]

Quality Gate passed

Issues
18 New issues
0 Accepted issues

Measures
0 Security Hotspots
78.1% Coverage on New Code
26.0% Duplication on New Code

See analysis details on SonarQube Cloud

[eweitz]

Looks good!

Any work implied by my comments strikes me as reasonable to consider ticketing for later. Looking forward to more performant Data Library filtering.

[rushtong]

We'll need a corresponding helmfile config update to support this: https://github.com/broadinstitute/terra-helmfile/blob/master/charts/consent/templates/_consent.yaml.tpl

[rushtong]

If we are staging the OpenSearch rollout over time and we don't have values for production, this will likely cause the app to fail on startup.