Skip to content

CHANGELOG.md

Latest commit

 

History

History
1466 lines (1332 loc) · 83 KB

CHANGELOG.md

File metadata and controls

1466 lines (1332 loc) · 83 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

[Unreleased]

Added

  • zookeeper: Add 3.9.6 (#1662).
  • airflow, superset, druid, nifi: Add SBOMs for the frontend (npm) dependencies (#1600).
  • nifi: Backport NIFI-15958 to log periodic progress while waiting for the content archive scan and provenance re-index, for 2.6.0, 2.7.2, and 2.9.0 (#1611).
  • hbase: Add an SBOM for the web UI (npm) dependencies, which are unpacked from webjars and therefore not covered by the CycloneDX Maven plugin (#1620).
  • trino: Add SBOMs for the web UI, both for the two npm projects behind it and for the pre-built JavaScript vendored into the source tree (#1620).
  • hive: Restore the get_table and get_table_objects_by_name Thrift methods that HIVE-26537 removed in Hive 4.0.1, for 4.2.0 (#1636).
  • hadoop, spark: Add SBOMs for the pre-built JavaScript that is vendored into the source tree for the HDFS and Spark web UIs (#1620).
  • hive: Add 4.2.1 (#1637).
  • kafka: Add 4.3.1 and deprecate 4.2.1 (#1659, #1706).
  • stats-exporter: Add 0.31.0 (#1664).
  • airflow: Add 3.3.2, deprecate 3.2.2 (#1665, #1708).
  • nifi: Add 2.12.0 (#1667).
  • opensearch: Add 3.8.0 (#1669).
  • opensearch: Add the repository-azure plugin (#1689).
  • opensearch-dashboards: Add 3.8.0 (#1675).
  • nifi: Ship QueryNiFiReportingTask with the image (#1676).
  • hbase: Add 2.6.7 (#1678).
  • hbase: Add 3.0.0 as an experimental version, with hbase-opa-authorizer 1.0.0. It does not include Phoenix (no HBase 3.x support yet) (#1678).
  • vector: Add 0.58.0 (#1680, #1693).
  • trino: Add 483 (#1690).
  • trino-cli: Add 483 (#1690).
  • vector: Add the wrapper script /stackable/bin/vector-with-env-var-interpolation which enables the interpolation of environment variables in the Vector configuration files (#1693).
  • opa: Add 1.20.2 (#1697).
  • patchable: Use long hashes, and myers diff algorithm for portability (#1705).
  • spark: Add 4.1.3 and 4.2.0 (#1710).

Changed

  • krb5: Bump base image (#1721).
  • testing-tools: Bump various tools and Python dependencies (#1720).
  • ubi-rust-builders: Bump protoc to 36.2 (#1717).
  • tools: Bump kubectl to 1.37.1, yq to 4.54.1, jq to 1.8.2 (#1718).
  • opensearch-dashboards: Bump cdxgen to 13.2.0 and pin the CycloneDX spec version to 1.6 (#1600, #1675).
  • opa, statsd-exporter: Bump cyclonedx-gomod to 1.12.0 (#1639).
  • nifi: Updated dependencies for 2.6.0 and 2.9.0 (#1667).
  • testing-tools: Pull grpcurl from our own mirror instead of directly from Docker Hub (#1671).
  • superset: change statsd-exporter to 0.31.0 (#1673).
  • vector: Build with --locked (#1674).
  • ci: Bump stackabletech/actions to v0.18.4 (#1681).
  • java-devel: Pin versions-maven-plugin to 2.22.0 for mvn versions:set, maven-help-plugin to 3.5.2 for mvn help:evaluate and maven-dependency-plugin to 3.11.0 for mvn dependency:get, which otherwise resolve the latest release on every build unless the product POM pins them (#1682).
  • spark: Remove duplicated arguments from the mvn dependency:get calls for stax2-api and woodstox-core (#1682).
  • airflow, druid, hbase, nifi, opensearch-dashboards, superset, trino: Install global npm packages (cdxgen, pnpm, yarn, npm) with --ignore-scripts, and only resolve versions that were published at least 7 days ago (--before) (#1682).
  • superset: Pin npm to 10.9.9 instead of installing the latest version with nvm install --latest-npm (#1682).
  • opa: update golang to 1.27.1 (#1697).
  • spark: Pin pyarrow below 26 to satisfy scikit-learn dependency on NumPy 1.x (#1695).
  • spark-connect-client: Replace hard-coded Python dependency versions with image dependencies and bump them for Spark 4.2.0 (#1713).

Fixed

  • spark: Propagate the entrypoint's exit code so failed applications are no longer reported as successful (#1595).
  • superset: Fix the broken builds by excluding the cypress-base end-to-end test project from the frontend SBOM (#1616).
  • superset: Fix the broken 4.1.4 build by also excluding packages/superset-ui-switchboard from the frontend SBOM (#1621).
  • superset: Install nvm into /opt/nvm so that Node and npm, which are only needed to build the frontend, are no longer shipped in the final image (about 161 MB) (#1623).
  • vector: Generate the SBOM with the same feature set the binary is built with, so that the integrations that are not compiled in are no longer reported (#1630).
  • base images: Exclude the build-time dependencies from the Rust SBOMs (#1630).
  • kafka: Exclude the non-runtime configurations and the projects that are not shipped from the SBOM (#1630).
  • opensearch: Exclude the test framework, the test fixtures, the QA projects and the benchmarks from the SBOM of 3.1.0 (#1630).
  • opensearch: Restrict the SBOM of the Prometheus exporter to the runtime dependencies (#1630).
  • opensearch-dashboards: Pass --required-only to cdxgen (#1630). This turned out to have no effect, see #1635.
  • opensearch-dashboards: Pass --type js to cdxgen instead of the non-existing --target option. cdxgen silently ignored it and auto-detected every ecosystem in the source tree, which added the GitHub Actions workflows and the Gradle and Python files of the build tooling to the SBOM (#1635).
  • kafka: Include the releaseOnly configuration in the SBOM of 4.1.1 and 4.2.1. The core and tools projects declare the Log4j runtime bindings there, so they were shipped in libs/ without being part of the SBOM (#1635).
  • kafka: Exclude the generator, integration test and Connect test plugin projects from the SBOM (#1635).
  • opensearch: Exclude the build-tools project and the remaining unshipped projects from the SBOM of 3.1.0 (#1635).
  • airflow, superset: Add the missing purls to all packages that are installed from a local wheel or a direct URL, and normalize the names in the purls as defined in the Python packaging specification (#1635).
  • hbase: Exclude the optional npm dependencies from the web UI SBOM (#1630).
  • airflow, superset: Create the Python SBOM from a separate environment, so that neither cyclonedx-bom nor its dependencies end up in the SBOM and in the image (#1630).
  • airflow, superset: Add the missing purl to the Airflow and Superset packages in the Python SBOM. They are installed from a locally built wheel, and without a purl they show up twice in the image SBOM (#1630).
  • opa, statsd-exporter: Detect the licenses of the Go dependencies (#1639).
  • opa, statsd-exporter: Report the Go dependencies at module level instead of package and file level (#1639).
  • opensearch-dashboards: Generate the SBOM from the built distribution instead of the source worktree, so dev dependencies are excluded (#1663).
  • opensearch-dashboards: Only read the package.json of installed packages when generating the SBOM. The subpath stubs, test fixtures, benchmarks and examples that packages ship below their own directory were reported as components that do not exist on npmjs, most of them without a version (#1670).
  • hive: Build against the Hive modules built alongside each other (in the same reactor) rather than the ones published on Maven Central, for 4.2.0. Upstream fixed one instance of this for Hive 4.3.0 in HIVE-29827 but there are others. (#1636).
  • nifi: Backport NIFI-16431 into 2.12.0 and 2.9.0 (#1686).
  • nifi: Remove develocity extension which is not compatible with Maven 3.10 (#1704).
  • nifi: Ship one SBOM per nifi-iceberg-bundle NAR instead of the aggregate SBOM of the build, which listed dependencies of test-only modules and other versions that are not shipped and caused false positive vulnerability findings (#1714).
  • hive: Remove develocity extension which is not compatible with Maven 3.10 (#1707).
  • hadoop: Backport HADOOP-19885 into 3.5.0 (#1704).
  • airflow: Bump apache-airflow-providers-cncf-kubernetes to 10.18.0 for 3.2.2. This version includes a fix for scheduler crashloops when using KubernetesExecutor (#1709).
  • hive: Bump hive-metastore-opa-authorizer to 1.0.1 to fix a serialization bug (#1712).

Removed

  • zookeeper: Remove 3.9.4 (#1662).
  • hive: Remove 4.0.1 (#1637).
  • omid: remove 1.1.2 (#1593).
  • ci: Remove SLSA build provenance generation for published image indexes (#1596).
  • kafka: Removed 3.9.1, 4.1.1 (#1659).
  • airflow: Remove 3.1.6 (#1665).
  • nifi: Remove 2.7.2 (#1667).
  • opensearch: Removed 3.4.0 (#1669).
  • superset: Remove 6.0.0 (#1673).
  • opensearch-dashboards: Remove 3.4.0 (#1675).
  • druid: Remove 30.0.1, 35.0.1 (#1677).
  • hbase: Remove 2.6.4 (#1678).
  • vector: Remove 0.55.0 (#1680).
  • hadoop: Remove 3.4.2 (#1683).
  • trino: Remove 479 (#1690).
  • trino-cli: Remove 481 (#1690).
  • opa: Remove 1.12.3 (#1697).
  • spark: Remove 3.5.8 and 4.1.1 (#1710).

[26.7.0] - 2026-07-21

[26.7.0-rc2] - 2026-07-20

[26.7.0-rc1] - 2026-07-16

Added

  • ci: Generate SLSA build provenance for published image indexes and attest it in each registry (#1559).

  • hadoop: Add precompiled hadoop for later reuse in dependent images (#1466, #1474).

  • nifi: Add version 2.9.0 (#1463).

  • nifi: Backport NIFI-15801 to 2.x versions (#1481).

  • nifi: Backport NIFI-15901 to 2.x versions (#1481).

  • nifi: Add patches for 2.9.0 with NIFI-16067 and NIFI-16069 to fix PutIcebergRecord bugs and allow complex nested types (#1561).

  • testing-tools: Added grpcurl utility (#1493).

  • opa: Add 1.16.2 (#1509).

  • kafka: Add 3.9.2 and 4.2.1 (#1483).

  • trino: Add 481 (#1518).

  • superset: Add 6.1.0 (#1514).

  • zookeeper: Add 3.9.5 (#1515).

  • hadoop: Add 3.5.0 and 3.4.3 (#1511).

  • airflow: Add 3.2.2 (#1519, #1541).

  • druid: Add 37.0.0 (#1535).

  • hbase: Add 2.6.6 (#1547).

  • spark: Add 4.1.2 (#1550).

  • spark: Add the OpenLineage listener under the dedicated directory /stackable/spark/openlineage/ (#1577).

  • opensearch: Add 3.6.0 (#1549).

  • opensearch-dashboards: Add 3.6.0 (#1551).

  • spark: Add hbase-connector protobuf classes ([#1573]).

  • java-base: Add jvmkill (#1579, #1580).

Changed

  • airflow: Bump statsd_exporter to 0.30.0 (#1524).
  • ci: Bump docker/login-action from v3.6.0 to v4.1.0 and stackabletech/actions to v0.14.3 to escape Node.js 20 deprecation (#1507).
  • ci: Bump stackabletech/actions to v0.16.0 (#1559).
  • hbase: Update hbase-opa-authorizer from 0.1.0 to 0.2.0 and then 0.3.0 (#1446, #1454).
  • stackable-base: Bump containerdebug to 0.4.0 and config-utils to 0.4.0 (#1521).
  • statsd_exporter: Bump version from 0.28.0 to 0.30.0 (#1524). This uses a git mirror and patchable instead of sourcing from Nexus.
  • superset: Bump statsd_exporter to 0.30.0 (#1524).
  • hadoop: Refactor cloud library provisioning to downstream images. The jars are now conveniently placed in /stackable/hadoop-cloud-libraries/ to be easily picked up (#1511).
  • spark: bump hadoop 3.4.2 to 3.4.3 (#1533)
  • hive: Bump 4.2.0 to Hadoop 3.4.3 (#1539).
  • java-devel: Bump Maven to 3.9.16 (#1548).
  • spark: fix graceful shutdown at SIGTERM (#1564)
  • spark-k8s/hbase-connectors: bump hbase to 2.6.6 ([#1573]).

Fixed

  • trino: Backport fix for wrong deletes in Delta Lake (#1453).
  • opensearch: Scope CycloneDX SBOM to shipped components only, eliminating false positive CVEs from unshipped plugins (#1452).
  • vector: Look for SBOM in correct location (#1471).
  • vector: Use correct license (#1476).
  • trino: Build a patched Airlift from source and depend on it to backport airlift/airlift#1943, applying the configured max response header size to Jetty's maxResponseHeaderSize (#1510).
  • airflow: Route DAG listings and menu items through OPA in the Airflow 3 OPA auth manager, and wire the OPA cache on the FastAPI api-server init path (#1512).

Removed

  • nifi: Remove 1.28.1, deprecate 2.7.2 (#1520).
  • opa: Remove 1.8.0 (#1509).
  • spark-k8s: Remove 3.5.7 and 4.0.1 (#1525).
  • hive: Remove 4.1.0 (#1539).
  • druid: Remove 34.0.0 (#1535).
  • java-base: Drop Java 8 (#1548).
  • hbase: Remove 2.6.3 (#1547).

[26.3.0] - 2026-03-16

[26.3.0-rc1] - 2026-03-16

Added

  • airflow: Add 3.1.6 (#1405, #1422).
  • druid: Add 35.0.1 (#1406).
  • superset: Add 6.0.0 (#1337, #1393).
  • opa: Add 1.12.3 (#1396, #1424).
  • hive: Build hive-metastore-opa-authorizer from source and add to image (#1340).
  • hive: Add 4.2.0 (#1356).
  • nifi: Add patches to replace process group root ID placeholder (#1358).
  • opensearch: Add 3.4.0 (#1391).
  • opensearch-dashboards: Add 3.4.0 (#1392).
  • testing-tools: build testing tools subimages in workflow (#1366).
  • kafka: Add 4.1.1 (#1395).
  • spark: Add 4.1.1 (#1402).
  • spark-connect-client: Add 4.1.1 (#1402).
  • spark-k8s/hbase-connectors: new image extracted from spark dockerfile (#1402).
  • trino: Add 479 (#1403).
  • hbase: Add 2.6.4 (and phoenix 5.3.0) (#1408).
  • spark: Add 3.5.8 (#1414).
  • spark-connect-client: Add 3.5.8 (#1414).
  • hbase: Backport HBASE-29797 to all HBase versions (2.6.3 and 2.6.4) (#1425).
  • druid: Make the clientAuthenticationMethod configurable in Druid 35.0.1 (#1431).
  • ubi10-rust-builder: Add new ubi10 base image for operators to begin using (#1432).

Changed

  • airflow: Extend list of providers for 3.0.6 (#1336)
  • airflow: Bump celery version to 5.5.3 for Airflow 3.x (#1343).
  • druid: Bump HDFS to 3.4.2 for 34.0.0 (#1409).
  • testing-tools: refactoring: Split image into multiple images, remove unnecessary components and switch to UBI as base image (#1354).
  • hive: fixed 4.0.1 shaded hive-metastore-opa-authorizer jar by relocating dependencies (#1356).
  • hadoop: Bump to hdfs-utils 0.5.0 (#1360).
  • testing-tools: fix: add kubectl and openssl (#1367).
  • trino: Backport Kafka offset handling to 477 (#1373).
  • trino-cli: Bump to 479 (#1403).
  • ubi: Bumped ubi9 and ubi10 hashes (#1386).
  • vector: Bumped from 0.49.0 to 0.52.0 (#1387).
  • spark: Use one Dockerfile per major product version (#1402). Remove all HBase dependencies from the Spark 4 image. Pull logging dependencies with mvn instead of curl to remove manual maintenance in Nexus packages.
  • hbase: Update hbase-operator-tools from 1.3.0-fd5a5fb to 1.3.0 (#1425).
  • nifi: Backported NiFi-15567 to NiFi 2.6.0 and 2.7.2 to fix CVE CVE-2026-25903 (#1429).
  • ubi9-rust-builder: Bump rust toolchain and cargo auditable versions (#1432).
  • stackable-base: Bump ubi9 image hash (#1433).
  • stackable-devel: Bump ubi9 image hash, update rust toolchain (#1433, #1435).
  • stackable-base: Bump config-utils to 0.3.0 and cert-tools to 0.1.1 (#1442).
  • stackable-base: Bump containerdebug 0.3.0 (#1447).

Removed

  • airflow: Remove 2.10.5 and 3.0.1 (#1405).
  • druid: Remove 33.0.0 (#1406).
  • hdfs: Remove 3.4.1 (#1409).
  • opensearch: Remove the performance-analyzer plugin from the OpenSearch image (#1357).
  • superset: Remove 4.0.2 and 4.1.2 (#1394).
  • kafka: Remove 3.7.2 and 4.1.0 (#1395).
  • spark: Remove 3.5.6 (#1402).
  • spark-connect-client: Remove 3.5.6 (#1402).
  • opa: Remove 1.4.2 (#1396).
  • zookeeper: Remove 3.9.3 (#1401).
  • trino: Remove 451 and 476 (#1403).
  • hbase: Remove 2.6.2 (#1408).
  • spark: remove the JRE before installing the JDK to prevent version conflicts (#1410).
  • vector: Remove the Vector state directory /stackable/vector/var because the state should be persisted in the log directory (#1413).
  • spark: Remove 3.5.7 in (#1414) but restored in (#1423).
  • spark-connect-client: Remove 3.5.7 in (#1414) but restored in (#1423).

Fixed

  • testing-tools: Re-add pytest Python package as well as diffutils package (#1388).
  • testing-tools: Move Kerberos packages from testing-tools/hive to parent since they provide kinit which is needed in other tests too (ex. HBase). (#1389).
  • hbase: Removed test class from backport HBASE-29797 to HBase version 2.6.3 (#1426).
  • superset: Pin setup-tools to ensure pkg_resources are installed (needed for 4.1.4 builds) (#1428).
  • ubi10-rust-builder: Add gzip dependency for the ONBUILD step (#1436).
  • airflow: Pin virtualenv to prevent hatch pulling in a version with a breaking change (#1437).
  • airflow: Allow overriding the logging configuration in Airflow 3.1.x (#1445).

[25.11.0] - 2025-11-07

[25.11.0-rc1] - 2025-11-06

Added

  • ubi9-rust-builder: Include .tar.gz snapshots of the operator source code in container images (#1207).
  • opensearch: Add Opensearch as new product with version 3.1.0 (#1215).
  • opensearch: Use build-repo.stackable.tech instead of Maven Central (#1222).
  • opensearch: Add the opensearch-prometheus-exporter plugin to the image (#1223).
  • opensearch: Replace the demo configuration of the OpenSearch Security plugin with a minimal one (#1228).
  • opensearch: Install common plugins from Maven Central (#1322).
  • opensearch-dashboards: Add an image for Opensearch Dashboards with version 3.1.0 (#1248).
  • nifi: Backport NIFI-14848 to NiFi (#1225).
  • stackable-base: Add cert-tools (#1247).
  • kafka: Add jackson xml dataformat for Kafka 4.0.0 (#1262).
  • druid: Add 34.0.0 (#1263).
  • kafka: Add version 4.1.0 (#1277).
  • airflow: Add version 3.0.6 (#1278).
  • opa: Add 1.8.0 (#1279).
  • spark: Add 3.5.7 (#1280).
  • spark-connect-client: Add 3.5.7 (#1280).
  • superset: Add 4.1.4 (#1284).
  • spark: Add 4.0.1 (#1286).
  • spark-connect-client: Add 4.0.1 (#1286).
  • trino/trino-storage-connector: Add 477 (#1285).
  • testing-tools: Add upload_new_keycloak_version.sh script (#1289).
  • hadoop: Add 3.4.2 (#1291).
  • zookeeper: Add 3.9.4 (#1292).
  • nifi: Add 2.6.0 (#1293).
  • hive: Add 4.1.0 (#1295).
  • hbase: Add 2.6.3 (#1296).
  • airflow,superset: Build from source (#1304).
  • kafka: Add updated JMX config server.yaml for KRaft (#1308).
  • airflow: Add apache-kafka provider plus dependencies to 3.0.6 image (#1313).
  • airflow,superset: Reduce image size and add a snapshot of the source code (#1326).

Changed

  • all: Use our build-repo to cache NPM dependencies (#1219).
  • java: Use a more recent Maven version for all Java based products (#1220, [#1293]).
  • ubi9-rust-builder: Bump ubi9 base image (#1253).
  • ubi9-rust-builder: Bump Rust toolchain to 1.89.0, rustup to 1.28.2, and cargo-auditable to 0.7.1 (#1318).
  • stackable-base: Bump ubi9 base image (#1253).
  • stackable-devel: Bump ubi9 base image and update cargo-auditable to 0.7.0 (#1253).
  • stackable-devel: Bump Rust toolchain to 1.89.0 and cargo-auditable to 0.7.1 (#1319).
  • vector: Bump to 0.49.0 and build from source (applying patches) (#1258, #1323).
  • airflow: Bump uvicorn dependency to 0.37.0 (#1264).
  • trino-cli: Bump to 477 (#1285).
  • tools: Bump dependency versions - kubectl to 1.34.1, yq to 4.47.2, and jq to 1.8.1 (#1290).
  • testing-tools: Update keycloak dependency to 26.3.5 and python:3.12-slim-bullseye base image (#1289).
  • hbase: move hbck2.env to hbase-operator-tools image and add log4j2 properties for this tool (#1300).
  • hbase: replace sed calls with config-utils template where possible (#1301).
  • superset: Fix the 4.1.2 build when building from source (#1309)
  • superset: Pin luxon to version 3.6.1 to fix build (#1315, #1316)
  • nifi: Use a patched version of logback to fix corrupted logs (#1314)
  • zookeeper: Use a patched version of logback to fix corrupted logs (#1320)
  • kafka: Use patched version of reload4j to fix corrupted logs (#1330)

Fixed

  • opensearch: Fix insecure file permissions (#1311).

Removed

  • opensearch: Stop applying formatting plugin (#1230).
  • druid: Remove 31.0.1 (#1263).
  • kafka: Remove version 4.0.0 (#1277).
  • airflow: Remove version 2.10.4 (#1278).
  • opa: Remove 1.0.1 (#1279).
  • spark: Remove 3.5.5 (#1280).
  • spark-connect-client: Remove unused example script from the image (#1280).
  • kafka: Remove 3.9.0 (#1283).
  • spark: Remove 4.0.0 (#1286).
  • spark-connect-client: Remove 4.0.0 (#1286).
  • trino/trino-storage-conector: Remove 470 (#1285).
  • hbase: Remove 2.6.1 (#1296).

[25.7.0] - 2025-07-23

[25.7.0-rc1] - 2025-07-18

Added

  • airflow: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1054).
  • airflow: Add 2.10.5 (#1108).
  • airflow: Add 3.0.1 (#1122).
  • druid: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1039).
  • druid: Add 33.0.0 (#1110).
  • hadoop: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1029).
  • hbase: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1028).
  • hbase: provide patches to implement listener endpoints (#1159).
  • hive: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1040).
  • spark-connect-client: A new image for Spark connect tests and demos (#1034)
  • kafka: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1041).
  • kafka: build kafka-opa-plugin from source (#1177).
  • nifi: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1027).
  • nifi: Add nifi-iceberg-bundle for NiFi 2.4.0 (#1060, #1106).
  • nifi: Add 2.4.0 (#1114).
  • nifi: Add git-sync (#1107).
  • opa: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1038).
  • opa: Add 1.4.2 (#1103).
  • spark-k8s: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1055).
  • superset: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1053).
  • superset: Add version 4.1.2 (#1102).
  • trino: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1025).
  • trino: Add 476 (#1095).
  • trino-storage-connector: Add 476 (#1095).
  • zookeeper: check for correct permissions and ownerships in /stackable folder via check-permissions-ownership.sh provided in stackable-base image (#1043).
  • nifi: Build and add OPA authorizer plugin nar (#1058).
  • nifi: Add nifi-iceberg-bundle for NiFi 2.2.0 (#1060, #1106).
  • java: Add JDK 24 (#1097).
  • ci: Add golang image to mirror workflow (#1103).
  • omid: bump version to 1.1.3 (#1105).
  • hbase: add 2.6.2 and upgrade dependencies (#1101).
  • kafka: Add 4.0.0 (#1117).
  • Include .tar.gz snapshots of the product source code in container images (#1126).
  • airflow: OPA authorizer for Airflow 3.x (#1127).
  • kafka: Add 3.9.1 (#1149).
  • spark-k8s: Add 3.5.6 (#1142).
  • spark-connect-client: Add 3.5.6 (#1142).
  • git-sync: Bump version to 4.4.1 (#1151).
  • zookeeper: bump jetty version for CVE-2024-13009 in 3.9.3 (#1179)
  • zookeeper: bump netty version for CVE-2025-24970 in 3.9.3 (#1180)
  • hadoop: backport HADOOP-19352, HADOOP-19335, HADOOP-19465, HADOOP-19456 and HADOOP-19225 to fix vulnerabilities in Hadoop 3.4.1 (#1184)
  • hadoop: Backport HADOOP-18583 to make OpenSSL 3.x work with the native hadoop libraries (#1209).
  • spark: backport [SPARK-51311] Promote bcprov-jdk18on to compile scope (#1212).

Changed

  • airflow,superset: Use uv to build the product (#1116).
  • ubi-rust-builder: Bump Rust toolchain to 1.85.0, cargo-cyclonedx to 0.5.7, and cargo-auditable to 0.6.6 (#1050).
  • ubi9-rust-builder: Bump base image and update protoc to 30.2 (#1091, #1163).
  • stackable-base: Bump ubi9 base image (#1163).
  • stackable-devel: Bump ubi9 base image (#1103, #1137, #1163).
  • spark-k8s: Include spark-connect jars, replace OpenJDK with Temurin JDK, cleanup (#1034).
  • spark-connect-client: Image is now completely based on spark-k8s and includes JupyterLab and other demo dependencies ([#1071]).
  • jmx_exporter: Bump products to use 1.3.0 (#1090, #1156).
  • kubectl: Bump products to use 1.33.0 (#1090).
  • yq: Bump products to use 4.45.2 (#1090).
  • cyclonedx-bom: Bump airflow and superset to use 6.0.0 (#1090).
  • trino-cli: Bump to 476 (#1095).
  • vector: Bump to 0.46.1 (#1098).
  • spark: update dependencies for 3.5.5 (#1094).
  • nifi: include NAR SBOMs (#1119).
  • nifi: update patch allowing to bypass host header validation starting with NiFi 2.4.0 (#1125).
  • BREAKING: kcat: Stop building kcat image (#1124).
  • containerdebug updated to 0.2.0 (#1128).
  • Build Hadoop as stackable and configure the Stackable Nexus build-repo for the root user (#1133).
  • patchable: The base branch is now configured as the git upstream branch (#1131).
  • airflow: Updates the entrypoint script and removes the check for GID == 0 (#1138).
  • druid: Bump druiod-opa-authorizer to 0.7.0 (#1139).
  • vector: Bump to 0.47.0 (#1152).
  • zookeeper: backport ZOOKEEPER-4846, ZOOKEEPER-4921, ZOOKEEPER-4925 into Zookeeper 3.9.3 (#1150).
  • testing-tools: Update base image (#1165).
  • trino: Enable custom versions (#1168).
  • zookeeper: Enable custom versions (#1169).
  • opa: Enable custom versions (#1170).
  • use custom product versions for Hadoop, HBase, Phoenix, hbase-operator-tools, Druid, Hive and Spark (#1173).
  • hbase: Bump dependencies to the latest patch level for HBase 2.6.1 and 2.6.2 (#1185).
  • hadoop: Separate Dockerfiles for Hadoop build and HDFS image (#1186).
  • ubi-rust-builder: Bump Rust toolchain to 1.87.0, cargo-auditable to 0.7.0 and protoc to 31.1 (#1197).
  • stackable-base, stackable-devel, ubi-rust-builder: Update ubi-minimal base image (#1197).
  • testing-tools: Update python 3.12-slim-bullseye base image (#1197).

Fixed

  • airflow: Pin Cython version (#1116).
  • druid: reduce docker image size by removing the recursive chown/chmods in the final image (#1039).
  • hadoop: reduce docker image size by removing the recursive chown/chmods in the final image (#1029).
  • hadoop: adapt the JMX exporter configuration to also export boolean metrics ([#1140]).
  • hbase: reduce docker image size by removing the recursive chown/chmods in the final image (#1028).
  • hive: reduce docker image size by removing the recursive chown/chmods in the final image (#1040).
  • kafka: reduce docker image size by removing the recursive chown/chmods in the final image (#1041).
  • Add --locked flag to cargo install commands for reproducible builds (#1044).
  • nifi: reduce docker image size by removing the recursive chown/chmods in the final image (#1027).
  • opa: reduce docker image size by removing the recursive chown/chmods in the final image (#1038).
  • opa: Manually install Go 1.23.9 (#1103).
  • spark-k8s: reduce docker image size by removing the recursive chown/chmods in the final image (#1042).
  • superset: Pin Cython version (#1116).
  • trino: reduce docker image size by removing the recursive chown/chmods in the final image (#1025).
  • zookeeper: reduce docker image size by removing the recursive chown/chmods in the final image (#1043).
  • Fixed two hardcoded username references (#1052).
  • ubi9-rust-builder: Use pinned rustup version (#1121).
  • hive: Patch for postgres CVE-2024-1597 (#1100).
  • bump image-tools (for bake) and nixpkgs (for nodejs_20, used by pre-commit) (#1100).
  • bump image-tools (for bake) to fix RELEASE arg (#1188).
  • nifi: automatically determine NiFi version create reporting task script (#1189).

Removed

  • ci: Remove Nexus steps from build, mirror and release workflows (#1056). Also remove the old release workflow.
  • trino: Remove 455 (#1095).
  • trino-storage-connector: Remove 455 (#1095).
  • zookeeper: Remove 3.9.2 (#1093).
  • Remove ubi8-rust-builder image (#1091).
  • spark: remove 3.5.2 (#1094).
  • hadoop: Remove 3.3.4 and 3.4.0 (#1099).
  • opa: Remove 0.67.1 (#1103).
  • opa: Remove legacy bundle-builder from container build (#1103).
  • omid: Remove 1.1.3-SNAPSHOT (#1105).
  • hbase: Remove 2.4.18 (#1101)
  • druid: Remove 30.0.0 (#1110).
  • nifi: Remove 2.2.0 (#1114).
  • kafka: Remove 3.7.1 and 3.8.0 (#1117).
  • spark-connect-client: Remove 3.5.5 (#1142).
  • nifi: Enable custom versions ([#1172]).
  • kafka: Enable custom versions (#1171).
  • omid: Enable custom versions (#1174).

[25.3.0] - 2025-03-21

Added

  • omid: Added 1.1.3-SNAPSHOT to allow for easier scanning pre-release
  • airflow: Add OPA support to Airflow (#978).
  • nifi: Activate include-hadoop profile for NiFi version 2 (#958).
  • nifi: Add NiFi hadoop Azure and GCP libraries (#943).
  • superset: Add role mapping from OPA (#979).
  • base: Add containerdebug tool (#928, #959).
  • tools: Add the package util-linux-core (#952). util-linux-core contains a basic set of Linux utilities, including the command logger which allows to enter messages into the system log.
  • vector: Add version 0.43.1 (#980).
  • druid: Add version 30.0.1 and 31.0.1 (#984)
  • opa: Add version 1.0.1 (#981, #1000).
  • statsd-exporter: Bump version to 0.28.0 (#982).
  • git-sync: Bump version to 4.4.0 (#990).
  • kafka: Add versions 3.7.2 and 3.9.0 (#988).
  • java: Add JDK/JRE 23 (#992).
  • trino: Add 469 (#993).
  • trino-cli: Add version 469 (#993).
  • hbase: Support for 2.6.1 (#997).
  • trino-storage-connector: Add version 469 (#996).
  • trino: Add 470 (#999).
  • trino-cli: Add version 470 (#999).
  • trino-storage-connector: Add version 470 (#999).
  • superset: Add version 4.1.1 (#991).
  • Add Patchable patch management tool (#1003, #1005, #1007, #1026).
  • nifi: Add 1.28.1, 2.2.0 (#1006).
  • airflow: Add 2.10.4 (#1021).
  • hadoop: Add 3.4.1, use jmx_export 1.1.0 (#1021).
  • hive: Add 4.0.1, use jmx_export 1.1.0 (#1021).
  • zookeeper: Add 3.9.3, use jmx_export 1.1.0 (#1021).
  • hbase: Use jmx_export 1.1.0 (#1021).
  • omid: Use jmx_export 1.1.0 (#1021).
  • spark: Add 3.5.5 (#1022).
  • trino: Add libstdc++ package, needed by snappy and duckdb (#1015).
  • hive: Revert the removal of 4.0.0 ([#1031]).

Changed

  • stackable-base: Bump cargo-cyclonedx to 0.5.7 (#1013).
  • Update registry references to oci (#989).
  • trino-storage-connector: Move the build out of trino/ for easier patching (#996).
  • phoenix: Bump 5.2.0 to 5.2.1 (#997, #1009).
  • BREAKING: druid: Bump opa-authorizer to 0.6.0 for all versions (#984).

Removed

  • kafka: Remove kubectl, as we are now using listener-op (#884).
  • vector: remove version 0.41.1 (#980).
  • opa: remove version 0.66.0 (#981).
  • trino: Remove 469 (#999).
  • trino-cli: Remove version 469 (#999).
  • trino-storage-connector: Remove version 469 (#999).
  • nifi: Remove 2.0.0 (#1006).
  • druid: Remove 26.0.0 (#984)
  • airflow: Remove 2.9.2, and 2.10.2 (#1021).
  • hive: Remove 4.0.0 (#1021).
  • spark: Remove 3.5.1 (#1022).

Fixed

  • stackable-base: Install missing rust toolchains (#1013).
  • opa: Install missing rust toolchains (#1013).
  • druid: Fix CVE-2023-34455 in Druid 30.0.0 by deleting a dependency (#935).
  • hadoop: Fix the JMX exporter configuration for metrics suffixed with _total, _info and _created (#962).
  • nix: Move pkg-config to nativeBuildInputs (#1021).
  • hadoop: Use the fast mirror in the download script (#1021).

[24.11.1] - 2025-01-14

Changed

  • ci: Fix various static analysis errors (#955).
  • all java products: These now use the Stackable Nexus build-repo by default instead of pulling from Maven central (#953).
  • all java products: Maven is now consistently run with --batch-mode and --no-transfer-progress to reduce noise (#953).

Added

  • tools: Add the package util-linux-core (#952). util-linux-core contains a basic set of Linux utilities, including the command logger which allows to enter messages into the system log.

[24.11.0] - 2024-11-18

Added

  • ci: Add mirror workflow, add new helper scripts (#819).
  • opa: Add version 0.67.1 (#797).
  • vector: Add version 0.41.1 (#802, #815, #867).
  • airflow: Add version 2.9.3 (#809).
  • airflow: Add version 2.10.2 (#877).
  • kafka: Add version 3.8.0 (#813).
  • hive: Add version 4.0.0 (#818).
  • trino: Add version 455 (#822).
  • trino-cli: Add version 455 (#822).
  • spark: Add version 3.5.2 (#848).
  • statsd-exporter: Bump version to 0.27.1 (#866, #879).
  • hadoop: Add patch "HADOOP-18516: Support Fixed SAS Token for ABFS Authentication" (#852).
  • hbase: Add hadoop-azure.jar to the lib directory to support the Azure Blob Filesystem and the Azure Data Lake Storage (#853).
  • kafka: Add cyrus-sasl-gssapi package for kerberos (#874).
  • spark: Add HBase connector (#878, #882).
  • hbase: hbase-entrypoint.sh script to start and gracefully stop services (#898).
  • tools: install yq command line tool for YAML manipulation (#912).
  • nifi: Add version 2.0.0 (#917).

Changed

  • ci: Rename local actions, adjust action inputs and outputs, add definition README file (#819).
  • Update cargo-cyclonedx to 0.5.5 and build CycloneDX 1.5 files (#783).
  • Enable Docker build checks (#872).
  • java: migrate to temurin jdk/jre (#894).
  • tools: bump kubectl to 1.31.1 and jq to 1.7.1 (#896).
  • Make username, user id, group id configurable, use numeric ids everywhere, change group of all files to 0 (#849, #890, #897).
  • ci: Bump stackabletech/actions to 0.2.0 (#901, #903, #907, #910, #913).
  • ubi-rust-builder: Bump Rust toolchain to 1.81.0 (#902).
  • ci: Handle release builds in the same build workflows (#913).
  • hadoop: Bump to hdfs-utils 0.4.0 (#914).
  • superset: Fix CVE-2024-1135 by upgrading gunicorn from 21.2.0 to 22.0.0 (#919).
  • jmx_exporter: Updated to a custom-built version of 1.0.1 to fix performance regressions (#920).

Removed

  • opa: Remove version 0.61.0 (#797).
  • vector: Remove version 0.39.0 (#802).
  • airflow: Remove versions 2.6.3, 2.8.1, 2.8.4 (#809).
  • kafka: Remove versions 3.4.1, 3.6.1, 3.6.2 (#813).
  • trino: Remove versions 414, 442 (#822).
  • trino-cli: Remove version 451 (#822).
  • hbase: Remove 2.4.17 (#846).
  • omid: Remove 1.1.0 and 1.1.1 (#846).
  • spark: Remove 3.4.2 and 3.4.3 (#848).
  • statsd-exporter: Remove 0.26.1 (#866).
  • superset: Remove 2.1.3, 3.1.0 and 3.1.3 (#866).
  • zookeeper: Remove 3.8.4 (#851).
  • nifi: Remove 1.21.0 and 1.25.0 (#868).
  • druid: Remove 28.0.1 (#880).
  • nifi: Removed binaries from upload nifi script (#917).

Fixed

  • hbase: link to phoenix server jar (#811).
  • spark: Fix CVE-2024-36114 in Spark 3.5.1 by upgrading a dependency. Spark 3.5.2 is not affected. (#921)
  • trino: Correctly report Trino version (#881).
  • hive: Fix CVE-2024-36114 in Hive 3.1.3 and 4.0.0 by upgrading a dependency. (#922).
  • nifi: Fix CVE-2024-36114 in NiFi 1.27.0 and 2.0.0 by upgrading a dependency. (#924).
  • hbase: Fix CVE-2024-36114 in HBase 2.6.0 by upgrading a dependency. (#925).
  • druid: Fix CVE-2024-36114 in Druid 26.0.0 and 30.0.0 by upgrading a dependency (#926).
  • hbase: Fix CVE-2023-34455 in HBase 2.4.18 by upgrading a dependency. (#934).

[24.7.0] - 2024-07-24

Added

  • omid: Add version 1.1.1 & 1.1.2 (#553).
  • ubi9-rust-builder: A builder image using UBI9 instead of the current UBI8 (#583).
  • Build all 0.0.0-dev product images as multi-arch and push them to Nexus and Harbor. Also SBOMs are generated and everything is signed (#614, #616).
  • hbase: Enable snapshot exports to S3; The HBase image depends now on the Hadoop image. The required AWS JARs are copied from the Hadoop image to the HBase image. The script export-snapshot-to-s3 makes exporting easier (#621).
  • kafka: Build from source (#659, #661).
  • kafka: Add jmx broker config to builder image (#703).
  • nifi: Build from source (#678).
  • omid: Include Apache Omid in all workflows such as building and releasing images (#635).
  • java-devel: New image to serve as base layer for builder stages (#665).
  • stackable-base: Mitigate CVE-2023-37920 by removing e-Tugra root certificates (#673).
  • hadoop: Exclude YARN and Mapreduce projects from build (#667).
  • hadoop: Exclude unused jars and mitigate snappy-java CVEs by bumping dependency (#682).
  • hadoop: Add version 3.4.0 (#743).
  • druid: Build from source (#684, #696).
  • opa: Add log processing script to opa for decision logging (#695, #704).
  • hbase: Added new image for 2.6.0 including the new OPA authorizer (#701).
  • stackable-base: Add config-utils (#706).
  • omid: Include Apache Omid Examples to simplify testing (#721).
  • nifi: Add support for 1.27.0 and 2.0.0-M4 (#744, #767).
  • kafka: Add versions 3.6.2 and 3.7.1 (#745).
  • trino & trino-cli: Add version 451 (#758).
  • airflow: Add version 2.8.4 and 2.9.2 (#762).
  • superset: Add version 3.1.3 and 4.0.2 (#768).
  • druid: Support for 30.0.0 using Java 17 (#731).
  • hbase: Support for HBase 2.4.18 (#740).
  • spark-k8s: Support for 3.5.1 using Java 17 (#771).
  • airflow & superset: Build statsd_exporter from source (#777).

Changed

  • all: Switched all product builds from UBI8 to UBI9.4 (#628)
  • hbase: Remove the symlink /stackable/jmx/jmx_prometheus_javaagent-0.16.1.jar which is unused since SDP 23.11 (#621).
  • hive: Only build and ship Hive metastore. This reduces the image size from 2.63GB to 1.9GB and should also reduce the number of dependencies (#619, #622).
  • ubi8-rust-builder: Bump protoc from 21.5 to 26.1 (#624).
  • pass platform argument to preflight check (#626).
  • nifi: provision stackable-bcrypt from Maven (#663)
  • nifi: move /bin/stackable-bcrypt to /stackable/stackable-bcrypt and added softlink for backwards compatibility (#678).
  • nifi: patch nifi-assembly pom file to not zip binaries after the build to save disk space (#685).
  • hadoop: use java-devel as base layer for the builder stage (#665)
  • hive: use java-devel as base layer for the builder stage (#665)
  • zookeeper: use java-devel as base layer for the builder stage (#665)
  • hbase: use java-devel as base layer for the builder stage (#665)
  • omid: use java-devel as base layer for the builder stage (#665)
  • kafka: use java-devel as base layer for the builder stage (#665)
  • opa-bundle-builder: Bump image to 1.1.2 (#666)
  • opa: Build from source (#676)
  • trino: Build from source (#687).
  • spark: Build from source (#679)
  • all: Moved the LOG4J_FORMAT_MSG_NO_LOOKUPS env variable from the individual Dockerfiles to java-base and java-devel (#727)
  • all: Move product versions into product directory in preparation for individual product build workflows (#732)
  • all: Bump rustc 1.79.0, protoc 27.2, git-sync 4.2.3, statsd-exporter 0.26.1, vector 0.39.0, jmx-exporter 1.0.1, inotify_tools 3.22.1.0-1.el9 (#624, #737)

Fixed

  • superset: Let Superset 3.1.0 build on ARM by adding make and diffutils (#611).
  • airflow: Let Airflow 2.8.x and 2.9.x build on ARM by adding make and diffutils (#612).
  • python:3.11 manifest list fixed. Added proper hash (#613).
  • trino-cli: Include the trino-cli in the CI build process (#614).
  • hive: Fix compilation on ARM by back-porting HIVE-21939 from this commit (#617).
  • hive: Fix compilation on ARM in CI as well (#619).
  • hive: Fix compilation of x86 in CI due to lower disk usage to prevent disk running full (#619).
  • hive: Provide logging dependency previously bundled with the hadoop yarn client (#688).
  • all: Use correct hbase versions (#734)
  • airflow: fix missing libstdc++.so.6 error message when running the image (#778)

Removed

  • zookeeper: Remove unsupported version 3.8.3 and 3.9.1 (#628, #736).
  • java-base: Remove openjdk-devel rpm package again to reduce the vulnerability surface (#665)
  • trino: Remove unsupported version 428 (#687).
  • nifi: Remove unsupported version 1.23.2 (#744).
  • kafka: Remove unsupported version 3.5.2 (#745).
  • airflow: Remove unsupported version 2.7.2, 2.7.3 and 2.8.3 (#762).
  • superset: Remove version 2.1.1, 3.0.1 and 3.0.3 (#768).
  • druid: Remove support for 27.0.0 (#731)
  • spark-k8s: Remove support for 3.4.1 and 3.5.0 (#771).

[24.3.0] - 2024-03-20

Added

  • omid: init at 1.1.0 (#493).
  • hadoop: Allow datanodes to override their registration addresses (#506, #544).
  • hadoop: Add async-profiler and backport HADOOP-18055 and HADOOP-18077 to support it (#540).
  • hadoop: Add tar package, so that kubectl cp can be used to copy log files and profiler flamegraphs (#540).
  • hbase: Add async-profiler and backport HBASE-28242 to support it (#540).
  • hbase: Allow multiple certificates in the KeyStores which is required for rotating CA certificates. Because of this, HBASE-27027 was backported to HBase version 2.4.12 (#540).
  • nifi: Add Apache Iceberg extensions (#529).
  • testing-tools: Add krb5-user library for Kerberos tests (#531).
  • testing-tools: Add the Python library Beautiful Soup 4 (#536).
  • java-base: Add openjdk-devel package for tool such as jps or jmap (#537).
  • java-base: Add JDK 21 (#547).
  • airflow: Add 2.7.3, 2.8.1, 2.8.3 (#562, #593).
  • druid: Add 28.0.1 (#558).
  • kafka: Add 3.5.2, 3.6.1 (#559).
  • nifi: Add version 1.25.0 using java 21 (#552).
  • opa: Add version 0.61.0 (#538).
  • spark: Add version 3.4.2 (#560).
  • superset: Add version 2.1.3,3.0.3,3.1.0 (#563).
  • trino: Add version 442 (#597).
  • vector: Switch from version 0.33.0 to 0.35.0 (#547, #549).
  • zookeeper: Add version 3.8.4 (#591).
  • zookeeper: Add version 3.9.1, 3.9.2 (#551, #592).
  • hadoop: Add hdfs-utils (#566).
  • testing-tools: add pytest 8.0.1 (#575).
  • trino-cli: Command line for Trino version 442 (#597)
  • kafka-testing-tools (incorporating kcat): New image. Command line utility for interacting with Kafka (#590)
  • spark: Add version 3.5.1 (#588).

Changed

  • kafka: Pulling kcat from Nexus rather than GitHub (#534).
  • Reworking architecture selection mechanism for binaries (#534).
  • Fixing base images to multi-architecture lists (#534).
  • airflow and superset: Pull statsd-exporter as binary from Nexus instead of extracting out of the official docker image (#534).
  • changed microdnf configuration to not install weak dependencies by adding install_weak_deps=0 (#533)
  • ubi8-rust-builder: bump ubi8-minimal image to latest 8.9 (#514).
  • stackable-base: bump ubi8-minimal image to latest 8.9 (#514).
  • ubi8-rust-builder: bump rust toolchain to 1.75.0 (#542, #517).
  • GH workflows: make preflight an independent manual workflow and update to version 1.7.2 (#519).
  • hadoop: Build from source (#526).
  • superset: Add patch that fixes saved queries export (#539).
  • inotify-tools: Download from Nexus instead of using the EPEL 8 repository (#549).
  • hadoop: Add patches to fix missing operationType for some operations in authorizer (#555, #564).
  • airflow: bump git-sync to 4.2.1 (#562).
  • hdfs: bump topology-provider to 0.2.0 (#565).
  • java-base: Add krb5-workstation for all Java based products, as it is used by at least Zookeeper (in the future), HDFS, HBase, Trino, Spark, Druid (#572).
  • hdfs: bump topology-provider to 0.3.0 (#579).
  • ubi8-rust-builder: bump rust toolchain to 1.76.0 ([#584]).
  • opa: bump bundle builder to version 1.1.1 (#585).

Removed

  • airflow: Remove support for 2.6.1 (#562).
  • hadoop: Remove support for version 3.2.2 and 3.2.4 (this ends the 3.2 line) (#540, #571).
  • hbase: Remove support for version 2.4.12 (#567).
  • kafka: Remove support for version 2.8.2, 3.4.0, 3.5.1 (#559).
  • opa: Remove support for version 0.51.0 (#547).
  • spark: Remove support for version 3.4.0, 3.4.0-java17 (#560).
  • superset: Remove support for version 2.1.0 (#563).
  • zookeeper: Remove support for version 3.8.1 (#551).

[23.11.0] - 2023-11-30

Added

  • hadoop: Added Stackable topology provider jar to enable k8s-based rack awareness (#509)

  • hadoop: Add all necessary components to the image to mount HDFS using FUSE (#400)

  • hbase: Add hbase-operator-tools (#497, #498).

  • java-base: Add needed tzdata-java package (#425).

  • testing-tools: Add java, tzdata-java, unzip (#464, #465, #466).

  • airflow: added support for 2.6.3, 2.7.2 (#477).

  • druid: added support for 27.0.0 (#485).

  • hadoop: added support for 3.2.4, 3.3.6 (#478).

  • hbase: added new version 2.4.17 (#494).

  • hbase: use jmx-exporter 0.20.0 (#494).

  • hbase: added hadoop native compression (#494).

  • hive: added upload new version script (#472).

  • hive: Update postgresql driver in Hive metastore 3.1.3 to 42.6.0 (#505).

  • kafka: add support for versions 3.4.1, 3.5.1 (#476).

  • nifi: added support for version 1.23.2 (#473).

  • opa: add version 0.57.0 (#471).

  • opa: add new version upload script (#471).

  • spark: added versions 3.4.1, 3.5.0 (#475).

  • superset: add new version 2.1.1, 3.0.1 (#482, #489).

  • superset: add tzdata library as ubi-minimal has removed it (#499).

  • trino: removed support for versions 428 (#487).

  • zookeeper: add version 3.8.3 (#470).

  • zookeeper: add upload script (#470).

Changed

  • Extract image tools their own repository (#437)

  • Bump ubi8-rust-builder toolchain to 1.71.0 (#419).

  • BREAKING: Upgrade Vector in all product images to version 0.33.0. The integration tests of the operators must be adapted because the metric processedEventsTotal was replaced by receivedEventsTotal (#429, #479).

  • BREAKING: Use RPM instead of tar.gz for Vector. Because of that, the location of the Vector executable changed, and the operator-rs version 0.45.0 or newer is required (#429).

  • spark-k8s: Rework spark images to build on top of java-base image. This fixes the missing tzdata-java package in 0.0.0-dev versions (#434).

  • airflow: Updated git-sync to 3.6.8 (#431).

  • airflow: Updated statsd-exporter to 0.24, this was accidentally moved to a very old version previously (0.3.0) (#431).

  • airflow: Added wrapper script to allow the triggering of pre/post hook actions (#435).

  • hadoop: bumped jmx-exporter version to 0.20.0 (#478).

  • hbase: added soft link for jmx-exporter (#494).

  • hbase: rename jmx_exporter configs to match rolenames in operators (#494).

  • hive: bump jmx-exporter to 0.20.0 (#472).

  • spark: bump jmx-exporter to 0.20.0 and access via softlink (#475).

  • superset: removed patches that are obsolete since 2.0.0 (#482).

  • superset: bump statsd_exporter to 0.24.0 and set via conf.py (#482).

  • trino: using new OPA authorizer from https://github.com/bloomberg/trino/tree/add-open-policy-agent for version 428 (#487).

  • zookeeper: bumped jmx-exporter version to 0.20.0 (#470).

Removed

  • airflow: Remove unused environment variable AIRFLOW_UID (#429).

  • java-base: Remove hard-coded JVM security properties containing DNS cache settings. Going forward operators will configure DNS cache settings (#433)

  • pyspark-k8s: The PySpark image has been removed completely. Python is now installed with the Spark image (#436)

  • Removed all product specific changelogs and updated the root file (#440)

  • airflow: removed support for 2.2.3, 2.2.4, 2.2.5, 2.4.1 (#477).

  • druid: removed support for 0.23.0, 24.0.0 (#485).

  • hadoop: removed support for 3.3.1, 3.3.3 (#478).

  • hive: remove version 2.3.9 (#472).

  • kafka: removed support for versions 2.7.1, 3.1.0, 3.2.0, 3.3.1 (#476).

  • nifi: removed support for version 1.15.x, 1.16.x, 1.18.x, 1.20.x (#473).

  • nifi: removed openssl from image (#473).

  • opa: removed versions 0.27.1, 0.28.0, 0.37.2, 0.41.0, 0.45.0 (#471).

  • spark: removed versions 3.2.1, 3.3.0 versions (#475).

  • superset: removed versions 1.3.2, 1.4.1, 1.4.2, 1.5.1, 1.5.3, 2.0.1 (#482).

  • trino: removed support for versions 377, 387, 395, 396, 403 (#487).

  • zookeeper: removed versions 3.5.8, 3.6.3, 3.7.0, 3.8.0 (#470).

[23.7.0] - 2023-07-14

Added

  • airflow: Support for version 2.6.1 (#379).
  • druid: Support for version 26.0.0 (#384).
  • hadoop: Add krb5-workstation and openssl packages - needed for Kerberos support (#347).
  • hive: Added jackson-dataformat-xml-2.7.9.jar (2.3.9) and jackson-dataformat-xml-2.12.3.jar (3.1.3) for XmlFormat conversion for logging (#293).
  • nifi: Support for version 1.20.0, 1.21.0 (#365).
  • trino: Add htpasswd tool (#385).
  • trino: [EXPERIMENTAL] Add Snowlift Trino Storage Connector, but only for Trino version 414 (#397)
  • zooKeeper: Support for version 3.8.1 (#381).

Changed

  • nifi: Upgraded to the base image java-base:11-stackable0.3.0. The java-base image contains a layer which provides Vector. The creation of the stackable user and group happens in the stackable-base layer and is therefore removed from this image (#297).
  • opa: Add multilog (daemontools) to opa image (#333).
  • opa: Upgraded to the vector base image (#329).
  • opa: Support for version `0.51.0`` (#382).
  • stackable-base: Update ubi-minimal base image from 8.7@sha256:3e1adcc31c6073d010b8043b070bd089d7bf37ee2c397c110211a6273453433f to registry.access.redhat.com/ubi8/ubi-minimal:8.8@sha256:14b404f4181904fb5edfde1a7a6b03fe1b0bb4dad1f5c02e16f797d5eea8c0cb ([#420]).
  • zookeeper: Make soft link for jmx-exporter e.g. jmx_prometheus_javaagent-<version>.jar -> jmx_prometheus_javaagent.jar (#381).

[23.4.0] - 2023-04-17

Added

  • Package inotify-tools added (#291).
  • Added krb5 image (#338).

Changed

  • Updated all internal images to rebuild their base images on demand (#321).
  • Unpinned testing-tools dependencies (#326).

Removed

  • Tools image (#325).
  • Replace build_product_images.py with the image_tools package and add OpenShift preflight checks for images (#339)

[23.1.0] - 2023-01-23

Added

  • Image vector added which installs Vector and is based on the stackable-base image. (#268).

Changed

  • Updated java base image to latest ubi8 tag 8.6-994 (#249).
  • Updated all java-base images to stackable0.2.2 (#250).
  • Updated all ubi8 base images to latest (8.6-994) (#250).

Removed

  • Retired Java 1.8.0 support (#248).