CHANGELOG

v1.7.15

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Add affinity to jobTemplate #2758 (#2760)
• feat: Implement delete expired index job #2702 (#2722)
• Add QUIC support #1771
• add example-client docker image #2705 (#2709)

♻️ Refactor

• refactor dockerfiles and update gitattributes #2743 (#2745)

🐛 Bugfix

• 🐛 Fix update deps workflow: buf is not found #2737 (#2739)
• [BUGFIX] resolve agent GetGraphStatistics API double-free error problem #2733
• fix rust-analyzer #2731 (#2732)
• Fix installation command for arm64 #2729 (#2730)
• fix not found error #2726 (#2727)
• Fix bind DOCKER_OPTS option #2718 (#2719)

✏️ Document

• Update README.md #2724 (#2725)
• 📝 Remove clj link #2710 (#2714)

💚 CI

• 💚 Multi-PF build for example-client #2713
• Add auto deps version update workflow #2707 (#2717)

⬆️ Update dependencies

• 💚 use ci-container for update deps cron job #2744 (#2748)
• update ubuntu version for devcontainer #2736 (#2750)
• ⬆️ update versions/BUF_VERSION #2703 (#2704)

🤝 Contributor

• docs: add highpon as a contributor for code #2721

v1.7.14

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Add String sorted topologicalSort #2696 #2698
• Add CPU_INFO_FLAGS for Apple Silicon #2694 #2697
• Add New gRPC Options and Add Reconnect Logic for connection Pool #2685 #2693
• Add option to disable dns resolve #2634 #2641
• Backport PR #2584 to release/v1.7 for Implement ngt property get API #2588
• add HTTP2 support for http.Client and Vald HTTP Server #2572 #2575

⚡ Improve performance

• Refactor grpc/status.withDetails function for performance #2664 #2668

♻️ Refactor

• Refactor use Absolute path for Makefile #2673
• Refactor internal/net/grpc/client.go #2675
• modify ParseError to FromError for agent handler #2667 #2679
• Backport PR #2674 to release/v1.7 for Refactor internal/net/grpc/client.go #2675
• Backport PR #2670 to release/v1.7 for Refactor use Absolute path for Makefile #2673
• Refactor grpc/status.withDetails function for performance #2664 #2668
• Refactor for release v1.7.14 #2639 #2648
• refactor(gateway): delete unused file #2644 #2646
• Refactor test checkFunc condition #2599 #2602
• Backport PR #2586 to release/v1.7 for modify rust package structure #2590
• Backport PR #2577 to release/v1.7 for refactor docker and change buildkit-syft-scanner reference to ghcr.io #2578

🐛 Bugfix

• Fix gRPC error handling for gateway/filter handler #2669 #2689
• fix: increase limit #2683 #2686
• Fix gRPC error handling for mirror-gateway handler #2665 #2681
• Fix gRPC error msg handling for lb-gateway handler #2663 #2682
• Bugfix ingress route settings #2636 #2642
• Fix broken links in the document files #2611 #2614
• Fix: make command name #2610 #2612
• Bugfix NGT flush logic #2598 #2606

✏️ Document

• Fix broken links in the document files #2611 #2614

✅ Testing

• Refactor test checkFunc condition #2599 #2602

💚 CI

• Buf CLI migrate to v2 #2691 #2695
• [create-pull-request] automated change #2677 #2678
• automatically generate workflows #2595 #2603

📈 Metrics/Tracing

• Introduce an observability crate using opentelemetry-rust #2535 #2609

Summary by CodeRabbit

• New Features

  • Added several new contributors to the project, enhancing community involvement.
  • Introduced a new configuration file for spell checking, improving documentation quality.
  • Expanded the project with new configuration files, documentation, and source code for enhanced functionality.

• Bug Fixes

  • Updated version information in issue templates for accuracy.

• Documentation

  • Improved clarity in the pull request template and updated version information.

• Chores

  • Modified GitHub Actions for better handling of Docker image tags.

v1.7.13

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

[Bugfix]

• General Fixes

  1. Fix index correction process #2565 (#2566)
  2. libquadmath is not available on ARM #2559
  3. fix: add checkout option #2545 (#2546)
  4. fix: make format #2534 (#2540)
  5. fix conflict bug #2537
  6. Bugfix that caused an error when argument has 3 or more nil arguments #2517 (#2520)
  7. Bugfix recreate benchmark job when operator reboot #2463 (#2464)
  8. Fix agent-faiss build failed #2418 (#2419)
  9. Fix the logic to determine docker image #2410 (#2420)

• Backport and Release-Related

  1. Fix workflow trigger for backport pr creation #2471 (#2472)
  2. Fix output settings to determine-docker-image-tag action and release branch build tag name #2423 (#2425)

• E2E and Index

  1. Fix e2e for read replica and add e2e for index operator #2455 (#2459)
  2. Fix index job logic to pass DNS A record #2438 (#2448)

• Documentation and Other

  1. fix: typo of execution rule #2426 (#2427)
  2. 📝 Fix typo of file name #2413 (#2415)

[Enhancement]

• General Improvements

  1. Update dependencies, C++ standard, and improve Dockerfiles for better build systems and localization #2549 (#2557)
  2. Implement ngt Statistics API #2539 (#2547)
  3. refactor index manager service add index service API to expose index informations #2525 (#2532)

• API and Logic Changes

  1. Change default image tag from latest to nightly #2516 (#2518)
  2. update large top-K ratio handling logic #2509 (#2511)
  3. add inner product distance type for ngt #2454 (#2458)
  4. Implement index operator logic for read replica rotation #2444 (#2456)

• Performance and Optimization

  1. update deps & add validation for Flush API when agent is Read Only #2433 (#2436)
  2. Add index-operator template implementation #2375 (#2424)

• Testing and Metrics

  1. Implement client metrics interceptor for continuous benchmark job #2477 (#2480)
  2. Add tests for index information export #2412 (#2414)

[CI]

1. [create-pull-request] automated change #2552 (#2556)
2. Add workflow to check git conflict for backport PR #2548 (#2550)
3. [CI] Add workflow to synchronize ubuntu base image #2526 (#2527)
4. Automatically add backport main label for release-pr #2473 (#2475)
5. change external docker image reference to ghcr.io registry #2567 (#2568)

[Backport]

1. Backport PR #2542, #2538 to release/v1.7 #2543
2. Backport docs updates to release/v1.7 #2521
3. Backport Flush API #2434

[Documentation]

1. capitalize faq #2512 (#2522)
2. add faiss in values.yaml & valdrelease.yaml #2514 (#2519)
3. add read replica and rotator docs #2497 (#2499)
4. Update continuous benchmark docs #2485 (#2486)
5. docs: add hrichiksite as a contributor for doc #2441 (#2442)

[Other]

1. Add base of benchmark operator dashboard #2430 (#2453)
2. Add client metrics panels for continuous benchmark job #2481 (#2483)
3. Add unit tests for index operator #2460 (#2461)
4. add reviewer guideline #2507 (#2508)
5. Sync release/v1.7 to main #2495
6. Add snapshot timestamp annotations to read replica agent #2428 (#2443)
7. Update build rule for nightly image #2421 (#2422)

v1.7.12

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Add rotate-all option to rotator #2305 #2393
• Make agent export index metrics to Pod k8s resource #2319 #2372

♻️ Refactor

• Delete unnecessary code for mirror #2366 #2391

🐛 Bugfix

• Resolve kvs already closed before last saving #2390 #2394

✏️ Document

• Create continous benchmark doc #2352 #2395

✅ Testing

• Fix: build error of internal kvs test #2396 #2398

💚 CI

• Fix: disable protobuf dispatch for client #2401 #2403
• Add Con-Bench helm chart to the Vald charts #2388 #2389
• Update workflow to release readreplica chart #2383 #2387
• Backport ci deps others #2386
• Update docker build target platform selection rules #2370 #2374
• Add commit hash build image #2359 #2371
• Refactor code using golangci-lint #2362 #2365
• Change docker scan timeout longer #2363 #2364

⬆️ Update dependencies

• Update deps #2404 #2405

🔒 Security

• Create SECURITY.md #2367 #2368

🎨 Design

• Change JP logo to EN logo #2369 #2392

v1.7.11

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Add HPA for read replica #2307
• Add internal KVS pogreb package #2302
• Two version deploy support #2171
• Add mirror gateway definitions and Implementations #2262
• Initialize dev env for Rust agent #2293
• Add new grafana dashboard for agent memory metrics #2279
• Implement continuous benchmark tool #2216

♻️ Refactor

• Add newline between params to avoid false formatting #2347
• Fix golangci-lint config and apply tagalign #2326
• Refactor postAttachCommand #2312
• Refactor ignore rule #2339
• Fix NGT default params #2332
• Format yaml using google/yamlfmt & update go version and dependencies #2322
• Refactor update opentelemetry-go & faiss #2303
• Change discoverer client to broadcast to read replicas #2276
• Add stern and telepresence #2320
• Add issue metrics #2308
• Add dispatch workflow for update contents of vdaas/web repo #2294
• Fix: add release build for bench and mirror #2300
• Fix deeepsource errors #2299
• Add go cache for improvement docker build performance #2297
• Add detailed log for readreplica rotator #2281
• Add isSymlink function and test to gen license to avoid for symlink to become normal file. #2290
• Add owner reference to the resources made by rotator to delete them when read replica resources are deleted #2287
• Make vald-readreplica values.yaml to symbolic link #2286
• Separate readreplica chart #2283
• Happy New Year 2024 #2284

🐛 Bugfix

• Fix: disable arm64 #2354
• gcc environment for ARM #2334
• Revert dev Dockerfile to use official devcontainer image #2335
• Revert docker-image.yaml change #2336
• Fix release pr workflow #2333
• Fix e2e regressions #2327
• Bugfix grpc ip direct connection status check #2316
• Fix k3d connectivity error #2317
• Change lincense/gen/main.go to skip shebang #2313
• Stop using ENV ARCH and add –platform in Dockerfile #2304
• gRPC pool connection health check for DNS Addr may fail during VIP member disconnection #2277
• Fix isSymlink function to correctly check for symbolic links #2292
• Disable disconnection during non-IP-direct connection #2291
• Fix git add chart directory for release #2356

✏️ Document

• Add search optimization document #2306
• Update capacity planning doc #2295

💚 CI

• Change to dynamically switch CI container image tag #2310
• Add E2E tests for read replica feature #2298
• CI, Docker EXTRA_ARGS not working problem #2278

v1.7.10

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Implement malloc metrics #2161
• Add svc discoverer for readreplica svc #2263
• Add agent readreplica resources #2258
• Add cronjob for readreplica rotator #2242

♻️ Refactor

• Apply make proto/all #2266
• Migratation to buf #2236
• Update schema #2265

🐛 Bugfix

• Resolve duplicated cluster wide resources name problem #2274

✏️ Document

• Add caution sentence for deploy multi-Vald clusters #2271

💚 CI

• Disable BUILDKIT_INLINE_CACHE on GitHub Actions #2270
• Fix docker build for scanning #2269
• change login user and token for ghcr.io & small refactor #2268
• Add e2e job for index management job #2239
• Add docker buildx cache #2261

v1.7.9

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Add read replica rotator #2241
• Implement manifests for Index Management Job #2235
• Add job error to report index correction error status #2231
• Add implementation for save index job #2227
• Add implementation for create index job #2223
• Add index correction metrics #2215
• Add index correction document #2217
• Add make command to update template #2212
• Add job to check format difference #2214
• Add verification for index correction e2e and add clusterrole cronjobs for operator to deploy index correction #2205
• Add StreamListObject to LB #2203
• Add index correction helm templates and E2E #2200
• Add index correction internal logic #2194
• Add bbolt as internal/db/kvs #2177

⚡ Improve performance

• Improve index correction performance #2234

♻️ Refactor

• Refactor Index Management Job #2232
• Fix invalid network policy schema #2230
• Add minikube to create volume snapshot development environment locally #2228
• Enable ingress resource in the get started document #2211
• Add step to get k3s latest version #2206
• Update telepresence and helm-docs installer and update deps #2195
• Replace x/slices with standard slices pkg #2193
• add benchmark and check program for core ngt #2179

🐛 Bugfix

• Revert vtpool for ResourceExhausted problem #2255
• Fix deleted contour ingress controller apply #2229

✏️ Document

• Add document for RemoveByTimestamp RPC #2238

💚 CI

• Disable exhaustruct #2240
• Fix fails when there are format differences #2226

⬆️ Update dependencies

• update deps #2208
• update dependencies #2260

v1.7.8

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

♻️ Refactor

• change default creation poolsize #2190
• List kvs and vqueue data #2188
• refactor semver ci #2189

v1.7.7

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Add CopyBuffer to copy.go #2167
• Add Vald standard internal/sync package #2153
• Add RemoveByTimestamp RPC #2158
• Implement StreamListObject and its tests #2145
• Add apiversion capabilities check to helm template #2137
• Add timestamp field to Object.Vector #2136
• Add gache’s generic Map as internal/sync.Map and replace standard sync.Map with it #2115
• Make internal/cache generic #2104
• Install additional tools for docker image for devcontainer #2101
• Install buf and apply buf format #2094
• Add backup origin when CoW enabled and failed to load primary #2091
• Add decode kvsdb tool #2059
• Add user custom network policy #2078

♻️ Refactor

• Refactor agent ngt core. #2172
• Refactor proto #2173
• Refactor search status #2168
• Refactor internal/core/algorithm/ngt mutex lock timing #2144
• Refactor github actions #2141
• Update license text #2169
• Refactor agent error not to wrap with details for performance issue #2154
• Use internal comparator instead of go-cmp #2132
• Refactor context #2121
• Propagate context to Search operation. #2117
• Refactor fix url http to https #2090
• Update “make gotests/gen” command #2085

🐛 Bugfix

• Fix duplicate make command #2165
• Add timestamp check for GetObject e2e #2142
• Modified apiversion capabilities check #2149
• Fix ngt index path of test case #2130
• Fix hack/benchmark search interface change #2129
• Fix internal/gache definition variable type #2123
• Use GOBIN instead of GOPATH/bin #2102
• Fix jaeger operator wait logic #2114
• Fix make k8s/metrics/jaeger/deploy failure #2077
• Bugfix Makefile KUBECONFIG recursive reference #2089
• Fix deploy command #2088
• Fix non-trusted module problem of v1.7.6 and disable not found debug message #2076
• Bugfix lb gateway pacicked caused by pairing heap search aggregator makes nil pointer when empty search result #2181

✏️ Document

• Update testing guideline for updated testing policy #2131
• Add troubleshooting for each rpc #2163
• Fix format network policy document #2108
• Add broken index backup document #2096
• Add network policy document #2095
• Fix 404 URL link #2098
• Update observability document #2086
• Fix typo of contribution guide #2087
• Update docs: search API and client API config #2081

✅ Testing

• Re-Generate test codes #2107
• Update golangci-lint configuration: use white-list configuration pattern #2106

💚 CI

• Fix coverage CI error #2150
• Remove some linters to make ci faster #2116

📈 Metrics/Tracing

• Divide latency of CreateIndex and SaveIndex metrics #2099
• Add broken index count metrics #2083

⬆️ Update dependencies

• Update go modules #2092

🎨 Design

• Modified svg images #2178

v1.7.6

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

⚠️ ⚠️ ⚠️ Warning ⚠️ ⚠️ ⚠️

• v1.7.6 does not support vald-agent-sidecar for some reason.
• You can use the vald-agent-sidecar by setting the vald-agent-ngt image tag as v1.7.5 or earlier.
• We will support vald-agent-sidecar in the future version again.

✨ New feature

• Add search algorithm benchmark and update search aggregation algo #2044
• Add broken index backup #2034
• Add network policy #2022

♻️ Refactor

• Add save index operation log #2048
• Added flg that can disable to ingress defaultBackend #1976
• Refactor and Add test for service/ngt.go #2040
• Add e2e envs to devcontainer #2032
• Update RoundTrip retry condition #2033

🐛 Bugfix

• Fix fp16 problems #2049
• Add KUBECTL_VERSION value to workflow #2052
• Remove sudo from kubectl and small refactor around os/arch #2037
• Disable vtproto pooling due to the performance degradation #2063
• Fix to create index_path when it does not exists #2060

✏️ Document

• Add documentation for devcontiner #2042
• Create README for each docker image #2014

💚 CI

• Disable deepsource TestCoverage due to the Deepsource Coverage collect server timeout is too short for Vald testing #2038
• Update Docker Build workflow with forked sources #2036
• Fix e2e-max-dim test #2028
• Fix E2E actions on PR #2025
• Change E2E actions to use local charts on PR #2024
• Update format chatops #2021
• Format code with prettier and gofumpt #2015

📈 Metrics/Tracing

• Add command to deploy monitoring stack #2030
• Fixed duplicate counting in CPU graphs #2019

⬆️ Update dependencies

• Update go modules #2053
• Update NGT version #2026

🤝 Contributor

• Add takuyaymd as a contributor for maintenance #2020

v1.7.5

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New features

• Add index with timestamp #1984

♻️ Refactor

• Improve errors.Join performance #2010
• Refactor error returning timing of doSearch function #1996
• Refactor makefile for non GOPATH strict environment #2 #1998
• Refactor makefile for non GOPATH strict environment #1997

🐛 Bugfix

• Correction of a bug that returned NotFound as success 0 when balancedUpdate is disabled and all ReplicaAgents are AlreadyExists (already have the exact same Index). #2011
• Refactor replace errors wrap with join #2001
• Remove nvimlog #1994

💚 CI

• Fix chatops format workflow #2007
• Fix incorrect error output of gen-test chatopts command #2004
• Fix Makefile bug and update deps for checking bugfix #2002
• Output error to chatops comment #1999
• Fix ChatOpts /gen-test command error #1993

✏️ Document

• Update unit test guideline for unimplemented test #1983

✅ Testing

• Implement generic function tests #2008
• Generate empty test using /gen-test ChatOpts command #2005
• Update internal/info test and add new case for coverage #2003

⬆️ Update dependencies

• Update go module and libs #2012

🤝 Contributor

• Add ykadowak as a contributor for code, and test #2009

v1.7.4

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

🐛 Bug fix

• Fix range concurrency branch rule #1986
• Update makefile for “not implemented” placeholder #1967
• Non-gRPC style error parse result returns Unknown status, it should be re-parse to find inside status #1981
• Enable gorules #1980
• Format code with prettier and gofumpt #1971

📝 Document

• Fix documentation typo disable_balanced_update #1978

🤝 Contributor

• docs: add junsei-ando as a contributor for doc #1979

v1.7.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New feature

• Add disable balanced update features & use generic type for BidirectionalStream #1964

🐛 Bug fix

• Fix grafana dashboard query for backoff retry count #1961

♻️ Refactor

• Refactor conv.go #1968

📝 Document

• Add new API parameter and update observability docs #1966

⬆️ Dependency update

• Update deps #1969

v1.7.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

🐛 Bug fix

• Vald gRPC Client and Pool logic makes huge backoff #1953
• Missing backoff metrics #1958

♻️ Refactor

• Update test template to exclude deepsource warning #1954

✅ Test

• Remove non-implemented test #1952

v1.7.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

🐛 Bugfix

• [bugfix] add target length validation for each gRPC client exection method #1939

♻️ Refactor

• update gRPC status code for API docs #1943
• Refactor: Add t.Helper() on test helper function #1935
• Fix syntax error on dump context workflow #1936
• format codes #1934

v1.7.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New Feature

• Introduce OTLP for metrics and trace #1824
• Add manifest to deploy opentelemetry-operator #1819

⬆️ Dependencies update

• Update go modules and go version #1922
• Update go modules #1904

🐛 Bug fix

• Divide agent errors for QBG and Faiss implementation #1924
• Bugfix status handling for idle connection #1921
• Fix invalid character error #1914
• Fixed duplicate counts of working_memory_set_bytes #1911
• Bug fix using undefined a variable at maxDimensionTest #1856
• Bug fix prometheus export return value #1817

♻️ Refactor

• Happy New Year 2023 #1918
• Add auto-update libs & deps make command #1917
• Add canceled status for CreateIndex API #1892
• Update concurrent cancellation group name #1912
• Remove blank when all parameters are not used and Add ErrJobFuncNotFound #1879
• Rename doXXX() #1878
• Remove deprecated functional option (internal/net/grpc) #1877
• Fix deepsource: RVV-B0001 Confusing naming of struct fields or methods #1875
• Fix deepsource: VET-V0008 lock erroneously passed by value internal/net test #1874
• Fix deepsource: RVV-B0001 confusing naming of struct fields or methods #1844
• Fix deepsource: SCC-U1000 Unused code #1873
• Fix deepsource: RVV-B0006 Method modifies receiver #1872
• Fix deepsource: SCC-SA4006 Value assigned to a variable is never read before being overwritten #1871
• Fix deepsource: VET-V0008 Lock erroneously passed by value (pkg/agent) #1868
• Fix deepsource: VET-V0008 lock erroneously passed by value internal/info test #1869
• Fix deepsource: DOK-W1001 found consecutive run command #1870
• Fix deepsource: VET-V0008 lock erroneously passed by value (internal/net) #1867
• Fix deepsource: CRT-D0001 append possibly assigns to a wrong variable #1866
• Fix deepsource: VET-V0008 Lock erroneously passed by value (pkg/manager) #1861
• Fix deepsource: VET-V0008 lock erroneously passed by value pkg/discoverer #1857
• Fix deepsource: RVV-B0006 Method modifies receiver #1865
• Fix deepsource: VET-V0008 Lock erroneously passed by value (internal/test, singleflight, observability) #1863
• Fix deepsource: VET-V0008 lock erroneously passed by value info #1864
• Fix deepsource: VET-V0008 Lock erroneously passed by value internal/client #1862
• Fix deepsource: VET-V0008 lock erroneously passed by value internal/info,iocopy,errgroup #1860
• Fix deepsource: VET-V0008 Lock erroneously passed by value internal/db, backoff, circuitbreaker #1859
• Fix deepsource: RVV-B0009 Redefinition of builtin #1858
• Fix deepsource: CRT-A0014 switch single case can be rewritten as if or if-else #1855
• Fix deepsource: RVV-A0003 Exit inside non-main function ./hack #1854
• Fix deepsource: SCC-S1003 replace call to strings.Index with strings.Contains #1853
• Fix deepsource: RVV-B0013 Unused method receiver #1852
• Fix deepsource: CRT-D0007 Duplicate cases found in switch statement #1851
• Fix deepsource: GO-W1009 using a deprecated function, variable, constant or field #1846
• Fix deepsource: RVV-B0011 exported function returning value of unexported type #1848
• Fix deepsource: GSC-G103 Function call made to an unsafe package #1850
• Fix deepsource: RVV-B0012 Unused parameter in the function
• Fix deepsource: DOK-SC2002, DOK-W1001 Useless cat and Multiple consecutive RUN #1847
• Fix deepsource: dockerfile warning #1835
• Fix deepsource RVV-B0013 #1832
• Fix deepsource VET-V0007 unkeyed composite literals #1837
• Fix deepsource: Audit required: Insecure gRPC server #1833
• Fix deepsource: Potential slowloris attack #1834
• Fix deepsource: Unsafe defer of os.Close #1836
• Fix deepsource: RVV-A0003 exit inside non-main function #1838
• Fix deepsource: GSC-G404 Audit the random number generation source (rand) #1839
• Fix makefile #1828
• Refactor circuitbreaker #1816

✅ Test

• Refactor Insert Upsert Testing #1919

💚 CI

• Ci/GitHub action docker/update docker login action #1903
• Add actions workflow validation #1902
• Change docker build permission #1901
• Update docker login action #1900
• Format code with prettier and gofumpt #1886
• Update deepsource configuration #1881
• Update gotestfmt org #1880
• Add escape for e2e workflow #1845
• Resolve GitHub Actions warning #1818

📝 Document

• Create observability configuration document #1882
• Add takuyaymd as a contributor for bug, and code #1913
• Update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE #1885
• Fix typo comment #1831
• Add filter gateway api doc #1821
• Fix dead link #1823
• Update pull request template #1820

v1.6.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

🐛 Bugfix

• Bugfix Circuit Breaker half-open error handling #1811

📝 Document fix

• Fix dead link #1807

⬆️ Dependencies

• Update go modules and add small test for strings #1812

v1.6.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

🐛 Bugfix

• Bugfix success handling in the half-open and add flow control #1805
• Fix string concat buffer overflow #1806

✅ Test

• Implement pkg/agent/handler createAndSaveIndex test case #1794

📝 Document

• Add cluster role document #1796
• Fix document format #1804

v1.6.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

🐛 Bugfix

• fix metrics bug #1800

✅ Test

• Add test for attributesFromError method #1801

v1.6.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

Description:

✨ New feature

• Introduce opentelemetry #1778
• Change opencensus tracing to opentelemetry tracing #1767
• Add circuit breaker implementation #1738

⬆️ Dependency update

• Deleted deprecated dependency for OTEL #1795
• Delete stackdriver dependencies #1761

🐛 Bug fix

• Fix fossa workflow bug #1787
• Fix failed github workflow #1745
• Add safe directory configuration #1748

♻️ Refactor

• Refactor internal package (net, file, logger) #1768
• ♻️ Set default image tag as latest #1766
• Upgrade ubuntu version #1743
• Deleted vald_ prefix of dashboard #1785
• Use gotestfmt instead of tparse #1788

✅ Test

• Implement agent handler saveIndex test case #1731
• Ignore gorules test #1790
• Fix chaos test #1757
• Implement agent handler createIndex test case #1710
• Implement agent handler indexInfo test case #1708

📝 Document

• Update testing guideline & template #1791
• Add Client API Config document #1783
• Add backup configuration document #1754
• Add upgrade document #1777
• Update document by feedback #1773
• Add filter config document #1755
• Add deployment document #1758
• Update the images of agent page #1753
• Update config document #1751

v1.5.6

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ Feature

• Add distance type #1732
• Add vald-helm-operator E2E #1722

⬆️ update dependencies

• Delete tensorflow #1723
• Update deps #1724

✏️ Documents

• Add capacity planning document #1714
• Update filter gateway document #1721
• Fix capacity planning doc #1736
• Fix file name of capacity planning document #1737

v1.5.5

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

♻️ Refactor

• Make format #1717
• Remove unnecessary import path on pkg test #1712
• Fix to get only backoff metrics of discover RPC #1706

🐛 Bugfix

• Return uuid when exits rpc called #1709

✏️ Documents

• Add textlint for document #1715
• Modified design of troubleshooting image #1705
• Update tutorial images #1704
• Add troubleshooting flow chart document #1688
• Update data-flow docs for new images and using remove instead of delete #1693

✅ Test

• Implement agent handler getObject test case #1707
• Implement stream insert test case #1697
• Implement upsert test cases #1685

⬆️ Update dependencies

• Update deps #1719
• Update deps #1702
• Automatically update k8s manifests #1701

v1.5.4

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New features

• Add backoff metrics panel #1694
• Add backoff metrics for grpc #1684
• Setup jaeger operator #1682

⬆️ update dependencies

• Update deps #1695
• Update deps #1699

♻️ Refactor

• Split agent pkg handler implementation #1690
• Refactor pkg test helper functions #1678

🐛 Bugfix

• Fix error handling in readyForUpdate and return NotFound error when delete fails in multiUpdate #1681
• Fix race error of server package #1689

✏️ Documents

• Add API status code description #1679
• Modified data flow images #1687
• Correspond to update omission #1686
• Renew basic architecture image #1680

v1.5.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ Feature

• add invalid id argument handling #1667

🐛 Bugfix

• fix update bug #1660
• fix typo argument in Makefile and Makefile.d/function.mk #1673

💚 CI

• fix chaos test temporarily #1665

📝 Document

• add search config details document #1661

✅ Test

• implement pkg handler exists test cases #1628
• implement multi insert test case for pkg agent handler #1612
• create investigation test of max dim for NGT #1633
• implement pkg handler remove test cases #1644
• add e2e test for maxDimensionTest #1650
• implement update handler test cases #1657

⬆️ Update dependencies

• update manifests version #1642
• update go module #1643
• fix go tool installation #1649
• update kind version #1668

🎨 Design

• update dataflow image #1647

🔒 Security

• fix CWE-285 #1654

v1.5.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

⬆️ update dependencies

• update libs version (#1636)
• update libs version (#1632)

✨ feature

• use ReadWriteOncePod instead of ReadWriteOnce and remove initializer (#1627)

♻️ refactor

• refactor: improve memory high usage of vald-agent (#1617)

🔒 security

• security: fix vulnerability problem of helm operator (#1625)
• [Security] Fix vulnerability problem of helm operator (#1611)
• security fix Vulnerability due to usage of old golang.org/x:net in example depentency (#1641)

💚 ci

• ci: Fix CodeQL warning (#1629)
• fix fails actions job & update version (#1620)
• [CI] Allow e2e deploy action jobs to run in parallel (#1616)

✅ test

• fix superfluous response.WriteHeader call (#1631)
• implement search-by-id pkg test (#1624)

📝 document

• document: update formats (#1634)
• docs: add dotdc as a contributor for doc (#1623)
• doc: fixed architecture link in get-started.md (#1619)
• add FAQ and Troubleshooting document (#1591)

v1.5.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

⬆️ update dependencies

• Upgrade pyroscope version (#1605)

🐛 bugfix

• bugfix internal/file and add CreateTemp function and resolve go module failure (#1608)

✅ Test

• fix search handler test (#1613)
• fix fails test of e2e chaos (#1603)
• Implement pkg ngt handler insert test (#1552)
• implement agent ngt handler search test (#1557)

📝 document

• add vald users (#1601)
• update brand guidelines pdf (#1600)
• fix file name of search api (#1599)
• [ImgBot] Optimize images (#1598)
• cleanup document images (#1595)

v1.5.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New features

• Add values yaml for the back up the agent index data (#1566)
• Implement uniform/gaussian distributed random float32/uint8 vector generator (#1573)
• Add min_num in each search service api (#1576)
• Add copy on write (#1578)
• Add example values for using Pyroscope (#1582)

♻️ Refactor

• Deleted resource limits of agent ngt and added in memory mode example (#1571)
• Improve string conversion performace (#1577)
• Update dependencies version (#1593)

✏️ Documents

• Add gateway component overview document (#1549)
• Update API docs and fix format (#1568)
• Update dataflow images (#1572)
• Add discoverer component overview document (#1574)
• Add index manager component overview document (#1575)
• Update README (#1584)

🐛 Bugfix

• Add error handling when there is no data in google cloud storage. (#1556)
• Reviewdog markdown workflow (#1585)
• Fix invalid URL (#1589)

✅ Test

• Implement test for net/grpc codec,logger and server (#1530)
• Update test for go1.17 update & -race test (#1431)

v1.4.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [bugfix] fix miss param for fp16 (#1563)
• [bugfix] add missing empty dir mount for s3 backup without pvs (#1562)

v1.4.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New features

• Add agent minnum field and support fp16 (#1558)
• Add pyroscope manifest running on persistent volume (#1551)
• Add settings for profiling with pyroscope (#1539)
• Add pyroscope manifest (#1520)
• Add linear search handler for gateway-lb / ingress-filter / agent-core-ngt (#1511)
• Add grpc custom codec (#1490)
• Update grpc codes (#1489)
• Add NGT linear search API (#1504)

♻️ Refactor

• Delete unsupported library sptag (#1559)
• Improved search operation (#1546)
• Add description timeout of search config (#1541)
• Update dependencies version (#1538)
• Happy new year (#1525)
• Update libs version (#1524)
• Add the missing go.sum (#1517)
• Update license headers / Format codes (#1514)
• Add .gitattributes (#1512)
• Update get started with using kubernetes ingress (#1510)
• Fix command template (#1508)
• Update dependencies version (#1501)
• modify .pb.go & swagger (#1493)
• Add reshape vector proto, remove meta/backup proto (#1492)

✏️ Documents

• Add agent component overview document (#1544)
• Add build api proto document (#1540)
• Add remove/object api document (#1536)
• Add search api document (#1534)
• Add upsert api document (#1533)
• Add update api document (#1529)
• Add insert api document (#1516)

🐛 Bugfix

• Fix vulnerability problem of helm-operator (#1535)

✅ Test

• Implement internal/net/grpc metrics & proto & types test (#1507)
• Implement and modify internal/io tests (#1509)
• Implement internal/net net.go&dialer.go test (#1505)
• Implement internal/net/grpc/credentials and health test (#1502)
• Implement internal/net/control test (#1500)
• Remove unsupported feature from public document (#1497)

🎉 Cellebration!

• Add liusy182 as a contributor for example (#1519)
• Add zchee as a contributor for a11y (#1513)

v1.3.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Add documentation comments to proto files (#1452)
• Add ngt index count panel to agent grafana dashboard (#1483)
• add grpc keepalive EnforcementPolicy support (#1487)
• fix timing of removeInvalidIndex (#1481)
• [bugfix] add validation to agent service option InitialDelayMaxDuration (#1482)

v1.3.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add startupProbe support (#1473)
• add label / field selectors for discoverer (#1472)

v1.2.4

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update go patch version (#1464)
• [bugfix] sidecar e2e testing (#1465)
• update dependencies version including NGT (#1461)
• fix unlimited gorountine processing in kvsdb (#1458)
• Refactor hack pkg agent e2e benchmark (#1430)
• Remove non-exist components from doc and ci (#1450)
• ♻️ 📝 add default_pool_size in example yml (#1457)
• reduce memory usage around ngt implementation & refactor agent/lb & auto-generate unit test (#1449)
• Remove rinx from several yamls (#1451)
• Add E2E scenario with SkipStrictExistCheck enabled (#1415)
• fix filter-gateway chart (#1454)
• Implement pkg/agent/core/ngt/service/option test (#1429)

v1.2.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update go module dependencies & update go patch version to 1.17.1 (#1445)
• [bugfix] fix unknown status problems in search operation (#1439)
• Add tools.mk for installing CI tools (#1442)
• Fix icon image path in Chart.yaml (#1441)
• fix(Makefile): 🐛 Remove components (#1440)
• Change golangci-lint version to the latest and Fix docker build error (#1435)
• Fix golangci-lint rule (#1380)
• Add vqueue test for Exists and GetVector method (#1425)

v1.2.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Add stateful PBT for NGT service (#1384)
• add default logger when logger not initialized (#1424)
• feat: ✨ Add LB gateway dashboard (#1420)
• chore-deps: ⬆️ Upgrade OSDK to v1.11.0 (#1422)
• change default epsilon value to 0.1 from 0.0.1 (#1421)
• add go vet for checking cpu compatibility and update deps and refactor small code (#1418)
• Delete insert and delete channel of vqueue (#1400)
• downgrade cloud.google.com/go to resolve runtime panic (#1413)
• [bugfix] resolve errgroup limitation channel close panic (#1412)
• Update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#1409)
• update go version to 1.17 and update go module dependencies (#1404)
• refactor grpc logging and use os.PathSeparator instead of / (#1405)
• Remove schema of security contexts (#1406)
• change security context uid to distroless nonroot uid (#1402)

v1.2.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• remove global errgroup from kvsdb goroutine limitation (#1398)
• add google grpc healthz & logger (#1394)
• fix e2e multi apis test code (#1397)
• 📝 fix command in vald agent standalone on docker (#1393)
• add Makefile & Makefile.d to build kick rule (#1391)
• format codes (#1389)
• [proposal] add golines as vald default formatter (#1337)
• replace gogo protobuf to vt protobuf (#1378)
• refactor gateway request result location aggregation logic & use xxh3 for kvsdb hashing (#1376)
• Add E2E tests for multi-APIs (#1353)
• Add test for the function to get length of vqueue (#1382)
• remove unused path of format/yaml command (#1383)
• [Documentation] fix image filename (#1377)
• Vald moves to a vector search engine that enables more simple and high-speed retrieval. This is the first step of Simple-Vald. (#1365)
• Add e2e-profiling job (#1356)
• fix svg error on dataflow image (#1375)
• remove invalid gateway component reference from chart.NOTES (#1371)

v1.2.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

Release Vald v1.2.0

Changes:

• fix build failure on arm cpu due to the xxh3 dependency version (#1368)
• Add core algorithm ngt test (#1364)
• add mote accurate directory detection logic for removing (#1366)
• remove meta backup compressor from charts (#1334)
• update go module version (#1363)
• Update architecture overview (#1304)
• Improve internal package tests (#1227)
• fix bug of bulkinsert when error occurs and refactor error message (#1361)
• change initial-index-directory removal logic (#1359)
• ci: 👷 Add gnupg to ci-container (#1362)
• ci: 👷 add condition to trigger importing gpg key (#1360)
• fix: 🐛 Fix mount paths when using persistent volume claim template (#1358)
• ci: 👷 Add Upsert operation tests (#1347)
• config: ⚙️ Use GPG key for signing commits (#1351)
• add time validation for vqueue (#1352)
• chore-deps: ⬆️ Upgrade tools (#1355)
• comment out backup/meta/compressor build command in Makefile (#1346)
• remove: ➖ Remove backup, meta components from CI (#1331)
• add line trace logging when log mode is glg and level is debug (#1348)
• update go version to 1.16.6 and update go module dependencies (#1345)
• [bugfix] agent createindex operation’s time.Ticker purges too slow & buffer overflow due to the unnecessary error wrapping (#1343)
• [bugfix] change kvsdb and vqueue check order for Exists operation (#1341)
• update go module dependencies (#1336)
• bugfix nil pointer panic in agent’s MultiUpsert operation (#1335)
• [bugfix] agent.GetObject API returns old indexed vector problem instead of vqueue’s new data (#1333)
• add timestamp handler for agent timestamp controlled update (#1324)
• fix: 🐛 Fix typo (#1330)
• remove owner and description info from resource info rich error for each grpc handler (#1327)
• Update documents: configurations (#1289

v1.1.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix remove api return wrong error of non exsiting replicas (#1318)
• update go modules and update go version to 1.16.5 from 1.16.4 (#1306)
• Implement test for internal/core/alogrithm/ngt/option and refactor (#1251)
• fix build error due to e2e benchmark invalid creating new client (#1221)
• bugfix correct error backoff handling for lb gateway (#1309)
• Apply ruleguard fixes (#1302)
• Add ruleguard rules (#1301)
• bugfix add feature vector duplication checking for LB-GW Upsert operation. (#1303)
• fix fails race condition test (#1299)
• Update dashboards, add operator dashboard and several panels (#1280)
• Add composite actions for E2E tests (#1257)
• add save index wait duration to index-manager for multiple agent index upload delay (#1292)
• Bugfix index count problem of ngt (#1288)
• fix example/helm/values.yaml (#1290)
• Fix time condition of agent & lb gateway (#1285)
• Use gofumpt for format workflow (#1281)
• [bugfix] kvsdb: do not increment the counter if key exists (#1282)
• Revert “🎨 Use gofumpt as a default formatter (#1278)” (#1279)
• 🎨 Use gofumpt as a default formatter (#1278)
• 📝 fix some wrongs (#1274)
• Refactor E2E tests: split operations into a new package (#1220)
• 🐛 Fix the chart: agent-sidecar initContainer mode (#1271)

v1.1.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [patch] release Vald v1.1.1 (#1268)
• fix copy CI error (#1269)
• bugfix nil internal/net/grpc.Client.Reconnect nil pointer fix (#1270)
• Docs/readme/replace architecture overview (#1267)
• format code (#1266)
• 🤖 Update license headers / Format Go codes and YAML files (#1265)
• [bugfix] append timing of vqueue existing map (#1264)
• add resource type infos to grpc error response (#1262)
• 🔧 Fix clusterrole of scylla-cluster member (#1263)
• refactor file I/O & replace io.Copy to vald original faster Copy function (#1261)
• [bugfix] change exists cheking for agent vqueue (#1256)
• 🤖 Update license headers / Format Go codes and YAML files (#1255)
• 🔥 Remove invalid initialization option (#1252)
• add single connection client for agent & vald (#1254)
• bugfix remove unneccessary error return & add gRPC status code handling for backoff (#1253)
• bugfix agent vqueue & refactor tools/deps (#1250)
• Add test for pkg/agent/core/ngt/service/vqueue/option (#1233)
• Add config agent core ngt service kvs test (#1223)
• Fix update-helm-chart workflow (#1249)
• 🤖 Automatically update k8s manifests (#1248)
• Fix path to the yq binary (#1247)

v1.1.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

Feature

• add correct gRPC status and error handling (#1224)
• Add Cloud Storage mode of Agent Sidecar. (#519)
• Add general info metrics package / Add NGT info metrics (#1195)
• improve internal/info implementation (#1177)
• Add saving flag to index.info payload (#1200)
• Fix mysql and cassandra schema definitions in initialize jobs (#1186)
• Remove values-xxx.yaml from Helm packages (#1107)
• Feature/internal net/use netaddr (#1154)
• Add Nop Logger for empty logger message (#1158)
• Remove arm64 build of filter-ingress-tf (#1153)
• add tensorflow filter (#951)
• Add OpenAPIv3 schema to CRDs (#1068)
• PR for review all logging statements (#1052)

Bugfix

• bugfix gateway search result merging process (#1238)
• remove nil check in Error() method in internal/errors (#1185)
• Bug fix of parallel test and goleak (#1231)
• 🚨 Fix linting errors (#1179)
• Fix mutex deadlock when calling error occurred (#1225)
• fix nil pointer panic when err is nil in Is() (#1216)
• Fix typo & missed schema definition (#1156)
• 🔒 Fix validation about zip slip (#1150)
• 🔒 Fix security issue: Add validation about path of extracted file (#1145)
• fix: nil pointer bug when config is nil and refactor variable name (#1139)
• 🐛 Fix gateway service selectors in Helm chart (#1109)
• Bugfix correct error handling for agent apis (#1144)

Document

• separate tutorials into each document and add images (#1230)
• Update Tutotial/Get-Started (#1203)
• Update unit-test-guideline.md (#1213)
• create docs/user-guides/sdks (#1182)
• Fix typo in README. (#1163)

CI/CD

• Upgrade to GitHub-native Dependabot (#1211)
• Use kubectl create/replace for upgrading CRDs (#1199)
• 🔧 Fix scylla deploy task (#1159)

Test Code

• Add config agent core ngt test (#1219)
• implement pkg/agent/core/ngt/router test & refactor router implementation (#1214)
• Implement pkg/agent/core/ngt/handler/grpc/option test (#1215)
• refactor config error handling (#1190)
• Implement pkg/agent/core/ngt/router/option test (#1206)
• Implement safety bench code (#1171)
• create internal/config/redis test (#1147)
• Implement internal/config/transport test (#1172)
• Add internal/config/sidecar test (#1173)
• Add benchmark for internal/timeutil/time.go (#1086)
• Add internal/config/observability unit test (#1155)
• Add test for internal/config/mysql (#1151)
• create internal/config/cassandra test (#1117)
• create test for internal/config/server (#1175)
• Add internal/config/lb test (#1134)
• create internal/config/net test (#1140)
• ✅ create internal/config/meta test (#1133)
• Add internal/config/index test (#1129)
• ✅ create internal/config/backup test (#1132)
• delete internal/config/debug file (#1124)
• create internal/config/grpc test (#1130)
• Add internal/config/discoverer test (#1122)
• Add internal/config/filter.go test (#1125)
• create internal/config/gateway test (#1128)
• Implement internal/info/info.go benchmark (#1093)
• Add internal/config/client.go test (#1121)
• Implement internal/timeutil/location/loc.go benchmark test (#1091)
• ✅ remove unused variable from mysql test (#1120)
• feat: add blob test and comment (#1114)
• create bench code for internal/rand (#1089)
• Add test internal/config/compress.go (#1097)
• create internal/config/backoff test (#1104)
• change params for passing test of internal/backoff (#1108)
• remove unnecessary tests and update test (#1061)
• add internal backoff test (#1085)
• Add internal/core/algorithm/ngt/util.go test (#1066)
• Fix hack/tools/metrics failed builds (#1094)
• make timeouts for e2e and chaos tests longer (#1092)

Dependencies

• update go version to 1.16.4 (#1239)
• ⬆️ Upgrade helm, valdcli, kubelinter and osdk (#1181)
• update codecov version for vulnerability (#1207)

Others

• update go modules (#1242)
• [ImgBot] Optimize images (#1241)
• Update license headers / Format codes (#1212)
• remove ngt version in filter-ingress-tensorflow (#1157)
• remove license from bot config json (#1164)
• improve internal/timeutil/location implementation (#1176)

v1.0.4

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Fix error handling of SearchByID API in lb gateway (#1084)
• Update Agent dashboard (#1069)
• Revise gRPC error statuses and details in meta (Redis/Cassandra) (#1013)
• add remove sample code for tutorial (#1053)
• add grpc reflection (#1064)
• remove vcache for vald agent due to vcache delete timing control failure and time ordered concurrent vector queue called vqueue (#1028)
• refactor discoverer client (#1056)
• bugfix nil pointer no target discovered (#1055)
• Upgrade Operator SDK version to v1.4.2 (#1038)

v1.0.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• fix MySQL panic test (#996)
• Update tutorial to support v1 (#1009)
• remove not supported control flag on darwin (#1025)
• Add strategy section to Docker build workflows (#1024, #1019)
• move internal/net/tcp package to internal/net package and support unix domain socket (#1010)
• Implement internal/info/info test (#862)
• add test for internal/errors/runner (#1007)
• add logo guideline (#973)
• Fix invalid changelogs / update changelog workflows (#1002)
• Add test case for internal/errors/observability.go (#993)

v1.0.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• v1.0.2 Release (#998)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#997)
• Bug fix on StreamGetObject API and DNS cache expiration / refactor net connection (#986)
• Remove base docker image (#995)
• Use namespaced names for priorityclasses of new gateways (#992)
• Add E2E Chaos tests running on GitHub Actions (#899)
• Add zap logger to chart schema (#985)
• add test for internal/errors/runtime (#984)
• add test for internal/errors/tensorflow (#982)
• add test for internal/errors/unit (#979)
• update chatops permission (#990)
• 🤖 Automatically update k8s manifests (#981)

v1.0.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix lb-gateway’s Insert rpc nil pointer panic (#980)
• Implement internal/errors/worker test (#952)
• create test for internal/errors/errors.go (#929)
• Add test case for internal/errors/net.go (#969)
• 🤖 Automatically update k8s manifests (#975)

v1.0.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• v1.0.0 Release (#974)
• Bug fix for gateway (#963)
• Add test case for internal/errors/ngt.go (#936)
• create new test and refactor for errors/option (#950)
• Use checksum of configmap for sidecar-enabled Agents. (#970)
• 🔧 Use cass-operator to deploy cassandra for dev cluster (#968)
• add test for internal/errors/vald (#958)
• Remove actions/cache to improve workflow speed / Refactoring docker-build workflows (#957)
• add filter gateway (#948)
• 🤖 Update license headers / Format Go codes and YAML files (#954)
• Add Zap logger and access log interceptor (#944)
• Add test case for internal/errors/mysql.go (#918)
• Fix invalid data loading code in example (#949)
• Add option to use networking.k8s.io/v1beta1 ingresses (#945)
• bugfix gateway-lb nil pointer panic due to nil filter configuration (#943)
• update rbac.authorization.k8s.io v1beta1 to v1 (#942)
• Update Grafana dashboards (#940)
• Add a gRPC interceptor for embedding payloads into trace spans (#900)
• add goleak.IgnoreCurrent option for Parallel testing (#941)
• update go modules (#939)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#937)
• ⚡ Revise build command for multiplatforms (#890)
• update dependencies (#935)
• E2E deploy test: rewrite in go tests (#814)
• create unit test guideline (#869)
• feature/apis/change grpc error object (#934)
• Add test case for internal/errors/http.go (#908)
• 🤖 Update license headers / Format Go codes and YAML files (#933)
• revise kubelinter config / Add securityContext section to Helm chart (#833)
• 🤖 Update license headers / Format Go codes and YAML files (#932)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#931)
• os.free nil pointer failure in ngt cgo due to create index hang up (#930)
• change grpc bidi-stream error handling and change grpc API interface (#928)
• fix unclosed string literal in Dockerfile’s ARG MAINTAINER (#923)
• Revise building workflow of ci and dev containers (#922)
• bugfix add nil check for gRPC connection pool objects in grpc/client.go (#921)
• remove unneccessary pr-tag definition from chart (#920)
• 📝 Fix typo in gateway-vald configmap template (#919)
• change docker base image PRIMARY_TAG name from nightly to latest (#917)
• 💚 Use vdaas-ci token for making commits (#895)
• Vald V1 New Design APIs (#826)
• 🤖 Automatically update k8s manifests (#914)

v0.0.66

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix: do not create metadata file when create/append flag is not set for the agent/agent-sidecar (#904)
• 🤖 Update license headers / Format Go codes and YAML files (#913)
• 💚 Add formatter for main branch (#911)
• 📄 Update license headers for .github yamls (#907)
• Add test case for internal/errors/io.go (#910)
• Add test case for internal/errors/grpc.go (#903)
• 🤖 Automatically update k8s manifests (#906)

v0.0.65

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Happy new year (#905)
• ✅ Add test case for internal/errors/file.go (#893)
• 🤖 Automatically update k8s manifests (#902)

v0.0.64

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• 🔧 Rename PriorityClass names to contain namespace (#901)
• 🐛 Fix bug on updating status of VR & VHOR resources (#892)
• ✅ Implement internal/errors/blob test (#888)
• ✅ Add test for cassandra error (#865)
• ✅ Add test case for internal/errors/discoverer.go (#874)
• 🐛 ✅ remove invalid import package from internal/errors/mysql_test.go (#894)
• ✅ Add test for internal/errors/compressor.go (#870)
• 🤖 Automatically update k8s manifests (#887)

v0.0.63

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Remove go mod tidy from base image / Add valid token to semver job (#886)
• bugfix agent duplicated data update execution (#885)
• 📦 Build schemas when building helm-operator image (#879)
• ✅ Add s3 test and Refactor (#837)
• ✅ Add internal/net/http/client test (#858)
• ✅ add test case for json package (#857)
• Add FOSSA scan workflow & .fossa.yml (#846)
• ✅ create internal/net/http/client option test (#831)
• 💚 fix checkout-v2 fetch depths (#832)
• 🔧 update Helm 3.4.1, helm-docs (#829)
• ✅ test/internal/nosql/cassandra test (#809)
• 📝 fix coding style for mock (#806)
• CI: Add reviewdog-k8s (#824)
• Fix e2e-bench-agent CI to fail correctly (#800)
• Add internal/db/cassandra/conviction test (#799)
• add test (#798)
• 📝 Fix coding guideline about constructor due to mock implementation (#792)
• 🤖 Automatically update k8s manifests (#781)

v0.0.62

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add 3 new distance type support for agent-ngt (#780)
• upgrade KinD, Helm, valdcli, telepresence, tensorlfow, operator-sdk, helm-docs (#776)
• 🤖 Automatically update k8s manifests (#774)

v0.0.61

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• fix search result sorting codes (#772)
• 🤖 Automatically update k8s manifests (#771)

v0.0.60

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Fix fails test for s3 reader (#770)
• CI: Make docker builds fast again (#756)
• 🤖 Automatically update k8s manifests (#769)

v0.0.59

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix gateway index out of bounds (#768)
• 🤖 Automatically update k8s manifests (#766)

v0.0.58

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• change gateway vald’s mutex lock (#765)
• patch add more effective Close function for internal/core (#764)
• ✅ Fix mysql test failure (#750)
• 💚 remove deprecated set-env commands (#752)
• bugfix discoverer nil map reference (#745)
• add test of internal/db/rdb/mysql (#659)
• ✅ ♻️ Add test for internal/db/storage/blob/s3/reader (#718)
• ✅ Cassandra option test (part 2) (#724)
• CI: Build multi-platform Docker images (#727)
• ✅ Add test for s3 session option (#736)
• ✅ Create s3/session test (#702)
• 🔥 remove dependencies to gql proto (#731)
• 🤖 Automatically update k8s manifests (#730)

v0.0.57

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• fix duplicated search result (#729)
• ♻️ enable to inject only agent-sidecar on initContainer mode without enabling sidecar mode (#726)
• ✨ implement billion scale data (#612)
• Add devcontainer (#620)
• :white_check_makr: ♻️ Add test for s3/writer and Refactor. (#672)
• CI-container: upgrade dependencies of & remove workdir contents (#711)
• 🤖 Automatically update k8s manifests (#708)

v0.0.56

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add C.free & delete ivc before core.BulkInsert C’ function executing for reducing memory usage (#701)
• Add cassandra option test (#644)
• 📝 build single artifact from pbdocs task (#699)
• improve CI builds: use DOCKER_BUILDKIT (#706)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#695)
• 📝 add AVX2 to Requirements section (#686)
• 📝 update contributing guide (#678)
• Use runtime.GC for reducing indexing memory & replace saveMu with atomic busy loop for race control (#682)
• ✅ ♻️ Implement zstd test (#676)
• ✨ use internal client (#618)
• 🤖 Automatically update k8s manifests (#684)

v0.0.55

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• pass CFLAGS, CXXFLAGS to NGT build command (#683)
• 🤖 Automatically update k8s manifests (#681)

v0.0.54

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix error assertion (#680)
• 🤖 Automatically update k8s manifests (#679)

v0.0.53

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• remove cockroachdb/errors (#677)
• ✅ Add test case for storage/blob/s3/writer/option (#656)
• ✅ fix: failing tset (#671)
• 🐛 fix & upgrade manifests to operator-sdk v1.0.0 compatible (#667)
• 🤖 Automatically update k8s manifests (#666)

v0.0.52

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add build stage for operator-sdk docker v1.0.0 permission changes (#665)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#663)
• 🤖 Automatically update k8s manifests (#664)

v0.0.51

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update deps (#660)
• add metrics for indexer and sidecar (#642)
• ✏️ fix indents in helm chart of vald-helm-operator (#658)
• ✅ Add test for internal/compress/gob.go (#646)
• Upgrade go mod default: k8s.io/xxx v0.18.8 (#645)
• [Coding guideline] Add implementation and grouping section (#641)
• ✅ add internal/compress/lz4 test (#643)
• Add test case for s3/option.go (#640)
• Refactoring and Add test code for compress (#622)
• [ImgBot] Optimize images (#639)
• Add operation guide (#541)
• ✅ add internal/s3/reader/option test (#630)
• 🐛 Fix indexer’s creation_pool_size field (#637)
• 🔧 revise languagetool rules: disable EN_QUOTES (#635)
• 🔧 revise languagetool rules: disable TYPOS, DASH_RULE (#634)
• 🔧 revise languagetool rules (#633)
• [ImgBot] Optimize images (#632)
• Add upsert flow in architecture doc (#627)
• Add DB metrics & traces: Redis, MySQL (#623)
• ✅ add internal/db/rdb/mysql/model test (#628)
• 🔧 upload sarif only for HIGH or CRITICAL (#629)
• ✅ add internal/db/rdb/mysql/option test (#626)
• Add internal/net test (#615)
• ✅ Add test for gzip_option (#625)
• 📝 change showing image method (#624)
• ✅ Add internal/compress/zstd_option test (#621)
• use distroless for base image (#605)
• 📝 Coding guideline: Add error checking section (#614)
• ✅ add internal/compress/lz4_option test (#619)
• ✅ fix test fail (#616)
• ✅ Add test of internal/worker/queue_option (#613)
• [ImgBot] Optimize images (#617)
• 📝 Add update dataflow in architecture document (#601)
• Add internal/worker/worker test (#602)
• ♻️ refactor load test (#552)
• ✅ Add test case for internal/kvs/redis/option.go (#611)
• ✅ create internal/worker/queue test (#606)
• ✅ ♻️ Add internal roundtrip test code (#589)
• 📝 Documentation/performance/loadtest (#610)
• 🤖 Automatically update k8s manifests (#609)

v0.0.50

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Add warn logging messages to agent-sidecar & ignore io.EOF error when reading metadata.json (#608)
• Add DB metrics: Cassandra (#587)
• ♻️ Improve Singleflight performance (#580)
• [ImgBot] Optimize images (#607)
• 📝 add delete dataflow in architecture document (#591)
• ♻️ Add gaussian random vector generation (#595)
• ♻️ ✅ Refactoring internal/db/kvs/redis package (#590)
• 💚 Add reviewdog - markdown: LanguageTool (#604)
• 💚 Add reviewdog - hadolint (#603)
• 🤖 Automatically update k8s manifests (#599)

v0.0.49

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• 🐛 fix agent sidecar behavior (#598)
• 🤖 Automatically update k8s manifests (#597)

v0.0.48

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• 🐛 fix behavior when index path is empty (#596)
• ✅ add internal/net/http/transport/option test (#594)
• tensorflow savedmodel warmup (#539)
• 🤖 Automatically update k8s manifests (#592)

v0.0.47

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [agent-NGT, sidecar] Improve S3 backup/recover behavior (#556)
• ✅ add internal/cache/option test (#586)
• 🤖 Automatically update k8s manifests (#588)

v0.0.46

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Test/internal/tcp (#501)
• ✅ add internal/cache/gache test (#583)
• ✅ add cache test (#576)
• ✅ add internal/cache/gache/option test (#575)
• 🐛 ✅ fix: fails test (#578)
• ✅ Add test for internal/file/watch (#526)
• 🎨 update k8s manifests only on publish tags (#574)
• 🤖 Automatically update k8s manifests (#572)
• 🤖 Automatically update k8s manifests (#571)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#570)

v0.0.45

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix gateway & internal/net/grpc (#569)
• fix update-k8s workflow & update sample manifests (#567)
• ✅ Add test for internal/config/mysql.go (#563)
• 🐛 ✅ fix failed test (#561)
• ✅ internal/tls test (#485)
• pass tparse by tee command (#562)
• fix global cache (#560)
• ✅ add internal/config/ngt test (#554)
• ✅ internal/cache/cacher test (#553)
• ✅ Add test case for internal/file (#550)
• ✅ add internal/sync/singleflight test (#542)
• not to force rebuild gotests (#548)
• 📝 Add use case document (#482)
• ✅ add internal/log/mock/retry test (#549)
• feat: options test (#518)
• ✅ add log/mock/logger test (#538)
• 🐛 Fix condition check of chatops (#544)
• exclude hack codes (#543)

v0.0.44

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• use Len and InsertVCacheLen method for IndexInfo / add mutex for (Create|Save)Index (#536)
• documentation: tutorial/agent-on-docker (#516)
• Revise log messages along with the coding guideline (#504)
• 🎨 Add images of usecase (#537)
• ✅ add internal/config/tls test (#534)
• 🐛 Add cancel hook for file watcher (#535)
• 💚 Add test workflow (#531)
• added internal/config/log test (#530)
• add codeql config (#532)
• Added test case for internal/info pacakge. (#514)
• Add internal/runner test (#505)
• Added test case for internal/unit pacakge (#515)

v0.0.43

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Revise S3 reader/writer: compatible with IBM Cloud Object Storage (#509)
• 🐛 Close #502 / Fix roundtrip error handling (#508)
• Feature/drawio (#500)
• Added test case for internal/errorgroup (#494)
• Update Helm Chart info (#496)
• Revise triggers of workflow run & Fix reading changelogs from PR comments (#495)

v0.0.42

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• ✨ Add Stackdriver Monitoring, Tracing and Profiler support (#479)
• 💚 Add CodeQL workflow instead of LGTM.com (#486)
• Add internal/params pacakge test (#474)
• ✨ aws region can be specified with empty string (#477)
• Fix failed test case of internal/safety package (#464)
• send a request to GoProxy after a new version is published (#475)
• internal/db/storage/blob/s3: remove ctx from struct (#473)

v0.0.41

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Refactor agent-sidecar: fix S3 reader & add backoff logic (#467)
• 🐛 📝 fix link (#471)
• Fix /changelog command format (#470)
• fix: failing test (#469)
• fix: failing test (#468)
• ✨ Add options for AWS client (#460)
• Fix /format command (#466)
• Fix /format command (#465)
• Fix internal/log/retry pacakge (#458)
• [ImgBot] Optimize images (#461)
• 🎨 trim white margin at data flow images (#459)

v0.0.40

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Documentation: add concept section to the architecture document (#438)
• feat: level pacakge test (#455)
• [ImgBot] Optimize images (#457)
• fix document and added png images (#456)
• Fix test template bug (#452)
• Add WithOperation func to loadtest usecase (#454)
• 🐛 Fix k8s manifests for loadtest jobs (#453)
• bugfix change final stage of loadtest (#451)
• 🐛 Fix bug on /changelog command (#450)
• add loadtest job and container (#449)
• 🐛 Fix bug on changelog command (#448)

v0.0.39

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [patch] fix doc file path (#444)
• Add changelog command (ChatOps) (#447)
• Fix inconsistent wording (#442)
• [ImgBot] Optimize images (#443)
• [Document] Apply design template to flow diagram (#441)
• Document to deploy standalone agent (#407)
• implement load tester prototype (#363)
• 🐛 Add gRPC interceptor to recover panic in handlers (#440)
• tensorflow test (#378)
• 🍱 update architecture overview svg to add agent sidecar (#437)
• Example program: Add indexing interval description & fix logging message (#405)
• ✏️ Fix typo (#436)

v0.0.38

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• send PR when K8s manifests are updated (#435)
• Implementation of agent-sidecar storage backup logic (#409)
• Fix structure of grpc java package (#431)
• Remove AUTHORS/CONTRIBUTORS file (#428)
• Contribute document (#390)
• Separate the component section from architecture doc (#430)
• fix: delete fch channel because fch causes channel blocking (#429)
• Update Operator SDK version (#412)
• Documentation: About vald (#374)
• Vald architecture document (#366)
• Add JSON schema for Vald Helm Chart (#365)
• Revise ChatOps not to add go.mod & go.sum when /format runs (#406)
• add agent sidecar flame for implementation (#404)
• Upgrade Operator SDK version / Remove useless GO111MODULE=off (#402)
• Upgrade tools version (#399)
• Add app.kubernetes.io/xxx labels to all resources (#397)
• Vald contacts document (#373)
• add trace spans and metrics for agent-ngt and index-manager (#389)
• Add gen-test command for chatops (#379)
• Add internal/db/storage/blob (#388)

v0.0.37

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add agent auto save indexing feature (#385)
• 🐛 fix ngt distance_type (#384)
• Add topology spread constraints (#383)

v0.0.36

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update dependencies version (#381)
• Fix missing value on compressor health servers (#377)
• Fix compressor readiness shutdown_duration / Fix cassandra … (#376)
• Bump gopkg.in/yaml.v2 from 2.2.8 to 2.3.0 (#375)
• Fixinternal/log/format to match the test template (#369)
• Fix internal/log/logger to match the test template (#371)
• Fix failing tests of internal/log and modified to match the test template (#368)
• Add enabled flag to each component in Helm chart (#372)
• Add configurations.md (#356)

v0.0.35

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add storage backup option to agent (#367)
• Add client-node dispatcher (#370)
• Bump github.com/tensorflow/tensorflow (#364)
• change fmt.Errorf to errors.Errorf (#361)
• add goleak (#359)

v0.0.34

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• feature/internal/cassandra/add option (#358)
• update helm docs when version is published (#355)
• upgrade tools (#354)
• bugfix protoc-gen-validate resolve failure (#353)
• Fix conflicts between formatter and helm template (#350)
• Add more options and remove valdhelmoperatorrelease, valdrelease from vald-helm-operator chart (#334)

v0.0.33

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update k8s dependencies (#349)
• create missing test files by the our original test template (#348)
• create test template for using gotests (#327)
• Revise coverage CI settings (#347)
• fix tensorflow.go, option.go (#261)

v0.0.32

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix ip discoverer disconnection too slow (#344)
• Compressor: backup vectors in queue using PostStop function (#345)
• Revise backup/meta Cassandra default values (#336)

v0.0.31

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Resolve busy-loop on worker (#339)

v0.0.30

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• async compressor
• optimized gRPC connection pool
• update helm chart API version
• internal gRPC client for Vald
• Cassandra NewConvictionPolicy
• dicoverer now returns clone object
• new internal/sync/singleflight package
• new internal/net package
• coding guideline

v0.0.26

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• added helm operator
• added telepresence
• improved meta-Cassandra performance
• added doc users/get-started
• fixed some bugs