CHANGELOG

v1.5.4

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New features

• Add backoff metrics panel #1694
• Add backoff metrics for grpc #1684
• Setup jaeger operator #1682

⬆️ update dependencies

• Update deps #1695
• Update deps #1699

♻️ Refactor

• Split agent pkg handler implementation #1690
• Refactor pkg test helper functions #1678

🐛 Bugfix

• Fix error handling in readyForUpdate and return NotFound error when delete fails in multiUpdate #1681
• Fix race error of server package #1689

✏️ Documents

• Add API status code description #1679
• Modified data flow images #1687
• Correspond to update omission #1686
• Renew basic architecture image #1680

v1.5.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ Feature

• add invalid id argument handling #1667

🐛 Bugfix

• fix update bug #1660
• fix typo argument in Makefile and Makefile.d/function.mk #1673

💚 CI

• fix chaos test temporarily #1665

📝 Document

• add search config details document #1661

✅ Test

• implement pkg handler exists test cases #1628
• implement multi insert test case for pkg agent handler #1612
• create investigation test of max dim for NGT #1633
• implement pkg handler remove test cases #1644
• add e2e test for maxDimensionTest #1650
• implement update handler test cases #1657

⬆️ Update dependencies

• update manifests version #1642
• update go module #1643
• fix go tool installation #1649
• update kind version #1668

🎨 Design

• update dataflow image #1647

🔒 Security

• fix CWE-285 #1654

v1.5.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

⬆️ update dependencies

• update libs version (#1636)
• update libs version (#1632)

✨ feature

• use ReadWriteOncePod instead of ReadWriteOnce and remove initializer (#1627)

♻️ refactor

• refactor: improve memory high usage of vald-agent (#1617)

🔒 security

• security: fix vulnerability problem of helm operator (#1625)
• [Security] Fix vulnerability problem of helm operator (#1611)
• security fix Vulnerability due to usage of old golang.org/x:net in example depentency (#1641)

💚 ci

• ci: Fix CodeQL warning (#1629)
• fix fails actions job & update version (#1620)
• [CI] Allow e2e deploy action jobs to run in parallel (#1616)

✅ test

• fix superfluous response.WriteHeader call (#1631)
• implement search-by-id pkg test (#1624)

📝 document

• document: update formats (#1634)
• docs: add dotdc as a contributor for doc (#1623)
• doc: fixed architecture link in get-started (#1619)
• add FAQ and Troubleshooting document (#1591)

v1.5.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

⬆️ update dependencies

• Upgrade pyroscope version (#1605)

🐛 bugfix

• bugfix internal/file and add CreateTemp function and resolve go module failure (#1608)

✅ Test

• fix search handler test (#1613)
• fix fails test of e2e chaos (#1603)
• Implement pkg ngt handler insert test (#1552)
• implement agent ngt handler search test (#1557)

📝 document

• add vald users (#1601)
• update brand guidelines pdf (#1600)
• fix file name of search api (#1599)
• [ImgBot] Optimize images (#1598)
• cleanup document images (#1595)

v1.5.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New features

• Add values yaml for the back up the agent index data (#1566)
• Implement uniform/gaussian distributed random float32/uint8 vector generator (#1573)
• Add min_num in each search service api (#1576)
• Add copy on write (#1578)
• Add example values for using Pyroscope (#1582)

♻️ Refactor

• Deleted resource limits of agent ngt and added in memory mode example (#1571)
• Improve string conversion performace (#1577)
• Update dependencies version (#1593)

✏️ Documents

• Add gateway component overview document (#1549)
• Update API docs and fix format (#1568)
• Update dataflow images (#1572)
• Add discoverer component overview document (#1574)
• Add index manager component overview document (#1575)
• Update README (#1584)

🐛 Bugfix

• Add error handling when there is no data in google cloud storage. (#1556)
• Reviewdog markdown workflow (#1585)
• Fix invalid URL (#1589)

✅ Test

• Implement test for net/grpc codec,logger and server (#1530)
• Update test for go1.17 update & -race test (#1431)

v1.4.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [bugfix] fix miss param for fp16 (#1563)
• [bugfix] add missing empty dir mount for s3 backup without pvs (#1562)

v1.4.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

✨ New features

• Add agent minnum field and support fp16 (#1558)
• Add pyroscope manifest running on persistent volume (#1551)
• Add settings for profiling with pyroscope (#1539)
• Add pyroscope manifest (#1520)
• Add linear search handler for gateway-lb / ingress-filter / agent-core-ngt (#1511)
• Add grpc custom codec (#1490)
• Update grpc codes (#1489)
• Add NGT linear search API (#1504)

♻️ Refactor

• Delete unsupported library sptag (#1559)
• Improved search operation (#1546)
• Add description timeout of search config (#1541)
• Update dependencies version (#1538)
• Happy new year (#1525)
• Update libs version (#1524)
• Add the missing go.sum (#1517)
• Update license headers / Format codes (#1514)
• Add .gitattributes (#1512)
• Update get started with using kubernetes ingress (#1510)
• Fix command template (#1508)
• Update dependencies version (#1501)
• modify .pb.go & swagger (#1493)
• Add reshape vector proto, remove meta/backup proto (#1492)

✏️ Documents

• Add agent component overview document (#1544)
• Add build api proto document (#1540)
• Add remove/object api document (#1536)
• Add search api document (#1534)
• Add upsert api document (#1533)
• Add update api document (#1529)
• Add insert api document (#1516)

🐛 Bugfix

• Fix vulnerability problem of helm-operator (#1535)

✅ Test

• Implement internal/net/grpc metrics & proto & types test (#1507)
• Implement and modify internal/io tests (#1509)
• Implement internal/net net.go&dialer.go test (#1505)
• Implement internal/net/grpc/credentials and health test (#1502)
• Implement internal/net/control test (#1500)
• Remove unsupported feature from public document (#1497)

🎉 Cellebration!

• Add liusy182 as a contributor for example (#1519)
• Add zchee as a contributor for a11y (#1513)

v1.3.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Add documentation comments to proto files (#1452)
• Add ngt index count panel to agent grafana dashboard (#1483)
• add grpc keepalive EnforcementPolicy support (#1487)
• fix timing of removeInvalidIndex (#1481)
• [bugfix] add validation to agent service option InitialDelayMaxDuration (#1482)

v1.3.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add startupProbe support (#1473)
• add label / field selectors for discoverer (#1472)

v1.2.4

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update go patch version (#1464)
• [bugfix] sidecar e2e testing (#1465)
• update dependencies version including NGT (#1461)
• fix unlimited gorountine processing in kvsdb (#1458)
• Refactor hack pkg agent e2e benchmark (#1430)
• Remove non-exist components from doc and ci (#1450)
• ♻️ ✏ add default_pool_size in example yml (#1457)
• reduce memory usage around ngt implementation & refactor agent/lb & auto-generate unit test (#1449)
• Remove rinx from several yamls (#1451)
• Add E2E scenario with SkipStrictExistCheck enabled (#1415)
• fix filter-gateway chart (#1454)
• Implement pkg/agent/core/ngt/service/option test (#1429)

v1.2.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update go module dependencies & update go patch version to 1.17.1 (#1445)
• [bugfix] fix unknown status problems in search operation (#1439)
• Add tools.mk for installing CI tools (#1442)
• Fix icon image path in Chart.yaml (#1441)
• fix(Makefile): 🐛 Remove components (#1440)
• Change golangci-lint version to the latest and Fix docker build error (#1435)
• Fix golangci-lint rule (#1380)
• Add vqueue test for Exists and GetVector method (#1425)

v1.2.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Add stateful PBT for NGT service (#1384)
• add default logger when logger not initialized (#1424)
• feat: ✨ Add LB gateway dashboard (#1420)
• chore-deps: ⬆️ Upgrade OSDK to v1.11.0 (#1422)
• change default epsilon value to 0.1 from 0.0.1 (#1421)
• add go vet for checking cpu compatibility and update deps and refactor small code (#1418)
• Delete insert and delete channel of vqueue (#1400)
• downgrade cloud.google.com/go to resolve runtime panic (#1413)
• [bugfix] resolve errgroup limitation channel close panic (#1412)
• Update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#1409)
• update go version to 1.17 and update go module dependencies (#1404)
• refactor grpc logging and use os.PathSeparator instead of / (#1405)
• Remove schema of security contexts (#1406)
• change security context uid to distroless nonroot uid (#1402)

v1.2.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• remove global errgroup from kvsdb goroutine limitation (#1398)
• add google grpc healthz & logger (#1394)
• fix e2e multi apis test code (#1397)
• ✏ fix command in vald agent standalone on docker (#1393)
• add Makefile & Makefile.d to build kick rule (#1391)
• format codes (#1389)
• [proposal] add golines as vald default formatter (#1337)
• replace gogo protobuf to vt protobuf (#1378)
• refactor gateway request result location aggregation logic & use xxh3 for kvsdb hashing (#1376)
• Add E2E tests for multi-APIs (#1353)
• Add test for the function to get length of vqueue (#1382)
• remove unused path of format/yaml command (#1383)
• [Documentation] fix image filename (#1377)
• Vald moves to a vector search engine that enables more simple and high-speed retrieval. This is the first step of Simple-Vald. (#1365)
• Add e2e-profiling job (#1356)
• fix svg error on dataflow image (#1375)
• remove invalid gateway component reference from chart.NOTES (#1371)

v1.2.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

Release Vald v1.2.0

Changes:

• fix build failure on arm cpu due to the xxh3 dependency version (#1368)
• Add core algorithm ngt test (#1364)
• add mote accurate directory detection logic for removing (#1366)
• remove meta backup compressor from charts (#1334)
• update go module version (#1363)
• Update architecture overview (#1304)
• Improve internal package tests (#1227)
• fix bug of bulkinsert when error occurs and refactor error message (#1361)
• change initial-index-directory removal logic (#1359)
• ci: 👷‍♂️ Add gnupg to ci-container (#1362)
• ci: 👷‍♂️ add condition to trigger importing gpg key (#1360)
• fix: 🐛 Fix mount paths when using persistent volume claim template (#1358)
• ci: 👷‍♂️ Add Upsert operation tests (#1347)
• config: ⚙️ Use GPG key for signing commits (#1351)
• add time validation for vqueue (#1352)
• chore-deps: ⬆️ Upgrade tools (#1355)
• comment out backup/meta/compressor build command in Makefile (#1346)
• remove: ➖ Remove backup, meta components from CI (#1331)
• add line trace logging when log mode is glg and level is debug (#1348)
• update go version to 1.16.6 and update go module dependencies (#1345)
• [bugfix] agent createindex operation’s time.Ticker purges too slow & buffer overflow due to the unnecessary error wrapping (#1343)
• [bugfix] change kvsdb and vqueue check order for Exists operation (#1341)
• update go module dependencies (#1336)
• bugfix nil pointer panic in agent’s MultiUpsert operation (#1335)
• [bugfix] agent.GetObject API returns old indexed vector problem instead of vqueue’s new data (#1333)
• add timestamp handler for agent timestamp controlled update (#1324)
• fix: 🐛 Fix typo (#1330)
• remove owner and description info from resource info rich error for each grpc handler (#1327)
• Update documents: configurations (#1289

v1.1.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix remove api return wrong error of non exsiting replicas (#1318)
• update go modules and update go version to 1.16.5 from 1.16.4 (#1306)
• Implement test for internal/core/alogrithm/ngt/option and refactor (#1251)
• fix build error due to e2e benchmark invalid creating new client (#1221)
• bugfix correct error backoff handling for lb gateway (#1309)
• Apply ruleguard fixes (#1302)
• Add ruleguard rules (#1301)
• bugfix add feature vector duplication checking for LB-GW Upsert operation. (#1303)
• fix fails race condition test (#1299)
• Update dashboards, add operator dashboard and several panels (#1280)
• Add composite actions for E2E tests (#1257)
• add save index wait duration to index-manager for multiple agent index upload delay (#1292)
• Bugfix index count problem of ngt (#1288)
• fix example/helm/values.yaml (#1290)
• Fix time condition of agent & lb gateway (#1285)
• Use gofumpt for format workflow (#1281)
• [bugfix] kvsdb: do not increment the counter if key exists (#1282)
• Revert “🎨 Use gofumpt as a default formatter (#1278)” (#1279)
• 🎨 Use gofumpt as a default formatter (#1278)
• ✏ fix some wrongs (#1274)
• Refactor E2E tests: split operations into a new package (#1220)
• 🐛 Fix the chart: agent-sidecar initContainer mode (#1271)

v1.1.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [patch] release Vald v1.1.1 (#1268)
• fix copy CI error (#1269)
• bugfix nil internal/net/grpc.Client.Reconnect nil pointer fix (#1270)
• Docs/readme/replace architecture overview (#1267)
• format code (#1266)
• 🤖 Update license headers / Format Go codes and YAML files (#1265)
• [bugfix] append timing of vqueue existing map (#1264)
• add resource type infos to grpc error response (#1262)
• 🔧 Fix clusterrole of scylla-cluster member (#1263)
• refactor file I/O & replace io.Copy to vald original faster Copy function (#1261)
• [bugfix] change exists cheking for agent vqueue (#1256)
• 🤖 Update license headers / Format Go codes and YAML files (#1255)
• 🔥 Remove invalid initialization option (#1252)
• add single connection client for agent & vald (#1254)
• bugfix remove unneccessary error return & add grpc status code handling for backoff (#1253)
• bugfix agent vqueue & refactor tools/deps (#1250)
• Add test for pkg/agent/core/ngt/service/vqueue/option (#1233)
• Add config agent core ngt service kvs test (#1223)
• Fix update-helm-chart workflow (#1249)
• 🤖 Automatically update k8s manifests (#1248)
• Fix path to the yq binary (#1247)

v1.1.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

Feature

• add correct grpc status and error handling (#1224)
• Add Cloud Storage mode of Agent Sidecar. (#519)
• Add general info metrics package / Add NGT info metrics (#1195)
• improve internal/info implementation (#1177)
• Add saving flag to index.info payload (#1200)
• Fix mysql and cassandra schema definitions in initialize jobs (#1186)
• Remove values-xxx.yaml from Helm packages (#1107)
• Feature/internal net/use netaddr (#1154)
• Add Nop Logger for empty logger message (#1158)
• Remove arm64 build of filter-ingress-tf (#1153)
• add tensorflow filter (#951)
• Add OpenAPIv3 schema to CRDs (#1068)
• PR for review all logging statements (#1052)

Bugfix

• bugfix gateway search result merging process (#1238)
• remove nil check in Error() method in internal/errors (#1185)
• Bug fix of parallel test and goleak (#1231)
• 🚨 Fix linting errors (#1179)
• Fix mutex deadlock when calling error occurred (#1225)
• fix nil pointer panic when err is nil in Is() (#1216)
• Fix typo & missed schema definition (#1156)
• 🔒 Fix validation about zip slip (#1150)
• 🔒 Fix security issue: Add validation about path of extracted file (#1145)
• fix: nil pointer bug when config is nil and refactor variable name (#1139)
• 🐛 Fix gateway service selectors in Helm chart (#1109)
• Bugfix correct error handling for agent apis (#1144)

Document

• separate tutorials into each document and add images (#1230)
• Update Tutotial/Get-Started (#1203)
• Update unit-test-guideline (#1213)
• create docs/user-guides/sdks (#1182)
• Fix typo in README. (#1163)

CI/CD

• Upgrade to GitHub-native Dependabot (#1211)
• Use kubectl create/replace for upgrading CRDs (#1199)
• 🔧 Fix scylla deploy task (#1159)

Test Code

• Add config agent core ngt test (#1219)
• implement pkg/agent/core/ngt/router test & refactor router implementation (#1214)
• Implement pkg/agent/core/ngt/handler/grpc/option test (#1215)
• refactor config error handling (#1190)
• Implement pkg/agent/core/ngt/router/option test (#1206)
• Implement safety bench code (#1171)
• create internal/config/redis test (#1147)
• Implement internal/config/transport test (#1172)
• Add internal/config/sidecar test (#1173)
• Add benchmark for internal/timeutil/time.go (#1086)
• Add internal/config/observability unit test (#1155)
• Add test for internal/config/mysql (#1151)
• create internal/config/cassandra test (#1117)
• create test for internal/config/server (#1175)
• Add internal/config/lb test (#1134)
• create internal/config/net test (#1140)
• ✅ create internal/config/meta test (#1133)
• Add internal/config/index test (#1129)
• ✅ create internal/config/backup test (#1132)
• delete internal/config/debug file (#1124)
• create internal/config/grpc test (#1130)
• Add internal/config/discoverer test (#1122)
• Add internal/config/filter.go test (#1125)
• create internal/config/gateway test (#1128)
• Implement internal/info/info.go benchmark (#1093)
• Add internal/config/client.go test (#1121)
• Implement internal/timeutil/location/loc.go benchmark test (#1091)
• ✅ remove unused variable from mysql test (#1120)
• feat: add blob test and comment (#1114)
• create bench code for internal/rand (#1089)
• Add test internal/config/compress.go (#1097)
• create internal/config/backoff test (#1104)
• change params for passing test of internal/backoff (#1108)
• remove unnecessary tests and update test (#1061)
• add internal backoff test (#1085)
• Add internal/core/algorithm/ngt/util.go test (#1066)
• Fix hack/tools/metrics failed builds (#1094)
• make timeouts for e2e and chaos tests longer (#1092)

Dependencies

• update go version to 1.16.4 (#1239)
• ⬆️ Upgrade helm, valdcli, kubelinter and osdk (#1181)
• update codecov version for vulnerability (#1207)

Others

• update go modules (#1242)
• [ImgBot] Optimize images (#1241)
• Update license headers / Format codes (#1212)
• remove ngt version in filter-ingress-tensorflow (#1157)
• remove license from bot config json (#1164)
• improve internal/timeutil/location implementation (#1176)

v1.0.4

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Fix error handling of SearchByID API in lb gateway (#1084)
• Update Agent dashboard (#1069)
• Revise gRPC error statuses and details in meta (Redis/Cassandra) (#1013)
• add remove sample code for tutorial (#1053)
• add grpc reflection (#1064)
• remove vcache for vald agent due to vcache delete timing control failure and time ordered concurrent vector queue called vqueue (#1028)
• refactor discoverer client (#1056)
• bugfix nil pointer no target discovered (#1055)
• Upgrade Operator SDK version to v1.4.2 (#1038)

v1.0.3

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• fix MySQL panic test (#996)
• Update tutorial to support v1 (#1009)
• remove not supported control flag on darwin (#1025)
• Add strategy section to Docker build workflows (#1024, #1019)
• move internal/net/tcp package to internal/net package and support unix domain socket (#1010)
• Implement internal/info/info test (#862)
• add test for internal/errors/runner (#1007)
• add logo guideline (#973)
• Fix invalid changelogs / update changelog workflows (#1002)
• Add test case for internal/errors/observability.go (#993)

v1.0.2

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• v1.0.2 Release (#998)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#997)
• Bug fix on StreamGetObject API and DNS cache expiration / refactor net connection (#986)
• Remove base docker image (#995)
• Use namespaced names for priorityclasses of new gateways (#992)
• Add E2E Chaos tests running on GitHub Actions (#899)
• Add zap logger to chart schema (#985)
• add test for internal/errors/runtime (#984)
• add test for internal/errors/tensorflow (#982)
• add test for internal/errors/unit (#979)
• update chatops permission (#990)
• 🤖 Automatically update k8s manifests (#981)

v1.0.1

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix lb-gateway’s Insert rpc nil pointer panic (#980)
• Implement internal/errors/worker test (#952)
• create test for internal/errors/errors.go (#929)
• Add test case for internal/errors/net.go (#969)
• 🤖 Automatically update k8s manifests (#975)

v1.0.0

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• v1.0.0 Release (#974)
• Bug fix for gateway (#963)
• Add test case for internal/errors/ngt.go (#936)
• create new test and refactor for errors/option (#950)
• Use checksum of configmap for sidecar-enabled Agents. (#970)
• 🔧 Use cass-operator to deploy cassandra for dev cluster (#968)
• add test for internal/errors/vald (#958)
• Remove actions/cache to improve workflow speed / Refactoring docker-build workflows (#957)
• add filter gateway (#948)
• 🤖 Update license headers / Format Go codes and YAML files (#954)
• Add Zap logger and access log interceptor (#944)
• Add test case for internal/errors/mysql.go (#918)
• Fix invalid data loading code in example (#949)
• Add option to use networking.k8s.io/v1beta1 ingresses (#945)
• bugfix gateway-lb nil pointer panic due to nil filter configuration (#943)
• update rbac.authorization.k8s.io v1beta1 to v1 (#942)
• Update Grafana dashboards (#940)
• Add a gRPC interceptor for embedding payloads into trace spans (#900)
• add goleak.IgnoreCurrent option for Parallel testing (#941)
• update go modules (#939)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#937)
• ⚡ Revise build command for multiplatforms (#890)
• update dependencies (#935)
• E2E deploy test: rewrite in go tests (#814)
• create unit test guideline (#869)
• feature/apis/change grpc error object (#934)
• Add test case for internal/errors/http.go (#908)
• 🤖 Update license headers / Format Go codes and YAML files (#933)
• revise kubelinter config / Add securityContext section to Helm chart (#833)
• 🤖 Update license headers / Format Go codes and YAML files (#932)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#931)
• os.free nil pointer failure in ngt cgo due to create index hang up (#930)
• change grpc bidi-stream error handling and change grpc API interface (#928)
• fix unclosed string literal in Dockerfile’s ARG MAINTAINER (#923)
• Revise building workflow of ci and dev containers (#922)
• bugfix add nil check for grpc connection pool objects in grpc/client.go (#921)
• remove unneccessary pr-tag definition from chart (#920)
• ✏ Fix typo in gateway-vald configmap template (#919)
• change docker base image PRIMARY_TAG name from nightly to latest (#917)
• 💚 Use vdaas-ci token for making commits (#895)
• Vald V1 New Design APIs (#826)
• 🤖 Automatically update k8s manifests (#914)

v0.0.66

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix: do not create metadata file when create/append flag is not set for the agent/agent-sidecar (#904)
• 🤖 Update license headers / Format Go codes and YAML files (#913)
• 💚 Add formatter for master branch (#911)
• 📄 Update license headers for .github yamls (#907)
• Add test case for internal/errors/io.go (#910)
• Add test case for internal/errors/grpc.go (#903)
• 🤖 Automatically update k8s manifests (#906)

v0.0.65

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Happy new year (#905)
• ✅ Add test case for internal/errors/file.go (#893)
• 🤖 Automatically update k8s manifests (#902)

v0.0.64

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• 🔧 Rename PriorityClass names to contain namespace (#901)
• 🐛 Fix bug on updating status of VR & VHOR resources (#892)
• ✅ Implement internal/errors/blob test (#888)
• ✅ Add test for cassandra error (#865)
• ✅ Add test case for internal/errors/discoverer.go (#874)
• 🐛 ✅ remove invalid import package from internal/errors/mysql_test.go (#894)
• ✅ Add test for internal/errors/compressor.go (#870)
• 🤖 Automatically update k8s manifests (#887)

v0.0.63

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Remove go mod tidy from base image / Add valid token to semver job (#886)
• bugfix agent duplicated data update execution (#885)
• 📦 Build schemas when building helm-operator image (#879)
• ✅ Add s3 test and Refactor (#837)
• ✅ Add internal/net/http/client test (#858)
• ✅ add test case for json package (#857)
• Add FOSSA scan workflow & .fossa.yml (#846)
• ✅ create internal/net/http/client option test (#831)
• 💚 fix checkout-v2 fetch depths (#832)
• 🔧 update Helm 3.4.1, helm-docs (#829)
• ✅ test/internal/nosql/cassandra test (#809)
• ✏ fix coding style for mock (#806)
• CI: Add reviewdog-k8s (#824)
• Fix e2e-bench-agent CI to fail correctly (#800)
• Add internal/db/cassandra/conviction test (#799)
• add test (#798)
• ✏ Fix coding guideline about constructor due to mock implementation (#792)
• 🤖 Automatically update k8s manifests (#781)

v0.0.62

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add 3 new distance type support for agent-ngt (#780)
• upgrade KinD, Helm, valdcli, telepresence, tensorlfow, operator-sdk, helm-docs (#776)
• 🤖 Automatically update k8s manifests (#774)

v0.0.61

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• fix search result sorting codes (#772)
• 🤖 Automatically update k8s manifests (#771)

v0.0.60

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Fix fails test for s3 reader (#770)
• CI: Make docker builds fast again (#756)
• 🤖 Automatically update k8s manifests (#769)

v0.0.59

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix gateway index out of bounds (#768)
• 🤖 Automatically update k8s manifests (#766)

v0.0.58

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• change gateway vald’s mutex lock (#765)
• patch add more effective Close function for internal/core (#764)
• ✅ Fix mysql test failure (#750)
• 💚 remove deprecated set-env commands (#752)
• bugfix discoverer nil map reference (#745)
• add test of internal/db/rdb/mysql (#659)
• ✅ ♻️ Add test for internal/db/storage/blob/s3/reader (#718)
• ✅ Cassandra option test (part 2) (#724)
• CI: Build multi-platform Docker images (#727)
• ✅ Add test for s3 session option (#736)
• ✅ Create s3/session test (#702)
• 🔥 remove dependencies to gql proto (#731)
• 🤖 Automatically update k8s manifests (#730)

v0.0.57

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• fix duplicated search result (#729)
• ♻️ enable to inject only agent-sidecar on initContainer mode without enabling sidecar mode (#726)
• ✨ implement billion scale data (#612)
• Add devcontainer (#620)
• :white_check_makr: ♻️ Add test for s3/writer and Refactor. (#672)
• CI-container: upgrade dependencies of & remove workdir contents (#711)
• 🤖 Automatically update k8s manifests (#708)

v0.0.56

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add C.free & delete ivc before core.BulkInsert C’ function executing for reducing memory usage (#701)
• Add cassandra option test (#644)
• 📝 build single artifact from pbdocs task (#699)
• improve CI builds: use DOCKER_BUILDKIT (#706)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#695)
• ✏ add AVX2 to Requirements section (#686)
• ✏ update contributing guide (#678)
• Use runtime.GC for reducing indexing memory & replace saveMu with atomic busy loop for race control (#682)
• ✅ ♻️ Implement zstd test (#676)
• ✨ use internal client (#618)
• 🤖 Automatically update k8s manifests (#684)

v0.0.55

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• pass CFLAGS, CXXFLAGS to NGT build command (#683)
• 🤖 Automatically update k8s manifests (#681)

v0.0.54

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix error assertion (#680)
• 🤖 Automatically update k8s manifests (#679)

v0.0.53

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• remove cockroachdb/errors (#677)
• ✅ Add test case for storage/blob/s3/writer/option (#656)
• ✅ fix: failing tset (#671)
• 🐛 fix & upgrade manifests to operator-sdk v1.0.0 compatible (#667)
• 🤖 Automatically update k8s manifests (#666)

v0.0.52

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add build stage for operator-sdk docker v1.0.0 permission changes (#665)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#663)
• 🤖 Automatically update k8s manifests (#664)

v0.0.51

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update deps (#660)
• add metrics for indexer and sidecar (#642)
• ✏️ fix indents in helm chart of vald-helm-operator (#658)
• ✅ Add test for internal/compress/gob.go (#646)
• Upgrade go mod default: k8s.io/xxx v0.18.8 (#645)
• [Coding guideline] Add implementation and grouping section (#641)
• ✅ add internal/compress/lz4 test (#643)
• Add test case for s3/option.go (#640)
• Refactoring and Add test code for compress (#622)
• [ImgBot] Optimize images (#639)
• Add operation guide (#541)
• ✅ add internal/s3/reader/option test (#630)
• 🐛 Fix indexer’s creation_pool_size field (#637)
• 🔧 revise languagetool rules: disable EN_QUOTES (#635)
• 🔧 revise languagetool rules: disable TYPOS, DASH_RULE (#634)
• 🔧 revise languagetool rules (#633)
• [ImgBot] Optimize images (#632)
• Add upsert flow in architecture doc (#627)
• Add DB metrics & traces: Redis, MySQL (#623)
• ✅ add internal/db/rdb/mysql/model test (#628)
• 🔧 upload sarif only for HIGH or CRITICAL (#629)
• ✅ add internal/db/rdb/mysql/option test (#626)
• Add internal/net test (#615)
• ✅ Add test for gzip_option (#625)
• ✏ change showing image method (#624)
• ✅ Add internal/compress/zstd_option test (#621)
• use distroless for base image (#605)
• ✏ Coding guideline: Add error checking section (#614)
• ✅ add internal/compress/lz4_option test (#619)
• ✅ fix test fail (#616)
• ✅ Add test of internal/worker/queue_option (#613)
• [ImgBot] Optimize images (#617)
• ✏ Add update dataflow in architecture document (#601)
• Add internal/worker/worker test (#602)
• ♻️ refactor load test (#552)
• ✅ Add test case for internal/kvs/redis/option.go (#611)
• ✅ create internal/worker/queue test (#606)
• ✅ ♻️ Add internal roundtrip test code (#589)
• ✏ Documentation/performance/loadtest (#610)
• 🤖 Automatically update k8s manifests (#609)

v0.0.50

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Add warn logging messages to agent-sidecar & ignore io.EOF error when reading metadata.json (#608)
• Add DB metrics: Cassandra (#587)
• ♻️ Improve Singleflight performance (#580)
• [ImgBot] Optimize images (#607)
• ✏ add delete dataflow in architecture document (#591)
• ♻️ Add gaussian random vector generation (#595)
• ♻️ ✅ Refactoring internal/db/kvs/redis package (#590)
• 💚 Add reviewdog - markdown: LanguageTool (#604)
• 💚 Add reviewdog - hadolint (#603)
• 🤖 Automatically update k8s manifests (#599)

v0.0.49

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• 🐛 fix agent sidecar behavior (#598)
• 🤖 Automatically update k8s manifests (#597)

v0.0.48

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• 🐛 fix behavior when index path is empty (#596)
• ✅ add internal/net/http/transport/option test (#594)
• tensorflow savedmodel warmup (#539)
• 🤖 Automatically update k8s manifests (#592)

v0.0.47

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [agent-NGT, sidecar] Improve S3 backup/recover behavior (#556)
• ✅ add internal/cache/option test (#586)
• 🤖 Automatically update k8s manifests (#588)

v0.0.46

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Test/internal/tcp (#501)
• ✅ add internal/cache/gache test (#583)
• ✅ add cache test (#576)
• ✅ add internal/cache/gache/option test (#575)
• 🐛 ✅ fix: fails test (#578)
• ✅ Add test for internal/file/watch (#526)
• 🎨 update k8s manifests only on publish tags (#574)
• 🤖 Automatically update k8s manifests (#572)
• 🤖 Automatically update k8s manifests (#571)
• 🤖 Automatically update PULL_REQUEST_TEMPLATE and ISSUE_TEMPLATE (#570)

v0.0.45

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix gateway & internal/net/grpc (#569)
• fix update-k8s workflow & update sample manifests (#567)
• ✅ Add test for internal/config/mysql.go (#563)
• 🐛 ✅ fix failed test (#561)
• ✅ internal/tls test (#485)
• pass tparse by tee command (#562)
• fix global cache (#560)
• ✅ add internal/config/ngt test (#554)
• ✅ internal/cache/cacher test (#553)
• ✅ Add test case for internal/file (#550)
• ✅ add internal/singleflight test (#542)
• not to force rebuild gotests (#548)
• ✏ Add use case document (#482)
• ✅ add internal/log/mock/retry test (#549)
• feat: options test (#518)
• ✅ add log/mock/logger test (#538)
• 🐛 Fix condition check of chatops (#544)
• exclude hack codes (#543)

v0.0.44

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• use Len and InsertVCacheLen method for IndexInfo / add mutex for (Create|Save)Index (#536)
• documentation: tutorial/agent-on-docker (#516)
• Revise log messages along with the coding guideline (#504)
• 🎨 Add images of usecase (#537)
• ✅ add internal/config/tls test (#534)
• 🐛 Add cancel hook for file watcher (#535)
• 💚 Add test workflow (#531)
• added internal/config/log test (#530)
• add codeql config (#532)
• Added test case for internal/info pacakge. (#514)
• Add internal/runner test (#505)
• Added test case for internal/unit pacakge (#515)

v0.0.43

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Revise S3 reader/writer: compatible with IBM Cloud Object Storage (#509)
• 🐛 Close #502 / Fix roundtrip error handling (#508)
• Feature/drawio (#500)
• Added test case for internal/errorgroup (#494)
• Update Helm Chart info (#496)
• Revise triggers of workflow run & Fix reading changelogs from PR comments (#495)

v0.0.42

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• ✨ Add Stackdriver Monitoring, Tracing and Profiler support (#479)
• 💚 Add CodeQL workflow instead of LGTM.com (#486)
• Add internal/params pacakge test (#474)
• ✨ aws region can be specified with empty string (#477)
• Fix failed test case of internal/safety package (#464)
• send a request to GoProxy after a new version is published (#475)
• internal/db/storage/blob/s3: remove ctx from struct (#473)

v0.0.41

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Refactor agent-sidecar: fix S3 reader & add backoff logic (#467)
• 🐛 ✏ fix link (#471)
• Fix /changelog command format (#470)
• fix: failing test (#469)
• fix: failing test (#468)
• ✨ Add options for AWS client (#460)
• Fix /format command (#466)
• Fix /format command (#465)
• Fix internal/log/retry pacakge (#458)
• [ImgBot] Optimize images (#461)
• 🎨 trim white margin at data flow images (#459)

v0.0.40

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Documentation: add concept section to the architecture document (#438)
• feat: level pacakge test (#455)
• [ImgBot] Optimize images (#457)
• fix document and added png images (#456)
• Fix test template bug (#452)
• Add WithOperation func to loadtest usecase (#454)
• 🐛 Fix k8s manifests for loadtest jobs (#453)
• bugfix change final stage of loadtest (#451)
• 🐛 Fix bug on /changelog command (#450)
• add loadtest job and container (#449)
• 🐛 Fix bug on changelog command (#448)

v0.0.39

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• [patch] fix doc file path (#444)
• Add changelog command (ChatOps) (#447)
• Fix inconsistent wording (#442)
• [ImgBot] Optimize images (#443)
• [Document] Apply design template to flow diagram (#441)
• Document to deploy standalone agent (#407)
• implement load tester prototype (#363)
• 🐛 Add gRPC interceptor to recover panic in handlers (#440)
• tensorflow test (#378)
• 🍱 update architecture overview svg to add agent sidecar (#437)
• Example program: Add indexing interval description & fix logging message (#405)
• ✏️ Fix typo (#436)

v0.0.38

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• send PR when K8s manifests are updated (#435)
• Implementation of agent-sidecar storage backup logic (#409)
• Fix structure of grpc java package (#431)
• Remove AUTHORS/CONTRIBUTORS file (#428)
• Contribute document (#390)
• Separate the component section from architecture doc (#430)
• fix: delete fch channel because fch causes channel blocking (#429)
• Update Operator SDK version (#412)
• Documentation: About vald (#374)
• Vald architecture document (#366)
• Add JSON schema for Vald Helm Chart (#365)
• Revise ChatOps not to add go.mod & go.sum when /format runs (#406)
• add agent sidecar flame for implementation (#404)
• Upgrade Operator SDK version / Remove useless GO111MODULE=off (#402)
• Upgrade tools version (#399)
• Add app.kubernetes.io/xxx labels to all resources (#397)
• Vald contacts document (#373)
• add trace spans and metrics for agent-ngt and index-manager (#389)
• Add gen-test command for chatops (#379)
• Add internal/db/storage/blob (#388)

v0.0.37

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add agent auto save indexing feature (#385)
• 🐛 fix ngt distance_type (#384)
• Add topology spread constraints (#383)

v0.0.36

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update dependencies version (#381)
• Fix missing value on compressor health servers (#377)
• Fix compressor readiness shutdown_duration / Fix cassandra … (#376)
• Bump gopkg.in/yaml.v2 from 2.2.8 to 2.3.0 (#375)
• Fixinternal/log/format to match the test template (#369)
• Fix internal/log/logger to match the test template (#371)
• Fix failing tests of internal/log and modified to match the test template (#368)
• Add enabled flag to each component in Helm chart (#372)
• Add configurations (#356)

v0.0.35

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• add storage backup option to agent (#367)
• Add client-node dispatcher (#370)
• Bump github.com/tensorflow/tensorflow (#364)
• change fmt.Errorf to errors.Errorf (#361)
• add goleak (#359)

v0.0.34

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• feature/internal/cassandra/add option (#358)
• update helm docs when version is published (#355)
• upgrade tools (#354)
• bugfix protoc-gen-validate resolve failure (#353)
• Fix conflicts between formatter and helm template (#350)
• Add more options and remove valdhelmoperatorrelease, valdrelease from vald-helm-operator chart (#334)

v0.0.33

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• update k8s dependencies (#349)
• create missing test files by the our original test template (#348)
• create test template for using gotests (#327)
• Revise coverage CI settings (#347)
• fix tensorflow.go, option.go (#261)

v0.0.32

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• bugfix ip discoverer disconnection too slow (#344)
• Compressor: backup vectors in queue using PostStop function (#345)
• Revise backup/meta Cassandra default values (#336)

v0.0.31

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• Resolve busy-loop on worker (#339)

v0.0.30

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• async compressor
• optimized gRPC pool connection
• update helm chart API version
• internal gRPC client for Vald
• Cassandra NewConvictionPolicy
• dicoverer now returns clone object
• new internal/singleflight package
• new internal/net package
• coding guideline

v0.0.26

Docker images

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

• added helm operator
• added telepresence
• improved meta-Cassandra performance
• added doc users/get-started
• fixed some bugs