-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
183 changed files
with
16,649 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,78 @@ | ||
--- | ||
title: "This Week in Fluvio #66" | ||
date: 2024-11-18 | ||
weight: 20 | ||
--- | ||
Fluvio is a distributed, programmable streaming platform written in Rust. | ||
|
||
--- | ||
We released **Fluvio 0.13.0** last week. | ||
|
||
## New release | ||
Fluvio **v0.13.0** is now available! | ||
|
||
To update you can run `fvm update` | ||
|
||
```bash | ||
$ fvm update | ||
|
||
info: Updating fluvio stable to version 0.13.0. Current version is 0.12.1. | ||
info: Downloading (1/5): fluvio@0.13.0 | ||
info: Downloading (2/5): fluvio-cloud@0.2.26 | ||
info: Downloading (3/5): fluvio-run@0.13.0 | ||
info: Downloading (4/5): cdk@0.13.0 | ||
info: Downloading (5/5): smdk@0.13.0 | ||
done: Installed fluvio version 0.13.0 | ||
done: Now using fluvio version 0.13.0 | ||
|
||
``` | ||
|
||
If you don't have Fluvio in your machine run: | ||
|
||
``` | ||
curl -fsS https://hub.infinyon.cloud/install/install.sh | bash | ||
``` | ||
|
||
If you are enjoying Fluvio please share with your friends! | ||
|
||
## New features | ||
Notable changes in this new version: | ||
|
||
- The parameter `max-request-size` was added to the produce config and is recommended to use instead of `batch-size` for controlling request sizes. | ||
- Added the `--partition` and `--mirror` arguments to the `fluvio produce` command, enabling you to specify the partition or mirror where records should be produced. | ||
|
||
## Bug fixes | ||
This release includes several important bug fixes: | ||
|
||
- Resolved an issue where records exceeding the batch size caused unexpected behavior. | ||
- Enhanced the reliability of linking parent objects on local mode to ensure consistent relationships. | ||
- Fixed compatibility issues with older versions of the Fluvio CLI, ensuring seamless usage across versions. | ||
|
||
See the [CHANGELOG] for details | ||
|
||
## Good First Issues | ||
We love our open source community contributors. Here are some issues that you could contribute to. All the best. | ||
|
||
- [Add topic_producer_with_config to the Python Client] | ||
- [Improve fluvio topic describe with additional information] | ||
- [Different default SPU port] | ||
|
||
|
||
--- | ||
|
||
Get in touch with us on [Github Discussions] or join [our Discord channel] and come say hello! | ||
|
||
For the full list of changes this week, be sure to check out [our CHANGELOG]. | ||
|
||
[Fluvio open source]: https://github.com/infinyon/fluvio | ||
[our CHANGELOG]: https://github.com/infinyon/fluvio/blob/master/CHANGELOG.md | ||
[our Discord channel]: https://discordapp.com/invite/bBG2dTz | ||
[Github Discussions]: https://github.com/infinyon/fluvio/discussions | ||
|
||
[this form]: https://infinyon.com/request/ss-early-access/ | ||
[CHANGELOG]: https://github.com/infinyon/fluvio/blob/v0.13.0/CHANGELOG.md | ||
[When a topic is deleted, connected clients should have their connection closed]: https://github.com/infinyon/fluvio/issues/3836 | ||
[Remove localhost from fluvio in favor of 127.0.0.1]: https://github.com/infinyon/fluvio/issues/3866 | ||
[Add topic_producer_with_config to the Python Client]: https://github.com/infinyon/fluvio/issues/4159 | ||
[Improve fluvio topic describe with additional information]: https://github.com/infinyon/fluvio/issues/3968 | ||
[Different default SPU port]: https://github.com/infinyon/fluvio/issues/3739 |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/cdk-deploy-start-http-source-cat-facts-xform.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg --config ./http-cat-facts-transform.yaml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/cdk-deploy-start-http-source-cat-facts.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg --config ./http-cat-facts.yaml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/cdk-deploy-start-http-source-quotes.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg -c quotes-source-connector.yml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/cdk-deploy-start-http-source-string-quotes.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg -c string-quotes-source-connector.yml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/cdk-deploy-start-sql-sink-cat-facts.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-sql-sink-0.4.3.ipkg --config ./sql-cat-fact.yaml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/cdk-hub-download-http-source.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk hub download infinyon/http-source@0.3.8 |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/cdk-hub-download-sql-sink.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk hub download infinyon/sql-sink@0.4.3 |
2 changes: 2 additions & 0 deletions
2
versioned_docs/version-0.13.0/_embeds/cmds/hub-sm-download-jolt.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
fluvio hub smartmodule download infinyon/jolt@0.4.1 | ||
... cluster smartmodule install complete |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.13.0/_embeds/cmds/hub-sm-download-json-sql.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
fluvio hub sm download infinyon/json-sql@0.2.1 |
4 changes: 4 additions & 0 deletions
4
versioned_docs/version-0.13.0/_embeds/cmds/hub-sm-list-jolt.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
fluvio hub smartmodule list | ||
SMARTMODULE Visibility | ||
infinyon/jolt@0.4.1 public | ||
... |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
fluvio smartmodule list | ||
SMARTMODULE SIZE | ||
infinyon/jolt@0.4.1 589.3 KB |
4 changes: 4 additions & 0 deletions
4
versioned_docs/version-0.13.0/_embeds/cmds/sm-list-json-sql-jolt.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
fluvio sm list | ||
SMARTMODULE SIZE | ||
infinyon/json-sql@0.2.1 559.6 KB | ||
infinyon/jolt@0.4.1 589.3 KB |
11 changes: 11 additions & 0 deletions
11
versioned_docs/version-0.13.0/_embeds/connectors/http-cat-fact-basic.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: cat-facts | ||
type: http-source | ||
topic: cat-facts | ||
create-topic: true | ||
|
||
http: | ||
endpoint: "https://catfact.ninja/fact" | ||
interval: 10s |
18 changes: 18 additions & 0 deletions
18
versioned_docs/version-0.13.0/_embeds/connectors/http-cat-fact-transform.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,18 @@ | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: cat-facts-transformed | ||
type: http-source | ||
topic: cat-facts-data-transform | ||
|
||
http: | ||
endpoint: https://catfact.ninja/fact | ||
interval: 10s | ||
|
||
transforms: | ||
- uses: infinyon/jolt@0.4.1 | ||
with: | ||
spec: | ||
- operation: default | ||
spec: | ||
source: "http" |
17 changes: 17 additions & 0 deletions
17
versioned_docs/version-0.13.0/_embeds/connectors/http-source-quotes-transform.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
# string-quotes-source-connector.yml | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: string-quotes | ||
type: http-source | ||
topic: string-quotes | ||
http: | ||
endpoint: https://demo-data.infinyon.com/api/quote | ||
interval: 3s | ||
transforms: | ||
- uses: infinyon/jolt@0.4.1 | ||
with: | ||
spec: | ||
- operation: shift | ||
spec: | ||
quote: "" |
10 changes: 10 additions & 0 deletions
10
versioned_docs/version-0.13.0/_embeds/connectors/http-source-quotes.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# quotes-source-connector.yml | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: http-quotes | ||
type: http-source | ||
topic: quotes | ||
http: | ||
endpoint: https://demo-data.infinyon.com/api/quote | ||
interval: 3s |
27 changes: 27 additions & 0 deletions
27
versioned_docs/version-0.13.0/_embeds/connectors/sql-cat-fact.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
# sql.yaml | ||
apiVersion: 0.1.0 | ||
meta: | ||
name: simple-cat-facts-sql | ||
type: sql-sink | ||
version: 0.4.3 | ||
topic: cat-facts | ||
sql: | ||
url: "postgres://user:password@db.postgreshost.example/dbname" | ||
transforms: | ||
- uses: infinyon/json-sql@0.2.1 | ||
invoke: insert | ||
with: | ||
mapping: | ||
table: "animalfacts" | ||
map-columns: | ||
"length": | ||
json-key: "length" | ||
value: | ||
type: "int" | ||
default: "0" | ||
required: true | ||
"raw_fact_json": | ||
json-key: "$" | ||
value: | ||
type: "jsonb" | ||
required: true |
8 changes: 8 additions & 0 deletions
8
versioned_docs/version-0.13.0/_embeds/transforms/infinyon-jolt.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
#transforms.yml | ||
transforms: | ||
- uses: infinyon/jolt@0.4.1 | ||
with: | ||
spec: | ||
- operation: shift | ||
spec: | ||
quote: "" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
const versions = { | ||
infinyon_http_source: 'infinyon-http-source@0.3.8', | ||
} | ||
|
||
export default versions; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
{ | ||
"label": "Cloud CLI", | ||
"collapsed": true, | ||
"position": 30 | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,122 @@ | ||
--- | ||
sidebar_position: 20 | ||
title: "cluster" | ||
description: "Cluster functions using the Fluvio CLI" | ||
--- | ||
|
||
The `fluvio cloud cluster` family of commands is used to create, delete, and troubleshoot Fluvio clusters in cloud. | ||
|
||
```bash | ||
$ fluvio cloud cluster -h | ||
``` | ||
|
||
``` | ||
$ fluvio cloud cluster | ||
View Cluster information | ||
Usage: fluvio cloud cluster <COMMAND> | ||
Commands: | ||
create Create a new Fluvio cluster | ||
delete Delete an existing Fluvio cluster | ||
list List all Fluvio clusters | ||
sync Sync Fluvio cluster profile | ||
usage Print cluster usage stats | ||
``` | ||
|
||
--- | ||
|
||
## `fluvio cloud cluster create` | ||
|
||
This command is used to provision a new cluster. | ||
|
||
```bash | ||
$ fluvio cloud cluster create -h | ||
``` | ||
|
||
``` | ||
$ fluvio cloud cluster create | ||
Create a new Fluvio cluster | ||
Usage: fluvio cloud cluster create <NAME> [OPTIONS] | ||
Options: | ||
--profile <PROFILE> The name of the Profile to save | ||
--version <VERSION> Fix the Fluvio version of this cluster (not recommended) | ||
--region <REGION> The ID of the region in which to create this cluster (beta) | ||
``` | ||
|
||
Choosing a non-default region with `--region` is currently in private beta and not available to the public. | ||
|
||
Specifying `--version` fixes the Fluvio version and prevents the cluster from being auto-upgraded. This is for installing experimental releases and not generally recommended. | ||
|
||
## `fluvio cloud cluster sync` | ||
|
||
This command synchronized the cluster connection info to the Fluvio config on the machine | ||
|
||
```bash | ||
$ fluvio cloud cluster sync -h | ||
``` | ||
|
||
``` | ||
$ fluvio cloud cluster delete | ||
Delete an existing Fluvio cluster | ||
USAGE: | ||
fluvio cloud cluster delete <NAME> [OPTIONS] | ||
Options: | ||
--profile <PROFILE> The name of the Profile to save | ||
``` | ||
|
||
Example usage: | ||
|
||
```bash | ||
$ fluvio cloud cluster delete my-cluster | ||
``` | ||
|
||
## `fluvio cloud cluster list` | ||
|
||
Command to show the fluvio clusters in Cloud associated with current user. | ||
|
||
```bash | ||
$ fluvio cloud cluster list -h | ||
``` | ||
|
||
``` | ||
$ fluvio cloud cluster list | ||
List all Fluvio clusters | ||
USAGE: | ||
fluvio-cloud cluster list | ||
``` | ||
|
||
Example usage: | ||
|
||
```bash | ||
$ fluvio cloud cluster list | ||
|
||
ID ACTIVE STATE VERSION SPU_COUNT | ||
my-cluster true Installed 0.10.0 1 | ||
``` | ||
|
||
--- | ||
|
||
## `fluvio cloud cluster delete` | ||
|
||
This command deletes the specified cluster | ||
|
||
```bash | ||
$ fluvio cloud cluster delete -h | ||
``` | ||
|
||
``` | ||
$ fluvio cloud cluster delete | ||
Delete an existing Fluvio cluster | ||
USAGE: | ||
fluvio-cloud cluster delete <CLUSTER> | ||
``` | ||
|
||
Example usage: | ||
|
||
```bash | ||
$ fluvio cloud cluster delete my-cluster | ||
``` |
Oops, something went wrong.