This is a common error when transforming streams in Apache Flink based applications.
The solution is simple. We just need to import the following:
Which should import the necessary types for the operations.
In order to connect with a data source or sink, we need to use credentials. Kafka Connect added support for specifying credential using config providers. The support for file config provider is available with the installation package. This is discussed in KIP 297. The KIP was released in Apache Kafka 2.
Here is the JIRA.
https://issues.apache.org/jira/browse/KAFKA-6886
Changes in worker properties file [etc/schema-registry/connect-avro-distributed.properties]
Since the connectors are exposed through the RESTful service from Connect, the user credentials will be returned as a response. An additional update was required to fix this. This was worked as KAFKA-5117.
https://issues.apache.org/jira/browse/KAFKA-5117
KAFKA-5117
The fix for RESTful service was released in Kafka 2.1.x.
https://issues.apache.org/jira/browse/KAFKA-5117
If you are using Confluent Version, it should be available in 5.1.x.
https://docs.confluent.io/current/installation/versions-interoperability.html
Here is the credentials file couchbase.properties:
Couchbase supports document expiration. If the documents are ingested from Kafka through Couchbase Sink connector the expiration can be set at the connector side where we can set the expiration for each record upserted as document in couchbase.
Here is a sample configuration for the connector:
Here is a sample configuration from couchbase:
Sample Config from Couchbase: https://github.com/couchbase/kafka-connect-couchbase/blob/master/config/quickstart-couchbase-sink.properties