Python – Anaconda Installation Anaconda can be downloaded from the following link: You can select the version of the installer suitable for your system. Here we are choosing the Mac version. After downloading we can run it through the Terminal. To get a list of available sub-commands run anaconda-h.
Separate log file for connector The logs for Kafka connectors are generally added to connectDistributed.out. If you want to create a separate log file for your connector then you can update the following log4j.properties file. ../etc/kafka/connect-log4j.properties Add the following lines to the file: log4j.appender.connectorNameSpace=org.apache.log4j.RollingFileAppender log4j.appender.connectorNameSpace.DatePattern=’.’yyyy-MM-dd-HH log4j.appender.connectorNameSpace.MaxFileSize=10MB log4j.appender.connectorNameSpace.MaxBackupIndex=10 log4j.appender.connectorNameSpace.File=${kafka.logs.dir}/connect-my.log log4j.appender.connectorNameSpace.layout=org.apache.log4j.PatternLayout log4j.appender.connectorNameSpace.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss} %-5p %c{1}:%L – %m%n… Continue reading »
pip- 407 Proxy Authentication failed If you are running pip behind firewall, you might get the following error: The solution is very simple. Create a file pip.ini in your %user%/pip folder with the following configurations:
Angular – Progressive Web Apps using Service Workers Service workers enable creating progressive web applications. It is a script running in the web browser supporting caching of the application resources. They preserve the resources even after the user closes the tab and serves them when the application is requested again. Setting up Angular Project Let’s… Continue reading »
go – segmentation fault: 11 Running go after a few days, I notice that it is crashing with segmentation 11 error. In this post, we will try to get rid of this error in order to run go on our machine. Actually, I need this as a dependency to run some other development tool. Reading… Continue reading »
Hyperledger Fabric – Terminology Hyperledger Fabric is private and permissioned. In order to gain access, the peers need to be enrolled through a Membership Service Provider (MSP) . It has a deterministic consensus algorithm. Asset An asset holds a state and has ownership. They are key / value pairs representing a value, which enables to… Continue reading »
Hyperledger Fabric Composer & web sandbox Hyperledger Composer is an framework that allows development of Hyperledger fabric based blockchain applications. It must be noted that it has been deprecated with Fabric 1.4 released in August 2019. This is the first long term support release for Hyperledger fabric. It is pledged by maintainers to provide bug… Continue reading »
Apache Flink: could not find implicit value for evidence parameter of type This is a common error when transforming streams in Apache Flink based applications. The solution is simple. We just need to import the following: Which should import the necessary types for the operations.
Kafka Connect – Externalizing Secrets – KIP 297 In order to connect with a data source or sink, we need to use credentials. Kafka Connect added support for specifying credential using config providers. The support for file config provider is available with the installation package. This is discussed in KIP 297. The KIP was released… Continue reading »
Kafka Connect Couchbase Connector – Document Expiration Couchbase supports document expiration. If the documents are ingested from Kafka through Couchbase Sink connector the expiration can be set at the connector side where we can set the expiration for each record upserted as document in couchbase. Here is a sample configuration for the connector: Here is… Continue reading »