Kafka Connect – Externalizing Secrets – KIP 297 In order to connect with a data source or sink, we need to use credentials. Kafka Connect added support for specifying credential using config providers. The support for file config provider is available with the installation package. This is discussed in KIP 297. The KIP was released… Continue reading »
Apache Flink: History Server One of the problems we have faced running Apache Flink that we have a very limited windows for getting access to the details about failed / crashed jobs. The job details just disappear and cannot be retrieved especially form web front end. Here is how it looks like: Actually we are… Continue reading »
Confluent – Using off-the-shelf-connectors with Landoop’s Kafka Connect UI In this post we are going to see how easy it is to run a Kafka Connector in order to source data in Kafka using a well designed tool like Landoop’s Kafka Connect UI. We can use Kafka Connect’s REST API to determine what connectors are… Continue reading »
CORS with Kafka REST Proxy Landoop’s Kafka Topics UI is an excellent tools to view the topics in a Kafka Cluster in Confluent platform. It is based on AngularJS. If you just follow the instruction and run it using http_server, you would get the following error: The issue is with the default CORS settings on… Continue reading »
Postman – Interceptor Chrome Extension Postman has an alternate to fiddler to capture and replay the HTTP requests sent by browser. It is called Postman Interceptor. There is a number of steps you need to follow in order to get request interception. You can start with Postman and enable interceptor from the header. If Interceptor… Continue reading »
Play Framework and CORS with Angular2 Client(Cross Origin Resource Sharing) Although Play framework allows us to write complete web application including UI. But we can just keep our REST based HTTP service in Play Framework and access them from any other application hosted on another server. But as soon as you do it, you start… Continue reading »
Using PostMan for APIs: PostMan is a tool for testing HTTP REST Services. It’s a tool similar to Fiddler but a lot easier to use. It doesn’t work like a sniffer for all the HTTP traffic for the system. It works like a simple HTTP client. It allows to send HTTP requests with a request… Continue reading »