Apache Flink – Collections & Streams While developing a streaming application, it is often necessary to use some inputs as collections. This can be specially useful for testing purposes. In this post we are trying to discuss how we can create a DataStream from a collection. After applying some operators on the stream, we are… Continue reading »
![Apache Flink – Class Not found [org/apache/flink/streaming/api/scala/DataStream]](http://www.alternatestack.com/wp-content/uploads/2018/09/Screen-Shot-2018-09-16-at-5.29.04-PM-200x140.png)
Apache Flink – Class Not found [org/apache/flink/streaming/api/scala/DataStream] If you are developing a Flink app following examples on the web, you can most likely encounter the following error: Generally, the problem is resolved by correctly setting the source folder in a scala project in IntelliJ but the weird thing is that it is happening for a… Continue reading »
Custom Log4J Configuration file for Kafka In order to use a custom Log4J configuration file and to override the default one, we need to add the details in -Dlog4j.configuration. Here is how you can update the configuration path: As you can notice, we have also update the directory where logs are generated by overriding LOG_DIR.
Apache Flink – Change Port for web front end Apache Flink runs the dashboard on port 8081. Since this is a common port there might be conflict with some other services running on the same machines. You might encounter this scenario especially during development when many services are running on the your development machine. But… Continue reading »
IntelliJ & Scala – Could not load main class This is one of the most common error we see when we get new code from a source repository. We might also see it when we create a new Scala project. As we run the application, the console shows could not load main class The solution… Continue reading »
IntelliJ – Add New Scala Class Option – Not Available You might get into this problem every time a new Scala project is created. By default, the support of Scala is not available. So when you right click your src folder to add Scala Class, you might be disappointed to see no option for adding… Continue reading »
Angular Material Toggle Buttons Group with Binding In this post we are going to create an Angular App to use Button toggle groups from Angular material. We are going to do data binding of these buttons and generate the buttons using a list in the code behind in the component class. Let’s first create a… Continue reading »
Kafka-Consumer-Groups – Kafka CLI Tools Kafka-Consumer-Groups is a CLI tool which can be used to get the message consumption from Kafka. The tool can be used to get the list of topics and partitions consumed by a consumer group. It also details if a consumer is lagging in consumption of the messages. First we need… Continue reading »
Couchbase – Updating the Max Number of Buckets Per Cluster Couchbase sets a maximum limit of 10 buckets per cluster. Now this setting is configurable and REST API supports that. Here is how you can update it:
Deleting Connectors from Kafka Connect A connector can be deleting using Kafka Connect’s REST API. Here is the curl command: