Getting started with Akka Stream Kafka – Using Kafka the reactive streams way

19 September 2016 5 comments

A few days ago my eyes fell on a new release of Akka Stream Kafka. Since I’m doing a lot with Kafka currently and I really wanted to get my hands dirty with Akka this sounded very good. Also a good opportunity to see if an upgrade to Kafka 0.10.0.1 (from 0.8.2.2) is worth while (since older versions of Kafka are not supported in Akka Stream Kafka 0.11).

Read more…

Categories: English, java, work Tags: , ,

Finding the link between heart rate and running pace with Spark ML – Fitting a linear regression model

2 September 2016 1 comment

Besides crafting software I’m an avid runner and cyclist. Firstly for my health and secondly because of all the cool gadgets there are available. Recently I started with a Coursera course on Machine Learning and with that knowledge I combined the output of my running watch with Spark ML. In this article I discuss how to load gps and heart rate data to a linear regression model and ultimately get a formula with heart rate as input and running pace as output.

Read more…

At-least-once delivery with Kafka and Spark – Improve the reliability of your job

The default behaviour of a Spark-job is losing data when it explodes. This isn’t a bad choice per se, but at my current project we need higher reliability. In this article I’ll talk about at least once delivery with the Spark write ahead log. This article is focussed on Kafka, but can also be applied to other Receivers.

Read more…

Categories: English, java, work Tags: , , ,

Spring Boot with HTTP/2 – Start a server and make REST calls as a client

Since HTTP/2 is gaining momentum I thought it would be a nice experiment to see if it’s possible to convert some applications to HTTP/2. We have a bunch of Spring Boot micro services and those services communicate with each other via REST calls. All communication happens via JSON (Jackson 2). Running Spring Boot with HTTP/2 should be easy and hopefully Spring RestTemplate supports HTTP/2 for the inter service communication. Let’s see…

Read more…

Categories: English, java, work Tags: ,

HTTP/2 Server Push with JBoss undertow – And how to monitor things

With HTTP/2 it’s possible to deliver data at a client before the client even asks for the data. This will significantly improve latency and perceived download speed. Last hack day at JPoint we spent some time with HTTP/2 server push. I will show you how to get it running on your machine and show some tools to monitor/prove all this goodness.

Read more…

Categories: English, java, work Tags: ,

How to capture and decode HTTP/2 traffic with Wireshark

Last JavaOne I attended ‘HTTP 2.0 – What do I need to know?’, an excellent talk by Hadi Hariri. Many of the solutions of HTTP/2 are solutions to problems I face daily. Since I’m a curious guy I wanted to know what was happening at packet level in this awesomeness. Soon I faced SSL-decoded-packet-problems (in practice all HTTP/2 traffic is encrypted). Hadi mentioned Wireshark had support to solve this problem. He made it sound very easy, but since I wrote this article it was a bit harder.
The method I’ll explain to decode HTTP/2 can also be applied to HTTP/1.1

Read more…

Categories: English, work Tags: , , , ,

Uitslagen 2015

# datum wedstrijd plaats afstand tijd
1. 12-apr-15 ETU EK Powerman Holland Duathlon 2015 – Sprint Horst 5-20-2,5km 1:07:37 [u]
2. 29-aug-15 Run Bike Run Borne Borne 6,5-30-4,8km 1:47:22 [u]

Planning :

  1. 31-dec-15 – Sylvestercross, Soest

dikgedrukt is een PR

Categories: Uncategorized