Archive

Archive for October, 2015

Uitslagen 2015

# datum wedstrijd plaats afstand tijd
1. 12-apr-15 ETU EK Powerman Holland Duathlon 2015 – Sprint Horst 5-20-2,5km 1:07:37 [u]
2. 29-aug-15 Run Bike Run Borne Borne 6,5-30-4,8km 1:47:22 [u]

Planning :

  1. 31-dec-15 – Sylvestercross, Soest

dikgedrukt is een PR

Advertisements
Categories: Uncategorized

Spark Streaming Backpressure – finding the optimal rate is now done automatically

One of my complaints about Spark was that it wasn’t possible to set a dynamic maximum rate. This is a problem in many jobs since the maximum throughput isn’t always linear with the output rate. Another issue is with local testing. You have to set the rate to extremely low values and experiment a lot to make a Spark job usable on a local machine.
But all these problems are in the past with the introduction of backpressure (I believe it’s spelled as back pressure, but I’ll stick to the Spark notation).

Read more…

Categories: English, java, work Tags: , ,