Hacking Scrum

A lot of development organizations use Scrum as their preferred Agile process. Sometimes that’s just what you’ll have to go with. I was part of development teams before Agile was “en vogue” - we still delivered software in useful bits on time and within budget and with minimal preexisting specification. I’m not going to critic Scrum. Instead I will focus on how to change it to make it more pleasant for everybody involved.

Kubernetes on AWS with kops

I evaluated ways to deploy an Kubernetes cluster on AWS and settled on kops, since it is well supported by the Kubernetes community and can set up HA clusters.

Extending Spark's Accumulators

Spark’s accumulators can be used for much more than just adding up numbers. Spark only ships with int/double accumulators, but you can always create your own by implementing AccumulatorParam. Let’s say we’re processing log files with Spark Streaming and we would like to create a running tally of the most used browsers.