-
Announcing EventHubs ReIngest
When building a Kappa Architecture replaying historic events is an important property of the system. EventHub and IoTHub support EventHub Capture a way to automatically archive all incoming messages on Azure Blob or Azure Data Lake Store, this takes care of the archiving part. To replay those messages back onto an EventHub (preferably a different one!) I created nathan-gs/eventhubs-reingest, a Spark based application that reads the Avro messages, sorts, repartitions (by random chance) and writes them as fast as possible to EventHub.
-
OneDrive on NixOS using Docker
My NAS is a Atom based Thecus running NixOS. NixOS is a Linux distribution with a functional, as in functional programming, approach to package and configuration management. It contains many packages and services. In most cases enabling a new service is as easy as adding
services.openssh.enable = trueto/etc/nixos/configuration.nix.
Unfortunately skilion/onedrive, a D-lang based OneDrive client, is not available on NixOS and building it required a different version of the DMD compiler.
I was a bit lazy and also wanted to experiment with docker on NixOS so I decided to run skilion/onedrive as docker container on NixOS. -
Making SlideShare iframes responsive, using CSS
While reviving my blog I wanted a way to embed my presentations, by default the SlideShare embed code uses a fixed width and height.
-
Cloudera, Azure and Big Data at Cloudera Meetup '17
Big Industries hosted an evening of Cloudera in the Cloud. I presented on “Cloudera, Azure and Big Data”, showcasing how well Cloudera integrates with Azure data services, and how easy it is to deploy the full power of Cloudera’s enterprise data hub, as well as using Cloudera Altus on Azure.
-
Microsoft AI at SAI '17
SAI hosted an evening of Deep Learning frameworks in Antwerp. I talked on AI, breakthroughs and (ethical) challenges and how Microsoft can help your organization doing more with data.