Before It's Too Late: Finding Real-time Holes in Data

Do you work with data? Is it large, unwieldy, changing, or flaky? Does it come in flavours, formats, and colours? Don't you need to import it, from whatever the source?. That's only the beginning of the life cycle.

Eventually you write scripts to handle different data types. You have to continuously massage your data, and support migrations because of it. Next come scripts - one offs. Don't forget the eventual system that gets created to try and handle this. That is a lot of flux, a lot of maintenance.

Or - we use a real-time, programmable database. Your importers can evolve and live as close as possible ot their data. Your applications now run faster, you experience less downtime, your users are much happier.  

In this talk, we'll import some historic financial data into a legacy, relational database. We'll use a real-time database engine to co-ordinate workers to update our data set, and finally we'll learn about options to scale our data handling horizontally. You will reduce the load on your applications. Plus, there are bad jokes.