Saturday, 16 November 2013

What's the point of bringing data together?

So why is that we bring data together? What is the benefit in the end?
I'm asking these questions because with the advent of the digital age, and rapid development cycles, much of many companies data sources are left stranded, on their own, floating off into the ether and never to be seen again - unless you are directly concerned with that particular data source.

So what are these data sources and why should I care?
Well they could be your website and product page traffic data locked up in a third party analytics tool. It could be your app user data again locked up in a third party app solutions company. Maybe it's your media spend data? Is it your e-commerce data? Email marketing data? Facebook app data?
Whatever it is, centralising it into your data warehouse can add value and visibility across the business!


So what could I get out of centralising my data?
Firstly, it will provide a one stop shop for all your company data. This means whatever you are looking for you can find it in the Data Warehouse. Ask many an executive, business analyst, marketing manager, etc., of the times they have wanted visibility over specific activities and their cross-functional influence and the answer has been Too Hard? It's usually many, many times! It's also quite frustrating for those involved; especially when KPI's are riding hard on them.
Secondly, it gives a vast array of data for your analysts to mine and extrapolate insights from all at their fingertips. It is literally the equivalent of laying down water pipes to your house to save you from fetching your drinking water from the local well! It is of course absolutely doable to go and fetch water from the well but it is hardly the ideal situation and it will be much quicker in the long term to have everything at hand.
Thirdly, and most importantly, it's all about measurement! It's being able to know how many of your highest paying customers are using the app you created. Or whether the advertising you are conducting in certain media markets are producing a greater increase in sales versus those that are not receiving the activity.

So how does one actually bring it all together?
Well that's where you pick up the phone and bring in a Business Intelligence and Data Warehousing team in to create a data strategy and then begin the process of creating the connections between these far distant islands of data and your data warehouse.

Thursday, 7 November 2013

The treasure within

I recently watched Todd Sampson's redesign my brain series on ABC1 and I found it really cool how we all use so little of our brain and that with a little training we can increase our performance dramatically. It is fair to say that it was the opportunity and the gains to be made through some training that could result in a real impact that was most impressive to me. I guess the reason it struck a chord with me was my long held view of a similar ilk that we use only a little of the vast array of data within our companies' datamarts and warehouses and that with a little exploration and perhaps a bit of training a lot of value can be gained.

So where is it?
Largely this untapped data is contained in the transactional data that is collected every time a customer has an interaction with your company. This might be logging in online, updating information, it might be a late payment, a call into your service centre, it could be their payment timings; it could be a range of things. The key is that they are stored in transactional tables and by definition measure a behaviour of sorts.

So how can I use it?
Typically the way data modellers use the data in this sense is to link it back to the account table and rationalise the data into a flat file. This is done by aggregating the transactional data into a measure. For instance it could be the number of logins in the last 90 days, or calls into to the service centre in the last month or a yes/no flag as to whether they have made a late payment in a given time period.

From there it is about what you are looking to achieve. Is it to reduce churn? Is it about increasing sales? Is it about targeting people who are most likely to purchase? All of this data is typically held in the average data warehouse and it's about getting in touch with the right people who can give access to these tables.

I'm interested to hear about peoples experience with using data from strange sources to achieve a measurable outcome - please share if you can and any challenges faced!