Archive | Database RSS feed for this section

13 March 2012 38 Comments

Harvesting Twitter Search Results for Analysis using Python & SQL Server

Twitter. It’s everywhere. It’s Data. Realtime, Social, Contextual Data. But, if you want to do any real trending, data mining, post-processing, or even simple analysis on it – you really need to be making a historical record of what you’re looking for and store it in a usable way. I will show you how to create SQL Server tables and use a simple Python script to pull out tweets and save them for future analysis.

25 February 2012 0 Comments

Rare Shit: Scoring Songs on a Setlist by Historical Context (Frequency, Rank, Ntile)

It’s interesting, the types of data conversations you have with people when discussing a unique project like MetallicAnalysis. You’re trying to show things in a different way and get as deep as possible, BUT never want to get too lame or “tech-y”, else it loses contact with the actual subject matter and begins to make less sense. Numbers are cool, but numbers that ACTUALLY FUCKING MEAN SOMETHING to the average fan / person are way cooler…

17 February 2012 2 Comments

Some Metallica Setlist Analysis using Tableau Public Visualization Software and some Python Hacking

I’ve been messing around with Tableau Public for a few nights, and I must say that it is damned impressive, and I’ve used a LOT of Reporting / Analysis / Business Intelligence tools in my day.

I needed to do a proper test / POC; the question was – what kind of data do I use to give it a proper test drive?

Anyone who knows me knows that I’m a huge Metallica fan, hell for as long as I can remember, that’s just been “one of my things” (as many current, ex-girlfriends, and ex-wives can attest to)…

2 June 2011 1 Comment

Cross Post: SQL Server, Business Intelligence, Data Mining, & Major League Baseball (I)

Just a recent article I wrote for the C&C Computer Solutions site / blog. Great stuff. Here’s a bit of the intro, but for the MEAT of it, you’ll have to go to the C&C site and read it yourself…

18 August 2010 7 Comments

Mortgage Software Hack: Importing Contacts automatically into Encompass WITHOUT the SDK (just with SQL)

Anyone who has ever dealt with the mortgage software package “Encompass” from Ellie Mae – from any kind of support / IT standpoint knows the pain. It just… well, doesn’t behave as you would assume. Seemingly simple things (from an integration / workflow standpoint) just don’t play nice, help in the web forums is laughable, […]

10 August 2010 0 Comments

Business Intelligence, Tools, Dirty Caveman Sex, Open-Source – Part 1

Business Intelligence. I hate the term as an IT buzzword. So sick of hearing Business Intelligence-this, Business Intelligence-that, Business Intelligence-expert-my-ass. But, hate it or not “Business Intelligence” shiz isn’t going anywhere – in fact, its been here in one way, shape, or form since the first caveman traded a sharp rock for some unsanctioned cave-nookie.

8 December 2009 5 Comments

Using XLWT and Python to export an Oracle dataset to Excel (Python Simple ETL Part 2)

A few months ago, I showed how you can do simple back and forth ETL task with python scripts – this time I’m going to take it one step further and show how with an extra python module we can actually export data to a usable Excel format as well. I often use this method […]

1 December 2009 1 Comment

Cut-N-Paste Corner: Microsoft SQL Server 2000, 2005, 2008 Simple Loop Template

I think that ‘data wrangling’ takes a special kind of problem solving mentality. Keeping data current, cleaning it, merging it, aggregating it, and creating summary (or data warehouse) tables for reporting purposes… For MANY years I used Express installations of SQL Server 2000 as my ultimate data Swiss Army knife. It was like a secret […]