C# has some pretty brilliant encryption classes built in. For a recent project, i needed to store a password in clear text (it needs to be passed onto another system) and i figured i didn't want to be storing it in a settings file without being encrypted. Of course, anyone who decompiles the executable of my program can figure out how to decrypt it, but it's better than nothing. So here's the code:

Read the rest of this post »

This post is kindof a follow on from yesterdays fast but memory intensive file reconciliation post. On StackOverflow it was suggested to me that when reconciling large files, it'd be more memory efficient to sort the files first,

Read the rest of this post »

In this entry, i'm going to explain the techniques i use to (quickly) reconcile large data sets, eg a million rows. I use this to compare large tables or large files against each other, to find any data rows that are in either file that are missing from the other.

Read the rest of this post »