Tiernan's Comms Closet

So, we are 2 weeks into the new year (give or take a few hours as of writing this) and i am already starting to think about upgrades… some are more likely than others… but here are my thoughts for the new year and upgrades…

• Phones: So, i have had my G1 for a while now (Got it on in the first 2 weeks of July, meaning i have had it nearly 6 months!) and i think it is time to upgrade soon. There are a few phones on the market that are interesting me. here is my current short list in no particular order:
• Apple iPhone 3GS (or newer). O2 Ireland loose the Exclusive contract on this soon, and Vodafone are to also get their hands on it. Since i am a Vodafone Customer, and have a contract with them, i only have to resign some paper and pick one up… Rumours are that the next Gen (which will be the 4 Gen iPhone, but not necessarily 4G network support) will be out in April, but my money is on next gen coming around June or July, around the WWDC…
• Nokia N900. Very cool looking device. Vodafone Ireland are to get their hands on this soon (maybe this month). looks very cool, fast and well, that keyboard is handy.
• HTC HD2. Windows Mobile 6.5, 1Gz Processor, 800×480 display. What more can i say? Very nice device. O2 Ireland might get their hands on this, and if not, Expansys have it…
• Google Nexus one. Not sure if this should be on the list, since Android has kind of annoyed me on the G1, but it does look nice. I got to play with out of these over the Christmas, and it was very nice and responsive. 1Gz processor makes it nearly 2x the speed of the G1. Using a phone for a quick demo is all well and good, but the real test is using it as your main phone. Lower Priority than the rest…
• Likeliness of happening: Highly. Last year i changed phones 4 or 5 times… This is practically inevitable…
• Hardware: After the build of the V.Next Workstation, and the MacPro becoming a HyperV server, there are very few things needed… but improvement can still happen…
• The Proliant: This still only has 5Gb of ram and a Dual Core Processor. Not sure if i should go an upgrade this to a Quad core and 8Gb ram, or just build a new box with that kind of spec. Either way, the machine will get upgraded to Windows Server 2008 R2. Likelihood: 60% chance.
• Mac Pro: No changes needed for this. 12Gb ram, Dual Dual core processors, 10k RPM hdds… Very nice. might just tweek its network connections… Likelihood: 100% chance.
• God Box (AKA the V.Next): Thinking of adding a second graphics card. Maybe some more internal storage. and depending on how things go, maybe more memory. 12Gb is quite a lot at the moment, but we see how things go. If the Graphics card gets upgraded, more monitors might be on the cards also… Likelihood: 70% chance.
• Opteron and Power Edge: these machines are now pretty much maxed out and out of upgrade options (Think i have a 2Gb or 4Gb upgrade for the Power Edge which never got installed… Might do that if i can find the memory). This year, i think these machines will loose their server status and might be officially deprecated… Likelihood: 65% chance
• Media Centre: Over the last few years, i have had a few machines that i have called Media Centres… Now i think it is time to build a new one. Probably be a Quad Core box, few gigs of RAM, PCI-Express DVB-S2 tuners and a nice graphics card… We see how things go over the year. Likelihood: 55% chance
• SAN: I have been wanting to build a SAN for a while now, mainly to store photos, videos, Ripped DVDs, Recorded TV shows, Software and VMs. With the move to Hyper-V i think getting this build sooner rather than later would come in handy. this way i can use the Failover support in Hyper-V. I am also now running at about 110Gb of photos stored on my machine, and have a lot of Music, Video, etc. If the Media Centre gets built, It will consume 2Gb per hour of SD video recorded and more for HD stuff… You can never have enough storage! Likelihood: 75% chance in one for or another…
• House: Big purchase in Life. the rest are nice to haves, this would be epic! As the lads in work have started to call it “The Gadget Platform”. The place i can turn into a Gadget Haven… At this point in the year, i cant see this happening, unless i win the lotto or accidently become rich some how, but its on the list as a possibility… Likelihood: 7% chance
• New Car: My current car, my BMW 523i, is now 10 years old… It is still a nice car, don’t get me wrong, but it is a bit expensive to run: it drinks fuel like there is no tomorrow and the Road Tax is about a grand a year… I would love to get a newer car, another 5 series, but this time it would be a Diesel. the 520D, 525D, 530D or 535D are all beautiful cars, the 535D (3L, Twin Turbo) being the one, money no object, i would buy tomorrow. the 520d makes the most financial sense, being class B for road tax (less than 200EUR a year) and drinking very little fuel (probably about 2x the MPG mine does currently). Likelihood: <5% chance. house would be more important…

Think thats it for the moment… Lets see what the year brings us! Ohhh, and a belated Happy New Year!

Popularity: 9% [?]

So, i have been looking at Data De-Duplication, and have built a little demo app in C# for this idea… The code is on GitHub and if you have better ideas around the code, please leave comments or update the block.

This code is not intended for Production use. it is purely experimental!

One idea i would like to look into though is using a proper backing store for this data: MSSQL DB, Amazon S3, RackSpace Cloud Storage, Azure Blob Storage, etc. the theory would go as follows:

• user points de-dupe tool to a folder
• folder is processed – each file is broken into 512byte blocks (could be more or less, configurable in code) and check-summed (currently using SHA512, but been told its over kill!) an Index file is created for every “real” file on the system. they contain the block IDs in order for the given real file.
• after each block is check-summed, it is checked against the backing store. If the checksum exists in the backing store, the id is written to the index file. if not, a new block is added to the backing store and that ID is added to the index.
• When a user wants the file, the index file is checked, all the blocks are pulled from the correct locations, and built up for the user to work with. Any changes go though the same process. if the user only changes a couple of sections at the end of a file, only those couple of sections should be changed…

You get some problems with changes, in that you dont really want to change all instances of that particular block, incase you break something else… you also need to have something cleaning blocks also, just to remove dead or orphaned blocks…

Running this on some XML files on my drive (about 3200 XMP files from Adobe Lightroom) the code finds 43k blocks duplicated, with an estimated 21mb duplicated. it does no de-duplication at the moment…

Ideally, this should be built as a FileSystem (showing as a hard drive, backed to, say, SQL server or a single large file) or as a SMB share, which can be mounted in Windows… Now to figure out if its possible…

Popularity: 11% [?]

Right. so OSNews has a post asking users to post their setup they are currently using… I was going to post a comment with mine, but though it would take up too much space… so, here is mine. Leave a comment if you wish with your setup…

Main workstation: There was a series of posts about this machine, and the v.next has now become the v.current. This machine currently acts as Dev Workstation, Hyper-V Server, and anything else i need a big fast machine for (Photo processing, Video Editing and conversion, etc) Specs are as follows:

Dual Xeon (Nehamam) 2.26Gz (Quad core, Hyper Threaded)
12Gb DDR 3 Memory
2 300Gb Western Digital Velociraptors (Raid 0 for boot and system drives)
2 1Tb Western Digital Caviar Black Drives (Raid 1 for Data)
NVidia GeForce 275 Graphics with 896mb ram
Running Windows Server 2008 R2.

Proliant Server (Hyper-V, Active Directory Domain Controller (secondary), DNS (Secondary), DHCP)
Intel Xeon 2.6Gz, Dual core
5 Gb Ram (DDR2 IIRC)
Currently got a 250Gb boot drive, and 2 500 Gb data drives, but this will change when the SAN gets built…
Windows 2008 Server (upgrading to R2 soon)

Mac Pro (Hyper-V Server, Remote Desktop Gateway)
Dual proc, Dual Core Xeon 2.66Gz
12Gb RAM
2 74Gb Western Digital Raptors
ATI Radion 9600GT Graphics (512mb ram)
Windows Server 2008 R2

Opteron Box (IIS, SQL Active Directory! only found out its setup for this now!)
Dual Opteron processor (old style, no Virtualization Technology, not even Dual core!)
2GB RAM (maxed out!) this is a SFF Box…
80Gb HDD
Windows Server 2008
Very basic box… Does the job, and nothing else…

Poweredge (Active Directory (Primary), DNS (Primary))
2.4Gz P4 Xeon (Hyper threaded, 64 bit and nothing else)
768Mb RAM…
80Gb HDD
Windows Server 2003 (Yup… its old!)
This used to act as the main webserver, SQL, ISA and Exchange box in the house, but it got old and needed to be replaced. now its just a nice little Active Directory box… Eventually planning on paving, upgrading the RAM and keeping just for AD and DNS. Maybe even a bit of file sharing…

Laptop (main working laptop, college notes, messing around when im board box…)
MacBook Pro
2.4Gz Core 2 Duo processor
4Gb RAM
250Gb (i think) HDD
Dual boot Win 7 X64 Ultimate and OSX 10.6 (Mostly Win7)
Its a Late 2008 UniBody MacBook Pro… More specs if yo go looking for it… Too lazy to look now…

NetBook (Messing with the MacBook is too big)
MSI Wind
Atom 1.6Gz Processor
2Gb RAM
160Gb HDD
Windows 7

So, thats about it… What have you got?

Popularity: 10% [?]

In yesterday’s Budget, the Irish government added a EUR15 per tonn of CO2 tax to companies… Some quick maths!

burning a Liter of Petrol produces 2.39KG of CO2 Per Liter burned. diesel = 2.62KG / L

that means for Petrol, you would need to burn 418.4 L to produce a Tonn of CO2 (381.6 for Diesel).

so, EUR15 / 418 = 3.5c (Diesel = EUR15 / 381 = 3.93).

Now, thats based on Metric toness and the the government are obviously screwing us a little more…

This maths can also be used to figure out your CO2 emissions from your car…

If your car does 25 MPG (on average) this works out at 11.3L per 100km. this works out that for every 100k you would create 27Kg of CO2. divide that by 100 and you get 270g of CO2 / KM… that’s a LOT!

the opposite is also possible to work out.. My car produces 245g of CO2 per KM…

KG of co2 produces per 100k = (245 * 100) / 1000 = 24.5KG

24.5KG / 2.39 Kg = 10.25L per 100k.

which is about 27.5MPG… change 2.39 for 2.62 for diesel, where appropriate… your millage may vary (sorry, pun intended…)

Popularity: 13% [?]

So, i have been busy working on code for Torrent Helper (still looking for a proper name and URL) and one of the things i wanted to add was a version number footer… ust for the laugh, just cause i could… But how? So, this is how you do it…

First, you need to modify the AssemblyInfo.cs file in your project (I have 2 projects, my website and my backend service). In here i set the AssemblyVersion and AssemblyFileVersion to 0.1.*. The * tells the compiler to magically build the number…

Next, how do you get it back out programatically? (click to see the larger version)

As you can see, i have 2 functions here. one (PrintBuild()) is called by the web site where i want to put the data (I know this is not pretty, but its working… maybe some dat i will changed it… the second functions only job is to get the information about the assembly and work out the date and time it was built… Any questions, leave a comment.

Popularity: 17% [?]

Today i would like to announce the release of Torrent Helper, a website i started coding about 19 hours ago (as of time of writing this post at 6pm on Satrday). The coding of this project started at 11PM on Friday, and took a short break at 6am for some sleep… It was officially released (with a pop up on Twitter) at 5.29pm…

Anyway, what does it do? You give it a Torrent file (Legal of course), either the URL or an existing torrent you have somewhere, and it will find extra trackers for that given torrent, add them to the file and send it back to you… Thats pretty much it!

Any questions, drop me a mail (tierno [at] lotas-smartman [dot] net) or leave a comment.

Popularity: 17% [?]

A Few days ago on the Jungle Disk blog, it was announced they would be releasing a BETA of their new product: Jungle Disk Server. This sounded very interesting, and one of the more interesting features that was added was De-Duplication…. let me try explain with a bit of detail…

I am backing up my SVN server. I have 2 scheduled tasks: every 15 min, take the latest revesions that where not previously backed up and dump them to a file… then weekly, take a full backup. i ran this on a folder with 13 full backups (about 730mb a piece, totaling about 9Gb) and 31 smaller backups, averaging about a meg and a half… there is a LOT of duplicated data here: every full backup is the equivilant of the last weeks full backup and the smaller 15min backups… and it goes on. De-Duplication looks at all the blocks, and figures out of they have already been backed up… If so, it wont back it up again, put puts a pointer to that block in the backup db…

So, we say the last full backup is 750mb… that shold be all that is needed… Jungle Disks first backup of this server found 8.45Gb and uploaded 149mb! Thats it! there is compression going on there also, but that is pretty impressive! A Full backup has been run since then, and it brough the total file size to 9.17Gb, and the upload was 4.47mb! Very, VERY Cool!

So, at the moment, i have it backing up my SQL server, my Ubuntu server (where the blogs live, both the WordPress dirs and the MySQL server itself) and also my SVN Box. So far so good! Check if out.

Popularity: 53% [?]

So, it has been a couple of weeks since i last posted the status of the upgrade… In those weeks, i have finilized the parts list, started ordering stuff, and stuff has started arriving! But first, some news about the Mac Pro… you all though it was dead… I though it was dead… then i cleaned the graphics card, and, well, its working again…. but, and this is a big but, the graphics card is still over heating… pain in the arse… going to try replace the Graphics card and use it as a server… more on that later.

So, Final parts list:

1. Mobo and Chips – Went with the Intel S5520SC and E5520 processors. Ordered them and they arrived a few weeks ago. Unboxing photos here.
2. Coolers: Went with non Watercooling… kind of chickened out at the idea of water flowing around a couple of grands worth of computer… Went with the Noctua NH-U12 DX. Photos and Unboxing here.
3. Case: Antec P193
4. HDDs: Boot: 2 x WD Velociraptor 300Gbs Data: Currently 2 1Tb WD Black Editions
5. Graphics: Asus GeForce 275 with 896Mb Ram
6. Powe Supply: Corsair HX-1000w
7. Memory: 12Gb Kingston (Still waiting on this…)

Photos of the first part of the build are up here, Once the memory arrives, i will fill in the HDDs, grab a DVDR from somewhere and stick that in and hook up some monitors. We can then start testing this bad boy!

Popularity: 53% [?]

Right… So, my blog is currently living on an Ubuntu box here in the house and is running 3 of my blogs (this one, The Angry Viking and Tiernans Photography Blog). With all the news about WordPress being under attack, i though i better share some of my scripts i use for Backing up the sites…

1. i am using S3Sync for the Upload to S3…
2. The code for the Script is available on this Gist. It was slightly modified (Removing my DB username and passwords, and only backing up one DB and Directory).
3. I want this to run every night, but at the moment it is kicked off manually…
4. There should be a clean up part at the end deleting the uploaded file… Ideally the uploader should check if the upload file was finished before deleting also…

If there is anything anyone can see that could be changed, please leave a comment.

Popularity: 55% [?]

So, i have been thinking about building a ZFS powered SAN, and today i started thinking about using USB keys and drives… Why? SATA controllers with more than 4 ports are not cheap!

So, the way i was thinking was as follows (If anyone knows about ZFS and SANs, tell me if this is completely off the wall!)

• Buy a basic Board and Chip, some RAM and a couple of PCI Express or PCI USB controllers
• Stick in 2 Western Digital Raptors (i have 2 Spare 74Gb 10k drives here) and use them for ZIL storage. Or split them so one is for ZIL, the other for Cache
• attach some USB Drives to the machine. I was thinking 16 x 32Gb USB Keys, but realized i can get a 500Gb external drive that takes no external power for about the same price…

In theory, when writing and reading, the external drives would be slower than expected, but with the ZIL and Cache Drives, things should (in theory…) be faster… Any thoughs?

Popularity: 60% [?]