apt-get upgrade and apt-get install is slow as hell

Hello,

I ordered a new VPS with this specs:
4GB Ram 4GB Swap 4 Cores
I installed Debian 6.0 64 bit minimal and I try to bring my system up 2 date. So I run apt-get update and apt-get upgrade. But apt-get upgrade is REALLY slow. So I reinstalled my VPS and tested the dd speed:

root@s7:~# dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 9.16583 s, 117 MB/s<br><br>

FreeVPS.us Benchmark:

root@s7:~# wget freevps.us/downloads/bench.sh -O - -o /dev/null|bash
CPU model :  Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz
Number of cores : 4
CPU frequency :  3300.013 MHz
Total amount of ram : 4096 MB
Total amount of swap : 4096 MB
System uptime :   3 min,
Download speed from CacheFly: 34.1MB/s
Download speed from Coloat, Atlanta GA: 7.14MB/s
Download speed from Softlayer, Dallas, TX: 5.21MB/s
Download speed from Linode, Tokyo, JP: 5.21MB/s
Download speed from i3d.net, NL: 17.3MB/s
Download speed from Leaseweb, Haarlem, NL: 25.0MB/s
Download speed from Softlayer, Singapore: 2.79MB/s
Download speed from Softlayer, Seattle, WA: 2.43MB/s
Download speed from Softlayer, San Jose, CA: 6.63MB/s
Download speed from Softlayer, Washington, DC: 7.02MB/
I/O speed :  133 MB/s

I think the results are ok, so why is it so slow? btw atm I'm running a ServerBear Benchmark to see the CPU speed.