Zach Shepherd's WordPress Blog

Just another WordPress weblog

Wednesday, October 28, 2009

Amazon “Quadruple Extra Large” High-Memory Instances

Yesterday Amazon added a High-Memory section of EC2 instances, which included a “Quadruple Extra Large” size. According to the EC2 website, a Quadruple Extra Large instance has “68.4 GB of memory, 26 EC2 Compute Units (8 virtual cores with 3.25 EC2 Compute Units each), 1690 GB of instance storage, 64-bit platform.” As I wasn’t really clear what the 26 EC2 Compute Units would correspond to, I decided to spin one up and poke around. The results are below:

[root@ip-10-218-21-207 ~]# cat /proc/cpuinfo
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 1
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc up pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc up pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc up pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc up pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 5
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc up pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc up pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 7
siblings	: 1
core id		: 0
cpu cores	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc up pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca popcnt lahf_lm
bogomips	: 5338.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

[root@ip-10-218-21-207 ~]# cat /proc/meminfo
MemTotal:     71687580 kB
MemFree:      70139596 kB
Buffers:          4496 kB
Cached:          41520 kB
SwapCached:          0 kB
Active:          15004 kB
Inactive:        35668 kB
SwapTotal:           0 kB
SwapFree:            0 kB
Dirty:             100 kB
Writeback:           0 kB
AnonPages:        4752 kB
Mapped:           5072 kB
Slab:             7960 kB
SReclaimable:     2176 kB
SUnreclaim:       5784 kB
PageTables:        780 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  35843788 kB
Committed_AS:    24060 kB
VmallocTotal: 34359738367 kB
VmallocUsed:       180 kB
VmallocChunk: 34359738187 kB

And the results of kernbench were:

Wed Oct 28 15:30:56 EDT 2009
2.6.21.7-2.fc8xen-ec2-v1.0
Average Half load -j 4 Run (std deviation):
Elapsed Time 114.174 (0.646939)
User Time 356.632 (0.178802)
System Time 76.702 (0.189394)
Percent CPU 379.2 (2.16795)
Context Switches 38541.4 (379.793)
Sleeps 75838 (83.7735)

Average Optimal load -j 32 Run (std deviation):
Elapsed Time 65.466 (0.375673)
User Time 362.856 (6.58352)
System Time 84.936 (8.6855)
Percent CPU 542.4 (172.06)
Context Switches 62848.3 (25625.2)
Sleeps 88501.2 (13376.4)

Average Maximal load -j Run (std deviation):
Elapsed Time 65.036 (0.0260768)
User Time 364.585 (5.8557)
System Time 87.3113 (7.78531)
Percent CPU 597.333 (159.682)
Context Switches 64255.9 (20651.1)
Sleeps 83271.7 (13178.6)

posted by Zach at 5:53 pm  

Friday, September 11, 2009

lilurl

For some reason, I decided that I wanted a simple, easy url shortener for personal use. I spent 5 minutes installing lilurl and another 5 minutes hacking in a simple password field (so that only I and people I know can use it).

The hack:

17a18,20
> // Password
> define('MD5_PASS', '5f4dcc3b5aa765d61d8327deb882cf99');
>
diff -r lilurl/index.php l.zjs.name/index.php
11a12,13
>  if ( md5($_POST['password']) != MD5_PASS ) { die('Incorrect Password'); }
>
179a182,184
>   <br />
>   <label for="password">Enter your password:</label>
>   <input type="password" name="password" id="password" />

posted by Zach at 1:46 pm  

Tuesday, August 4, 2009

“Me”

I’m not sure where I originally got the idea, but at one point I decided it would be a good idea to compile a list of my profiles, accounts, and other web pages related to me. Since then, I’ve been slowly compiling a list of accounts.

This is both for my benefit (so I can keep track of my accounts) and yours (so you can stalk check whether or not a user is me).

This is a work in progress, but I will try to keep it up-to-date. If you see someone you think is me on a website not listed here, drop me an email; It’s very possible that I forgot an account or two.

The list: http://zjs.name/me

posted by Zach at 10:05 pm  

Tuesday, August 4, 2009

My Summer

This summer, I returned to the vCloud team at VMware in Cambridge. I’ve been living in Central Square above Toscanini’s and commuting to Kendall Square on foot, by bike, or, in bad weather, by taking the T.

I’ve had a few recurring events for fun; Pandemonium Books and Games organizes Saturday night Munchkin games and some “Cambervillian” xkcd readers (plus friends) get together for games on a weekly basis (as well as other events).

In June, I presented an Introductory Xen session at Usenix with Wenjin Hu for the second time. Our slides have been posted on the COSI website under a Creative Commons license. This November, I’ll be presenting a similar session at LISA with Professor Matthews.

Last month, Suzanne and I traveled to Provo where we stayed at the to the Seven Stars Resort for a week-long vacation.

Oxt weekend, I will be heading back to Potsdam. On the 17th, Suzanne and I will be moving into our apartment at Clarkson to begin work on the Integrator’s Freshman Survival Guide.

posted by Zach at 9:25 pm  

Tuesday, August 4, 2009

Back from another blogging hiatus

There are a few things from this summer I’d like to post about, so I’ll probably be making a few posts over the next few days. I’m not sure how long the enthusiasm will last, but I’ll try to use it productively.

posted by Zach at 7:32 pm  

Tuesday, April 21, 2009

Styled output (unix c/c++)

After seeing a program that had colored and styled (bold) output, I decided to look into it. There isn’t a lot of information available, so I’m not sure how widely supported it is. It seems to be compatible with gnome-terminal in a few versions of Ubuntu, but I’m not sure what else (if you try it, let me know).

After a lot of trial-and-error (the tutorials I found were all incomplete), I wrote the following program to output the “code” to style text in any one of 8 colors (with an additional 8 background colors) and 4 styles (plain, bold, underlined, and strikethrough). The output leads me to believe underline is poorly supported (only some text is underlined), but for coloring error messages, this is probably sufficient.

Update: It looks like the proper term for these are ANSI escape codes. When you use the proper term, it’s much easier to find tutorials. I’ll leave this up in case anyone stumbles across it not knowing the proper term.

(more…)

posted by Zach at 7:04 pm  

Wednesday, April 15, 2009

Semester Wrap-up: Projects

I worked on a few projects this semester. Regrettably, most of my time was spent discussing rather than doing. Information about each can be found elsewhere (and in other posts, of course).

posted by Zach at 7:24 pm  

Wednesday, April 15, 2009

Semester Wrap-up: Presentations

There weren’t many presentations given this semester, but I did give on version control using subversion (based on the subversion book) the materials are on docs (pdf).

posted by Zach at 7:12 pm  

Wednesday, April 15, 2009

Production Server Setup: Again

At this evenings lab admin meeting there was a presentations inline with what we were currently working on. Jim Owens presented some ideas in the form of a set of proposals for the ways we manage the lab.

The summary of the discussion was that we’re already consolidating in a similar way to his proposal except that we plan to leave righteous alone (move the “core services” to one of the new xen machines keeping stability and security in mind, “projects” to a separate xen machine, and use the third for unstable projects or development).

posted by Zach at 7:05 pm  

Wednesday, April 15, 2009

Docs Status Update

Docs is still running smoothly; it only had a brief bit of downtime (early morning one day) other than general downtime for power outages and such.

The downtime was linked to an error with the sendmail package that was installed causing many, many processes to be spawned (and woken up every 10 minutes). Ryan and I installed an extra package (sensible-mda) to fix the issue.

Backups are still being made on a regular basis, and minutes are being uploaded regularly (although they haven’t been taken as much this semester).

posted by Zach at 7:05 pm  
Next Page »

Powered by WordPress