Another "newbie" aking for help with quad G34...

AXm77 · Nov 10, 2012

I asking you guys for help with my quad.
Up to last week I was running S8812 with 2 Opterons 6176 (non-SE) and one 6134 with quite good results : 32 cores @2.3GHz - p8101 ~ 20min TPF.
To make this configuration to work I had to flash bios 1.02 (pre-Interlagos), set CPU DownCore Mode to Maximum Core Level (option do not exist in later BIOS-es)
save change and disconnect power from system (otherwise I was ending with only 24 cores - 3 nodes x 8 cores).
Last week I got pair Opterons 6168's and decided to update system. I installed 6168's in socket 0 and 1, 6176's - 2 and 3 (as it marked on PBC). BIOS reporting 48 cores and all memory counted (16GB).

That is TPC -l:

Code:

 Main processor is Family 10h Processor
	Family: 0xf		Model: 0x9		Stepping: 0x1
	Extended Family: 0x10	Extended Model: 0x9
	Package Type: 0x3	BrandId: 0x45f	
Machine has 8 nodes
Processor has 6 cores
Processor has 5 p-states
Processor has 0 boost states

Power States table:
-- Node: 0 Core 0
core 0 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 0 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 0 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 0 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 0 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 0 Core 1
core 1 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 1 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 1 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 1 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 1 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 0 Core 2
core 2 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 2 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 2 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 2 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 2 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 0 Core 3
core 3 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 3 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 3 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 3 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 3 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 0 Core 4
core 4 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 4 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 4 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 4 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 4 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 0 Core 5
core 5 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 5 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 5 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 5 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 5 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 1 Core 0
core 0 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 0 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 0 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 0 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 0 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 1 Core 1
core 1 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 1 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 1 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 1 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 1 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 1 Core 2
core 2 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 2 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 2 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 2 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 2 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 1 Core 3
core 3 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 3 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 3 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 3 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 3 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 1 Core 4
core 4 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 4 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 4 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 4 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 4 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 1 Core 5
core 5 pstate 0 (p0) - En:1 VID:36 FID:3 DID:0.00 Freq:1900 VCore:1.1000
core 5 pstate 1 (p1) - En:1 VID:40 FID:14 DID:1.00 Freq:1500 VCore:1.0500
core 5 pstate 2 (p2) - En:1 VID:43 FID:10 DID:1.00 Freq:1300 VCore:1.0125
core 5 pstate 3 (p3) - En:1 VID:45 FID:4 DID:1.00 Freq:1000 VCore:0.9875
core 5 pstate 4 (p4) - En:1 VID:47 FID:0 DID:1.00 Freq:800 VCore:0.9625
-- Node: 2 Core 0
core 0 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 0 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 0 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 0 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 0 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 2 Core 1
core 1 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 1 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 1 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 1 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 1 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 2 Core 2
core 2 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 2 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 2 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 2 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 2 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 2 Core 3
core 3 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 3 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 3 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 3 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 3 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 2 Core 4
core 4 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 4 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 4 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 4 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 4 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 2 Core 5
core 5 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 5 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 5 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 5 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 5 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 3 Core 0
core 0 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 0 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 0 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 0 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 0 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 3 Core 1
core 1 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 1 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 1 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 1 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 1 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 3 Core 2
core 2 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 2 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 2 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 2 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 2 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 3 Core 3
core 3 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 3 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 3 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 3 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 3 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 3 Core 4
core 4 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 4 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 4 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 4 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 4 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 3 Core 5
core 5 pstate 0 (p0) - En:1 VID:34 FID:3 DID:0.00 Freq:1900 VCore:1.1250
core 5 pstate 1 (p1) - En:1 VID:38 FID:14 DID:1.00 Freq:1500 VCore:1.0750
core 5 pstate 2 (p2) - En:1 VID:41 FID:10 DID:1.00 Freq:1300 VCore:1.0375
core 5 pstate 3 (p3) - En:1 VID:43 FID:4 DID:1.00 Freq:1000 VCore:1.0125
core 5 pstate 4 (p4) - En:1 VID:45 FID:0 DID:1.00 Freq:800 VCore:0.9875
-- Node: 4 Core 0
core 0 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 0 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 0 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 0 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 0 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 4 Core 1
core 1 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 1 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 1 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 1 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 1 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 4 Core 2
core 2 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 2 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 2 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 2 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 2 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 4 Core 3
core 3 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 3 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 3 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 3 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 3 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 4 Core 4
core 4 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 4 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 4 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 4 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 4 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 4 Core 5
core 5 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 5 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 5 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 5 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 5 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 5 Core 0
core 0 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 0 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 0 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 0 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 0 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 5 Core 1
core 1 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 1 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 1 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 1 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 1 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 5 Core 2
core 2 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 2 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 2 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 2 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 2 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 5 Core 3
core 3 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 3 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 3 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 3 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 3 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 5 Core 4
core 4 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 4 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 4 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 4 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 4 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 5 Core 5
core 5 pstate 0 (p0) - En:1 VID:37 FID:3 DID:0.00 Freq:1900 VCore:1.0875
core 5 pstate 1 (p1) - En:1 VID:41 FID:14 DID:1.00 Freq:1500 VCore:1.0375
core 5 pstate 2 (p2) - En:1 VID:44 FID:10 DID:1.00 Freq:1300 VCore:1.0000
core 5 pstate 3 (p3) - En:1 VID:46 FID:4 DID:1.00 Freq:1000 VCore:0.9750
core 5 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 6 Core 0
core 0 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 0 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 0 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 0 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 0 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 6 Core 1
core 1 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 1 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 1 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 1 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 1 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 6 Core 2
core 2 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 2 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 2 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 2 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 2 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 6 Core 3
core 3 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 3 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 3 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 3 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 3 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 6 Core 4
core 4 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 4 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 4 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 4 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 4 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 6 Core 5
core 5 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 5 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 5 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 5 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 5 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 7 Core 0
core 0 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 0 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 0 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 0 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 0 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 7 Core 1
core 1 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 1 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 1 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 1 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 1 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 7 Core 2
core 2 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 2 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 2 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 2 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 2 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 7 Core 3
core 3 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 3 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 3 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 3 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 3 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 7 Core 4
core 4 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 4 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 4 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 4 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 4 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500
-- Node: 7 Core 5
core 5 pstate 0 (p0) - En:1 VID:38 FID:3 DID:0.00 Freq:1900 VCore:1.0750
core 5 pstate 1 (p1) - En:1 VID:42 FID:14 DID:1.00 Freq:1500 VCore:1.0250
core 5 pstate 2 (p2) - En:1 VID:45 FID:10 DID:1.00 Freq:1300 VCore:0.9875
core 5 pstate 3 (p3) - En:1 VID:47 FID:4 DID:1.00 Freq:1000 VCore:0.9625
core 5 pstate 4 (p4) - En:1 VID:48 FID:0 DID:1.00 Freq:800 VCore:0.9500

 --- Node 0:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 1900 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 36 (1.100v)
Processor AltVID: 47 (0.962v)

 --- Node 1:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 1900 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 36 (1.100v)
Processor AltVID: 47 (0.962v)

 --- Node 2:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 2300 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 34 (1.125v)
Processor AltVID: 45 (0.988v)

 --- Node 3:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 2300 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 34 (1.125v)
Processor AltVID: 45 (0.988v)

 --- Node 4:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 1900 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 37 (1.087v)
Processor AltVID: 48 (0.950v)


 --- Node 5:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 1900 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 37 (1.087v)
Processor AltVID: 48 (0.950v)

 --- Node 6:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 2300 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 38 (1.075v)
Processor AltVID: 48 (0.950v)

 --- Node 7:
Processor Maximum PState: 4
Processor Startup PState: 4
Processor Maximum Operating Frequency: 2300 MHz

Minimum allowed VID: 123 (0.013v) - Maximum allowed VID 38 (1.075v)
Processor AltVID: 48 (0.950v)

TPC -htc:

Code:

Hardware Thermal Control Status:

 --- Node 0:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 4

 --- Node 1:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 0

 --- Node 2:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 4

 --- Node 3:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 0

 --- Node 4:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 4

 --- Node 5:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 0

 --- Node 6:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 4

 --- Node 7:
HTC features enabled flag: false. Hardware Thermal Control is disabled.
HTC features currently active (means overheating): false
HTC features has been active (means overheated in past): false
HTC parameters are locked: false
HTC Slew control: by Tctl without Slew register
HTC Limit temperature (equal or above means overheating): 70
HTC Hysteresis temperature (equal or below means no more overheating) : 65
HTC PState Limit: 0

TPC -temp :

Code:

Detected processor: Family 10h Processor
Machine has 8 nodes
Processor has 6 cores
Processor has 5 p-states
Processor has 0 boost states
Processor temperature slew rate:9.0C

Temperature table:
Node 0	C0:41	C1:41	C2:41	C3:41	C4:41	C5:41	
Node 1	C0:40	C1:40	C2:40	C3:40	C4:40	C5:40	
Node 2	C0:44	C1:44	C2:44	C3:44	C4:44	C5:44	
Node 3	C0:43	C1:43	C2:43	C3:43	C4:43	C5:43	
Node 4	C0:42	C1:42	C2:42	C3:42	C4:42	C5:42	
Node 5	C0:42	C1:42	C2:42	C3:42	C4:42	C5:42	
Node 6	C0:45	C1:45	C2:45	C3:45	C4:45	C5:45	
Node 7	C0:45	C1:45	C2:45	C3:45	C4:45	C5:45

All that info was taken when system is folding:

Code:

ndy@FAH2:~/F@H$ ./fah6

Note: Please read the license agreement (fah6 -license). Further 
use of this software requires that you have read and accepted this agreement.

48 cores detected


--- Opening Log file [November 10 12:45:34 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/andy/F@H
Executable: ./fah6
Arguments: -smp 48 -bigbeta -verbosity 9 

[12:45:34] - Ask before connecting: No
[12:45:34] - User name: AXm77 (Team 276)
[12:45:34] - User ID: 15D59F6969CC3E84
[12:45:34] - Machine ID: 1
[12:45:34] 
[12:45:34] Could not open work queue, generating new queue...
[12:45:34] - Preparing to get new work unit...
[12:45:34] - Autosending finished units... [November 10 12:45:34 UTC]
[12:45:34] Cleaning up work directory
[12:45:34] Trying to send all finished work units
[12:45:34] + No unsent completed units remaining.
[12:45:34] - Autosend completed
[12:45:34] + Attempting to get work packet
[12:45:34] Passkey found
[12:45:34] - Will indicate memory of 16044 MB
[12:45:34] - Connecting to assignment server
[12:45:34] Connecting to http://assign.stanford.edu:8080/
[12:45:35] Posted data.
[12:45:35] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[12:45:35] + News From Folding@Home: Welcome to Folding@Home
[12:45:35] Loaded queue successfully.
[12:45:35] Sent data
[12:45:35] Connecting to http://128.143.231.201:8080/
[12:45:42] Posted data.
[12:45:42] Initial: 0000; - Receiving payload (expected size: 30316333)
[12:45:58] - Downloaded at ~1850 kB/s
[12:45:58] - Averaged speed for that direction ~1850 kB/s
[12:45:58] + Received work.
[12:45:58] + Closed connections
[12:45:58] 
[12:45:58] + Processing work unit
[12:45:58] Core required: FahCore_a5.exe
[12:45:58] Core found.
[12:45:58] Working on queue slot 01 [November 10 12:45:58 UTC]
[12:45:58] + Working ...
[12:45:58] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 01 -np 48 -checkpoint 10 -verbose -lifeline 3682 -version 634'

thekraken: The Kraken 0.7-pre15 (compiled Sat Jul 21 08:32:10 CDT 2012 by andy@FAH2)
thekraken: Processor affinity wrapper for Folding@Home
thekraken: The Kraken comes with ABSOLUTELY NO WARRANTY; licensed under GPLv2
thekraken: PID: 3692
thekraken: Logging to thekraken.log
[12:45:59] 
[12:45:59] *------------------------------*
[12:45:59] Folding@Home Gromacs SMP Core
[12:45:59] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[12:45:59] 
[12:45:59] Preparing to commence simulation
[12:45:59] - Looking at optimizations...
[12:45:59] - Created dyn
[12:45:59] - Files status OK
[12:46:03] - Expanded 30315821 -> 33158020 (decompressed 109.3 percent)
[12:46:03] Called DecompressByteArray: compressed_data_size=30315821 data_size=33158020, decompressed_data_size=33158020 diff=0
[12:46:04] - Digital signature verified
[12:46:04] 
[12:46:04] Project: 8101 (Run 18, Clone 8, Gen 56)
[12:46:04] 
[12:46:04] Assembly optimizations on if available.
[12:46:04] Entering M.D.
                         :-)  G  R  O  M  A  C  S  (-:

                   Groningen Machine for Chemical Simulation

                            :-)  VERSION 4.5.3  (-:

        Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
      Aldert van Buuren, Pr Bjelkmar, Rudi van Drunen, Anton Feenstra, 
        Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff, 
           Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz, 
                Michael Shirts, Alfons Sijbers, Peter Tieleman,

               Berk Hess, David van der Spoel, and Erik Lindahl.

       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
            Copyright (c) 2001-2010, The GROMACS development team at
        Uppsala University & The Royal Institute of Technology, Sweden.
            check out http://www.gromacs.org for more information.


                               :-)  Gromacs  (-:

Reading file work/wudata_01.tpr, VERSION 4.5.5-dev-20120903-d64b9e3 (single precision)
[12:46:11] Mapping NT from 48 to 48 
Starting 48 threads
Making 2D domain decomposition 12 x 4 x 1
starting mdrun 'FP_membrane in water'
14250000 steps,  57000.0 ps (continuing from step 14000000,  56000.0 ps).
[12:46:17] Completed 0 out of 250000 steps  (0%)

NOTE: Turning on dynamic load balancing

[13:05:09] Completed 2500 out of 250000 steps  (1%)
[13:23:14] Completed 5000 out of 250000 steps  (2%)
[13:55:41] Completed 7500 out of 250000 steps  (3%)
[15:02:44] Completed 10000 out of 250000 steps  (4%)

On first look everything looks normal, but check TPF's:
first ~19 min, second ~18min, third ~22:30 and fourth: 1 hour 7 min!
Before that WU, I was working on another 8101 (started it with old config) and after restart on new configuration, made 5 frames with over 1 hour TPF.
I wiped out "work" folder and left only client.cfg, fah6, FahCore_a3 and a5, and both kraken files in main folder. As you can see, it didn't help at all

Sorry for long post, but anyone have idea, what is going on with that?

quickz · Nov 10, 2012

Is this issue (slow TPF) repeatable?
According the output of TPC -l, seems you have installed 6168's in socket 0, 2 and 6176's in 1, 3. Is this what you want?
And I’m curious about whether you could set the 6176s’ frequency to 2.3GHz by TPC?

AXm77 said:
I installed 6168's in socket 0 and 1, 6176's - 2 and 3 (as it marked on PBC).

AXm77 said:
On first look everything looks normal, but check TPF's:
first ~19 min, second ~18min, third ~22:30 and fourth: 1 hour 7 min!

AXm77 · Nov 10, 2012

As I stated before: when I resume WU after upgrade, I folded 5 frames @ over 1hour TPF.
After that I decided to wipe out Folding folder and downloaded new WU, wich log you can see at my post above.
After that I shut down machine in case something is wrong with it.

I installed cpu's according to manual: CPU 0 & 1 - 6168's, 2 & 3 - 6176's.

From my log you can see TPC counting CPU's in different order (0-3-1-2).

I don't know how verify CPU frequency in Ubuntu. Any help with that?

BTW: anyone know what TPF (8101) I can expect from that system (48 cores @1.9GHz, 16x 1GB 1333)?

Nicolas_orleans · Nov 10, 2012

AXm77 said:
I don't know how verify CPU frequency in Ubuntu. Any help with that?

You can go to code.google.com/p/i7z/, download source, compile, then run from terminal sudo ./i7z

AXm77 · Nov 10, 2012

Nicolas_orleans said:
You can go to code.google.com/p/i7z/, download source, compile, then run from terminal sudo ./i7z

Did that:

Code:

andy@FAH2:~/i7z$ sudo ./i7z
i7z DEBUG: i7z version: svn-r77-(20-Nov-2011)
this was designed to be a intel proc utility. You can perhaps mod it for your machine?
Quitting i7z

Nicolas_orleans · Nov 10, 2012

Right, it's for i7/xeons on google code

But I think somebody get a modified version to work with Opterons ?

Nicolas_orleans · Nov 10, 2012

My bad. Found no report of modified version for Opterons, I mixed it with tear's version of tpc quoted here http://hardforum.com/showthread.php?t=1723137

I can only recommand you some old school command line :
grep MHz /proc/cpuinfo

And compare the value to max of each cpu with :
cat /sys/devices/system/cpu/cpuXX/cpufreq/scaling_max_freq where cpuXX will start as cpu0, cpu1 and so on

AXm77 · Nov 11, 2012

No problem. I tested that on nodes 2,3,6,7:

Code:

 tpc -set node 'x' core all pstate 0 frequency 2300

after that grep reporting all cores @ 1900, so you can't force higher clocks on retail CPU's

Restarted folding on machine, and to my suprise TPF holding around 18 min.
I'll try restat it again 4 frames before end, so in case over 1 hour TPF's I can finish unit in time.

Update:

I am getting weird results. I left WU to finish without restart and then, new one gave me pleasant surprise: 16:55 TPF (what I expected from that configuration).
Today morning, I just stopped F@H (CTRL+C) to restart with oneunit flag, my TPF went to 17:30, so I decided to restart computer bad idea: TPF holding @ 18:14.

Another "newbie" aking for help with quad G34...

AXm77

Limp Gawd

quickz

Limp Gawd

AXm77

Limp Gawd

Nicolas_orleans

[H]ard DCOTM May 2016

AXm77

Limp Gawd

Nicolas_orleans

[H]ard DCOTM May 2016

Nicolas_orleans

[H]ard DCOTM May 2016

AXm77

Limp Gawd