Jump to content

Welcome to ExtremeHW

Welcome to ExtremeHW, like most online communities you must register to view or post in our community, but don't worry this is a simple free process that requires minimal information for you to signup. Be a part of ExtremeHW by signing in or creating an account.

  • Start new topics and reply to others
  • Subscribe to topics and forums to get email updates
  • Get your own profile page and make new friends
  • Send personal messages to other members.
  • Take advantage of site exclusive features.

ExtremeHW Community Folding Project 2.0


Recommended Posts

Administrators

 

ExtremeHW-Logo-With-slogan-800-black.png.06447b919dad048117f725f83601c905.png                     Corsair-logo.thumb.png.9d2305086a2b7936bf3f225984787e0d.png

 

Hello all, 

 

So we originally had the Community Folding Project Thread which tracked a build of what was initially going to be the CFP for EHW, however upon sitting back and evaluating the build, it would not be able to perform at its best in its mining like rig configuration due to the fact that the PCIe bandwidth would be limited to 1x, which thanks to some very helpful individuals here were able to point out that there would be a fairly hefty performance hit. With this in mind, it was time to re-hash the CFP and do a rebuild best suited to Folding@Home overall. 

 

This thread will serve as a build log/CFP information centre. 

 

Firstly I wish to thank Corsair for sponsoring this project. They have been kind enough to support this project by sending us over the Corsair HX1000 Platinum PSU and a whopping 6x Corsair Premium PCIe 3.0 x16 Extension Cable 300mm riser cables. Corsair have been kind enough to support our folding events, so it is great to see that continued effort here as well!

 

Community Folding Project Specifications 

 

CPU:  Intel i9 10900x

CPU Cooler: EK AIO Basic 360

Motherboard: Asus WS X299 SAGE
RAM:  Corsair Dominator 3200Mhz (64Gb)
Case: XCase Minestation 1

PSU 1: Corsair HX1000 Platinum

PSU 2Antec Signature 1300w Platinum

Riser Cables: 6x Corsair Premium PCIe 3.0 x16 Extension Cable 300mm

Controller GPU: Nvidia GT710

Folding GPU's:  6x Nvidia Tesla M40

 

Due to the cost of GPU's at this point in time, thanks to the silicon shortage, buying gaming GPU's for folding would be prohibitively expensive. As such, thanks to @Avacado , I learned about the Nvidia Tesla M40 cards which are meant for GPU learning but serve Folding@Home very well. The Tesla M40 has the same/approximate folding power of the GTX1070 at about 1 Million PPD+ per GPU.  I was able to get 6x Tesla M40's from the USA for approx £500. If I were to get 6x GTX 1070's, we would be looking at approximately £2100, again this is due to the silicon shortage and mining craze. The maths was easy, it was time to buy the Tesla M40's.

 

Some of you may be wondering why I have such a powerful CPU for what will essentially be a GPU only folding rig. Well the answer is simple, it is all about PCIe lanes. In order to make sure that each GPU was running 4-8x bandwidth, it was essential to get a CPU that could deal out enough PCIe lanes to make that happen. The Intel i9 10900x has a total of 48 lanes which means that it will be able to host the 6x Tesla M40 GPU's without a detrimental performance hit.

 

At the time of buying the XCase Minestation 1 chassis, the manufacturer were out of stock. I managed to find one on Ebay, but of course due to the mining craze and lack of stock, there was some bidding competition to be had. This case was the perfect setup, and without making my own case, there was no other "off the shelf" product like this. So what happened ? I ended up paying through the teeth for it. RRP for the Minestation 1 is £118 (Inc Vat), I paid a healthy £270 for it. 

 

When initially looking at the motherboard and CPU combo to make this project happen, I found a rather nice bundle on Ebay which included the Asus WS X299 SAGE, Corsair Dominator 64GB RAM & an Intel i7 9800x. I managed to nab this at what I think was a good deal at £697. You will notice that I am not using the i7 9800x in this build, the simple reason is that it did not have enough PCIe lanes to make this project a success, hence the upgrade to the i9 10900x. At least I can sell the i7 9800x now. Oh and yes I know 64Gb RAM is overkill for this project, but it came with the board, so what can I say lol.

 

Product Pictures & Bits Required 

 

A build log cannot be complete without pictures of the products being used as well as those little bits and bobs you have to get.

 

IMG20210303141807.thumb.jpg.fcb08e10b1c60654fec84802d85ccc03.jpg

 

The XCase Minestation 1 in its flatpack form.

 

IMG20210325133008.thumb.jpg.ec297a37ce182b9efc109035d2364fd0.jpg

 

The Corsair HX1000 PSU and riser cables that were very kindly provided by Corsair.

 

IMG20210324101134.thumb.jpg.d5ddb1e97ed38dee73d12909cba0f1b0.jpg

 

Due to clearance issues that would likely arise with going air, I decided to go AIO for this project.

 

IMG20210329142141.thumb.jpg.0592b911585211066d6f1bb7658c8a29.jpg 

 

Extra bits and bobs. The ones that are not obvious are new mounting brackets for the Tesla M40's and the power adapters for M40's.

 

Build Progress

 

IMG20210303163912.thumb.jpg.177079a3adc7b9115eeff234f3802dc1.jpg

 

IMG20210303163916.thumb.jpg.804e75f38b965664ad314bae17dfdf6f.jpg

 

IMG20210305131123.thumb.jpg.81c485c6f2f1aae393d7a01e10ff29fb.jpg

 

IMG20210305131130.thumb.jpg.479d05ca969584c3fd6a5ef25c2bb815.jpg

 

IMG20210307190734.thumb.jpg.cbf2823e1bf9009ea35f2fe50bda9e38.jpg

 

A little bit of case modding so my Nvidia GT710 controller card is in the motherboard traditionally.

 

IMG20210307190745.thumb.jpg.bfbb8f231465814fd18a6cb1af9cc980.jpg

 

IMG20210324111734.thumb.jpg.778fc05bd25a74ad45d25c58685da1f8.jpg

 

IMG20210324111726.thumb.jpg.351e7e098c43cbb6fe74c1f31eaf3b3c.jpg

 

The AIO is soon to be put into a push pull config with a dedicated fan controller.

 

IMG20210324111729.thumb.jpg.9c26b1407a420437b898cf67cdd767fc.jpg

Link to post
Share on other sites
Administrators

I am now just waiting on the following items to complete the project, at least so far as hardware config: 

 

1x Set of fan extensions 

1x Fan controller so I can best set fan speeds. 

1x Fan filters/covers 

1x New thermal pads and Thermal Grizzly for M40 make over.

6x Nvidia Tesla M40 GPU's (These are being tested by my good man @mllrkllr88 in the states before shipping to me)

 

More to come soon !

Link to post
Share on other sites
News Editor

+Subbed. Thanks for the shout out. Can't wait to see what you come up with.  Wanna share some of that Corsair sponsor love? 😛 Tell them i'm short on ML120's. I only have about 30 of them. 

 

P.S. I freed up 5 of the custom coolers for the M40's as they will be going under water (I think I have 7 laying around). Let me know if you want them and i'll ship them to you. 

Edited by Avacado
Link to post
Share on other sites
Premium Platinum

Just what I needed to make my day even better, an update on the CFP!! :wheee_orange:

Nice writeup E, must be a pleasure to work with all that cool hardware. Did you feel the weight of that motherboard?

 

3 hours ago, ENTERPRISE said:

Firstly I wish to thank Corsair for sponsoring this project.

Thanks a lot for sponsoring this project Corsair! 

 

3 hours ago, ENTERPRISE said:

RRP for the Minestation 1 is £118 (Inc Vat), I paid a healthy £270 for it.

That's a lot of money, but at least you have the perfect case now. Looks like a good quality case with all the features you need for this project to work.

 

37 minutes ago, Avacado said:

Let me know if you want them and I'll ship them to you.

I'm sure they will be needed with 6 M40's in there! 

Link to post
Share on other sites
2 minutes ago, Avacado said:

Looking good E I am hoping to get mine running by the end of this weekend as well. Installing 5 GPU waterblocks is a PITA.

 

You want those fans for the Tesla's?

 

Yeah water blocks add in another factor that is for sure, I don't envy you. 

 

Sorry, I did see you say about fans, what did they look like again ?

Link to post
Share on other sites
EHW Folding@Home
1 hour ago, ENTERPRISE said:

So I did a little cable management today after getting the lamptron fan controller installed.

 

IMG20210405183408.thumb.jpg.e0bce888cc63e22da82483d2a35d1a4a.jpgIMG20210405183356.thumb.jpg.7a2075e58ac33b6fef647d56c76379f7.jpgIMG20210405183417.thumb.jpg.148d711bb334bcfa35401bb1ebe32c93.jpg

 

Looks great. Does that Lampron have any software control? 

 

 

Link to post
Share on other sites
3 hours ago, Avacado said:

 

20210122_211936.jpg

Oh nice. Will pm you about those.

2 hours ago, BWG said:

 

Looks great. Does that Lampron have any software control? 

 

 

 

No, hardware only which is how I wanted it. As I may switch to Linux sometime down the line, I wanted something OS independent.

Link to post
Share on other sites
EHW Folding@Home
6 minutes ago, ENTERPRISE said:

Oh nice. Will pm you about those.

 

No, hardware only which is how I wanted it. As I may switch to Linux sometime down the line, I wanted something OS independent.

 

Would be kinda cool to mount the controller internal, then have the knob external. Little hot glue probably to hold it. 

Link to post
Share on other sites
1 minute ago, BWG said:

 

Would be kinda cool to mount the controller internal, then have the knob external. Little hot glue probably to hold it. 

It was a thought but lifting the lid to mess with the controller will not be too much bother. Plus I will set the fabs to their optimal speed for cooling and leave it.

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...

Important Information

This Website may place and access certain Cookies on your computer. ExtremeHW uses Cookies to improve your experience of using the Website and to improve our range of products and services. ExtremeHW has carefully chosen these Cookies and has taken steps to ensure that your privacy is protected and respected at all times. All Cookies used by this Website are used in accordance with current UK and EU Cookie Law. For more information please see our Privacy Policy