NAS: Difference between revisions

From Rev0 Wiki
Jump to navigation Jump to search
 
(36 intermediate revisions by 2 users not shown)
Line 1: Line 1:
This page documents the network attached storage solution for home use and backups.
This page documents the network attached storage solution for home use and backups.


[[File:GC-D_1000_Top_Handheld.jpg|thumb|right|The final hardware for the GC-D 1000 Digital Geiger Counter.]]
[[File:R60.jpg|thumb|right|The R610 "learning" server.]]


==List of Features==
==List of Features==


===Server 1===
* ZFS file system
* ZFS file system
* 3x 14TB WD Ultrastar DC drives for main storage
* 3x 14TB WD Ultrastar DC drives for main storage, in 3x mirror configuration
* 1TB NVMe drive for fast storage
* 2x 1TB Teamgroup MP33 NVMe SSDs (600TBW) for ARC/ZIL storage, in 2x mirror configuration
* Samba server for LAN access to storage
* Compare to: [https://amzn.to/42oCsIS Synology DS923] ($1160) with [https://amzn.to/3p9ZO6y E10G22 10Gb upgrade] ($150)


==Electronics==
===Server 2===
* ZFS file system
* 4x 14TB WD Ultrastar DC drives for main storage, in 2x mirror configuration
* Samba server for LAN access to storage
 
==System Architecture==
===Dell Poweredge R610===
As a learning platform for ZFS setup, a temporary server was set up using 6x Toshiba 500GB 2.5" 5400rpm hard drives on a Poweredge R610. Ubuntu desktop 22.04 from a DVD (using the built in slim DVD reader) was installed to a Samsung 128GB high-endurance micro SD card on a Kingston MobileLite Plus USB micro SD card reader attached to the internal USB port. The installation was then converted to Ubuntu server using the following commands:
 
<syntaxhighlight lang=bash>sudo apt install ubuntu-server
reboot
sudo systemctl set-default multi-user.target
reboot
sudo apt purge ubuntu-desktop -y && sudo apt autoremove -y && sudo apt autoclean
reboot</syntaxhighlight>


[[File:GC-D_1000_Schematic_v1.1.png|thumb|right|The complete system schematic for the GC-D 1000 Geiger counter.]]
Zfsutils was then installed using the following command:


===High Voltage and Geiger===
<syntaxhighlight lang=bash>apt install zfsutils-linux</syntaxhighlight>
The high voltage DC is generated by a standard boost converter topology operating in PFM. An ATtiny10 microcontroller produces a 31250 Hz PWM waveform with a duty cycle of 94.9% (242/255), which switches a 600V 10.1A N-channel MOSFET. Current is directed through the inductor every on cycle, which stores electrical energy in the magnetic field of the inductor. On the off cycle, the magnetic field collapses, and the energy stored is directed through two series 400V 1A US1G diodes, and into the 0.1uF ceramic capacitor. The output voltage is regulated to a fixed 400V through a closed-loop feedback system. A divided output voltage is read by the ATtiny10. If the voltage exceeds the upper limit (425V), the PWM output is disabled. When the voltage falls below 400V, the PWM output is enabled. This high voltage is then applied to the anode of the Geiger tube through a 10M ohm resistor. The cathode is connected to ground through a 200k ohm resistor. When a high energy particle (in this case, a gamma ray) passes through the tube, it strikes the intert gas molecules inside, knocking electrons off in the process. These electrons carry enough energy to knock electrons off other molecules, producing a chain reaction called an avalanche. A halogen gas inside the tube replenishes electrons and prevents the tube from being stuck in the conducting mode. The 400V applied to the Geiger tube produces a high potential, which accelerates electrons toward the anode, producing a current. This current flows through the 200k ohm resistor and produces a voltage drop, which is filtered and buffered, then detected by the microcontroller, and represents one count.


===Microcontroller and LCD===
The 6 disks were physically labeled by the last 4 characters of their serial number in /dev/disk/by-id/, and the ZFS pool was created with the following command:
[[File:GC-D_1000_Board_v1.1.png|thumb|right|The PCB layout (top: red, bottom: blue) for the GC-D 1000.]]
In the simplest case, a digital Geiger counter would need only two functions, to count the pulses from the Geiger tube and calculate a rate, and to display the rate on the LCD. This project simply adds a few extra features, all very simple to implement.
First, the microcontroller needs to be able to count pulses from the Geiger tube over a certain time period. This is accomplished by running a timer divided down from a 24 MHz crystal. Pulses are detected by the microcontroller's hardware via a falling edge interrupt, which increments the ticks variable. The timer module produces an interrupt 50 times a second. Every second the microcontroller records how many pulses were detected since the last interrupt, and this value is added to an array of 32 values each 0.3s, which are averaged and displayed.
Next, the microcontroller needs to display values and text to the screen. This is achieved by sending binary data over an SPI data interface. An LCD function library handles the low-level conversion between ASCII characters from strings or numbers in variables to characters to be displayed to the LCD.
The microcontroller reads battery voltage and displays it as an 8-level bar graph. The microcontroller also optionally displays conversions in uSv/H and mR/H, and displays the corresponding accumulated dose (uSv in CPM mode). The microcontroller also maps the CPM value to a logarithmic bar graph, which is displayed in the middle of the screen.


===Hardware Revisions===
<syntaxhighlight lang=bash>zpool create tank mirror /dev/disk/by-id/(1) /dev/disk/by-id/(2) /dev/disk/by-id/(3) mirror /dev/disk/by-id/(4) /dev/disk/by-id/(5) /dev/disk/by-id/(6)</syntaxhighlight>
 
The ZFS pool was configured with LZ4 compression with the following command:
 
<syntaxhighlight lang=bash>zfs set compression=lz4 tank</syntaxhighlight>
 
To limit unnecessary packages being installed, suggested packages can be limited by editing this file using "vim /etc/apt/apt.conf":


====Revision 1.0====
<syntaxhighlight lang=bash>APT::Get::Install-Recommends "false";
This is the first revision of the GC-D 1000.
APT::Get::Install-Suggests "false";</syntaxhighlight>


====Revision 1.1====
Samba server was then installed following this procedure: https://ubuntu.com/tutorials/install-and-configure-samba#2-installing-samba
This is the second revision of the GC-D 1000, correcting several flaws in the circuit as well as enclosure, listed below:


'''PCB:'''
===HPE DL360p G8===
* Geiger tube signal routed to input pin with edge triggered interrupt
Upon receiving the DL360p G8 server, it became apparent that the built in P420i storage controller was malfunctioning, showing in the logs that it was disconnected or not present. After further research, the P420i was found to be problematic for ZFS integration, so a replacement HBA was purchased (Microsemi 2100-4i4e).
* USB port moved lower to accomodate enclosure design
* Voltage sense pin tied directly to VBAT allowing voltage read when switched off but plugged in (charging)
* <s>Added auto power-off capability (MCU signal to boost EN line)</s> Removed, battery monitor should be sufficient.
* Added LiPo battery monitor circuit


'''Enclosure:'''
===Hardware Revisions===
* Added space at top of enclosure for second SI3BG size (short/wide vs. thin/long)
* Increased clearance along edge seal for better fit
* Increased tolerances for better fit of PCB and edge snaps
* Modified magnet holders
* Improved buttons to add reach and fit in holes
* Increased hole size for PUR button access (USB program button)
* Minor cosmetic/structural improvements


'''Outstanding Issues:'''
====Revision 1.0====
* The buttons are currently not manufacturable by Shapeways. They must be redesigned (a rectangular slot/profile would be a better approach) to have increased wall thickness.
This is the first revision of the NFS.


====Revision 1.2 (Planned)====
====Configuration Files====
This is the third revision of the GC-D 1000, adding the option for an external probe (e.g. LND-382) for greater sensitivity.


'''PCB:'''
==Total Project Cost==
* Switch to boost-doubler topology (allows for simultaneous 400/800V supplies).
* Added accessory port for external Geiger probe
* Added mux to switch between Geiger tube outputs


'''Enclosure:'''
===Server 1===
* Added slot for external probe
* Redesigned buttons with rectangular profile and thicker walls
* Decreased clearance for PCB holder
* Added short internal guide tube for USB Boot pin to make pressing the button easier
* Added small nubs on rear of device to prevent case from being scratched if moved along a rough surface
* Added logo and button/switch text


====PCB Files====
{| border="1" style="text-align:center;"
Here is the Eagle schematic file for the GC-D 1000: http://rev0proto.com/files/GC-D_1000_v02.sch
|Component
Here is the Eagle board file for the GC-D 1000: http://rev0proto.com/files/GC-D_1000_v02.brd
|Cost
|Source
|- style="color:gray;text-align:left;"


==Enclosure==
|WD Ultrastar 14TB
|$129.99
|[https://amzn.to/3LXH976 Amazon]
|- style="color:gray;text-align:left;"


The enclosure for the GC-D 1000 was created with Autodesk Inventor 3D CAD software, and manufactured using rapid prototyping through [http://www.shapeways.com/ Shapeways]. Dimensions for all major parts and the PCB were taken from their respective datasheets or by using a digital caliper, and 3D representations were made in Inventor. Then the basic shape for the enclosure was devised, and it was created with the constraints given by the parts needed. The enclosure is made of 5 separate pieces, which are assembled by snapping them together.
|WD Ultrastar 14TB (New Pull)
|$169.99
|[https://www.disctech.com/Western-Digital-UltraStar-DC-HC530-WUH721414ALE604-0F31156-0F31284-14TB-3.5-7.2K-RPM-512e-SATA-6Gb Disctech]
|- style="color:gray;text-align:left;"


Here are the Autodesk Inventor files for the GC-D 1000: http://rev0proto.com/files/GC-D_1000_Model.zip
|WD Ultrastar 14TB (New)
|$209.00
|[https://www.disctech.com/Western-Digital-UltraStar-DC-HC530-WUH721414ALE604-0F31156-14TB-SATA-Hard-Drive?alsoavailable=T Disctech]
|- style="color:gray;text-align:left;"


==Code==
|Teamgroup MP33 1TB NVMe (x2)
|$97.80
|[https://amzn.to/3nzAre8 Amazon]
|- style="color:gray;text-align:left;"


Full source code for the project can be found here: http://rev0proto.com/files/gc-d_1000.zip
|HPE DL360p G8 Server
|$179.14
|[https://www.ebay.com/itm/185617068154 eBay]
|- style="color:gray;text-align:left;"


==Comparison to GC-D 100==
|HPE 530FLR 10Gb Network adapter
|$10.87
|[https://www.ebay.com/itm/155009611180 eBay]
|- style="color:gray;text-align:left;"


The first change I wanted to make on the GC-D 100 was the battery. With my previous experience from the rev0Trac VTx, I decided to use a single-cell 1000mAH LiPo for the GC-D 1000. The primary constraint for the batteries for the GC-D 100 was the voltage needed for the step-up converter. By optimizing the boost converter design, both through simulation and breadboard prototyping, I was able to design a circuit that would operate down to the LiPo minimum of 3.0V (the boost converter can operate down to 2.6V in practice). This allowed the device to operate on a single cell, eliminating the challenges of balancing and charging a dual-cell LiPo. The voltage for the ATtiny10 microcontroller is still provided by a 5V synchronous boost converter, and is needed to operate the MOSFET efficiently (high enough voltage to operate in saturation).
|DL360p 3.5" Drive Caddy (x2)
|$10.33
|[https://www.ebay.com/itm/133997791650 eBay]
|- style="color:gray;text-align:left;"


The high voltage circuitry in the GC-D 100 was scattered throughout the PCB layout, a potential danger when operating the device without the case, and a potential danger to the low-voltage circuitry surrounding it. The GC-D 1000 was routed such that the high voltage circuitry is spatially isolated in the bottom section of the PCB, clearly marked by silkscreen. I chose not to optically isolate the two sections due to the low selection of high-speed opto-isolators and the packages they are available in. The boost converter is operated by an independent microcontroller, freeing up cycles and adding an extra layer of isolation to the application MCU. The Geiger tube output is fed through a Schmitt inverter to clean up the signal and also provide isolation from the Geiger tube.
|Intel Xeon E5-2667 V2 CPU (x2)
|$30.44
|[https://www.ebay.com/itm/265339214092 eBay]
|- style="color:gray;text-align:left;"


Drawing again from my experience with the rev0Trac VTx, the GC-D 1000 uses a Nokia 5110 graphic LCD. In addition to giving more freedom with displaying information, it is thinner, cheaper, and much lower power than the 8x2 character LCD used in the GC-D 100.
|Asus 4x NVMe to PCIe 16x Adapter
|($64.95)
|[https://amzn.to/3HG1yuB Amazon]
|- style="color:gray;text-align:left;"


This device was designed on a smaller timeline (~6 weeks) than the original and optimized for cost and manufacturability, thus some of the more exotic features, such as location logging are left out. This device nevertheless uses a more powerful microcontroller, programmable over USB, and has much greater potential for expansion.
|12G SAS HBA
|$75.98
|[https://www.ebay.com/itm/354492178220 eBay]
|- style="color:gray;text-align:left;"


==Videos==
|Total Price
<HTML5video type="youtube" width="400" height="300" autoplay="false">1SHY4jAfTcM</HTML5video>
|$915.72
<HTML5video type="youtube" width="400" height="300" autoplay="false">nnFNTOPaNV0</HTML5video>
|
|-


==Photos==
|}
<gallery widths=180px heights=120px perrow=4>
File:GC-D_1000_Top_Handheld.jpg|GC-D 1000 Handheld
File:GC-D_1000_Top.jpg|Top view of the GC-D 1000
File:GC-D_1000_Bottom.jpg|Bottom view of the GC-D 1000
File:GC-D_1000_Side.jpg|Side view of the GC-D 1000
</gallery>


==Total Project Cost==


===Server 2===
{| border="1" style="text-align:center;"
{| border="1" style="text-align:center;"
|Component
|Component
Line 110: Line 132:
|- style="color:gray;text-align:left;"
|- style="color:gray;text-align:left;"


|WD Ultrastar 14TB (Mfg Refurb)
|WD Ultrastar 14TB
|$129.99
|$135.86
|[https://serverpartdeals.com/products/western-digital-ultrastar-dc-hc530-wuh721414ale604-14tb-7-2k-rpm-sata-6gb-s-512e-3-5-recertified-hard-drive Serverpartdeals]
|eBay - amtec_us
|- style="color:gray;text-align:left;"
 
|WD Ultrastar 14TB (Qty 2)
|$282.60
|eBay - serverpartdeals
|- style="color:gray;text-align:left;"
 
|WD Ultrastar 14TB
|$146.73
|eBay - serverpartdeals
|- style="color:gray;text-align:left;"
 
|HPE DL360p G8 Server
|$86.96
|[https://www.ebay.com/itm/185617068154 eBay]
|- style="color:gray;text-align:left;"
|- style="color:gray;text-align:left;"


|WD Ultrastar 14TB (New Pull)
|HPE 530FLR 10Gb Network adapter
|$169.99
|$10.87
|[https://www.disctech.com/Western-Digital-UltraStar-DC-HC530-WUH721414ALE604-0F31156-0F31284-14TB-3.5-7.2K-RPM-512e-SATA-6Gb Disctech]
|[https://www.ebay.com/itm/155009611180 eBay]
|- style="color:gray;text-align:left;"
|- style="color:gray;text-align:left;"


|WD Ultrastar 14TB (New)
|DL360p 3.5" Drive Caddy (x4)
|$209.00
|$18.48
|[https://www.disctech.com/Western-Digital-UltraStar-DC-HC530-WUH721414ALE604-0F31156-14TB-SATA-Hard-Drive?alsoavailable=T Disctech]
|[https://www.ebay.com/itm/133997791650 eBay]
|- style="color:gray;text-align:left;"
|- style="color:gray;text-align:left;"


|Total Price
|Total Price
|$508.98
|$681.50
|
|
|-
|-


|}
|}
==Links==
Main tutorial followed for setting up ZFS and explaining concepts: [https://pthree.org/2012/04/17/install-zfs-on-debian-gnulinux/ pthree.org]

Latest revision as of 19:30, 9 September 2023

This page documents the network attached storage solution for home use and backups.

File:R60.jpg
The R610 "learning" server.

List of Features

Server 1

  • ZFS file system
  • 3x 14TB WD Ultrastar DC drives for main storage, in 3x mirror configuration
  • 2x 1TB Teamgroup MP33 NVMe SSDs (600TBW) for ARC/ZIL storage, in 2x mirror configuration
  • Samba server for LAN access to storage
  • Compare to: Synology DS923 ($1160) with E10G22 10Gb upgrade ($150)

Server 2

  • ZFS file system
  • 4x 14TB WD Ultrastar DC drives for main storage, in 2x mirror configuration
  • Samba server for LAN access to storage

System Architecture

Dell Poweredge R610

As a learning platform for ZFS setup, a temporary server was set up using 6x Toshiba 500GB 2.5" 5400rpm hard drives on a Poweredge R610. Ubuntu desktop 22.04 from a DVD (using the built in slim DVD reader) was installed to a Samsung 128GB high-endurance micro SD card on a Kingston MobileLite Plus USB micro SD card reader attached to the internal USB port. The installation was then converted to Ubuntu server using the following commands: 

sudo apt install ubuntu-server
reboot
sudo systemctl set-default multi-user.target
reboot
sudo apt purge ubuntu-desktop -y && sudo apt autoremove -y && sudo apt autoclean
reboot

Zfsutils was then installed using the following command: 

apt install zfsutils-linux

The 6 disks were physically labeled by the last 4 characters of their serial number in /dev/disk/by-id/, and the ZFS pool was created with the following command: 

zpool create tank mirror /dev/disk/by-id/(1) /dev/disk/by-id/(2) /dev/disk/by-id/(3) mirror /dev/disk/by-id/(4) /dev/disk/by-id/(5) /dev/disk/by-id/(6)

The ZFS pool was configured with LZ4 compression with the following command: 

zfs set compression=lz4 tank

To limit unnecessary packages being installed, suggested packages can be limited by editing this file using "vim /etc/apt/apt.conf": 

APT::Get::Install-Recommends "false";
APT::Get::Install-Suggests "false";

Samba server was then installed following this procedure: https://ubuntu.com/tutorials/install-and-configure-samba#2-installing-samba

HPE DL360p G8

Upon receiving the DL360p G8 server, it became apparent that the built in P420i storage controller was malfunctioning, showing in the logs that it was disconnected or not present. After further research, the P420i was found to be problematic for ZFS integration, so a replacement HBA was purchased (Microsemi 2100-4i4e).

Hardware Revisions

Revision 1.0

This is the first revision of the NFS.

Configuration Files

Total Project Cost

Server 1

Component Cost Source
WD Ultrastar 14TB $129.99 Amazon
WD Ultrastar 14TB (New Pull) $169.99 Disctech
WD Ultrastar 14TB (New) $209.00 Disctech
Teamgroup MP33 1TB NVMe (x2) $97.80 Amazon
HPE DL360p G8 Server $179.14 eBay
HPE 530FLR 10Gb Network adapter $10.87 eBay
DL360p 3.5" Drive Caddy (x2) $10.33 eBay
Intel Xeon E5-2667 V2 CPU (x2) $30.44 eBay
Asus 4x NVMe to PCIe 16x Adapter ($64.95) Amazon
12G SAS HBA $75.98 eBay
Total Price $915.72


Server 2

Component Cost Source
WD Ultrastar 14TB $135.86 eBay - amtec_us
WD Ultrastar 14TB (Qty 2) $282.60 eBay - serverpartdeals
WD Ultrastar 14TB $146.73 eBay - serverpartdeals
HPE DL360p G8 Server $86.96 eBay
HPE 530FLR 10Gb Network adapter $10.87 eBay
DL360p 3.5" Drive Caddy (x4) $18.48 eBay
Total Price $681.50

Links

Main tutorial followed for setting up ZFS and explaining concepts: pthree.org

Retrieved from "https://wiki.rev0.net/index.php?title=NAS&oldid=1036"