sickprodigy/home-server
1
0
Fork 0
Code Issues 15 Pull Requests Packages Projects Releases Wiki Activity

Harddrive room depleting #15

New Issue
Closed
opened 2023-11-04 08:07:25 -04:00 by sickprodigy · 6 comments
sickprodigy commented 2023-11-04 08:07:25 -04:00
Owner
Copy Link

Running out of hard drive room. Need 2 6tb, and a 14tb currently. Need to find model numbers so I can match up something for a raid.

Running out of hard drive room. Need 2 6tb, and a 14tb currently. Need to find model numbers so I can match up something for a raid.
sickprodigy commented 2023-11-04 16:49:12 -04:00
Author
Owner
Copy Link

Deleted around 10% of seeding torrents, not my best choice, but opened 300gb for now.

Currently have a stack of hard drives

1 - 6 tb in server now

1 - 6 tb on shelf
3 - 3 tb on shelf
1 - 250 gb seagate hdd also, (debian os? from my old home server)

Deleted around 10% of seeding torrents, not my best choice, but opened 300gb for now. Currently have a stack of hard drives 1 - 6 tb in server now 1 - 6 tb on shelf 3 - 3 tb on shelf 1 - 250 gb seagate hdd also, (debian os? from my old home server)
sickprodigy commented 2023-11-12 08:35:15 -05:00
Author
Owner
Copy Link

Main Media Folder maxing out at 12.6 tb. Need to divide out music and documents. Documents would be better on an SSD so I can access instantly almost. Everything else can be spun up on a disc.

Documents
Games
Music

Need hard drives for those folders would be the easiest.

Main Media Folder maxing out at 12.6 tb. Need to divide out music and documents. Documents would be better on an SSD so I can access instantly almost. Everything else can be spun up on a disc. Documents Games Music Need hard drives for those folders would be the easiest.
sickprodigy pinned this 2023-11-12 20:13:15 -05:00
sickprodigy commented 2023-11-12 20:18:23 -05:00
Author
Owner
Copy Link

Command
root@server:/srv/samba/media# du -cha --max-depth=1 . | grep -E "M|G|T"

Memory Used:

803G    ./Music
6.7T    ./TvShows
395G    ./unsorted
810G    ./Videos
78G     ./Books
6.0T    ./Movies
156G    ./programs
559M    ./Pictures
8.3M    ./.cache
3.1T    ./games
677G    ./Documents
19T     .
19T     total

Games will be moved to 6tb I have available on server currently. Then that disk will be mounted at games location.

Which should solve this issue for a bit, till I figure out the best way to format each drive

https://www.phoronix.com/review/bcachefs-linux-2019

Command `root@server:/srv/samba/media# du -cha --max-depth=1 . | grep -E "M|G|T"` Memory Used: ``` 803G ./Music 6.7T ./TvShows 395G ./unsorted 810G ./Videos 78G ./Books 6.0T ./Movies 156G ./programs 559M ./Pictures 8.3M ./.cache 3.1T ./games 677G ./Documents 19T . 19T total ``` Games will be moved to 6tb I have available on server currently. Then that disk will be mounted at games location. Which should solve this issue for a bit, till I figure out the best way to format each drive https://www.phoronix.com/review/bcachefs-linux-2019
sickprodigy commented 2023-11-21 17:14:53 -05:00
Author
Owner
Copy Link

Used command

cp -r /srv/samba/media/games/* /mnt/6tb

Waiting for data to copy over, probably should have ran rsync instead

rsync -avzP /srv/samba/media/games/* /mnt/6tb

Will be the command, as cp doesn't verify the data it copies and may skip over files with no explanation I think.
Rsync verifies integrity of each file after sending also.

most recent run of:
du -cha --max-depth=1 /srv/samba/media | grep -E "M|G|T"

811G    /srv/samba/media/Music
6.8T    /srv/samba/media/TvShows
498G    /srv/samba/media/unsorted
810G    /srv/samba/media/Videos
80G     /srv/samba/media/Books
6.0T    /srv/samba/media/Movies
156G    /srv/samba/media/programs
559M    /srv/samba/media/Pictures
8.3M    /srv/samba/media/.cache
3.1T    /srv/samba/media/games
681G    /srv/samba/media/Documents
19T     /srv/samba/media
19T     total
Used command `cp -r /srv/samba/media/games/* /mnt/6tb` Waiting for data to copy over, probably should have ran rsync instead `rsync -avzP /srv/samba/media/games/* /mnt/6tb` Will be the command, as cp doesn't verify the data it copies and may skip over files with no explanation I think. Rsync verifies integrity of each file after sending also. most recent run of: `du -cha --max-depth=1 /srv/samba/media | grep -E "M|G|T"` ``` 811G /srv/samba/media/Music 6.8T /srv/samba/media/TvShows 498G /srv/samba/media/unsorted 810G /srv/samba/media/Videos 80G /srv/samba/media/Books 6.0T /srv/samba/media/Movies 156G /srv/samba/media/programs 559M /srv/samba/media/Pictures 8.3M /srv/samba/media/.cache 3.1T /srv/samba/media/games 681G /srv/samba/media/Documents 19T /srv/samba/media 19T total ```
sickprodigy commented 2023-11-22 07:13:33 -05:00
Author
Owner
Copy Link

Ran rsync just to make sure everything is the same. Took all night to transfer 3 tb for some reason. Lots of small files.

Ran rsync just to make sure everything is the same. Took all night to transfer 3 tb for some reason. Lots of small files.
sickprodigy commented 2023-11-23 09:06:47 -05:00
Author
Owner
Copy Link

After rsyncing

nano /etc/fstab

Samba Media Games Mount

UUID=d466101e-1965-421a-b4bc-3cf8fec28e86 /srv/samba/media/games ext4 defaults,nofail 0 1
systemctl daemon-reload
mount /srv/samba/media/games

df -h # after transferring everything.
Filesystem Size Used Avail Use% Mounted On
/dev/sdf2 218G 124G 84G 60% /
/dev/md1 118G 3.9G 108G 4% /srv/samba/rcs
/dev/sdf1 511M 5.9M 506M 2% /boot/efi
/dev/sdc 13T 8.9T 3.2T 74% /srv/samba/media
/dev/md11 9.1T 6.9T 1.8T 80% /srv/samba/media/TvShows
/dev/sda 5.5T 3.1T 2.1T 60% /srv/samba/media/games

We have minimum 1.8 tb avail on Tvshows, should last a month or 2.
Closing for now as it should be sometime before this issue arises again.

After rsyncing nano /etc/fstab # Samba Media Games Mount UUID=d466101e-1965-421a-b4bc-3cf8fec28e86 /srv/samba/media/games ext4 defaults,nofail 0 1 systemctl daemon-reload mount /srv/samba/media/games df -h # after transferring everything. Filesystem Size Used Avail Use% Mounted On /dev/sdf2 218G 124G 84G 60% / /dev/md1 118G 3.9G 108G 4% /srv/samba/rcs /dev/sdf1 511M 5.9M 506M 2% /boot/efi /dev/sdc 13T 8.9T 3.2T 74% /srv/samba/media /dev/md11 9.1T 6.9T 1.8T 80% /srv/samba/media/TvShows /dev/sda 5.5T 3.1T 2.1T 60% /srv/samba/media/games We have minimum 1.8 tb avail on Tvshows, should last a month or 2. Closing for now as it should be sometime before this issue arises again.
sickprodigy unpinned this 2023-11-23 13:42:38 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Compat/Breaking
Breaking change that won't be backward compatible
 Kind/Bug
Something is not working
 Kind/Documentation
Documentation changes
 Kind/Enhancement
Improve existing functionality
 Kind/Feature
New functionality
 Kind/Security
This is security issue
 Kind/Testing
Issue or pull request related to testing
Priority
Critical
The priority is critical
Priority
High
The priority is high
Priority
Low
The priority is low
Priority
Medium
The priority is medium
Reviewed
Confirmed
Issue has been confirmed
Reviewed
Duplicate
This issue or pull request already exists
Reviewed
Invalid
Invalid issue
Reviewed
Won't Fix
This issue won't be fixed
Status
Abandoned
Somebody has started to work on this but abandoned work
Status
Blocked
Something is blocking this issue or pull request
Status
Need More Info
Feedback is required to reproduce issue or to continue work
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
sickprodigy
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sickprodigy/home-server#15
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?