[Gluster-users] high load when copy directory with many files

[Strahil Nikolov]

I think that Adrian is right, we need more details:

- Machine Type - Physical/Virtual/Cloud
- NIC details from ethtool (bond and slaves)
- MTU size of NIC (bond and slaves)

- Disk type - HDD/SSD/NVMe
- LVM layout
- VDO (if any ?)
- Mount options of the bricks
- volume info

- output of 'cat  /proc/cmdline'
- tuned profile

- Number of clients and TSP nodes in the cluster
- Are you using it in HCI mode (where client and server is the same system) 

Best Regards,
Strahil Nikolov



В понеделник, 5 октомври 2020 г., 21:27:28 Гринуич+3, Adrian Quintero <adrianquintero at gmail.com> написа: 





Hi,
Have you tried tuned profiles? random-io
what type of storage are you using, spinning or SSD? 


Just guessing here,  if you can provide a bit more details maybe someone has already ran into this and has found a solution


regards, 

Adrian Quinter

On Mon, Oct 5, 2020, 1:55 PM Marco Lerda - FOREACH S.R.L. <marco.lerda at foreach.it> wrote:
> hi,
> we use glusterfs on a php application that have many small php files 
> images etc...
> We use glusterfs in replication mode.
> We have 2 nodes connected in fiber with 100MBps and less than 1 ms latency.
> We have also an arbiter on slower network (but the issue is there also 
> without the arbiter).
> When we copy a directory (cp command) with many files, cpu usage and 
> load explode raplidly,
> our application become inaccessible until the copy ends.
> 
> I wonder if is that normal or we have done something wrong.
> I know that glusterfs is not indicated with many small files, and I know 
> that it slow down,
> but I want to avoid that a simple copy of a directory will put down out 
> application.
> 
> Any suggestion?
> 
> Thanks a lot
> 
> 
> 
> ________
> 
> 
> 
> Community Meeting Calendar:
> 
> Schedule -
> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> Bridge: https://bluejeans.com/441850968
> 
> Gluster-users mailing list
> Gluster-users at gluster.org
> https://lists.gluster.org/mailman/listinfo/gluster-users
> 
________



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users at gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users