[Gluster-users] high load when copy directory with many files
hunter86_bg at yahoo.com
Tue Oct 6 14:51:22 UTC 2020
I think that Adrian is right, we need more details:
- Machine Type - Physical/Virtual/Cloud
- NIC details from ethtool (bond and slaves)
- MTU size of NIC (bond and slaves)
- Disk type - HDD/SSD/NVMe
- LVM layout
- VDO (if any ?)
- Mount options of the bricks
- volume info
- output of 'cat /proc/cmdline'
- tuned profile
- Number of clients and TSP nodes in the cluster
- Are you using it in HCI mode (where client and server is the same system)
В понеделник, 5 октомври 2020 г., 21:27:28 Гринуич+3, Adrian Quintero <adrianquintero at gmail.com> написа:
Have you tried tuned profiles? random-io
what type of storage are you using, spinning or SSD?
Just guessing here, if you can provide a bit more details maybe someone has already ran into this and has found a solution
On Mon, Oct 5, 2020, 1:55 PM Marco Lerda - FOREACH S.R.L. <marco.lerda at foreach.it> wrote:
> we use glusterfs on a php application that have many small php files
> images etc...
> We use glusterfs in replication mode.
> We have 2 nodes connected in fiber with 100MBps and less than 1 ms latency.
> We have also an arbiter on slower network (but the issue is there also
> without the arbiter).
> When we copy a directory (cp command) with many files, cpu usage and
> load explode raplidly,
> our application become inaccessible until the copy ends.
> I wonder if is that normal or we have done something wrong.
> I know that glusterfs is not indicated with many small files, and I know
> that it slow down,
> but I want to avoid that a simple copy of a directory will put down out
> Any suggestion?
> Thanks a lot
> Community Meeting Calendar:
> Schedule -
> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> Bridge: https://bluejeans.com/441850968
> Gluster-users mailing list
> Gluster-users at gluster.org
Community Meeting Calendar:
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Gluster-users mailing list
Gluster-users at gluster.org
More information about the Gluster-users