<div dir="ltr">I doubt whether it will make a big difference, but you can turn on performance.flush-behind.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jul 23, 2018 at 4:51 PM, Γιώργος Βασιλόπουλος <span dir="ltr"><<a href="mailto:g.vasilopoulos@uoc.gr" target="_blank">g.vasilopoulos@uoc.gr</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello<br>
<br>
I have set up an expirimental gluster replica 3 arbiter 1 volume for ovirt.<br>
<br>
Network between gluster servers is 2x1G (mode4 bonding) and network on ovirt is 1G<br>
<br>
I'm observing write performance is at about 30-35Mbytes /sec. Is this normal?<br>
<br>
I was expecting about 45-55MB/sec on write given that write speed should be network throughput/2.<br>
<br>
Is this expected given the fact that there is an arbiter volume in place ?<br>
<br>
Is network throughput/3 like a true replica 3 volume when there is an arbiter brick ?<br>
<br>
It seems that small or large files have little impact on performance currently.<br>
<br>
My volume settings are as follow<br>
<br>
Volume Name: gv01<br>
Type: Replicate<br>
Volume ID: 3396f285-ba1e-4360-94a9-5cc65e<wbr>de62c9<br>
Status: Started<br>
Snapshot Count: 0<br>
Number of Bricks: 1 x (2 + 1) = 3<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: gluster1.datacenter.uoc.gr:/gl<wbr>uster_bricks/brick00<br>
Brick2: gluster2.datacenter.uoc.gr:/gl<wbr>uster_bricks/brick00<br>
Brick3: gluster3.datacenter.uoc.gr:/gl<wbr>uster_bricks/brick00 (arbiter)<br>
Options Reconfigured:<br>
server.allow-insecure: on<br>
storage.owner-gid: 36<br>
storage.owner-uid: 36<br>
auth.allow: xxx.xxx.xxx.*,xxx.xxx.xxx.*<br>
user.cifs: off<br>
features.shard: on<br>
cluster.shd-wait-qlength: 10000<br>
cluster.shd-max-threads: 8<br>
cluster.locking-scheme: granular<br>
cluster.data-self-heal-algorit<wbr>hm: full<br>
cluster.server-quorum-type: server<br>
cluster.quorum-type: auto<br>
network.remote-dio: on<br>
performance.low-prio-threads: 32<br>
performance.io-cache: off<br>
performance.read-ahead: off<br>
performance.quick-read: off<br>
transport.address-family: inet<br>
nfs.disable: on<br>
performance.client-io-threads: on<br>
performance.cache-size: 192MB<br>
performance.write-behind-windo<wbr>w-size: 524288<br>
features.shard-block-size: 64MB<br>
cluster.eager-lock: enable<br>
diagnostics.brick-log-level: WARNING<br>
diagnostics.client-log-level: WARNING<br>
performance.cache-refresh-time<wbr>out: 4<br>
performance.strict-write-order<wbr>ing: off<br>
performance.flush-behind: off<br>
network.inode-lru-limit: 10000<br>
performance.md-cache-timeout: 600<br>
performance.cache-invalidation<wbr>: on<br>
features.cache-invalidation-ti<wbr>meout: 600<br>
features.cache-invalidation: on<br>
client.event-threads: 6<br>
server.event-threads: 6<br>
performance.stat-prefetch: on<br>
performance.parallel-readdir: false<br>
cluster.use-compound-fops: true<br>
cluster.readdir-optimize: true<br>
cluster.lookup-optimize: true<br>
cluster.self-heal-daemon: enable<br>
network.ping-timeout: 30<br>
performance.strict-o-direct: on<br>
cluster.granular-entry-heal: enable<br>
cluster.server-quorum-ratio: 51<br>
<br>
<br>
Regards<br>
<br>
George Vasilopoulos<br>
<br>
Systems administrator UCNET University of Crete<br>
<br>
-- <br>
Βασιλόπουλος Γιώργος<br>
Ηλεκτρολόγος Μηχανικός Τ.Ε.<br>
Διαχειριστής Υπολ. Συστημάτων<br>
<br>
Πανεπιστήμιο Κρήτης<br>
Κ.Υ.Υ.Τ.Π.Ε.<br>
Τμήμα Επικοινωνιών και Δικτύων<br>
Βούτες Ηρακλείου 70013<br>
Τηλ : 2810393310<br>
email : <a href="mailto:g.vasilopoulos@uoc.gr" target="_blank">g.vasilopoulos@uoc.gr</a><br>
<a href="http://www.ucnet.uoc.gr" rel="noreferrer" target="_blank">http://www.ucnet.uoc.gr</a><br>
<br>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mail<wbr>man/listinfo/gluster-users</a></blockquote></div><br></div>