<div dir="ltr"><div><div><div><div><div>Hello all,<br><br></div>I&#39;m trying to take advantage of the shard xlator, however I&#39;ve found it causes a lot of issues that I hope is easily resolvable<br><br></div>1) large file operations work well (copy file from folder a to folder b<br></div>2) seek operations and list operations frequently fail (ls directory, read bytes xyz at offset 235567)<br><br></div>Turning off the shard feature resolves this issue for new files created in the volume. mounted using the gluster fuse mount<br><br></div>here&#39;s my volume settings, please let me know if there&#39;s some changes I can make.<br><br>Option                                  Value                                   <br>------                                  -----                                   <br>cluster.lookup-unhashed                 on                                      <br>cluster.lookup-optimize                 on                                      <br>cluster.min-free-disk                   10%                                     <br>cluster.min-free-inodes                 5%                                      <br>cluster.rebalance-stats                 off                                     <br>cluster.subvols-per-directory           (null)                                  <br>cluster.readdir-optimize                off                                     <br>cluster.rsync-hash-regex                (null)                                  <br>cluster.extra-hash-regex                (null)                                  <br>cluster.dht-xattr-name                  trusted.glusterfs.dht                   <br>cluster.randomize-hash-range-by-gfid    off                                     <br>cluster.rebal-throttle                  normal                                  <br>cluster.lock-migration                  off                                     <br>cluster.local-volume-name               (null)                                  <br>cluster.weighted-rebalance              on                                      <br>cluster.switch-pattern                  (null)                                  <br>cluster.entry-change-log                on                                      <br>cluster.read-subvolume                  (null)                                  <br>cluster.read-subvolume-index            -1                                      <br>cluster.read-hash-mode                  1                                       <br>cluster.background-self-heal-count      8                                       <br>cluster.metadata-self-heal              on                                      <br>cluster.data-self-heal                  on                                      <br>cluster.entry-self-heal                 on                                      <br>cluster.self-heal-daemon                on                                      <br>cluster.heal-timeout                    600                                     <br>cluster.self-heal-window-size           1                                       <br>cluster.data-change-log                 on                                      <br>cluster.metadata-change-log             on                                      <br>cluster.data-self-heal-algorithm        diff                                    <br>cluster.eager-lock                      enable                                  <br>disperse.eager-lock                     on                                      <br>cluster.quorum-type                     auto                                    <br>cluster.quorum-count                    (null)                                  <br>cluster.choose-local                    on                                      <br>cluster.self-heal-readdir-size          1KB                                     <br>cluster.post-op-delay-secs              1                                       <br>cluster.ensure-durability               on                                      <br>cluster.consistent-metadata             no                                      <br>cluster.heal-wait-queue-length          128                                     <br>cluster.favorite-child-policy           none                                    <br>cluster.stripe-block-size               128KB                                   <br>cluster.stripe-coalesce                 true                                    <br>diagnostics.latency-measurement         off                                     <br>diagnostics.dump-fd-stats               off                                     <br>diagnostics.count-fop-hits              off                                     <br>diagnostics.brick-log-level             INFO                                    <br>diagnostics.client-log-level            INFO                                    <br>diagnostics.brick-sys-log-level         CRITICAL                                <br>diagnostics.client-sys-log-level        CRITICAL                                <br>diagnostics.brick-logger                (null)                                  <br>diagnostics.client-logger               (null)                                  <br>diagnostics.brick-log-format            (null)                                  <br>diagnostics.client-log-format           (null)                                  <br>diagnostics.brick-log-buf-size          5                                       <br>diagnostics.client-log-buf-size         5                                       <br>diagnostics.brick-log-flush-timeout     120                                     <br>diagnostics.client-log-flush-timeout    120                                     <br>diagnostics.stats-dump-interval         0                                       <br>diagnostics.fop-sample-interval         0                                       <br>diagnostics.fop-sample-buf-size         65535                                   <br>diagnostics.stats-dnscache-ttl-sec      86400                                   <br>performance.cache-max-file-size         0                                       <br>performance.cache-min-file-size         0                                       <br>performance.cache-refresh-timeout       1                                       <br>performance.cache-priority                                                      <br>performance.cache-size                  1GB                                     <br>performance.io-thread-count             64                                      <br>performance.high-prio-threads           16                                      <br>performance.normal-prio-threads         16                                      <br>performance.low-prio-threads            32                                      <br>performance.least-prio-threads          1                                       <br>performance.enable-least-priority       on                                      <br>performance.cache-size                  1GB                                     <br>performance.flush-behind                on                                      <br>performance.nfs.flush-behind            on                                      <br>performance.write-behind-window-size    2GB                                     <br>performance.resync-failed-syncs-after-fsyncoff                                     <br>performance.nfs.write-behind-window-size1MB                                     <br>performance.strict-o-direct             off                                     <br>performance.nfs.strict-o-direct         off                                     <br>performance.strict-write-ordering       off                                     <br>performance.nfs.strict-write-ordering   off                                     <br>performance.lazy-open                   yes                                     <br>performance.read-after-open             no                                      <br>performance.read-ahead-page-count       4                                       <br>performance.md-cache-timeout            1                                       <br>performance.cache-swift-metadata        true                                    <br>performance.cache-samba-metadata        false                                   <br>performance.cache-capability-xattrs     true                                    <br>performance.cache-ima-xattrs            on                                      <br>features.encryption                     off                                     <br>encryption.master-key                   (null)                                  <br>encryption.data-key-size                256                                     <br>encryption.block-size                   4096                                    <br>network.frame-timeout                   1800                                    <br>network.ping-timeout                    42                                      <br>network.tcp-window-size                 (null)                                  <br>features.lock-heal                      off                                     <br>features.grace-timeout                  10                                      <br>network.remote-dio                      disable                                 <br>client.event-threads                    3                                       <br>network.ping-timeout                    42                                      <br>network.tcp-window-size                 (null)                                  <br>network.inode-lru-limit                 90000                                   <br>auth.allow                              *                                       <br>auth.reject                             (null)                                  <br>transport.keepalive                     on                                      <br>server.allow-insecure                   on                                      <br>server.root-squash                      off                                     <br>server.anonuid                          65534                                   <br>server.anongid                          65534                                   <br>server.statedump-path                   /var/run/gluster                        <br>server.outstanding-rpc-limit            64                                      <br>features.lock-heal                      off                                     <br>features.grace-timeout                  10                                      <br>server.ssl                              (null)                                  <br>auth.ssl-allow                          *                                       <br>server.manage-gids                      off                                     <br>server.dynamic-auth                     on                                      <br>client.send-gids                        on                                      <br>server.gid-timeout                      300                                     <br>server.own-thread                       (null)                                  <br>server.event-threads                    3                                       <br>ssl.own-cert                            (null)                                  <br>ssl.private-key                         (null)                                  <br>ssl.ca-list                             (null)                                  <br>ssl.crl-path                            (null)                                  <br>ssl.certificate-depth                   (null)                                  <br>ssl.cipher-list                         (null)                                  <br>ssl.dh-param                            (null)                                  <br>ssl.ec-curve                            (null)                                  <br>transport.address-family                inet6                                   <br>performance.write-behind                on                                      <br>performance.read-ahead                  off                                     <br>performance.readdir-ahead               on                                      <br>performance.io-cache                    on                                      <br>performance.quick-read                  off                                     <br>performance.open-behind                 on                                      <br>performance.stat-prefetch               on                                      <br>performance.client-io-threads           on                                      <br>performance.nfs.write-behind            on                                      <br>performance.nfs.read-ahead              off                                     <br>performance.nfs.io-cache                off                                     <br>performance.nfs.quick-read              off                                     <br>performance.nfs.stat-prefetch           off                                     <br>performance.nfs.io-threads              off                                     <br>performance.force-readdirp              true                                    <br>performance.cache-invalidation          false                                   <br>features.uss                            off                                     <br>features.snapshot-directory             .snaps                                  <br>features.show-snapshot-directory        off                                     <br>network.compression                     off                                     <br>network.compression.window-size         -15                                     <br>network.compression.mem-level           8                                       <br>network.compression.min-size            0                                       <br>network.compression.compression-level   -1                                      <br>network.compression.debug               false                                   <br>features.limit-usage                    (null)                                  <br>features.quota-timeout                  0                                       <br>features.default-soft-limit             80%                                     <br>features.soft-timeout                   60                                      <br>features.hard-timeout                   5                                       <br>features.alert-time                     86400                                   <br>features.quota-deem-statfs              off                                     <br>geo-replication.indexing                off                                     <br>geo-replication.indexing                off<br clear="all"><div><div><div><div><div><div><div><div class="gmail_signature"><br>-ben<br></div></div>
</div></div></div></div></div></div></div>