[Bugs] [Bug 1435832] New: PostgreSQL DB Restore: unexpected data beyond EOF

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1435832

            Bug ID: 1435832
           Summary: PostgreSQL DB Restore: unexpected data beyond EOF
           Product: GlusterFS
           Version: 3.8
         Component: nfs
          Assignee: bugs at gluster.org
          Reporter: javishi at gmail.com
                CC: bugs at gluster.org



Description of problem:

I'm running Gluster in a kubernetes cluster with the help of
https://github.com/gluster/gluster-kubernetes.  I have a postgresql container
where the /var/lib/postgresql/data/pgdata directory is a glusterfs mounted
persistent volume.  I then run another container to restore a PostgreSQL
backup.  It successfully restores all tables except one, which happens to be
the largest sized table >100MB.  The error given for that table is:

```
ERROR:  unexpected data beyond EOF in block 14917 of relation base/78620/78991
HINT:  This has been seen to occur with buggy kernels; consider updating your
system.
CONTEXT:  COPY es_config_app_solutiondraft, line 906
```

I have tried several different containers to perform the restore on including
ubuntu:16:04, postgresql:9.6.2, and alpine:3.5.  All have the same issue. 
Interestingly, the entire restore works including the large table if I run it
directly on the postgresql container.  That makes me think this is related to
container to container networking and not necessarily gluster's fault but
wanted to report it in case there are any suggestions or kernel setting tweaks
to fix the issue.

Version-Release number of selected component (if applicable):

GlusterFS 3.8.5

PostgreSQL 9.6.2 Container:
uname -a
Linux develop-postgresql-3992946951-3srqg 4.4.0-65-generic #86-Ubuntu SMP Thu
Feb 23 17:49:58 UTC 2017 x86_64 GNU/Linux

Other containers used for the restore are running the same 4.4.0-65-generic
kernel.

Kubernetes 1.5.1
Docker 1.12.6

How reproducible:

First, get kubernetes working with gluster and heketi.  See
https://github.com/gluster/gluster-kubernetes

Steps to Reproduce:
1. Start a PostgreSQL "pod" with the /var/lib/postgresql/data/pgdata set up as
persistent volume.
2. Start a second container that can access the postgres container.
3. Attempt to restore a backup containing a large table >100MB.

Actual results:

Restore fails on large table with above error.

Expected results:

Restore applies cleanly, even for large tables.

Additional info:

Volume is mounted as type fuse.glusterfs.  From postgresql container:
# mount
10.163.148.196:vol_6d09a586370e26a718a74d5d280f8dfd on
/var/lib/postgresql/data/pgdata type fuse.glusterfs
(rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072)

Googling this error does return some fairly old results that don't really have
anything conclusive.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.