Questions tagged [distributed-filesystem]
The distributed-filesystem tag has no summary.
25 questions
1
vote
2
answers
680
views
Mirroring disk between computers
I want to have a logical disk (using LVM) that is mirrored between two computers. That is, I want one filesystem that has complete copies on two different computers.
I want to do this on Linux, ...
- 3,631
-2
votes
1
answer
495
views
How can I create or access a remote file shared by a distributed filesystem as if it were local?
In general, I would like to run local programs on remote files provided to me via a distributed file system (e.g. samba, NFS or whichever you recommend), and I want to access the remote files in a ...
- 107k
2
votes
2
answers
598
views
Does Opensolaris offer distributed ZFS filesystems
I haven't had any luck getting a confirmed yes or no to this question.
I'd like to run ZFS as a distributed file system (like Gluster or CEPH). OpenZFS and ZFS on Linux does not (yet) have file ...
- 248
0
votes
1
answer
687
views
Adding entries to fstab results in emergency mode
This is my local system configuration.
NAME="elementary OS"
VERSION="5.0 Juno"
I am mounting my remote server's file system on a subdirectory by this command, which is working fine.
sudo sshfs -o ...
- 131
2
votes
1
answer
3k
views
Unable to mount gfs2 file system on Debian Stretch, probable dlm mis-config?
I am experimenting with gfs2 on Debian Stretch, and having some difficulties. I am a reasonably experienced Linux admin, but new to shared-disk and parallel file systems.
My immediate project is to ...
- 53
3
votes
0
answers
200
views
Is it crazy to consider keeping my home directory on OpenAFS?
I am a sysadmin by trade, and I do what I do at work at home as well for fun. I have a Gentoo Linux laptop, Raspberry Pis running Raspian, a Gentoo server, ARM devices running Debian and have various ...
- 246
3
votes
0
answers
1k
views
Meta Data Server (MDS) cluster for pnfs
TL;DR
pNFS seems a great method for multiple concurrent access to centralised shared storage, but it has a problem: the single NFS server providing NFS metadata (meta data server, MDS) is a single ...
- 8,150
2
votes
2
answers
3k
views
ZFS read-only mount on Linux + simultaneous read-write mount on Solaris
We have to regularly copy quite huge files from Solaris to Linux (using network).
It currently takes almost half a day for one file.
The files in Solaris are on a ZFS filesystem.
So I thought what a ...
- 243
0
votes
1
answer
5k
views
How to move a directory?
I have a directory in HDFS with subdirectories that contain part-xxxxx files, created by Spark. I want to move that directory (and everything inside it) into a new directory. How to?
My attempt:
[...
- 191
2
votes
2
answers
2k
views
set up NFS two way syncronization [closed]
I have two servers that I want to "share" the home folder of, such that when I make changes on Server A they appear on Server B and when I make changes on Server B they appear on Server A.
Right now ...
1
vote
1
answer
196
views
Where would be the best location to mount a distributed filesystem? [closed]
We are looking at mounting a distributed file system on our RHEL machines and we think that the best location to mount the share is at /var/dfs. Where would the best location be to mount this share?
- 121
1
vote
1
answer
869
views
distributed file system that works well with multiple small files [closed]
Hi my use case is quite specific.
I have 20 Windows 7 machines constantly creating files in my storage; around 98% of these files are 2.1 MB. On average we create 24 million files every 3 days, and ...
- 149
3
votes
2
answers
1k
views
"Junctioned" symbolic links [duplicate]
Does Linux have the capability to use "junctioned" symbolic links? I'm not sure if this is an actual term or not, so let me explain the concept.
I have a git repository containing all my ...
- 449
2
votes
1
answer
2k
views
Validate start-dfs.sh
I am trying to setup a Hadoop cluster, where master is my laptop and slave is the virtualbox, following this guide. So, I did, from master:
gsamaras@gsamaras:/home/hadoopuser/hadoop/sbin$ sudo ./...
- 191
7
votes
2
answers
7k
views
Parallel vs Distributed vs Traditional File system
I am trying to understand the differences between these three file system at a very basic level.
Distributed FS: HDFS
Parallel FS : Lustre
Traditional FS : ext4/ext3/ NTFS/FAT etc.
I want to know ...
- 188