Questions tagged [file-systems]
techniques to organize and store files with their data on a computer.
101 questions
2
votes
2
answers
122
views
How to Design a Secure Script for Conditional File Access Based on Time and API Conditions?
I want to create a secure script that grants access to files based on specific conditions. The access should be controlled by both time-based and API-based conditions. The script should only allow ...
- 33
1
vote
2
answers
255
views
How to store an encrypted filesystem in a single file on disk on multiple platforms (maybe not portably), or alternatives
I'm in the very conceptual phase of designing an open source password manager that provides distributed Vaults that can be simultaneously accessed and managed from multiple devices with the promise of ...
- 111
2
votes
1
answer
107
views
What are some architectures and designs I could use to optimize the performance of file text data lookups?
I would like to write a program that essentially handles text data and metadata of files locally on a machine's filesystem. There is no need for any network activity. I am working with large ...
- 1,152
0
votes
0
answers
45
views
Enabling file editing on a file stored on a server through custom routes and POST/GET Requests
I am creating a platform which allows multiple users to edit a file simultaneously and I was wondering if using a web server with routes could be the correct architecture for this goal. I am trying to ...
- 115
3
votes
3
answers
922
views
File I/O - How HDD or SSD works with OS file system? [closed]
I've studied how data transfer with secondary storage(HDD or SSD) works.
Would you mind to check that my understanding is correct?
File system
block is basic read/write logical unit which is used in ...
- 133
0
votes
1
answer
310
views
How handle many files effectively?
I'm looking for a way to work with a huge amount (~10^9) of files (all sizes) in .NET using unspecified file system (NTFS, BTRFS...).
What I have done up to now is to store them in evenly in a folder-...
- 103
-1
votes
1
answer
116
views
File system for abstracting S3 object storage
We're looking for a scalable way to implement a file browser feature backed by a robust object storage system for the files. We were looking at an S3 compatible service, such as MinIO for this. Since ...
- 1,249
0
votes
2
answers
412
views
Building a program that truly deletes everything
We all know that if we delete a file, the operating system is recycling it but doesn't actually delete it. It just removes it from the directory indexes, and until the data is needed and overwritten, ...
- 127
0
votes
2
answers
180
views
Delete filesystem data associated with database record by delete hook, or internally in service logic?
Let's have many rows in the SQL database where every record has an image property that holds the path to file in the filesystem. Many database libraries have the ability to set-up hooks that are ...
- 165
0
votes
1
answer
529
views
Large file uploading in chunks
How to upload large(mb/gb) of video files from client to app server?
The solution as of now I know is pretty simple and widely used is to break file in chunks at at client side and send http post ...
- 81
1
vote
1
answer
652
views
Custom File System Index/Cache - How to save index
I've got an extremely oniony(deep) folder structure which contains Appx 1,000,000 text-based files on a network share. Using windows search is extremely slow and unreliable. I've created some text ...
- 379
5
votes
1
answer
2k
views
Why use strong checksums to detect random errors in a filesystem like btrfs?
Btrfs supports crc32c, xxhash, sha256 and blake2b as checksums when storing and reading files. crc32c and xxhash are designed to detect random errors while sha256 and blake2 are considered ...
- 61
1
vote
0
answers
37
views
(Installable) File System Driver, Shell Extension Handler or another approach?
I have an application that does some document handling as part of its functionality. I would like to implement a "Drive" emulator that would allow users to navigate and manage documents as ...
- 111
-3
votes
1
answer
241
views
Small scale document management system architecture / patterns
Im usually working with line of business desktop software. Mostly based on a single database.
Pretty often one of the requirements is to keep track of some files. Or the only way to implement a ...
- 99
-4
votes
1
answer
368
views
When to use dot files in Git repositories?
My Git repository contains dot files required by my tooling:
.dockerignore
.gitignore
.pre-commit-config.yaml
I'm using Azure Pipelines for CI/CD, which is typically defined in azure-pipelines.yml, ...
