COLLECTED BY
Organization:
Internet Archive
Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.
The Wayback Machine - https://web.archive.org/web/20200903125852/https://github.com/topics/large-files
Here are
65 public repositories
matching this topic...
PRDownloader - A file downloader library for Android with pause and resume support
Updated
Apr 27, 2020
Java
🚀 A pure PHP server and client for the tus resumable upload protocol v1.0.0
Google Arts And Culture Downloader. Python script to download high-resolution images from google arts & culture.
Updated
Jul 16, 2020
Python
A tool to download files from your FTP/SFTP servers in an organized way.
Updated
Jul 28, 2014
Clojure
Make app thinner. Help you find large files and compress png, gif, jpg, svg files. 应用程序瘦身工具,帮助你找到大文件,压缩png、gif、jpg、svg等文件。
Updated
Aug 21, 2020
JavaScript
Read large files line by line in a memory efficient (constant) way.
Settle for LESS: a fast and super-simple XML viewer for command-line
Updated
Mar 15, 2018
Shell
Simple and straightforward large files finder utility
Updated
May 7, 2020
Crystal
Updated
Jul 8, 2018
Nemerle
nodejs HTTP downloader with pause/resume support and segmented downloading
Updated
Jul 16, 2020
JavaScript
Fast multi-threaded file/stream data generator.
PHP implementation of the TUS resumable upload protocol v1.0.0.
Updated
Dec 4, 2018
JavaScript
日志文件分析工具,支持超大型日志文件,我自己做的基准测试是3分钟完成100GB日志的数据筛选并去重
Fast large file synchronization inspired by rsync
Updated
Mar 6, 2020
Python
Node wrapper around the dropbox upload session API to help concurrently upload files over 150mb to dropbox.
Updated
Jan 19, 2018
JavaScript
Bash + AWK script for quick Vlookups using CSV files. Ideal for large data sets
Updated
Jul 15, 2016
Shell
Line Catcher (LC) is an advanced programmable log parsing tool aimed to simplify and save time on viewing, searching, and parsing large text files
CSV toolkit written in golang
Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage
Updated
Mar 11, 2020
Julia
Notepad++ Plugin for reading large files
Grab each file and determine its size, if larger than specified. transcode and replace.
Updated
Jul 11, 2018
PowerShell
Robust and fault tolerant file transfer system.
Reading and writing in large file is a big promlen that can be solved with beautiful trick. we illustrate that with less memory.
Scripts for some useful git commands
Updated
May 16, 2019
Python
Client-side TUS protocol implementation in javascript
Updated
Oct 28, 2019
JavaScript
PRDownloader - A file downloader library for Android with pause and resume support using Kotlin
Updated
Jun 12, 2020
Kotlin
simple incremental pull of immutable large files
Improve this page
Add a description, image, and links to the
large-files
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
large-files
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session.
You signed out in another tab or window. Reload to refresh your session.