Results 1 to 12 of 12

Thread: Looking For A Simple Command-Line File Splitter/Joiner

  1. #1
    Member
    Join Date
    May 2012
    Location
    United States
    Posts
    341
    Thanks
    196
    Thanked 58 Times in 42 Posts

    Looking For A Simple Command-Line File Splitter/Joiner

    Hi everyone,

    I am looking for a small, simple, Win32 command-line tool to split and join big files (>8GB).

    Any suggestions?

  2. #2
    Member
    Join Date
    Feb 2013
    Location
    ARGENTINA
    Posts
    81
    Thanks
    220
    Thanked 26 Times in 18 Posts

    SplitSat

    I made this in .NET some time ago. Use at your own risk.

    http://encode.su/threads/1923-SPLITS...-File-Splitter

    Greetings.
    Last edited by surfersat; 16th April 2014 at 04:13.

  3. Thanks:

    Simorq (23rd May 2017)

  4. #3
    Member
    Join Date
    Jul 2006
    Location
    US
    Posts
    39
    Thanks
    26
    Thanked 1 Time in 1 Post
    I've used SFK (Swiss File Knife) for file splitting, but never for files > 8 GB.

    http://stahlworks.com/dev/swiss-file-knife.html

    here's the documentation on the split function. I don't see a reference to max file size.

    http://stahlworks.com/dev/index.php?tool=split

  5. #4
    Member
    Join Date
    May 2012
    Location
    United States
    Posts
    341
    Thanks
    196
    Thanked 58 Times in 42 Posts
    Quote Originally Posted by spark View Post
    I've used SFK (Swiss File Knife) for file splitting, but never for files > 8 GB.

    http://stahlworks.com/dev/swiss-file-knife.html

    here's the documentation on the split function. I don't see a reference to max file size.

    http://stahlworks.com/dev/index.php?tool=split
    Thanks! I'll give it a try.

  6. #5
    Member biject.bwts's Avatar
    Join Date
    Jun 2008
    Location
    texas
    Posts
    449
    Thanks
    23
    Thanked 14 Times in 10 Posts
    here is code I wrote a long time ago it will split a file into 2 files bijectively or join 2 files into one. I will some day offer different methods. But this method really one of the best of joining 2 files that are almost the same length.

    http://encode.su/threads/1677-Smart-...e-Splitter?#11

  7. #6
    Member
    Join Date
    May 2012
    Location
    United States
    Posts
    341
    Thanks
    196
    Thanked 58 Times in 42 Posts
    Quote Originally Posted by biject.bwts View Post
    here is code I wrote a long time ago it will split a file into 2 files bijectively or join 2 files into one. I will some day offer different methods. But this method really one of the best of joining 2 files that are almost the same length.

    http://encode.su/threads/1677-Smart-...e-Splitter?#11
    Hmm interesting...
    Thanks biject. I'll look into it.

  8. #7
    Member
    Join Date
    Jun 2013
    Location
    USA
    Posts
    98
    Thanks
    4
    Thanked 14 Times in 12 Posts
    Linux has had the 'split' command for ages. On Windows, Cygwin also includes it.

  9. Thanks:

    Bulat Ziganshin (29th January 2017)

  10. #8
    Member nikkho's Avatar
    Join Date
    Jul 2011
    Location
    Spain
    Posts
    552
    Thanks
    223
    Thanked 165 Times in 106 Posts
    Back in the old DOS days, I created one. It had the particularity that joining was performed by a simple batch file created by the program, so no need to have the program for joining.

    As for the executable, it was a quite compact 11 Kb executable, called split, which is still available at http://www.geocities.ws/siliconvalle...downloadd.html

  11. #9
    Member
    Join Date
    Jan 2014
    Location
    Bothell, Washington, USA
    Posts
    695
    Thanks
    153
    Thanked 183 Times in 108 Posts
    I have used HJSplit in the past. The website says it supports files over 100GB. There is a command line version, but I have not used it.

  12. #10
    Member
    Join Date
    Feb 2013
    Location
    San Diego
    Posts
    1,057
    Thanks
    54
    Thanked 72 Times in 56 Posts
    Quote Originally Posted by Mangix View Post
    Linux has had the 'split' command for ages. On Windows, Cygwin also includes it.
    You can use Cygwin on Windows and that's what I do. If you want the utilities without the dependency on Cygwin, that's what this appears to be (I haven't tried it): http://gnuwin32.sourceforge.net/

    A file split with `split` can be recreated with the `cat` utility.

    `dd` is an extremely versatile tool. There's also a utility called `csplit` that splits on boundaries that you specify.

  13. #11
    Member biject.bwts's Avatar
    Join Date
    Jun 2008
    Location
    texas
    Posts
    449
    Thanks
    23
    Thanked 14 Times in 10 Posts
    Its not that hard to write a bijective files spliter.

    Thank of a files as a list of bytes of all 256 symbols. You only need is to classify two of those symbols as dual use for control.
    If the file contains no control symbols and is even that is of length 2n you split into two files n bytes long.
    if the file is odd that is 2n+1 in length let the first file be n+1 bytes long and second file is n bytes long. in these two cases
    the file order and byte order is preserved which is what I assume you want.

    The fact is any two files null or not can be combined into a file that consists of only character used along with possible control characters to be combined into a single file. If control characters are used they would be added to end of each of the two files to be combined.

    It really is childs play to do this. If people ask I could write simple code to do this or give examples. It's just a simple concept of looking at file handling bijectively. I normally prefer looking at binary strings of any length but you can also play the same exact games when looking at bytes instead of bits.
    Last edited by biject.bwts; 17th June 2014 at 22:02. Reason: corrected error

  14. #12
    Member Karhunen's Avatar
    Join Date
    Dec 2011
    Location
    USA
    Posts
    91
    Thanks
    2
    Thanked 1 Time in 1 Post
    For command-line Win32 try http://ltr-data.se/opencode.html/#CmdUtils and the file you want is fsplitw.zip
    For people on multiple OS with tabbed split/join/checksum pages, a graphical Java based http://jfsplit.sourceforge.net/




    Last edited by Karhunen; 27th October 2014 at 18:50. Reason: Add additional link

Similar Threads

  1. Help!!! Need Recompression Command line for Precomp 0.4.3
    By Manjunath in forum Data Compression
    Replies: 9
    Last Post: 13th April 2014, 05:43
  2. Command Line Process Profiling Tool
    By david_werecat in forum Download Area
    Replies: 38
    Last Post: 30th December 2013, 17:12
  3. Smart Binary File Splitter
    By comp1 in forum The Off-Topic Lounge
    Replies: 10
    Last Post: 12th July 2013, 20:20
  4. Replies: 2
    Last Post: 23rd February 2013, 06:01
  5. command-line calculator for Windows?
    By Alexander Rhatushnyak in forum The Off-Topic Lounge
    Replies: 5
    Last Post: 29th January 2012, 23:40

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •