6

Split file based on size

view full story
linux-howto

http://www.unix.com – Hi Friends, Below is my requirement. I have a file with the below structure. 0001A1.... 0001B1.. .... 0001L1 0002A1 0002B1 ...... 0002L1 .. the first 4 characters are the sequence numbers for a record, A record will start with A1 and end with L1 with same sequence number. Now the file that is generated is too big. I need to split the file into multiple files with file size not exceeding 50MB. Assume if total length of file is 332 mb i need 7 splits with each 50 mb and with one condition the records should not be broken. Example: A1..L1 should not split into two files. Please (HowTos)

robot1's picture
Submitted by robot1 on 03/06/2012 – Made popular on 03/06/2012

Stories similar to Split file based on size

Hi all, I have a file which I want to split into several files based on a condition. This files has several records. I want one record per file. Each record ends with a //. So, I want to separate files based on this condition. I want split files to be named with the name across the field ID (for example: AACL2_BRAJA in the name give below). Also, I want the main file to be as such.

Although some file archivers offer us the option of split the files, this can be easily accomplished with two commands: split and cat. Splitting a file with split

split just needs the size of the parts that we want to create, and the file that we want to split, e.g.:

split -b 1024 file_to_split.bin

i tried to find a solution to this problem on the forums, but wasn't able to either understand some of the solutions.

I'm working with DNA data, and i have 2 files. The first file (a) is a file containing all sequence headers.

Hi,

I've one requirement. I have to split one comma delimited file into multiple files based on one of the column values.

How can I achieve this Unix

Here is the sample data.

Split pdf file 32 weeks 21 hours ago

Hello,

I made a document in odt format and exported it to the pdf format. The size of the pdf is about 24MB.

You may at times need to create a series of small compress files for a big file ( for instance, when you want to upload a very big file to Mediafire or Rapidshare, you will need to split this file into small parts). In Windows, the most popular tool for this task is WinRar to create rar files. In Linux, you can use the rar utility to compress a big file then split in into small parts as well.

I have a txt file which is formatted as 250,000 * 3600 (3600 rows and 250,000 column) I am going to split it into 3600 small txt which each file is 250,000 * 1.

I understand the split can basically split large file into small ones with certain size. If I followed the same technique, I would get the same size of files but each file can be either 249,999 * 1 or 250,001 *1.

Hi, I have a file that I want to split into multiple files based on the first column. All records with the same first column value should be written to a new file named after that column and the new file should not contain the original first column values anymore.

For example, if i have file f1.txt with data:

Code: a, x, y, z, ... b,23,9s,3e2,... a.9,2s,xs,... c,23,sd2,23,... b,9d,23,ds,...

Hi,.

I am writing a script to get the new files and split them.

Requirement Find the new files under the path "/wload/scmp/app/data/OAS" (There are 5 sub folders).