1

Large file data handling issue

view story
linux-howto

http://www.unix.com – I have a single record large file, semicolon ';' and pipe '|' separated. I am doing a vi on the file. It is throwing an error "File to long" I need to actually remove the last | symbol from this file. Code: sed -e 's/\|*$//' filename is working fine for small files. But not working on this big file. The file size is "614077" (HowTos)

robot1's picture
Submitted by robot1 on 11/15/2012

Stories similar to Large file data handling issue

Hi,

I have shell script which will read single edi document and break data between ST & SE to separate files.Below example should create 3 separate files.

Hi we are using AIX 5.3 64bit I have near about 79000 log file having naming convention like "IFTMBCSun Aug 14 07:45:00 PAKST 2011". This naming convention was created by a script error, now we need to rename these log file by removing extar spaces and (:) colon for that we wrote below script

Code: ls * | while read file do echo $file echo "$file" | sed "s/[ \:]//g&qu

awk performance issue 44 weeks 5 hours ago

Hi, I have the code below as

Code: cat <filename> | tr '~' '\n' | sed '/^$/ d' | sed "s/*/|/g" > <filename> awk -F\| -vt=`date +%m%d%y%H%M%S%s` '$1=="ST",$1=="SE"{if($1=="ST"){close(f);f="214_edifile_"t"" ++i} ; $1=$1; print>f}' OFS=\| <filename> This script replaces some characters and extracts the records

Hi All,

I need to create a script to process on 10 files.

UNIX file handling issue 27 weeks 2 days ago

I have a huge file semicolon( ; ) separated records are Pipe(|) delimited.

e.g

Code: abc;def;ghi|jkl;mno;pqr|123;456;789 I need to replace the 50th field(semicolon separated) of each record with 9006. The 50th field can have no value e.g. ;;

Can someone help me with the appropriate command.

Help for File Modification 1 year 14 weeks ago

Hi All, I have a file. This file contain huge amount of data. I want to modify this file. I want enter new line when count of "~ character is 79.

I have following code for downloading file from url to sdcard .

Some of my Mp3 files that I click and drag to the Mp3 player music folder aren't working. Some of the files work when i drag and drop, but a large number of them give this error message: "Error while copying "file name here".

There was an error copying the file into gphoto2://[usb:001,010]music/"file name here"

I want to append file names at the beginning of a line for each row

file content

Code: abc.txt.gz 123|654|987 bcd.txt.gz 876|trf|kjh I want a single output file with below format

Code: abc.txt.gz|123|654|987 bcd.txt.gz|876|trf|kjh

This one is working but only with unzip files,need to have something like this working with zip files as i cannot unzip the files ...

Code: awk '{pr