1

Faster command to remove headers for files ina directory

view story
linux-howto

http://www.unix.com – Good evening Im new at unix shell scripting and im planning to script a shell that removes headers for about 120 files in a directory and each file contains about 200000 lines in average. i know i will loop files to process each one and ive found in this great forum different solutions using grep, sed, awk, head, etc. But according to the above scenario and your experince and knowledge which command is the best for performance and does the homework faster ? Thanks in advance (HowTos)

jiqi2's picture
Submitted by jiqi2 on 11/13/2012

Stories similar to Faster command to remove headers for files ina directory

I have directory path in which there are several sub directories. In all these sub dir there will be one env.cnf file.

Hi all,

I need a shell script to write into a .txt file the no of files in a directory with extension and separated by comma in between.

In Unix, is there any way to compare every file in a directory to every other file in a directory, and then list each pair of files by similarity (meaning the amount of difference between each file)? There are already some command-line Unix programs (such as fdupes) that can find duplicate files in a directory, but I'm wondering if it's possible to find similar files using a shell script as well.

Hey guys,

I am looking for simple shell script, so i can remove every second file in a directory.

For example in any given directory there are 10.000 files:

0001.jpg 0002.jpg 0003.jpg 0004.jpg 0005.jpg 0006.jpg 0007.jpg 0008.jpg .... 1111.jpg 1112.jpg etc.

After running the command, it will delete every second file in the directory.

I have a requirement to merge chunks of text files in a directory to one or more files and then zip the merged file.

For ex: If i have half a million text files in a directory, say A. I want to merge sets of 50,000 files into 1 i.e. I will have 10 merged files each having the content of 50,000 files. Finally, I want to zip each merged file, i.e.

I have written a korn shell script . I copy a file from one mounted directory to other using cp command. This script runs daily at a time. But sporidally it fails to copy the files. So I have missing files at the destination directory for some days. Is my method a good one or is there some way i can throw an error if the cp command fails

A shell script is a script written for the shell, or command line interpreter, of an operating system. Typical operations performed by shell scripts include file manipulation, program execution, printing text etc. Shell : In computing, a shell is a piece of software that provides an interface for users.

shell scripting testing 2 years 24 weeks ago

I have an input file (10000 lines) named ‘out’ in the given format. Each two lines represent one structure. I am giving this data file as input to a shell program which creates 5000 folders; one directory for each chromosomes using built-in tool ‘mfold SEQ=input’ command. The shell program is ‘process.awk’ given below. I am executing with a command ‘awk –f process.awk out’.

Hi Everyone !

i want to make an application which is written in shell script and in Bourne shell (sh)

i want, when my script is executed, it read all the files in the directly and move them to folders according to their extension.

suppose i have a files:

test.txt test.jpg test.docx test.tgz

all files txt goes to directory txt, jpg extention files goes to folder jpg and same the docx files to