csv manipulation with sed and awk

if you have huge file and you need to split it into pieces by 40MB

 
split --bytes 40M --numeric-suffixes --suffix-length=3 file.csv spl

split file by 150 lines with -l parameter. spl is prefix for split files

 
split --l 150 --numeric-suffixes --suffix-length=3 file.csv spl

count number o lines with wc command. -l indicates lines

wc -l file.csv 

remove whitespace from file with sed

sed -i '/^$/d' file.csv

select columns 1-3 from file to newfile

cut -d, -f1-3 file.csv > newfile.csv