How to get ip and a specific substring from a string using grep and cut?

Question

linux

From the web server log file, you need to get pairs like IP: __utma. The lines in the file are standard, only through "|" cookies are saved.

80.247.101.110 - - [16/Aug/2013:06:58:23 +0400] "POST /edit HTTP/1.1" 404 327 "http://site.ru/" "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.22 (KHTML, like Gecko) Chrome/25.0.1364.172 YaBrowser/1.7.1364.17262 Safari/537.22" "-" | "__utma=230214667.2058679839.1371519930.1376615440.1376617932.52; __utmc=230214667; __utmz=230214667.1371519930.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none)"

Answer 1

Once such a booze has gone, then:

cat test.log | awk '{print $1,":",substr($0, index($0,"__utma"),64)}' | sed 's/ : __utma=/: /' | sed 's/;//'

I hope I understand you correctly?
At the exit:

80.247.101.110: 230214667.2058679839.1371519930.1376615440.1376617932.52

Answer 2

If you can awk, then like this:

cat ./data.txt | awk '{print $1,":",substr($0, index($0,"__utma"),64)}'

Answer 3

Here's how it's possible:

for line in $(cat log);
do
    ip=$(echo $line | grep -o "^[0-9]\+\.[0-9]\+\.[0-9]\+\.[0-9]\+")
    utma=$(echo $line |grep -o "__utma=\([0-9]\+\.\)\+[0-9]\+" | cut -d '=' -f2 )
    echo -en "$ip $utma\n"
done

Answer 4

cat log | awk -F"-" '{print $1,$4}' | awk '{print $1":",$4}' | sed 's/"__utma=//g' | sed 's/;$//'