Skip to main content

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

2
  • Hi, thanks for the response, I appreciate the effort you've put in there, but I feel a simpler solution may be possible. I have added some info to the bottom of my original post (see NEW EDIT section) with a hypothetical way I may achieve my goal, but I am unsure of the correct code still. Commented Nov 25, 2015 at 15:41
  • Some of the urls require different options to make it works (e.g. you must provide user-agent when request google), and that's why curl config file exist(i'm not sure how you get it though). And i prefer to provide general solution(with curl config file) which might help someone else, rather than specific to read line by line with strip first 6 characters "URL = ", such as while read -r line; do [ -z "$line" ] && continue; curl -vL "${line:6}" | sed '/mortgage/q' >> "results" ; done < curl_config . Commented Nov 26, 2015 at 8:31