Parsing JSON data from a curl API request

Question

I'm using Shodan's API https://developer.shodan.io/api to get my current network alerts. I want to parse out the id for the alerts with jq.

The curl request is curl -X GET -i https://api.shodan.io/shodan/alert/info?key={API KEY}

The output of that request is json data fomatted like so:

[
 {
  "name": "Test Alert",
  "created": "2017-01-09T21:53:17.104000",
  "expires": 0,
  "expiration": null,
  "filters": {
   "ip": [
    "198.20.88.870"
   ]
  },
  "id": "HKVGCP1WD79Z7W2T",
  "size": 1
 }
]

Using curl -X GET -i https://api.shodan.io/shodan/alert/info?key={API KEY} | jq '.id' give the following error:

"parse error: Invalid numeric literal at line 1, column 9"

Kusalananda · Accepted Answer · 2020-01-18 20:59:56Z

11

The -i option means curl will include http response headers which are not in JSON format. That is what causes your parse error, however given the json you provided, you need to use [] to tell it to iterate the array:

curl 'https://api.shodan.io/shodan/alert/info?key={API KEY}' | jq '.[].id'

alternatively (and IMO more intuitively) using json:

curl 'https://api.shodan.io/shodan/alert/info?key={API KEY}' | json -a id

Additionally json(1) has the -H option to ignore http response headers so you could use json -Ha id

edited Jan 18, 2020 at 20:59

Kusalananda♦

356k42 gold badges735 silver badges1.1k bronze badges

answered Jan 18, 2020 at 20:46

jesse_b

41.6k14 gold badges108 silver badges163 bronze badges

First solution worked, had to remove the -i on the curl. Thanks!

Ryan R
– Ryan R

2020-01-18 21:20:45 +00:00
Commented Jan 18, 2020 at 21:20

Add a comment |

Stack Exchange Network

Parsing JSON data from a curl API request

1 Answer 1

You must log in to answer this question.

Hot Network Questions

Parsing JSON data from a curl API request

1 Answer 1

You must log in to answer this question.

Related

Hot Network Questions