After taking a break from coding for some time, I am now diving back in as a beginner. I am currently using the requests library to fetch JSON data from the Incapsula API in order to collect stats about website traffic. My goal is to extract and write the "type of traffic, timestamp, and number" to a file for generating reports. The format of the API response looks like this:
{
"res": 0,
"res_message": "OK",
"visits_timeseries" : [
{
"id":"api.stats.visits_timeseries.human",
"name":"Human visits",
"data":[
[1344247200000,50],
[1344247500000,40],
...
]
},
{
"id":"api.stats.visits_timeseries.bot",
"name":"Bot visits",
"data":[
[1344247200000,10],
[1344247500000,20],
...
]
}
I am extracting the Visit_timeseries data using the following method:
r = requests.post('https://my.incapsula.com/api/stats/v1', params=payload)
reply=r.json()
reply = reply['visits_timeseries']
reply = pandas.DataFrame(reply)
The extracted data is presented in the form of (date in unix time, number of visits) :
print(reply[['name', 'data']].head())
name data
0 Human visits [[1500163200000, 39], [1499904000000, 73], [14...
1 Bot visits [[1500163200000, 1891], [1499904000000, 1926],...
I'm struggling with extracting specific fields from the dataframe to only include them in the excel file. I need to reformat the 'data' field into two separate rows (date, value), while keeping only the 'name' at the top.
What I envision is :
Human Visit Bot Visit
Date Value Value
Date Value Value
Date Value Value
Your assistance with this would be greatly appreciated! Thank you.