National Construction Market Regulation Public Service Platform (Siku a) platform data crawling

http://jzsc.mohurd.gov.cn/data/company hit business inquiries and found that the returned data is encrypted

1. Looking returned data

Now that the data is returned through this url, url global search

http://jzsc.mohurd.gov.cn/api/webApi/dataservice/query/comp/list?pg=0&pgsz=15

Try the global fuzzy search /query/comp/list

Click into the js function

The results returned by the request url is /dataservice/query/comp/listobtained, marked with a breakpoint click on the search step by step modal js code

Step by step debugging process is not analyzed, final positioning to feel like we want data into the Console print it tande

t

t is the first one in the data we request http://jzsc.mohurd.gov.cn/api/webApi/dataservice/query/comp/list?pg=0&pgsz=15the returned data

e This is where the data is not exactly what we want data

2. Analysis encryption

Since we already know how the data is encrypted, then we analyze the focus of this place

Which t.data points out that we have to make our first step in requesting the first step http://jzsc.mohurd.gov.cn/api/webApi/dataservice/query/comp/list?pg=0&pgsz=15to get results

Then we focus on analysis process p function, click into the p function, the following results

After the layers of encryption for data processing, call the toString method, since the encryption function has been found, we can write the code

3. code implementation

We will function p copy the code out, data is returned encrypted data, we use it to copy out

Run the project

The reason being given, which uand dis not initialized we are looking at u and d, on top of the function p

We added to the code to add the code to u and d

Run the project to test

Which returns the data, what we want results

Do not use for illegal purposes

Guess you like

Origin www.cnblogs.com/mingyangliang/p/11875817.html