S
S
Suxoi2016-10-05 13:22:25
PHP
Suxoi, 2016-10-05 13:22:25

How to get data from a site with dynamic js?

There is a site without HTML stats, through Charles I viewed the pages loading

in
stages =469F0452-18FF-3E05-8072-566D9785BE96 x-uid: 35D1D4CF-FEF0-3C11- A328
-C2C082899783
x-ah: rbybeswcvavfrqx
cf-ray: 2ecfc9ac9eca0485-FRA
content-type: text/ javascript
code

2. After the glass.qqsyzsca.js script, there is a POST request to /getSiteNotificationsAjax.htm , some text is passed in the header to the JS

3 function. Then a GET is sent to /static/js/gd-emp-photos-lightbox. js , in the response header
vary: Accept-Encoding
p3p: CP="IDC DSP COR ADM DEVi TAIi PSA PSD IVAi IVDi CONi HIS OUR IND CNT"
x-disti-cs: BYPASS
and also to text with function

4. Next POST request to /glass.tybcxseuyawxcabfft.js?PID=469F0452 -18FF-3E05-8072-566D9785BE96
HEADERS Request here is some mysterious
x-distil-ajax: dbtuytexwtyrsaubdadae
and a bunch of cookies


After that, after some time, a request is sent HEAD path:/glass.vzutzyfyfctqsdtacbf.js?PID=469F0452-18FF-3E05 -8072-566D9785BE96, where *.js changes,
x-ju responses come to HEADERS: /glass.vzutzyfyfctqsdtacbf.js?PID=469F0452-18FF-3E05-8072-566D9785BE96
x-uid: 35D1D4CF-FEF0-3C11-A3998-C2783
x-ah: dyzuawtv
vary: Accept-Encoding

Who faced this? The usual methods of curla and Phantom JS did not pull out the data, what kind of mysterious x-distil software ?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
R
romy4, 2016-10-05
@romy4

Study. Emulate ajax requests and responses with curl.

V
Vitaly, 2016-10-05
@vshvydky

If only you wrote a website, but in general, run nihgtmarejs and let it do the dirty work itself

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question