How to parse a link to a video in classmates?

A

Alexander Vasyuchenko2015-09-03 10:56:52

Parsing

Alexander Vasyuchenko, 2015-09-03 10:56:52

How to get a link to a video from a page on a video in classmates (for example , ok.ru/video/41451653700 )? I did not find anything worthwhile in the html code itself. Is there some sort of algorithm? The youtube-dl script, if I'm not mistaken, somehow it parses.

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

D

dstftw, 2015-09-03
@alexv1981

The algorithm is as follows:
1. Extract the value of the attributedata-options corresponding to the video ID from the page code, pass it through unescape , and pull it up as JSON .
Source snippet:

...
data-options="{&quot;playerId&quot;:&quot;VideoPopup_player_63567059965189_0&quot;,&quot;width&quot;:&quot;491&quot;,&quot;height&quot;:&quot;275&quot;,&quot;url&quot;:&quot;http://st.mycdn.me/static/MegaPlayer/10-1-2/vp.swf&quot;,&quot;url11&quot;:&quot;http://st.mycdn.me/static/MegaPlayer/10-1-2/vp11.swf&quot;,&quot;minFlashVersionNewPlayer&quot;:&quot;11.2&quot;,&quot;wmode&quot;:&quot;opaque&quot;,&quot;asa&quot;:true,&quot;provider&quot;:&quot;UPLOADED_ODKL&quot;,&quot;flashvars&quot;:{&quot;saveLastPlayingTimeFrom&quot;:&quot;30&quot;,&quot;bigLike&quot;:&quot;1&quot;,&quot;autoplayEnabled&quot;:&quot;1&quot;,&quot;locale&quot;:&quot;ru&quot;,&quot;noChannel&quot;:&quot;1&quot;,&quot;noExpandInFeed&quot;:&quot;0&quot;,&quot;enabledLocalStorage&quot;:&quot;1&quot;,&quot;minCacheTime&quot;:&quot;120&quot;,&quot;isLayer&quot;:&quot;1&quot;,&quot;metadataUrl&quot;:&quot;http://ok.ru%2Fdk%3Fcmd%3DvideoPlayerMetadata%26mid%3D29019278039%26mtId=63567059965189-0%26aid=529301710341&quot;,&quot;partition&quot;:&quot;4&quot;,&quot;translations&quot;:&quot;{\&quot;region_restriction\&quot;:\&quot;Видео недоступно для региона\&quot;,\&quot;upload\&quot;:\&quot;Добавить видео\&quot;,\&quot;exit_wide\&quot;:\&quot;Обычный размер\&quot;,\&quot;ultra\&quot;:\&quot;2160\&quot;,\&quot;subscribed\&quot;:\&quot;Вы подписаны\&quot;,\&quot;next_video\&quot;:\&quot;Следующее видео\&quot;,\&quot;unsubscribe\&quot;:\&quot;Отписаться\&quot;,\&quot;exit_fs\&quot;:\&quot;Свернуть\&quot;,\&quot;skip_adv\&quot;:\&quot;Пропустить рекламу\&quot;,\&quot;you\&quot;:\&quot;Вы\&quot;,\&quot;mute\&quot;:\&quot;Выключить звук\&quot;,\&quot;lowest\&quot;:\&quot;240\&quot;,\&quot;watch_ok\&quot;:\&quot;Смотреть в Одноклассниках\&quot;,\&quot;very_big_embed_size\&quot;:\&quot;Очень большой\&quot;,\&quot;copy_link\&quot;:\&quot;Копировать ссылку\&quot;,\&quot;adv_sec\&quot;:\&quot;сек\&quot;,\&quot;sd\&quot;:\&quot;480\&quot;,\&quot;low\&quot;:\&quot;360\&quot;,\&quot;adv_label\&quot;:\&quot;Реклама\&quot;,\&quot;share\&quot;:\&quot;Ссылка\&quot;,\&quot;not_found\&quot;:\&quot;Видео не найдено\&quot;,\&quot;quality_title\&quot;:\&quot;Качество\&quot;,\&quot;big_embed_size\&quot;:\&quot;Большой\&quot;,\&quot;quad\&quot;:\&quot;1440\&quot;,\&quot;link_to_video\&quot;:\&quot;Ссылка на видео\&quot;,\&quot;copy_link_time\&quot;:\&quot;Скопировать URL с привязкой ко времени\&quot;,\&quot;auto\&quot;:\&quot;Авто\&quot;,\&quot;decode\&quot;:\&quot;Браузер не поддерживает воспроизведение видео\&quot;,\&quot;small_embed_size\&quot;:\&quot;Маленький\&quot;,\&quot;quality_change\&quot;:\&quot;Изменить качество\&quot;,\&quot;external_not_found\&quot;:\&quot;Видео на внешнем ресурсе недоступно\&quot;,\&quot;other_embed_size\&quot;:\&quot;Другой размер\&quot;,\&quot;like\&quot;:\&quot;Класс!\&quot;,\&quot;replay\&quot;:\&quot;Смотреть ещё\&quot;,\&quot;adv\&quot;:\&quot;Вы сможете пропустить рекламу через\&quot;,\&quot;full\&quot;:\&quot;1080\&quot;,\&quot;copy_code\&quot;:\&quot;Скопировать код\&quot;,\&quot;link\&quot;:\&quot;Ссылка\&quot;,\&quot;network\&quot;:\&quot;Ошибка соединения\&quot;,\&quot;and\&quot;:\&quot;и\&quot;,\&quot;unmute\&quot;:\&quot;Включить звук\&quot;,\&quot;enter_wide\&quot;:\&quot;Широкий экран\&quot;,\&quot;subscribe\&quot;:\&quot;Подписаться\&quot;,\&quot;mobile\&quot;:\&quot;144\&quot;,\&quot;enter_fs\&quot;:\&quot;На весь экран\&quot;,\&quot;normal_embed_size\&quot;:\&quot;Средний\&quot;,\&quot;link_to_html_code\&quot;:\&quot;HTML-код\&quot;,\&quot;compilation\&quot;:\&quot;Канал:\&quot;,\&quot;hd\&quot;:\&quot;720\&quot;}&quot;,&quot;location&quot;:&quot;AutoplayLayerMovieRBlock/anonymMain/anonym&quot;,&quot;preferHd&quot;:&quot;1&quot;,&quot;hideExpand&quot;:&quot;0&quot;,&quot;noLikeButton&quot;:&quot;1&quot;,&quot;maxCachePartOfDuration&quot;:&quot;10&quot;,&quot;isAnonym&quot;:&quot;1&quot;,&quot;noUpload&quot;:&quot;1&quot;,&quot;adLogic&quot;:&quot;15,0,3,14400&quot;},&quot;noFlashText&quot;:&quot;Для воспроизведения видео вам необходимо \u003Ca class=\&quot;totalwhite mt-5 visible\&quot; href=\&quot;http://www.adobe.com/go/getflashplayer\&quot; target=\&quot;_blank\&quot;\u003Eустановить Adobe Flash Player\u003C/a\u003E&quot;,&quot;liveUnstartedText&quot;:&quot;Трансляция начнётся через&quot;,&quot;liveEndedText&quot;:&quot;Трансляция завершена&quot;,&quot;poster&quot;:&quot;http://vdp.mycdn.me/getImage?id=39435897559\u0026idx=7\u0026thumbType=32&quot;,&quot;isExternalPlayer&quot;:false,&quot;isHtml5Player&quot;:false}"
...

Pulled JSON:
1a. If there is no metadata in the resulting dictionary , that is d['flashvars']['metadata'], but there is d['flashvars']['metadataUrl'](for example, as for this video ), then you need to separately extract JSON with metadata by the metadataUrl link.
2. The received metadata is pulled into the dictionary . Direct links to videos are by keyvideos , several formats with different quality.

...
"videos":[{"name":"mobile","url":"http://217.20.153.79/?sig=2cd2ecf161b04e022ed586eb0b11fd417b6a4831\u0026ct=0\u0026urls=217.20.157.204%3B217.20.145.41\u0026expires=1441378063103\u0026clientType=0\u0026id=39435897559\u0026type=4","seekSchema":3},{"name":"lowest","url":"http://217.20.153.79/?sig=171cee4f29e74b25c3d2f4806b7d78909b320e77\u0026ct=0\u0026urls=217.20.157.204%3B217.20.145.41\u0026expires=1441378063103\u0026clientType=0\u0026id=39435897559\u0026type=0","seekSchema":3},{"name":"low","url":"http://217.20.153.79/?sig=d689c9fabffd4a49739254d4fec4f1dc42f1b4a3\u0026ct=0\u0026urls=217.20.157.204%3B217.20.145.41\u0026expires=1441378063103\u0026clientType=0\u0026id=39435897559\u0026type=1","seekSchema":3}]
...