TypeError: Cannot read property 'src' of null?

Question

Parsing

I go to the site using "puppetter", I want to parse the first image (url) in the feed, but only such an error Cannot read property 'src' of null. As I understood from the name of the error, src is empty, but I took a screenshot and the picture loaded there. The code:

export async function scrapeUrl () {
    const browser = await puppeteer.launch({
        headless: false,
        devtools: false,
        // args: ["--start-maximized"]
    });
    let page =  await browser.newPage();
    const pageURL = 'https://9gag.com/funny/fresh';

    try {
        await page.goto(pageURL, { waitUntil: 'domcontentloaded' });

    } catch (error) {
        console.log(`I can't open: ${pageURL} due to this mistake: ${error}`);
    }
    await page.waitFor(2000);
    await page.screenshot({path: 'buddy-screenshot.png'});
    const url = await page.$("div.post-container picture img");

    browser.close();

    return url.src;
};

And well, even with headless: true, the captcha is on the screen, who does what?

Answer 1

here is the line

const url = await page.$("div.post-container picture img");

finds no matching element div.post-container picture img
and returns null. As a result url = null