英文:
How do I access to a dynamic HTML element with web scrapping?
问题
我正在使用go-rod进行网页抓取。我想要访问一个动态<a>标签内的链接。
为了使这个<a>标签可见，我必须完成一个搜索器，它是一个没有submit按钮的input标签，格式如下：
<form>
<input> <!--这是搜索器-->
<form/>
所以，当我完成搜索器时，我想要访问的<a>标签就会出现：
到目前为止，一切都好。这是我用来完成搜索器的代码：
// 页面的 URL
page := rod.New().MustConnect().MustPage("https://www.sofascore.com/")
// 接受 cookies 提示
page.MustElement("cookiesAlertSelector...").MustClick()
// 完成搜索器
el := page.MustElement(`searcherSelector...`)
el.MustInput("Lionel Messi")
现在问题出现了，当我想要点击完成搜索器后显示的<a>标签时。
我尝试了以下代码：
divIWant := page.MustElement("aSelector...")
divIWant.MustClick()
以及：
divIWant := page.MustElement("aSelector...").MustWaitVisible()
divIWant.MustClick()
但是，它们都返回相同的错误：
panic: {-32000 Node is detached from document }
goroutine 1 [running]:
github.com/go-rod/rod/lib/utils.glob..func2({0x100742dc0?,
0x140002bad50?})
/Users/lucastomicbenitez/go/pkg/mod/github.com/go-rod/rod@v0.112.2/lib/utils/utils.go:65
+0x24 github.com/go-rod/rod.genE.func1({0x14000281ca0?, 0x1003a98b7?, 0x4?})
/Users/lucastomicbenitez/go/pkg/mod/github.com/go-rod/rod@v0.112.2/must.go:36
+0x64 github.com/go-rod/rod.(*Element).MustClick(0x14000289320) /Users/lucastomicbenitez/go/pkg/mod/github.com/go-rod/rod@v0.112.2/must.go:729
+0x9c main.main() /Users/lucastomicbenitez/development/golang/evolutionaryAlgorithm/main/main.go:22
+0x9c exit status 2
因此，为了寻找解决方案，我找到了这个 GitHub 问题，并尝试使用以下代码获取链接：
link := page.MustEval(`() => document.querySelector('aSelector...').href`)
但是它返回了以下错误：
panic: eval js error: TypeError: Cannot read properties of null (reading 'href')
不过，我非常确定选择器是正确的。
我做错了什么？
英文:
I'm using go-rod for web scrapping. I want to access to a link which is inside a dynamic <a>.
To make this a visible I have to complete a searcher which is an input with the next format (without a submit):
<form>
<input> <!--This is the searcher-->
<form/>
So, when I complete it, the a I want to access appears:
Until here, all It's ok. This is the code I use to complete the searcher:
//Page's url
page := rod.New().MustConnect().MustPage("https://www.sofascore.com/")
//Acept cookies alert
page.MustElement("cookiesAlertSelector...").MustClick()
//Completes the searcher
el := page.MustElement(`searcherSelector...`)
el.MustInput("Lionel Messi")
Now the problem appears, when I want to click the a which has been displayed after I completed the searcher.
I tried with this:
divIWant := page.MustElement("aSelector...")
divIWant.MustClick()
and with this:
divIWant := page.MustElement("aSelector...").MustWaitVisible()
divIWant.MustClick()
But, both of them returns me the same error:
> panic: {-32000 Node is detached from document }
>
> goroutine 1 [running]:
> github.com/go-rod/rod/lib/utils.glob..func2({0x100742dc0?,
> 0x140002bad50?})
> /Users/lucastomicbenitez/go/pkg/mod/github.com/go-rod/rod@v0.112.2/lib/utils/utils.go:65
> +0x24 github.com/go-rod/rod.genE.func1({0x14000281ca0?, 0x1003a98b7?, 0x4?})
> /Users/lucastomicbenitez/go/pkg/mod/github.com/go-rod/rod@v0.112.2/must.go:36
> +0x64 github.com/go-rod/rod.(*Element).MustClick(0x14000289320) /Users/lucastomicbenitez/go/pkg/mod/github.com/go-rod/rod@v0.112.2/must.go:729
> +0x9c main.main() /Users/lucastomicbenitez/development/golang/evolutionaryAlgorithm/main/main.go:22
> +0x9c exit status 2
So, looking for some solution I found this github issue and tried this to get the link:
link := page.MustEval(`()=> document.querySelector('aSelector...').href`)
But it returns this:
> panic: eval js error: TypeError: Cannot read properties of null
> (reading 'href')
However, I'm pretty sure the selector is correct.
What am I doing wrong?
答案1
得分: 2
根据评论中@Hymns For Disco的说法，我只需要在搜索完成后等待一段时间。
el.MustInput("Lionel Messi")
time.Sleep(time.Second)
link := page.MustEval(`() => document.querySelector('aSelector...').href`)
英文:
As @Hymns For Disco said in the comments, I just needed to wait some time after the searcher is completed.
el.MustInput("Lionel Messi")
time.Sleep(time.Second)
link := page.MustEval(`()=> document.querySelector('aSelector...').href`)
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论