英文:
Selenium finding and updating class with web app
问题
以下是您的内容的中文翻译：
不久前，我设置了一个使用selenium的Python脚本来爬取网站的脚本。我尝试将这段代码调整为从新网页获取数据，但遇到了问题。问题似乎是页面是一个应用程序，而不是一个更标准的网页（而且我的理解不够充分）。
我似乎试图更新的元素是"ag-paging-number"。我尝试使用click()代替page，但也没有奏效。
最终，该脚本应该循环遍历1496页并保存数据（如果有关如何设置目录的提示，将非常有帮助）。感谢任何帮助。
显然，一旦脚本正常工作，我会切换到无头模式。
英文:
Some time ago I set up a Python script utilizing selenium to crawl across a website. I have tried to adopt the code to get data from a new webpage but have run into trouble. The issue seems to be that the page is an app rather than a more standard page (and my understanding is not ideal).
The element I seem to be trying to update is "ag-paging-number". I tried click() instead of page and this did not work either.
Ulitmately, the script should cycle through the 1496 pages and save down the data (Any tips on how to set the directory would be great). Any help would be appreciated.
Obviously once the script is working I will switch to headless
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
import time
import codecs
options = Options()
options.add_argument("--window-size=1920,1200")
driver = webdriver.Chrome()
url = "https://app.climatevaluation.com/apps/projections/table/index.html"
driver.get(url)
for page in range(1,1496,1):
time.sleep(10)
try:
driver.find_element_by_class_name("ag-paging-number").click()
except:
break
with codecs.open('session'+str(page)+'.htm', 'w','utf-8') as out:
out.write(driver.page_source)
答案1
得分: 0
我认为你愿意点击下一页按钮吗？
使用 driver.find_element_by_xpath("//div[@ref='btNext']/span").click()
在循环之前，你可能还想添加 driver.implicitly_wait(10)。
英文:
I think you are willing to click the next page button?
Use driver.find_element_by_xpath("//div[@ref='btNext']/span").click()
You might also want to add driver.implicitly_wait(10) before the loop
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论