英文:
Python Selenium find_elements by xPATH returns nothing
问题
你的Python代码看起来没错，但是可能是因为网页加载延迟或者XPath选择器不准确导致无法提取文本。你可以尝试添加等待，确保页面加载完成后再提取文本。这是一个示例：
from selenium.webdriver.common.by import Byfrom selenium import webdriverfrom selenium.webdriver.support.ui import WebDriverWaitfrom selenium.webdriver.support import expected_conditions as ECdriver = webdriver.Chrome()driver.get('https://bid.cars/pl/search/results?search-type=filters&type=Automobile&year-from=1900&year-to=2024&make=Jeep&model=Cherokee&auction-type=All')# 使用等待确保页面加载完成wait = WebDriverWait(driver, 10)element = wait.until(EC.presence_of_element_located((By.XPATH, "//div[@class='row']//div[1]//div[2]//div[2]//ul[1]//li[1]")))all_spans = driver.find_elements(by=By.XPATH, value="//div[@class='row']//div[1]//div[2]//div[2]//ul[1]//li[1]")for span in all_spans:print(span.text)
这个代码会等待页面元素加载完成，然后再提取文本。如果还有问题，可能需要检查XPath选择器是否准确匹配到你想要的元素。
英文:
Hi I am new in python selenium. I want to extract some information from the following page https://bid.cars/pl/search/results?search-type=filters&type=Automobile&year-from=1900&year-to=2024&make=Jeep&model=Cherokee&auction-type=All
The page returns list of sold cars. Each car has unique identifier (Eg."Numer: 0-35954378"). I want to extract value for all the cars. As a tart point I am trying to extract value 0-35954378.
Click to display screeshot.
Via SelectorsHub I retrieved the element Xpath //body[1]/section[1]/div[1]/div[1]/div[2]/div[2]/div[2]/div[1]/div[2]/div[2]/ul[1]/li[1]/span[1]
My python code looks like below but it returns nothing
from selenium.webdriver.common.by import Byfrom selenium import webdriverdriver=webdriver.Chrome()driver.get('https://bid.cars/pl/search/results?search-type=filters&type=Automobile&year-from=1900&year-to=2024&make=Jeep&model=Cherokee&auction-type=All')all_spans = driver.find_elements(by=By.XPATH,value="//div[@class='row']//div[1]//div[2]//div[2]//ul[1]//li[1]")for span in all_spans:print(span.text)
What I am doing wrong ?
答案1
得分: 0
你只需要等页面完全加载并显示所需元素。你可以通过使用selenium的waits来实现。
尝试这个：
all_spans = WebDriverWait(driver, 20).until(EC.presence_of_all_elements_located((By.XPATH, "//div[@class='row']//div[1]//div[2]//div[2]//ul[1]//li[1]")))for span in all_spans:print(span.text)
所需导入：
from selenium.webdriver.common.by import Byfrom selenium.webdriver.support.ui import WebDriverWaitfrom selenium.webdriver.support import expected_conditions as EC
控制台输出：
Numer: 0-35954378进程以退出代码0完成
更新： 如果你有兴趣打印所有元素的Numer:。然后尝试下面的代码：
all_spans = WebDriverWait(driver, 20).until(EC.presence_of_all_elements_located((By.XPATH, "//span[text()='Numer:']//parent::li")))for span in all_spans:print(span.text)
控制台输出：
Numer: 0-35954378Numer: 0-35259548Numer: 0-35311342Numer: 0-35436922Numer: 0-35362206Numer: 0-35707354Numer: 0-35779189Numer: 0-35994685Numer: 0-35536329Numer: 0-35945281Numer: 0-35873282Numer: 0-35959753Numer: 0-35837249Numer: 0-35776807Numer: 0-35618989Numer: 0-35532919Numer: 0-35631487Numer: 1-40989193Numer: 1-43697413Numer: 1-40468853Numer: 1-45289353Numer: 1-45289173Numer: 1-42777553Numer: 1-41613883Numer: 1-72373302Numer: 1-39444273Numer: 1-73146322Numer: 1-42996963Numer: 1-38210013Numer: 1-72783072Numer: 1-39825163Numer: 1-39480713Numer: 1-41967373Numer: 1-38702863Numer: 1-43687943Numer: 1-66278552Numer: 1-35865053Numer: 1-36381873Numer: 1-42179823Numer: 1-42478053Numer: 1-40804723Numer: 1-60160692Numer: 1-42572953Numer: 1-41972593Numer: 1-71537212Numer: 1-39706293Numer: 1-69067952Numer: 1-40590473Numer: 1-42523973Numer: 1-37934343进程以退出代码0完成
英文:
You just have to wait until the page loads completely and desired element is visible. You can achieve that by using selenium's waits
Try this:
all_spans = WebDriverWait(driver, 20).until(EC.presence_of_all_elements_located((By.XPATH, "//div[@class='row']//div[1]//div[2]//div[2]//ul[1]//li[1]")))for span in all_spans:print(span.text)
Imports required:
from selenium.webdriver.common.by import Byfrom selenium.webdriver.support.ui import WebDriverWaitfrom selenium.webdriver.support import expected_conditions as EC
Console output:
Numer: 0-35954378Process finished with exit code 0
UPDATE: In case you are interested in printing all the elements Numer:. Then try the below code:
all_spans = WebDriverWait(driver, 20).until(EC.presence_of_all_elements_located((By.XPATH, "//span[text()='Numer:']//parent::li")))for span in all_spans:print(span.text)
Console Output:
Numer: 0-35954378Numer: 0-35259548Numer: 0-35311342Numer: 0-35436922Numer: 0-35362206Numer: 0-35707354Numer: 0-35779189Numer: 0-35994685Numer: 0-35536329Numer: 0-35945281Numer: 0-35873282Numer: 0-35959753Numer: 0-35837249Numer: 0-35776807Numer: 0-35618989Numer: 0-35532919Numer: 0-35631487Numer: 1-40989193Numer: 1-43697413Numer: 1-40468853Numer: 1-45289353Numer: 1-45289173Numer: 1-42777553Numer: 1-41613883Numer: 1-72373302Numer: 1-39444273Numer: 1-73146322Numer: 1-42996963Numer: 1-38210013Numer: 1-72783072Numer: 1-39825163Numer: 1-39480713Numer: 1-41967373Numer: 1-38702863Numer: 1-43687943Numer: 1-66278552Numer: 1-35865053Numer: 1-36381873Numer: 1-42179823Numer: 1-42478053Numer: 1-40804723Numer: 1-60160692Numer: 1-42572953Numer: 1-41972593Numer: 1-71537212Numer: 1-39706293Numer: 1-69067952Numer: 1-40590473Numer: 1-42523973Numer: 1-37934343Process finished with exit code 0
答案2
得分: 0
只返回翻译好的部分：
"Along with the wait, it is also a good idea to avoid as much as possible this type of xpath : div[1]//li[2]... In your case you can use the methods available for the selenium elements:
除了等待，尽量避免使用这种类型的XPath：div[1]//li[2]... 在你的情况下，你可以使用Selenium元素可用的方法：
list_res= driver.find_element(By.CLASS_NAME, 'items-row')
vehicles = list_res.find_elements(By.CLASS_NAME, 'lots-search')
check if ther is any car in the page
如果页面上没有汽车，检查一下
if len(vehicles)==0:
print("No car in the list")
print("列表中没有汽车")
for vehicle in vehicles:
item_specs = vehicle.find_element(By.CLASS_NAME, 'item-specs')
number = item_specs.find_elements(By.TAG_NAME, 'li')[0]
print(number.text)
The code is more readable and easy to debug
代码更易读且易于调试"
英文:
Along with the wait, it is also a good idea to avoid as much as possible this type of xpath : div[1]//li[2]... In your case you can use the methods available for the selenium elements:
list_res= driver.find_element(By.CLASS_NAME, 'items-row')vehicles = list_res.find_elements(By.CLASS_NAME, 'lots-search')# check if ther is any car in the pageif len(vehicles)==0:print("No car in the list")for vehicle in vehicles:item_specs = vehicle.find_element(By.CLASS_NAME, 'item-specs')number = item_specs.find_elements(By.TAG_NAME, 'li')[0]print(number.text)
The code is more readable and easy to debug
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论