英文:
requests.exceptions.InvalidSchema: no connection adapters were found. I'm trying to iterate through a list
问题
I can help you translate the code part of your text into Chinese. Here it is:
我正在尝试迭代一个URL列表，并使用request和BeatifulSoup来提取每个URL的标题名称。
但是我一直在收到这个错误：
> requests.exceptions.InvalidSchema: 找不到与“['https://reddit.com/?feed=home', 'https://reddit.com/chunkCSS/CollectionCommentsPage~CommentsPage~CountryPage~Frontpage~GovernanceReleaseNotesModal~ModListing~Mod~e3d63e32.74eb929a3827c754ba25_.css', 'https://reddit.com/chunkCSS/CountryPage~Frontpage~ModListing~Multireddit~ProfileComments~ProfileOverview~ProfilePosts~Subreddit.e72fce90a7f3165091b9_.css', 'https://reddit.com/chunkCSS/Frontpage.85a25b7700617eafa94b_.css', 'https://reddit.com/?feed=home', 'https://reddit.com/r/popular/']”的连接适配器。
代码：
pages = []
for admin_login_pages in domains:
with open("urls.txt", "w") as f:
f.write(admin_login_pages)
if "admin" in admin_login_pages:
if "login" in admin_login_pages:
pages.append(admin_login_pages)
with open("urls.txt", "r") as fread:
url_list = [x.strip() for x in fread.readlines()]
r = requests.get(str(url_list))
soup = BeautifulSoup(r.content, 'html.parser')
for title in soup.find_all('title'):
print(f"{admin_login_pages} - {title.get_text()}")
if not pages:
print(f"{Fore.RED} 找不到管理页面或登录页面")
else:
for page_list in pages:
print(f"{Fore.GREEN} {page_list}")
这是你的代码的翻译部分。
英文:
I'm trying to iterate through a list of urls and use request and BeatifulSoup to extract the title name of each url.
But I keep getting this error:
> requests.exceptions.InvalidSchema: No connection adapters were found for "['https://reddit.com/?feed=home', 'https://reddit.com/chunkCSS/CollectionCommentsPage~CommentsPage~CountryPage~Frontpage~GovernanceReleaseNotesModal~ModListing~Mod~e3d63e32.74eb929a3827c754ba25_.css', 'https://reddit.com/chunkCSS/CountryPage~Frontpage~ModListing~Multireddit~ProfileComments~ProfileOverview~ProfilePosts~Subreddit.e72fce90a7f3165091b9_.css', 'https://reddit.com/chunkCSS/Frontpage.85a25b7700617eafa94b_.css', 'https://reddit.com/?feed=home', 'https://reddit.com/r/popular/',]
The Code:
pages = []
for admin_login_pages in domains:
with open("urls.txt", "w") as f:
f.write(admin_login_pages)
if "admin" in admin_login_pages:
if "login" in admin_login_pages:
pages.append(admin_login_pages)
with open("urls.txt", "r") as fread:
url_list = [x.strip() for x in fread.readlines()]
r = requests.get(str(url_list))
soup = BeautifulSoup(r.content, 'html.parser')
for title in soup.find_all('title'):
print(f"{admin_login_pages} - {title.get_text()}")
if not pages:
print(f"{Fore.RED} No admin or login pages Found")
else:
for page_list in pages:
print(f"{Fore.GREEN} {page_list}")
答案1
得分: 0
正如我在评论中所述，您正在将列表的字符串表示作为URL传递给请求。这样做是行不通的。相反，应该遍历url_list，并分别对每个URL进行请求。
这是稍微重构过的代码示例：
pages = []
with open("urls.txt", "r") as fread:
url_list = [x.strip() for x in fread.readlines()]
with open("urls.txt", "w") as f:
for admin_login_pages in domains:
f.write(admin_login_pages)
if "admin" in admin_login_pages and "login" in admin_login_pages:
pages.append(admin_login_pages)
for url in url_list:
r = requests.get(url)
soup = BeautifulSoup(r.content, "html.parser")
title = soup.find("title")
print(f"{admin_login_pages} - {title.get_text()}")
if not pages:
print(f"{Fore.RED} 未找到管理员或登录页面")
else:
for page_list in pages:
print(f"{Fore.GREEN} {page_list}")
英文:
As I stated in the comment, you are feeding the string representation of the list as an URL to requests. That isn't going to work. Iterate over url_list instead and do a request to each URL separately.
Here is slightly refactored code as an example:
pages = []
with open("urls.txt", "r") as fread:
url_list = [x.strip() for x in fread.readlines()]
with open("urls.txt", "w") as f:
for admin_login_pages in domains:
f.write(admin_login_pages)
if "admin" in admin_login_pages and "login" in admin_login_pages:
pages.append(admin_login_pages)
for url in url_list:
r = requests.get(url)
soup = BeautifulSoup(r.content, "html.parser")
title = soup.find("title")
print(f"{admin_login_pages} - {title.get_text()}")
if not pages:
print(f"{Fore.RED} No admin or login pages Found")
else:
for page_list in pages:
print(f"{Fore.GREEN} {page_list}")
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论