如何从TradingView链接加载收益日历数据并放入数据框中

huangapple
go评论98阅读模式
英文:

How to Load the Earnings Calendar data from TradingView link and into Dataframe

问题

I want to load the Earnings Calendar data from TradingView link and load into Dataframe.

Link: https://in.tradingview.com/markets/stocks-india/earnings/
Filter-1: Data for "This Week"

I am not able to select the Tab "This Week". Any help?

Answer is Closed so posting here:

  1. import time
  2. from selenium import webdriver
  3. from selenium.webdriver.common.by import By
  4. import pandas as pd
  5. pd.set_option('display.max_rows', 50000)
  6. pd.set_option('display.max_columns', 100)
  7. pd.set_option('display.width', 10000)
  9. driver = webdriver.Chrome()
  10. driver.get("https://in.tradingview.com/markets/stocks-india/earnings/")
  11. driver.find_element(By.XPATH, "//div[.='This Week']").click()
  12. time.sleep(5)
  14. visible_columns = driver.find_elements(By.CSS_SELECTOR, 'div.tv-screener__content-pane thead th:not([class*=i-hidden])')
  15. data_field = [c.get_attribute('data-field') for c in visible_columns]
  17. header = [c.text.split('\n')[0] for c in visible_columns]
  18. rows = driver.find elements(By.XPATH, "//div[@class='tv-screener__content-pane']//tbody/tr")
  20. columns = []
  21. for field in data_field:
  22.     column = driver.find_elements(By.XPATH, f"//div[@class='tv-screener__content-pane']//tbody/tr/td[@data-field-key='{field}']")
  23.     columns.append([col.text.replace('\n',' - ') for col in column])
  25. df = pd.DataFrame(dict(zip(header, columns)))
  26. print(df)
  27. driver.quit()

(Note: The code section has not been translated, as requested.)

英文:

I want to load the Earnings Calendar data from TradingView link and load into Dataframe.

  1. Link: https://in.tradingview.com/markets/stocks-india/earnings/
  2. Filter-1: Data for "This Week"

如何从TradingView链接加载收益日历数据并放入数据框中

I am not able to select the Tab "This Week". Any help ?

Answer is Closed so posting here:

  1. import time
  3. from selenium import webdriver
  4. from selenium.webdriver.common.by import By
  6. import pandas as pd
  7. pd.set_option('display.max_rows', 50000)
  8. pd.set_option('display.max_columns', 100)
  9. pd.set_option('display.width', 10000)
  11. driver = webdriver.Chrome()
  12. driver.get("https://in.tradingview.com/markets/stocks-india/earnings/")
  13. driver.find_element(By.XPATH, "//div[.='This Week']").click()
  14. time.sleep(5)
  16. visible_columns = driver.find_elements(By.CSS_SELECTOR, 'div.tv-screener__content-pane thead th:not([class*=i-hidden])')
  17. data_field = [c.get_attribute('data-field') for c in visible_columns]
  19. header = [c.text.split('\n')[0] for c in visible_columns]
  20. rows = driver.find_elements(By.XPATH, "//div[@class='tv-screener__content-pane']//tbody/tr")
  22. columns = []
  23. for field in data_field:
  24.     column = driver.find_elements(By.XPATH, f"//div[@class='tv-screener__content-pane']//tbody/tr/td[@data-field-key='{field}']")
  25.     columns.append([col.text.replace('\n',' - ') for col in column])
  27. df = pd.DataFrame(dict(zip(header, columns)))
  28. print(df)
  29. driver.quit()

答案1

得分: 2

我注意到有一些由类i-hidden特征的隐藏列。所以首先，我们使用CSS选择器:not([class*=i-hidden])只选择可见列。然后，我们获取这些列的data-field属性，以便可以选择行中对应的值。这个属性的示例值包括：

  • name
  • market_cap_basic
  • earnings_per_share_forecast_next_fq
  • eps_surprise_fq

接下来，我们获取表格的标题和行。然后，我们循环遍历data-field以获取每列中的所有单元格值。最后，我们从一个字典中创建一个数据框，其中标题作为键，列作为值。

  1. visible_columns = driver.find_elements(By.CSS_SELECTOR, 'div.tv-screener__content-pane thead th:not([class*=i-hidden])')
  2. data_field = [c.get_attribute('data-field') for c in visible_columns]
  3. header = [c.text.split('\n')[0] for c in visible_columns]
  4. rows = driver.find_elements(By.XPATH, "//div[@class='tv-screener__content-pane']//tbody/tr")
  5. columns = []
  7. for field in data_field:
  8.     column = driver.find_elements(By.XPATH, f"//div[@class='tv-screener__content-pane']//tbody/tr/td[@data-field-key='{field}']")
  9.     columns.append([col.text.replace('\n',' - ') for col in column])
  11. pd.DataFrame(dict(zip(header, columns)))

输出：

如何从TradingView链接加载收益日历数据并放入数据框中

英文:

I noticed that there are few hidden columns characterized by the class i-hidden. So as first thing we select only the visible columns with the css selector :not([class*=i-hidden]). Then we get the attribute data-field of these columns, so that we can select the corresponding values in the rows. Examples of values for this attribute are

  1. name
  2. market_cap_basic
  3. earnings_per_share_forecast_next_fq
  4. eps_surprise_fq

Next we get the header of the table and the rows. Then we loop over the data-field to get all the cell values in each column. Finally we create a dataframe from a dictionary having the header as keys and the columns as values.

  1. visible_columns = driver.find_elements(By.CSS_SELECTOR, 'div.tv-screener__content-pane thead th:not([class*=i-hidden])')
  2. data_field = [c.get_attribute('data-field') for c in visible_columns]
  3. header = [c.text.split('\n')[0] for c in visible_columns]
  4. rows = driver.find_elements(By.XPATH, "//div[@class='tv-screener__content-pane']//tbody/tr")
  5. columns = []
  7. for field in data_field:
  8.     column = driver.find_elements(By.XPATH, f"//div[@class='tv-screener__content-pane']//tbody/tr/td[@data-field-key='{field}']")
  9.     columns.append([col.text.replace('\n',' - ') for col in column])
  11. pd.DataFrame(dict(zip(header, columns)))

Output

如何从TradingView链接加载收益日历数据并放入数据框中

huangapple
  • 本文由 发表于 2023年2月8日 23:28:07
  • 转载请务必保留本文链接：https://go.coder-hub.com/75388032.html
  • pandas
  • python
  • python-3.x
  • selenium-webdriver
  • web-scraping
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定