需要帮助与 lxml.html 和 xpath

添方夜弹

1. data = response.text
   
2. tree = html.fromstring(data)
   
3. Services_Product = tree.xpath("//dt[text()='Services/Products']/following-sibling::dd[1]")

复制代码

这需要更多的工作。这个领域是

1. file = open('html_01.txt', 'r')
   
2. data = file.read()
   
3. tree = html.fromstring(data)
   
4. Services_Product = tree.xpath("//dt[text()='Services/Products']/following-sibling::dd[1]")
   
5. stuff = Services_Product[0].xpath("//li")
   
6. for elem in stuff:
   
7.     print(elem[0][0].text)

复制代码

远方的树

可以用作BS的解析器，我总是这样做。

1. soup = BeautifulSoup(response.content, 'lxml')

复制代码

1. from lxml import html
   
2. import requests
   
3. 
   
4. 
   
5. resonse = requests.get(url)
   
6. tree = html.fromstring(resonse.content)
   
7. prod = tree.xpath('//*[@id="business-info"]/dl/dd[3]/ul')
   
8. for tag in prod[0].getchildren():
   
9.     print(tag.text)

复制代码

蓝精灵童鞋

当使用不同的标签并希望从该文本时，在已找到的部分上使用html2文本更容易

1. import html2text
   
2. 
   
3. data = '''\
   
4. <dd>
   
5.   A block of text here.... bla bla bla....
   
6.   <ul>
   
7.     <li><p>Item 1.  for some reason they wraped this in a p</p></li>
   
8.     <li><strong>And this item is important</strong>bla bla bla</li>
   
9.     <li>And just more info here...</li>
   
10.   </ul>
    
11.   And finally more stuff here...
    
12. </dd>'''
    
13. 
    
14. text = html2text.HTML2Text()
    
15. text.mark_code = True
    
16. text.ignore_emphasis = True
    
17. text.single_line_break = True
    
18. text.ignore_links = True
    
19. text = text.handle(data)
    
20. print(text.strip())

复制代码