Selenium Scrape in Python -


sorry basic question, still trying learn. trying figure out smart way of scraping stock data following html, using selenium2 , python (multiple <tr> of following on page):

<a name="line209"></a><tr align="right" class="odd" nowrap> <a name="line210"></a><td>& </td> <a name="line211"></a><td  align="left"><strong> <a name="line212"></a>bac n</strong></td> <a name="line213"></a><td>+</td> <a name="line214"></a><td>17.45</td> <a name="line215"></a><td>17.49</td> <a name="line216"></a><td><strong>17.47</strong></td> <a name="line217"></a><td><strong><font class="fontgreen"> <a name="line218"></a>0.14 (0.81%)</font></strong></td> <a name="line219"></a><td>81,974,096</td> <a name="line220"></a><td align="middle"></td> <a name="line221"></a><td>& </td> <a name="line222"></a></tr>

of above code, need extract:

  • bac n
  • +
  • 17.45
  • 17.49
  • 17.47
  • 0.14 (0.81%)
  • 81,974,096

ok following code want do. in spirit of learning, make more efficient. hope can help:

def getdata():     tickerdata=[]     tickercounter=0     ignoretext=['symbol','t','bid','ask','last',' ','','change','volume','fsi','buy   sell  ']       if quotetype=="summary":         numdatapoints=9     elif quotetype=="detail":         numdatapoints=21      tr in driver.find_elements_by_xpath("//table[contains(@class, 'tablestyle2')]"):         tds=tr.find_elements_by_tag_name('td')         td in tds:             if td.text not in ignoretext:                 if len(tickerdata) == numdatapoints:                     insertdata(tickerdata,tickercounter)                     tickerdata=[]                     tickercounter += 1                 tickerdata.append(td.text)                           insertdata(tickerdata,tickercounter)

thanks in advance!!

load string variable called html.

from bs4 import beautifulsoup soup = beautifulsoup(html) tags = soup.findall('td') tag in tags:     print tag.gettext()

beautifulsoup 1 of many ways parse data. use pure python functions if understand basic python finding strings "


Comments

Post a Comment

Popular posts from this blog

get url and add instance to a model with prefilled foreign key :django admin -

Image
i have page in each contest shown in row. each row contains contest id , link other model names have foreign key contest. news model: class news(models.model): title = models.charfield(max_length=50, null=true) description = models.textfield() time = models.timefield( default= datetime.datetime.now().time()) contest = models.foreignkey(contest) i want use admin adding , changing these models. want when user clicks on 'news' has foreign key contest id=1, shows list of news value foreign key. use {% instance in instances %} <tr class="{% cycle 'row1' 'row2' %}"> <td>{{ instance.title }}</td> <td>{{ instance.starttime }}</td> <td>{{ instance.timespan }}</td> <td>{{ instance.date }}</td> <td><a href="/adm...
Read more

android - Keyboard hides my half of edit-text and button below it even in scroll view -

i having trouble keyboard covers edit-text , half of button in scroll view. here's layout , please tell me how should resolve problem. many questions on topic none of them s working me. <?xml version="1.0" encoding="utf-8"?> <linearlayout xmlns:android="http://schemas.android.com/apk/res/android" android:layout_width="match_parent" android:background="@drawable/bg" android:layout_height="match_parent"> <scrollview android:layout_width="match_parent" android:fillviewport="true" android:layout_height="match_parent"> <relativelayout android:layout_width="match_parent" android:layout_height="wrap_content" android:orientation="vertical"> <linearlayout android:layout_width="match_parent" android:layout_height="w...
Read more

css - Make div keyboard-scrollable in jQuery Mobile? -

from can tell, although jquery-mobile-powered pages can contain divs overflow set scroll or auto, , these divs can scrolled one-screen bar or mouse wheel, cannot scrolled using arrow keys, page-up/page-down, or home/end. instead, official "page" div (with data-role="page") absorbs input. perhaps other divs can't acquire focus, i'm not sure. is there way around this? edit: jsfiddle of simple example: https://jsfiddle.net/qogz0shx/ <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script> <script src="https://ajax.googleapis.com/ajax/libs/jquerymobile/1.4.5/jquery.mobile.min.js"> </script> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"/> <style> #outer { overflow:scroll; height: 50vh; width: 50vw; } #inner { height: 500vh; width: 500vw; } ...
Read more