xml - Load a table from wikipedia into R -

-

i'm trying load table of supreme court justices r following url. https://en.wikipedia.org/wiki/list_of_justices_of_the_supreme_court_of_the_united_states

i'm using following code:

scotusurl <- "https://en.wikipedia.org/wiki/list_of_justices_of_the_supreme_court_of_the_united_states" scotusdata <- geturl(scotusurl, ssl.verifypeer = false) scotusdoc <- htmlparse(scotusdata) scotusdata <- scotusdoc['//table[@class="wikitable"]'] scotustable <- readhtmltable(scotusdata[[1]], stringsasfactors = false)

r returns scotustable null. goal here data.frame in r can use make ggplot of scotus justice tenure on court. had script working make awesome plot, after recent decisions changed on page , script not function. went through html on wikipedia try find changes, i'm not webdev break script isn't apparent.

additionally, there method in r allow me cache data page i'm not referencing url? seem ideal way avoid issue in future. appreciate help.

as aside, scotus in on-going hobby/side-project of mine if there's other data source out there that's better wikipedia, i'm ears.

edit: sorry should have listed dependencies. i'm using xml, plyr, rcurl, data.table, , ggplot2 libraries.

if don't mind using different package, can try "rvest" package.

library(rvest)     scotusurl <- "https://en.wikipedia.org/wiki/list_of_justices_of_the_supreme_court_of_the_united_states"

  • option 1: grab tables page , use html_table function extract tables you're interested in.

    temp <- scotusurl %>%    html %>%   html_nodes("table")  html_table(temp[1]) ## "legend" table html_table(temp[2]) ## table you're interested in

  • option 2: inspect table element , copy xpath read table directly (right-click, inspect element, scroll relevant "table" tag, right click on that, , select "copy xpath").

    scotusurl %>%    html %>%    html_nodes(xpath = '//*[@id="mw-content-text"]/table[2]') %>%    html_table

another option loading data in google spreadsheet , reading using "googlesheets" package.

in google drive, create new spreadsheet named, instance "supreme court". in first worksheet, enter:

=importhtml("https://en.wikipedia.org/wiki/list_of_justices_of_the_supreme_court_of_the_united_states", "table", 2)

this automatically scrape table google spreadsheet.

from there, in r can do:

library(googlesheets) sc <- gs_title("supreme court") gs_read(sc)

Comments

Post a Comment

Popular posts from this blog

Android : Making Listview full screen -

-
<linearlayout xmlns:android="http://schemas.android.com/apk/res/android" xmlns:tools="http://schemas.android.com/tools" android:layout_width="match_parent" android:layout_height="match_parent" android:orientation="vertical" tools:context=".mainactivity"> <edittext android:layout_margintop="5dp" android:layout_width="match_parent" android:layout_height="50dp" android:background="@drawable/location_edittext" android:id="@+id/locationeditext" android:textsize="15sp" android:textcolor="#999" android:paddingleft="15dp" /> <com.example.ravi_gupta.slider.viewpagercustomduration android:layout_width="wrap_content" android:layout_height="0dp" android:id="@+id/viewpager" android:scrollbarstyle="outsideoverlay" android:layout_weight="0.5...
Read more

javascript - Parse JSON from the body of the POST -

-
i'm using cameratag.com record video on website. service can send json response server can save data database. don't know how proceed here: the documentation states please note json repsonse passed in body of post , not form parameters. here example of how parse response in ruby: data = json.parse(request.raw_post) video_uuid = data["uuid"] but don't know how data on javascript. i'm not experienced in js please bare me :) post sample: { "uuid": "00012710-4b65-0131-ffe6-22000a499ea4", "camera_uuid": "98373a20-79ee-0130-3e42-1231390fcc11", "created_at": "2013-12-20t05:25:02.000z", "percent_complete": 100, "short_code": "kktb4q", "metadata": { }, "state": "published", "recorded_from": "http://singwho.com", "publish_type": null, "formats": [ { "name...
Read more

javascript - How to Hide Date Menu from Datepicker in yii2 -

-
basically in datetimepicker widget date choose first time, how can hide date option widget , filter according time. tried not working want hide remove button [ 'attribute'=>'time', 'label'=>'time', 'format'=>'raw', 'value'=>function($data){ return date('h:i:s',strtotime($data->time)); }, 'filter'=> datetimepicker::widget([ 'model' => $searchmodel, 'attribute' => 'time', 'clientoptions' => [ 'autoclose' => true, 'format' => 'hh:ii', 'showon' =...
Read more