apache spark - Scala:case class runTime Error -

-

this demo ran ok. when move class function(my former project) , call function, compiles failure.

     object dfmain {          case class person(name: string, age: double, t:string)          def main (args: array[string]): unit = {          val sc = new sparkcontext("local", "scala word count")          val sqlcontext = new org.apache.spark.sql.sqlcontext(sc)          import sqlcontext.implicits._          val bsonrdd = sc.parallelize(("foo",1,"female")::                                         ("bar",2,"male")::                                      ("baz",-1,"female")::nil)                       .map(tuple=>{                     var bson = new basicbsonobject()                     bson.put("name","bfoo")                     bson.put("value",0.1)                     bson.put("t","female")                     (null,bson)                  })     val tdf = bsonrdd.map(_._2)               .map(f=>person(f.get("name").tostring,                    f.get("value").tostring.todouble,                    f.get("t").tostring)).todf()         tdf.limit(1).show()  } }

'mysqldao.insertintomysql()' compile error

object mysqldao {      private val sc= new sparkcontext("local", "scala word count")      val sqlcontext = new org.apache.spark.sql.sqlcontext(sc)      import sqlcontext.implicits._       case class person(name: string, age: double, t:string)      def insertintomysql(): unit ={        val bsonrdd = sc.parallelize(("foo",1,"female")::                                      ("bar",2,"male")::                                      ("baz",-1,"female")::nil)                        .map(tuple=>{                val bson = new basicbsonobject()                bson.put("name","bfoo")                bson.put("value",0.1)                bson.put("t","female")                (null,bson)          })  val tdf = bsonrdd.map(_._2).map( f=> person(f.get("name").tostring,                                            f.get("value").tostring.todouble,                                             f.get("t").tostring)).todf()     tdf.limit(1).show()   } }

will, when call 'mysqldao.insertintomysql()' gets error of

value typedproductiterator not member of object scala.runtim.scala.scalarunttime

case class person(name: string, age: double, t:string)

i suppose case class isn't seen in closure inside map function. move package level.

case class person(name: string, age: double, t:string) object mysqldao { ... }

Comments

Post a Comment

Popular posts from this blog

Android : Making Listview full screen -

-
<linearlayout xmlns:android="http://schemas.android.com/apk/res/android" xmlns:tools="http://schemas.android.com/tools" android:layout_width="match_parent" android:layout_height="match_parent" android:orientation="vertical" tools:context=".mainactivity"> <edittext android:layout_margintop="5dp" android:layout_width="match_parent" android:layout_height="50dp" android:background="@drawable/location_edittext" android:id="@+id/locationeditext" android:textsize="15sp" android:textcolor="#999" android:paddingleft="15dp" /> <com.example.ravi_gupta.slider.viewpagercustomduration android:layout_width="wrap_content" android:layout_height="0dp" android:id="@+id/viewpager" android:scrollbarstyle="outsideoverlay" android:layout_weight="0.5...
Read more

javascript - Parse JSON from the body of the POST -

-
i'm using cameratag.com record video on website. service can send json response server can save data database. don't know how proceed here: the documentation states please note json repsonse passed in body of post , not form parameters. here example of how parse response in ruby: data = json.parse(request.raw_post) video_uuid = data["uuid"] but don't know how data on javascript. i'm not experienced in js please bare me :) post sample: { "uuid": "00012710-4b65-0131-ffe6-22000a499ea4", "camera_uuid": "98373a20-79ee-0130-3e42-1231390fcc11", "created_at": "2013-12-20t05:25:02.000z", "percent_complete": 100, "short_code": "kktb4q", "metadata": { }, "state": "published", "recorded_from": "http://singwho.com", "publish_type": null, "formats": [ { "name...
Read more

Automatically Create Database in Entity Framework 6 with Automatic Migrations Disabled -

-
i able automatically create new database, if not exist, using code-first ef6 automatic migrations disabled. if recall correctly, before automatic migrations existed in entity framework, worked fine. however, in ef6, receive following exception: an exception of type 'system.data.entity.migrations.infrastructure.automaticmigrationsdisabledexception' occurred in entityframework.dll not handled in user code additional information: unable update database match current model because there pending changes , automatic migration disabled. either write pending model changes code-based migration or enable automatic migration. set dbmigrationsconfiguration.automaticmigrationsenabled true enable automatic migration. to verify exception not caused external factor in production project, created new test project. however, same exception. for database context, have: public class mycontext : dbcontext { public dbset<entity> entities { get; set; } ...
Read more