python - Linear Regression Lasagne / Theano -


i'm trying make simple multivariate linear regression lasagne. input:

x_train = np.array([[37.93, 139.5, 329., 16.64,                     16.81, 16.57, 1., 707.,                     39.72, 149.25, 352.25, 16.61,                     16.91, 16.60, 40.11, 151.5,                     361.75, 16.95, 16.98, 16.79]]).astype(np.float32) y_train = np.array([37.92, 138.25, 324.66, 16.28, 16.27, 16.28]).astype(np.float32)

for 2 data points network should able learn y perfectly.

here model:

i1 = t.matrix() y = t.vector() lay1 = lasagne.layers.inputlayer(shape=(none,20),input_var=i1) out1 = lasagne.layers.get_output(lay1) lay2 = lasagne.layers.denselayer(lay1, 6, nonlinearity=lasagne.nonlinearities.linear) out2 = lasagne.layers.get_output(lay2) params = lasagne.layers.get_all_params(lay2, trainable=true) cost = t.sum(lasagne.objectives.squared_error(out2, y)) grad = t.grad(cost, params) updates = lasagne.updates.sgd(grad, params, learning_rate=0.1)  f_train = theano.function([i1, y], [out1, out2, cost], updates=updates)

after executing multiple times

f_train(x_train,y_train)

the cost explodes infinity. idea going wrong here?

thanks!

the network has capacity single training instance. need apply strong regularization prevent training diverging. alternatively, , more realistically, give more complex training data (many instances).

with single instance task can solved using 1 input, instead of 20, , denselayer's bias disabled:

import numpy np import theano import lasagne import theano.tensor t   def compile():     x, z = t.matrices('x', 'z')     lh = lasagne.layers.inputlayer(shape=(none, 1), input_var=x)     ly = lasagne.layers.denselayer(lh, 6, nonlinearity=lasagne.nonlinearities.linear,                                    b=none)     y = lasagne.layers.get_output(ly)     params = lasagne.layers.get_all_params(ly, trainable=true)     cost = t.sum(lasagne.objectives.squared_error(y, z))     updates = lasagne.updates.sgd(cost, params, learning_rate=0.0001)     return theano.function([x, z], [y, cost], updates=updates)   def main():     f_train = compile()      x_train = np.array([[37.93]]).astype(theano.config.floatx)     y_train = np.array([[37.92, 138.25, 324.66, 16.28, 16.27, 16.28]])\         .astype(theano.config.floatx)      _ in xrange(100):         print f_train(x_train, y_train)   main()

note learning rate needs reduced lot prevent divergence.


Comments

Post a Comment

Popular posts from this blog

get url and add instance to a model with prefilled foreign key :django admin -

Image
i have page in each contest shown in row. each row contains contest id , link other model names have foreign key contest. news model: class news(models.model): title = models.charfield(max_length=50, null=true) description = models.textfield() time = models.timefield( default= datetime.datetime.now().time()) contest = models.foreignkey(contest) i want use admin adding , changing these models. want when user clicks on 'news' has foreign key contest id=1, shows list of news value foreign key. use {% instance in instances %} <tr class="{% cycle 'row1' 'row2' %}"> <td>{{ instance.title }}</td> <td>{{ instance.starttime }}</td> <td>{{ instance.timespan }}</td> <td>{{ instance.date }}</td> <td><a href="/adm...
Read more

css - Make div keyboard-scrollable in jQuery Mobile? -

from can tell, although jquery-mobile-powered pages can contain divs overflow set scroll or auto, , these divs can scrolled one-screen bar or mouse wheel, cannot scrolled using arrow keys, page-up/page-down, or home/end. instead, official "page" div (with data-role="page") absorbs input. perhaps other divs can't acquire focus, i'm not sure. is there way around this? edit: jsfiddle of simple example: https://jsfiddle.net/qogz0shx/ <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script> <script src="https://ajax.googleapis.com/ajax/libs/jquerymobile/1.4.5/jquery.mobile.min.js"> </script> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"/> <style> #outer { overflow:scroll; height: 50vh; width: 50vw; } #inner { height: 500vh; width: 500vw; } ...
Read more

android - Keyboard hides my half of edit-text and button below it even in scroll view -

i having trouble keyboard covers edit-text , half of button in scroll view. here's layout , please tell me how should resolve problem. many questions on topic none of them s working me. <?xml version="1.0" encoding="utf-8"?> <linearlayout xmlns:android="http://schemas.android.com/apk/res/android" android:layout_width="match_parent" android:background="@drawable/bg" android:layout_height="match_parent"> <scrollview android:layout_width="match_parent" android:fillviewport="true" android:layout_height="match_parent"> <relativelayout android:layout_width="match_parent" android:layout_height="wrap_content" android:orientation="vertical"> <linearlayout android:layout_width="match_parent" android:layout_height="w...
Read more