e168f08 - Latest Comments in Cooler

Re: Cooler

vaughanatworld — Tue, 27 Jan 2009 11:50:59 -0000

This sounds like a plan.

Having been laid off mid last week, a new adventure begins. I want to use this time to retool.

The calculus I am trying to solve is how long it will take for me to become employable in RoR. It seems to me, 6 to 18 months.

Re: Cooler

xertroyt — Tue, 27 Jan 2009 11:06:41 -0000

Yes, by all means. Why don't you ask some questions right here.

Here are some brief notes on getting a Rails job:

0. The course is good for looking for a job, but it would be a component in a whole package involving who you know, what you know, and how you grow as a developer.

1. Who: You really should start networking by going to meetings of the Boston Ruby Group (http://bostonrb.org/). For women, e-mail Amy about her new group for Women and Ruby and Boston.

2. What: I would advise everyone to start downloading and reading code. There are countless awesome Ruby/Rails packages you can find at RubyForge and/or Github. What you want to find are full apps. Then go over the code. Also, you may well find projects that need documentation or light fixes. You would be amazed at how many sophisticated projects have open tickets that are essentially one-line fixes. To learn how to contribute patches and fixes, Google for a screencast on using Github.

3. Growing: You need to think of your developer status as a work in progress. Make a list of things to learn. E.g., if you've never configured a Linux system, learn by doing it. If you've never used source control (e.g., subversion), set it up. If you've never used a bug tracker, set it up. All of these tools can be useful for your personal use.

Re: Cooler

vaughanatworld — Tue, 27 Jan 2009 10:59:19 -0000

John, can we talk about employment with RoR?

Re: Cooler

Ana — Wed, 21 Jan 2009 21:14:56 -0000

Off-topic, did anyone else rsvp to that 4-week rails class at sermo that John forwarded a few days ago? I haven't heard anything back and was wondering if anyone knows if it's actually happening.

Re: Cooler

xertroyt — Wed, 21 Jan 2009 15:41:58 -0000

Strange.

The e168:submit task uses the standard rake package target, so it should be grabbing the Rakefile normally.

I just verified the e168:submit task, but I'm on a Mac.

Just ZIP up your project with any tool -- or, if you like, use the e168:submit task and zip up the Rakefile separately.

Re: Cooler

xertroyt — Wed, 21 Jan 2009 15:41:50 -0000

Nothing is really coming to mind -- sorry!

Re: Cooler

Ana — Wed, 21 Jan 2009 15:27:28 -0000

Rakefile not getting packaged?
Hi, I am trying to rake package to submit but for some reason the rakefile isn't getting packaged up. It seems to be the only file that's missing. The weird thing is, it's in the package directory but it's not in the .zip. (I'm using the zip_in_ruby script that came with metricsmine)

Re: Cooler

sa — Wed, 21 Jan 2009 13:32:20 -0000

last minute cleaning-
I was making the code clean now few things don't work and I do not know why.

My logout does not logout anymore -
Console shows that email is genereated and sent, but i never get in my inbox.

Re: Cooler

xertroyt — Sun, 18 Jan 2009 21:15:37 -0000

Pat,

I just sent an e-mail out on that topic. I covered some of the expectations here: http://e168f08.plugh.org/assignments/final-proj...

As far as length, "what it should look like," etc.: The key is to think about the audience. The audience is a developer like yourself who must understand (1) What the app is supposed to do; and (2) how it is implemented. If you are like me, this is a high standard -- I personally need very clear and complete documentation to understand someone else's work.

John

Re: Cooler

Pat — Sun, 18 Jan 2009 21:00:08 -0000

Would it be possible to get some more information about what the write up for the final project should contain, or maybe an example of what the write up should look like? I've got my project just about done, but I'm lost on the write up.

Thanks

Re: Cooler

GeorgeS — Fri, 16 Jan 2009 23:47:21 -0000

yes

Re: Cooler

Ana — Thu, 15 Jan 2009 22:36:38 -0000

Fantastic, thanks!

Re: Cooler

kmorrison — Thu, 15 Jan 2009 21:33:39 -0000

auto_discovery_link_tag :atom, { :controller => :posts, :action => :feed, :id => @user.login, :format => :atom } %>

Re: Cooler

Ana — Thu, 15 Jan 2009 18:12:37 -0000

Quick question about links/routes/atom feeds:

I'm exposing an atom feed for a user at the url: http://localhost:3000/posts/feed/username.atom

In my posts controller:
def feed
@user = User.find_by_login(params[:id])
@posts = @user.posts.find(:all, :order => :created_at).reverse
respond_to do |format|
format.html
format.atom
end
end

Now in the html I want to put in an link tag using <%= auto_discovery_link_tag :atom, {:controller=>:posts, :action=>:feed, :id=>@user.login }, {} %>

But that gives me
http://localhost:3000/posts/feed/username
instead of
http://localhost:3000/posts/feed/username.atom

Is there any way I can get the suffix in there?

Re: Cooler

xertroyt — Wed, 14 Jan 2009 08:58:00 -0000

Very good. Did you use a "text" column for the data?

Re: Cooler

GeorgeS — Wed, 14 Jan 2009 00:37:45 -0000

I serialized the rows, and it seems to be much quicker now

Re: Cooler

katemuse — Tue, 13 Jan 2009 21:40:31 -0000

Where is everybody?

Can anyone suggest a good summary of the differences between all the different ajax remote tags and when to use which?

Thanks.

Re: Cooler

xertroyt — Tue, 13 Jan 2009 02:13:26 -0000

George -- I wrote a little simulation app like yours (similar columns) that updates 3000 rows.

The total time to update 3000 rows, row by row, in Sqlite3, is: 60 seconds.

I also tried it on MySQL: 47 seconds.

You are updating each row separately. 3000 / 60 is 50, so you're updating 50 rows per second.

I don't know enough about your application to know what to recommend. What does your application do? Does this need to happen very frequently? Or can it happen once a night or once per hour? If the answer is "Yes," then you should run this update code periodically with a scheduled task or cron job.

Does the data need to be access immediately after it is updated? If the answer is "no," you could update the data asynchronously with Workling (see http://github.com/purzelrakete/workling/tree/ma...)

Does the data need to be accessed "row-wise" or do you tend to want to grab all 3,000 rows each time? If the answer is the latter, then the data should not be kept in rows. Let us say that it is a Hash, and you want to grab it once, update the 3,000 items, and save it back at once. What you would want to look at is the ActiveRecord "serialize" feature which allows for saving a big object as one column value. If you want to know more about this, let me know.

If it is the former -- the data has to be accessed row-wise, and you also need to update 3,000 rows at a time -- we should talk.

Re: Cooler

xertroyt — Tue, 13 Jan 2009 01:46:04 -0000

Must you save every single word? Or can you be more selective?

How much RAM is on your computer?

Re: Cooler

xertroyt — Tue, 13 Jan 2009 01:43:07 -0000

If you want to scrape only, use hpricot or nokogiri. If you want to "click buttons" on a live web site, and follow links, etc., then you would additional want to use Mechanize.

In your case: Use hpricot or nokogiri.

Re: Cooler

GeorgeS — Tue, 13 Jan 2009 00:31:39 -0000

Forgot to mention, the Word table in question has a text column, 4 integer columns, and a creation timestamp column, if that informatoin is helpful

Re: Cooler

GeorgeS — Tue, 13 Jan 2009 00:29:01 -0000

I collected the Word table rows in an array, and wrote them out like this:
save_these_words.each { |each| each.save }

I read Time.now before that statement and again aftewards, and it confirms that this is the major bottleneck. (The value is 6.8 seconds)

In the ouput of script/server there are a bunch of these lines:
UPDATE "words" SET "current_index" = 816, "current_position" = 19239 WHERE "id" = 2166

A bunch print out at once, there's a pause, then another bunch, etc, for around 5 seconds, for roughly a thousand rows from id=1300 to id=2300. There is a lot of hard disk activity too.

Re: Cooler

katemuse — Mon, 12 Jan 2009 19:37:06 -0000

Re: Cooler

xertroyt — Mon, 12 Jan 2009 16:52:55 -0000

You say something like:

filenames = Dir.glob("*.html")
filenames.each do |filename|
doc = Nokogiri::HTML(open(filename))
end

see http://www.ruby-doc.org/core/classes/Dir.html#M...

Re: Cooler

katemuse — Mon, 12 Jan 2009 16:46:35 -0000

Nokogiri seemed simpler to me and the reviews seemed quite positive. I never tried Hpricot. The glob I wrote was just to show what I was trying to achieve, although I understood that wasn't the way to do it. I guess what I'm asking is, how would you suggest handling this in ruby? Would I need to use "mechanize"?
thanks