Comments on: scrAPI and redirects without complete URL http://www.rickwargo.com/2006/11/03/scrapi-and-redirects-without-complete-url/ Acquiring information, one day at a time. Thu, 26 Jan 2012 11:03:28 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Rick Wargohttp://www.rickwargo.com/2006/11/03/scrapi-and-redirects-without-complete-url/comment-page-1/#comment-4232 Rick Wargo Sat, 08 Sep 2007 02:39:30 +0000 http://www.rickwargo.com/2006/11/03/scrapi-and-redirects-without-complete-url/#comment-4232 I'm not even sure this works anymore, but here is what I wrote to scrape CB for one company: <code>require 'unescape' class FiberlinkJob < Scraper::Base process "td>a.job_title", :title => :text, :url => "@href" process "td", :description => :text process "span.tip_11", :location => :text, :posted_on => :text, :jobcode => "", :guid => "" result :title, :description, :location, :posted_on, :url, :jobcode, :guid def collect self.title = unescape(self.title) self.url = unescape(self.url) self.url = self.url.sub(/\&sc.*/, '') self.location = location.sub(/.*Location: (^[&]+).*/, '\1') self.posted_on = posted_on.sub(/.*Posted: ([A-Za-z]+).(\d+).*/, '\1 \2') self.guid = self.url end end class Fiberlink < Scraper::Base def Fiberlink.url "http://www.careerbuilder.com/JobSeeker/Companies/CompanyJobResults.aspx?Comp_DID=C250M6WSR21P12J2CN" end array :jobs process "table#snapshotOff1 tr", :jobs => FiberlinkJob result :jobs end</code> Good luck! Rick I’m not even sure this works anymore, but here is what I wrote to scrape CB for one company:

require 'unescape'

class FiberlinkJob < Scraper::Base
process "td>a.job_title", :title => :text, :url => "@href"
process "td", :description => :text
process "span.tip_11", :location => :text, :posted_on => :text,
:jobcode => "", :guid => ""

result :title, :description, :location, :posted_on, :url, :jobcode, :guid

def collect
self.title = unescape(self.title)
self.url = unescape(self.url)

self.url = self.url.sub(/\&sc.*/, '')

self.location = location.sub(/.*Location: (^[&]+).*/, '\1')
self.posted_on = posted_on.sub(/.*Posted: ([A-Za-z]+).(\d+).*/, '\1 \2')
self.guid = self.url
end
end

class Fiberlink < Scraper::Base
def Fiberlink.url
"http://www.careerbuilder.com/JobSeeker/Companies/CompanyJobResults.aspx?Comp_DID=C250M6WSR21P12J2CN"
end

array :jobs
process "table#snapshotOff1 tr", :jobs => FiberlinkJob
result :jobs
end

Good luck!
Rick

]]> By: Nick Bhanjihttp://www.rickwargo.com/2006/11/03/scrapi-and-redirects-without-complete-url/comment-page-1/#comment-4225 Nick Bhanji Fri, 07 Sep 2007 16:24:48 +0000 http://www.rickwargo.com/2006/11/03/scrapi-and-redirects-without-complete-url/#comment-4225 I am trying to scrap search from careerbuilder.com, How did you managed to take care of odd/even rows and company name in the row. I am new to this. I am trying to use gathered information to assist students looking for job. thanks in advance nick.bh I am trying to scrap search from careerbuilder.com, How did you managed to take care of odd/even rows and company name in the row. I am new to this. I am trying to use gathered information to assist students looking for job.

thanks in advance

nick.bh

]]>