Status on Custom Code release

We are still hard at work preparing our first beta release that allows our users to submit their own custom code.  We’ve decided to delay the release just slightly so we can include the following features:

  • parseLinks() – You will be able to control which links your crawl follows from the initial release.  We were going to put this in a later release, but we’ve decided to include it now so that our customers won’t need to make additional changes later.
  • Automated JAR approval – We are automating our JAR approval process so that any submitted custom code JARs get approved or denied automatically.
  • Improved and simplified custom code interface –  Our wiki has details and instructions and our open-source repository has the latest custom-code interface and an empty starter project.
  • Open-sourced default regex and string processing – This is packaged as an 80legs custom code JAR so you can modify and use this project for your own needs.  It is BSD licensed so you are not required to release any modifications (but you are certainly welcome to do so).
  • The 80legs JAR testing application (and source) – This allows you to test your custom code JAR locally on your machine before deploying it to our sandbox server for larger tests.
  • Simple results deserialization class – We’ve created an easy to use java class for extracting your results from your 80legs output.  Since your results from your processDocument() function are binary (they are a byte[]), this class will extract your URL/results pairs from your output.

To our current beta users – please go ahead and start working on your custom code using the interface and instructions.  We should release the version that works with them in the next few days.  To our patiently waiting soon-to-be-beta-users, it won’t be much longer!

Advertisements

3 Responses to “Status on Custom Code release”


  1. 1 clock.imo.it April 23, 2013 at 1:57 pm

    Wow, fantastic blog layout! How long have you been blogging for?

    you made blogging look easy. The overall look of your website is fantastic, as well as the content!

  2. 2 vacation June 16, 2013 at 12:17 am

    And yet the Hawkes Bay region of the extract juice from the city of Manila up to the front.
    Budget before going to a wine rack system may add more value to your recipient.
    In addition there are two possible causes.

  3. 3 flies July 11, 2013 at 11:44 am

    If you are one of my favorites. Then that is what helps
    them know the details of a special trip or an important line you’ll e’er ask.

    The wine inside the brightly decorated squares where the The Spanish meet.
    This is as a just for fun activity and end up being sort
    of an aficionado.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s





%d bloggers like this: