Released 0.82 – the improvements keep coming!

We’ve just pushed out 0.82.  Improvements and changes include:

  • Smarter URL selection for larger crawls
  • Sandbox jobs run automatically and the user gets access to stdout from their 80App
  • Domain throttling information in the portal
  • Time estimates shown in the portal
  • Crawled result files additions:
    • page size
    • parse time in milliseconds
    • process time in milliseconds
    • compute timeouts get COMPUTE_TIMEOUT_GOOD or COMPUTE_TIMEOUT_BAD
  • Several improvements for large job performance
  • User can specify data for the jar upload which gets passed into the initialize() during the validation test
  • Fixed problem with multiple Loading Code errors
  • Improved default link parsing
  • Better web portal login behavior

As usual, we’ve started working on the next release already, which will have things like:

  • Allowing larger crawls
  • Allowing larger seed lists
  • Creating result files on the fly

Check out for all the details!

0 Responses to “Released 0.82 – the improvements keep coming!”

  1. Leave a Comment

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

Twitter Updates

%d bloggers like this: