<div dir="ltr">Hi Phil,<div><br></div><div>Thanks for the suggestion. Some of them are really nice. I never think of it.</div><div><br></div><div>Yes, the scraper follow links. </div><div>
<br></div><div>Regards</div><div>Leigh</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 3 July 2014 15:45, Phil Scadden <span dir="ltr"><<a href="mailto:p.scadden@gns.cri.nz" target="_blank">p.scadden@gns.cri.nz</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="">On 3/07/2014 2:01 p.m., Leigh Wanstead wrote:<br>
> I have a question for you guys related to how to be a good developer<br>
> to solve the problem :-)<br>
</div>Well I have done website scrapping - no browser involved - but with the<br>
site owners blessing. Tough problem. Does the scraper follow links in<br>
your site? You could put in a link that is hidden by css and return<br>
garbage to anything that follows it. Make a very close study of header<br>
etc of anything that might give them away. Dont use it block - use it to<br>
generate garbage content for them instead.<br>
<br>
You could use js to get and display text with lazy loading. Or put text<br>
in image/flash. That makes it a pain in the neck for scrapers. Vary the<br>
dom layout at random but use matching css to make the appearance the<br>
same for users - this doesnt stop scraping but makes finding the<br>
relevant information a pain because to the scraper, the website is<br>
constantly changing format.<br>
<br>
<br>
Notice: This email and any attachments are confidential.<br>
If received in error please destroy and immediately notify us.<br>
Do not copy or disclose the contents.<br>
<div class="HOEnZb"><div class="h5"><br>
_______________________________________________<br>
NZ Borland Developers Group - Delphi mailing list<br>
Post: <a href="mailto:delphi@listserver.123.net.nz">delphi@listserver.123.net.nz</a><br>
Admin: <a href="http://delphi.org.nz/mailman/listinfo/delphi" target="_blank">http://delphi.org.nz/mailman/listinfo/delphi</a><br>
Unsubscribe: send an email to <a href="mailto:delphi-request@listserver.123.net.nz">delphi-request@listserver.123.net.nz</a> with Subject: unsubscribe<br>
</div></div></blockquote></div><br></div>