Using Proxies For Scraping With PHP & cURL
We’ve all been there: You finally get your scraper working perfectly, you run your short tests and all your data is being returned as expected, so you let your scraper go wild. Then BAM! Errors are being thrown left, right and center, and you realise the target site is blocking your scraper. Usually the problem is that your IP has been blocked for requesting too many pages in too short a space of time. The solution? Use proxies. Using proxies allows your requests to go through many different IP addresses... Read The Rest →
Automating Client Side Password Encryption For PHP/cURL Web Bot Form Submission
I know I haven’t posted anything in months and my loyal readers (hah!) have been hassling me for another installment of the Web Scraping with PHP & cURL series. I assure you, it is coming soon, though this post will be covering the solution of a web scraping and automation problem using PHP. So, you can enjoy this while you wait… The Problem – JavaScript Client-Side Encryption Of Passwords Before Form Submission Recently I came across something that is either becoming more common, or I am more frequently encountering due... Read The Rest →
2013 New Years Resolutions – The Plan!
So, it appears another year is upon us, and once again it’s time to make a list of all the things I’d like to accomplish. Every year I write a list on a scrap of paper and within a few weeks it’s lost somewhere behind the stacks of clutter on my desk and very little on it gets done. So, I figure if I write it here, it’s impossible to ignore. Education / Learning Complete Foundation Engineering Year Master HTML5 & CSS3 Learn Laravel PHP framework Learn Meteor JS Complete... Read The Rest →
Lightbox Banner Ads WordPress Plugin [Beta]
This is a plugin that I originally developed a while ago for use on my adult sites. But, I figure I may as well release it publicly. Lightbox Banner Ads (LBA) WordPress plugin can be used to display banner ads alongside media opened in lightboxes. It comes with a number of different lightbox choices, including shadowbox, lightbox2. Ad positioning – above media, below media, over media. Download: lightbox-banner-ads.zip IMPORTANT This is something I hacked together for quick use on a few of my own sites. As such, it is very... Read The Rest →
Nominated for Adult Learner of the Year 2012
I went down to check the post this morning and had a nice little surprise waiting for me. Upon opening an envelope, which looked like the usual spam that our letterbox gets stuffed with, I find this nice little certificate and letter congratulating me on being nominated for Adult Learner of the Year. It seems kind of ironic, considering that I don’t feel, personally, that I’ve made all that much progress and, that since around Christmas time, I seem to barely even bother to go in – maybe my work... Read The Rest →