Tulisan Lain: .NET40

Showing posts with label .NET40. Show all posts

Thursday, August 7, 2014

Getting Meta content by name using HTMLAgility

Getting Meta content by name using HTMLAgility

ItemTitle = TrimString(document.DocumentNode.SelectSingleNode("//meta[@name='title']").Attributes["content"].Value);

Saturday, August 2, 2014

Really completed webbrowser_documentcompleted

Code explain better

string body = "";
private void thebrowser_DocumentCompleted(object sender, WebBrowserDocumentCompletedEventArgs e)
        {
            if (thebrowser.ReadyState != WebBrowserReadyState.Complete)
                return;
            if (e.Url.AbsolutePath != (sender as WebBrowser).Url.AbsolutePath)
                return;
            if (body == thebrowser.Document.Body.InnerHtml) return;
            body = thebrowser.Document.Body.InnerHtml;

           
        }

Sunday, July 6, 2014

BreakThrough Limit Maximum number Concureent connections

According to this[

Trying to run multiple HTTP requests in parallel, but being limited by Windows (registry)

] question , I take it as my own personal note

Look at first answers

It is matter of ServicePoint. Which provides connection management for HTTP connections. The default maximum number of concurrent connections allowed by a ServicePoint object is 2. So if you need to increase it you can use ServicePointManager.DefaultConnectionLimit property. Just check the link in MSDN there you can see a sample. And set the value you need.

Solving:
Just add this code anytime before you begin making the HTTP requests.

   System.Net.ServicePointManager.DefaultConnectionLimit = 1000; //or some other number > 4

Saturday, July 5, 2014

Cannot apply indexing with [] to an expression of type System.Collections.Generic.IEnumerable

Cannot apply indexing with [] to an expression of type System.Collections.Generic.IEnumerable
Error:
Cannot apply indexing with [] to an expression of type 'System.Collections.Generic.IEnumerable<ANY_TYPE>

Solution:
If used of IEnumerable SampleArray then you can access to elements like:
- SampleArray[index] WRONG
- SampleArray.ElementAt(index) RIGHT
Because the IEnumerable interface dose not support of [] for indexing :-))

taken from here http://blog.amastaneh.com/2011/06/cannot-apply-indexing-with-to.html for my own personal notification

Monday, June 30, 2014

Asin Grabber Extreme Edition ( AMAZON ASIN GRABBER ) C# .NET version

Scraping time

FB GROUP

https://www.facebook.com/groups/526739581526885/

Mengikuti postingan yang terdahulu Asin Grabber kesana jika kalian nggak tahu cara gunainnya ... :)

Sekarang proses lebih cepat, download juga lebih cepat ( banyak yang blum di optimasikan tapi ini fork codenya artinya langkah awal untuk yang lebih baik )

Nah jika kalian nanya apa sih bedanya, asin grabber v3.1 yang biasa dengan EE ( extreme edition ) jawabannya gampang, yang biasa mengunakan LOOPING yang traditional, sedangkan methode EE mengunakan parallel programming.
Bahasa simplenya, yang biasa scrapping url satu satu. Sedangkan yang EE scrapping bisa 3 atau 4 dalam waktu yang bersamaanya.. :D

Download

v2.1(update)

http://www.mediafire.com/download/ndb4dygkz1mjca5/AsinGraber_EEv2.1.zip

bug fixes & improves :

Error jika tidak ada asin
Tidak mengunakan browser lagi, agar tidak terjadi crash saat scrapping dalam jumlah banyak
jump link jika error

v2.2(update)

http://www.mediafire.com/download/u3x838wqe8qa2ab/AGE.Ev2.2.zip

bug fixes & improves :

Perbaikan UI
Scrapping jadi tiap folder dengan datetime dan nama negara contoh amazon.fr
Back to UN threaded mode. Still hard dealing with storing text file at same times. :)