html parsing problem using C#

Question

From here, I am trying to get data from stock quote for every 10 mins interval.

I used WebClient for downloading the page content and for parsing I used regular expressions. It is working fine for other urls. For the Particular URL, my parsing code not working.

I think it is the problem with javascript, When I load the page in Browser, after loading the page content, It took some extra time to plot the data. May be this guy is using some client side script for this page. Can anyone help me Please..........

What information do you want from that page?

Mark Byers
– Mark Byers

2010-02-20 12:41:04 +00:00
Commented Feb 20, 2010 at 12:41 — Mark Byers
– Mark Byers, Commented Feb 20, 2010 at 12:41
Hi Mark, In that page I need Open Interest value.

Raghu
– Raghu

2010-02-20 13:08:36 +00:00
Commented Feb 20, 2010 at 13:08 — Raghu
– Raghu, Commented Feb 20, 2010 at 13:08

Community · Accepted Answer · 2017-05-23 10:32:58Z

4

HTML Agility Pack will save you tons of headaches. Try it instead of using regexps to parse HTML.

For what it's worth, in the page you link to the quote data is indeed in Javascript code, check http://www.nseindia.com/js/getquotedata.js and http://www.nseindia.com/js/quote_data.js

edited May 23, 2017 at 10:32

CommunityBot

11 silver badge

answered Feb 20, 2010 at 12:44

Vinko Vrsalovic

342k55 gold badges341 silver badges374 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Nick Craver Over a year ago

+1 Agreed, and of course the obligatory link: stackoverflow.com/questions/1732348/…

Raghu Over a year ago

Hello Vinko, one more doubt, I have downloaded the content of the link to String as like @Asad Butt suggests, When I see the source of this String there is no values(Open Interest) in it. I think those are dynamically generates this report using JavaScript, Is this situation can handle by the HTML Agility Pack?

Vinko Vrsalovic Over a year ago

@Raghavendra: No, you have to understand how the data is stored in the Javascript file, download it and obtain the relevant part.

Raghu Over a year ago

I have gone through the javascript file and I found there is a Iframe and I got the exact link. From the above page, in middle part it contains a seperate URL to load data and I found it. Once again Thank you very much.......

Asad · Accepted Answer · 2010-02-20 14:04:22Z

2

as per @Vinko Vrsalovic answer, Html Agility pack is your friend. Here is a sample

  WebClient client = new WebClient();
  string source = client.DownloadString(url);

  HtmlAgilityPack.HtmlDocument document = new HtmlAgilityPack.HtmlDocument();
  document.LoadHtml(source);

  HtmlNodeCollection nodes = document.DocumentNode.SelectNodes("//*[@href]");

   foreach (HtmlNode node in nodes)
   {
    if (node.Attributes.Contains("class"))
    {
     if (node.Attributes["class"].Value.Contains("StockData"))
     {// Here is our info }
    }
   }

answered Feb 20, 2010 at 14:04

Asad

22k17 gold badges73 silver badges94 bronze badges

Collectives™ on Stack Overflow

html parsing problem using C#

2 Answers 2

4 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related