Develop Reference

web scraping jsoup java unable to scrape full information

I have an information to be scraped from a website. I could scrape it. But not all the information is being scraped. There is so much of data loss. The following images helps you further to understand :
I used Jsoup, connected it to URL and then extracted this particular data using the following code :
Document doc = Jsoup.connect("https://www.awattar.com/tariffs/hourly#").userAgent("Mozilla/17.0").get();
Elements durationCycle = doc.select("g.x.axis g.tick text");
But in the result, I couldn't find any of that related information at all. So I printed the whole document from the URL and it shows the following :
I could see the information when I download the page and read it as an input file but not when I connect directly to URL. But I want to connect it to URL. Is there any suggestion?
I hope my question is understandable. Let me know in case if it is not explanatory.

There is a request body limitation in Jsoup. you should use the maxBodySize parameter:
Document doc = Jsoup.connect("https://www.awattar.com/tariffs/hourly#").userAgent("Mozilla/17.0").maxBodySize(0).get();
"0" is no limit.

Gettin only the Text and Image from a link

As you see in the picture I have a WebView that I fill it with a Link got from News Websites.My question is that Is there a way to get the Text of this news and its Image only instead of getting the whole page? Because when the whole Web page is there it looks like a browser
Please take a look at my ScrenHot

Try to get the RSS feeds from news site like http://feeds.bbci.co.uk/news/rss.xml
or use News API -> https://newsapi.org/ .If you are using RSS feeds you will get list of news items in xml format which you have to parse in order to get title ,subject and image from it . Nearly each newspaper have similar type of RSS feeds so you don't different technique for different newspaper . In case of News API , you can get similar feeds in json format . Choose whatever format you like .

Java Jsoup: Retrieve only the article

Trying to retrieve the text of the article. I want to select all of the text within
<p>... </p>
I was able to do that.
But I only want to retrieve the text from the article body, not the entire page
Document article = Jsoup.connect("html doc").get();
Elements paragraphs = article.select("p");
The code above gets the entire text from the page. I just want the text between
<article itemprop= "articleBody">...</article>
I'm sorry if this was hard to understand, I tried to formulate the
questions as best I could.

Elements#text() will return text-only content of all the combined paragraphs (see here for more details https://jsoup.org/apidocs/org/jsoup/select/Elements.html)

Try selecting on the itemprop attribute
for (Element paragraph : doc.select("article[itemprop=articleBody]"))
System.out.println(paragraph.text());
See CSS Selectors for more tips

How to read XML data in android

Hi i have been trying to read my XML file in my android but have been unsuccessful.
this is my XML file : http://collectionservice.byethost13.com/backup.XML
all i have to do is that there is a row tag in the document and have to show only the IDs in all the row tags inside the Listview of the first screen.
Can any body give me an example or something will be very thankful.
Hi i just want to show this XML file:
ID on the first screen listview from the XML and then on click on the specific id it goes to the next screen and show ID,Name,Phone,Department,What_Ever of that id.
Can anybody do give me a code or something have to give it to the client today and i am new to android will be very thankful to you.
Man have tried many links but no successes
Pretty please.

Here the official documentation, pretty clear and simple : https://developer.android.com/training/basics/network-ops/xml.html

I found that simple-xml is very easy to use to parse xml into objects.
The docs are well written so it could be helpful to you.

You can use SaxParser to parse XML file in android. Extend DefaultHandler class to read your tags.
Find a simple example here

How to fetch image without image tag in RSS parsing?

I am parsing XML of a RSS feed, in the main web site there are images in all items, but in the RSS feed there is no image tag or link. How can I merge the parsed data from RSS and a image from the main website? Is there any way?