Looking for a "web-scraping script builder" [closed] - java

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
I'm writing the code to access and download data from some web sites using HTMLUnit.
I was wondering whether a tool that could help me exists. I think maybe to a visual tool, something that lets you express the path you want to follow on the web sites visually and generates the Java code.
I'd like something for HTMLUnit, but I'm open to other solutions.
Writing screen-scraping code gets very repetitive :(

I used to work at screen-scraper. Not sure if it's quite what you're looking for, but it's definitely a powerful tool for building web-scraping scripts.

Not exactly visual tools, but maybe you could use something like JMeter or The Grinder for recording navigation scripts of web pages. They surely are easier to use than writing all the input requests by hand in HTMLUnit.

There is only one tool that does exactly this - and does it very very well - but it's highly expensive, since their technology is amazing. Some of the biggest companies uses this. I think you might be able to get a free trail, if you want to try it out. http://kapowsoftware.com/

Related

Automaticly Click a button on a remote website Every 50 Minutes? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Closed 7 years ago.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Improve this question
I got a mine craft server online (https://server.pro/control-panel/1446793/) and I need to click the restart button every 45-55 Minutes. How can I do this? Is it possible to Do using GC (google code)? If not do i use java? Is it even possible? I have no idea what to do. Any response is helpful (even if it says something I have done wrong :) )
If i do need to use JAVA what program would i use to make the script (If there is one)
I am not familiar with either of those languages, however I have made an autoclicker in C. It can be found here. If you are unwilling to use mine, there are many other autoclickers out there.
There are many ways to do it. You could write some javascript that is injected into the page by plugin. You could also do it in Java with a Robot although that would be more hacky than the first solution. Also the Selenium library may help you as it's used for writing tests that will click different things on the web page.
You don't need to click the button from the remote to restart the server.
You can do that with a plugin, for example auto-restart plugin

Simple open source DHT implementation in Java for learning purposes [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 7 years ago.
Improve this question
I'm looking for recommendations for a simple open source implementation of a Distributed Hash Table in Java to play around with. No fancy features, just for learning purposes, no production functionality needed. It should be simple to set up (e.g. 1 physical machine with n-JVMs) and well documented preferably with some examples, tutorials or starting guides.
Research yields these candidates: FreePastry and OpenChord but I'm not fully convinced they meet my criteria simplicity-wise.
Have you got any experience with these or other implementations? Recommendations?
Thanks & adios
There is TomP2P on Github.
Maybe JDHT will fit the bill. I haven't checked it out myself, but it's written at a university, sometimes that means it's simple and used for teaching. :-)
I have been working on an implementation of Kademlia lately. It's very simple to setup and use and it's well documented. There are several tests written that demonstrate the different functionality as well as a starting guide in the Readme.md file itself.
You can use openkad
I started with free pastry..I've had a great experience with it. It was very simple to set up and run a ring of nodes. I've been mainly using PAST (File storage) and its been quite easy to get running. I'd suggest having a look at the PAST tutorial here. https://trac.freepastry.org/wiki/tut_past
The code is over simplified in my opinion but you say that is all you need so I guess thats ok.

Best framework for build in help system for java based web application [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 5 years ago.
Improve this question
I am looking for a framework that will help me to build help system for my java based web application. Would be great if it will be the system that easy to use and maintain but provides all features average help system needs.
At the moment I see it as a some kind of system that will produce bunch of html pages with search functionality located in http://host/MySuperApp/docs/. The documentation will have a lot of code snippets and graphics. At the moment multilanguage support is not really needed even it is standard feature this days.
Any other features that are great but I wasn't thinking about them yet are welcome.
Any suggestions are appretiated,
Thank you guys in advance!
Some years ago, I worked with the Eclipse Help System. Eclipse is not necessarily needed to integrate it in your project. Its helpfiles are also based on .html pages. Unfortunatly I dont know if they continue developing it, but at this time it already provided all the aspects you would expect from a help system.
There are a lot examples out there on how to integrate it in your project, but its possible, that maybe there are already better frameworks today.
Have you tried http://www.sphinx-doc.org/en/stable/. It was initially created for python. Very easy to use.

Building Reports with Java [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
I am building a j2ee web application with a MySQL db.
I need to whip up some reports, and slice and dice the data in various ways.
Is it best to tackle each report requirement, write the code to serve up the data?
Or, is there a framework I should look into?
Take a look at JasperReports (http://www.jasperforge.org). You can integrate it into your Java app or use it as a stand-alone reporting application along the same lines as Crystal Reports.
It's hard to give a precise answer as you didn't give many details so I'd just suggest to have a look at JasperReport (and iReport), Eclipse Birt or Pentaho Report.
This thread will give you some information on the differences between them. Or Google a bit.
recommend ireport, a sub-project in JasperReports
http://jasperforge.org/plugins/project/project_home.php?projectname=ireport
You might also want to look at Docmosis since you can do a lot of the work in the templates which are just doc or odf documents. You can't do everything in Docmosis but typical report stuff can be done faster little code.

Java wiki engine [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
There are plenty of Java wiki engines. I'm currently looking for good lightweight wiki , something like the community wiki on Stack Overflow, that can be easily integrated into excising applications.
I personally use JSP Wiki. It's lightweight, easy to use, and obviously uses Java. You just drop it in an application server, make some small config changes and you're golden! I set this up as my company's Wiki and it runs just great.
I really like Mylyn WikiText: besides offering UI elements like an Eclipse editor, it offers API and Ant tasks for working with various wiki formats (Textile, MediaWiki, Confluence, Trac) and exporting to HTML, PDF, and others. It's available in Eclipse Galileo and as a standalone library (see bottom of the page).
Consider FitNesse if this is in any way programming related. It allows you to write tests in the Wiki and have the testing framework update the Wikipages with the results. This allows others than programmers to collaborate on this.
http://fitnesse.org/FitNesse.UserGuide.OneMinuteDescription
check out GWiki, http://labs.micromata.de/display/gwiki/Home it's great.

Categories

Resources