Logging in and redirecting into a website using jsoup
Iam presently using jsoup library for parsing websites.Can I use jsoup.connect(url).get() using login info. user id and password or else any other library that could provide this function.I have seen some solutions using login page parsing of the website.But is there any way to directly connect using user name and pwd.Thanks for help.
You have to understand how the user authenticates itself on the site you are parsing. May be the username and password are sent as GET/POST request parameter (if the login form is used, see "Form-based authentication") or the site uses web container authentification, that is configured in the web.xml (Basic, NTLM, Kerberos etc.).
In case of form-based authentication accepting POST requests you can use