Manipulate Web Page Controls To Retrieve Data

  • I retrieve data about local reservoirs (elevation, precipitation, gated release, ...) from a web site (http://www.swf-wc.usace.army.m…/rcshtml.pl?page=Reports). Retrieving the reports requires manipulating three drop boxes ("Select lake", "Year", "Data Type"). After that, I copy the data to the clipboard, and, back in Excel, push a button that pastes the text and extracts the data.


    I'd like to programmatically manipulate those controls so that data retrieval can be completely automated. Is that possible?


    Thanks in advance for suggestions.

    [SIZE=1]Entia non sunt multiplicanda sine necessitate.[/SIZE]

  • Re: Manipulate Web Page Controls To Retrieve Data


    Thanks, Norie, I'd appreciate it. I looked at the HTML source for the page -- is that where you start to identify the controls?


    Quote

    ... it appears to be a US military site


    It's the Army Corps of Engineers -- the guys tasked with maintaining and adminstering US waterways. More Government than military, at least in this role.


    Edit: Here's the privacy policy posted on the site:


    Quote
    • CorpsWeb is provided as a public service by the U.S. Army Corps of Engineers (USACE).
    • Information presented on CorpsWeb public web sites is considered public information and may be distributed or copied. Use of appropriate byline/photo/image credits is requested.
    • For site management, information collected at CorpsWeb public web sites is for statistical purposes. These government computer systems use software programs to create summary statistics, which are used for such purposes as assessing what information is of most and least interest, determining technical design specifications, and identifying system performance or problem areas.
    • For site security purposes and to ensure that this service remains available to all users, these government computer systems employs software programs to monitor network traffic to identify unauthorized attempts to upload or change information, or otherwise cause damage.
    • Except for authorized law enforcement investigations, no other attempts are made to identify individual users or their usage habits. Raw data logs are used for no other purposes and are scheduled for regular destruction in accordance with Modern Army Record Keeping System (MARKS). All data collection activities are in strict accordance with Department of Defense Directive 5240.1 (reference (p)).
    • Unauthorized attempts to upload information or change information on these services are strictly prohibited and may be punishable under the Computer Fraud and Abuse Act of 1987 and the National Information Infrastructure Protection Act.

    [SIZE=1]Entia non sunt multiplicanda sine necessitate.[/SIZE]

  • Re: Manipulate Web Page Controls To Retrieve Data


    shg


    Looking at the source is a good start.


    But understanding it is probably more useful.:)


    I don't have time to look at this specific URL, especially with no data. eg what reservoir, report etc and what data you actually want to get.


    Here's a good resource and the attached workbook might give you some ideas.