How to export extracted data to a database?

_{The latest version for this tutorial is available here. Go to have a check now!}

_{Besides data export to commonly used formats such as CSV, XLS, HTML etc, Octoparse also supports data export to databases, including SqlServer, MySql, and Oracle.}

Export extracted data to a database manually

1) Access data extracted in the cloud or locally

• Click "More Actions"
• Click "View Data"
• Select "Cloud Data" or "Local Data"

• Click the "Export" button from the lower right corner
• Select "Export to database"
• Confirm and click "Export data" 

3) Click "Next" to proceed

• Select a previously saved configuration setting if there's any
• From the drop-down menu, select the type of database
• Fill in the database information, such as server, username, password etc.

5) Test the connection

• Next to "Database Name", select the database to export the data
• Click "Test Connection"
• When the connection is tested available, click "Next" 

• Select an existing table from the "Data Table" drop-down options.
• Match the source data fields (data fields extracted) to the target data fields from the designated table.
• Select any source data fields to use as primary keys. 
• Click "Next" 

7) Click "Next" and wait for the data export to finish. 

Automatic data export to a database  

You can also set a schedule for data export to any database ahead of time (only for data extracted in the cloud). Data will be exported to the designated database according to the pre-set schedule. 

2) Select “Export to database (Automatic)"

3) Click "Export data"

4) Click "Next" to proceed

• Select an existing table from the "Data Table" drop-down options
• Match the source data fields (data fields extracted) to the target data fields from the designated table.
• Select any source data fields to use as primary keys
• Click "Next" 

8) Set a schedule

• Enter the name of the schedule into the text box next to "Scheduled Export"
• Select at what time interval you would like to export the data to the database, ie. the export is scheduled to run every 4 hours in the screenshot. 
• Click "Next" 

9）Click "Finish" to complete the Auto-export Setup

10）From the pop-up window, you can start/stop/delete the scheduled auto export to the database.

Related Articles:

What's new in Octoparse 7.X? 

Dealing with AJAX 

Select items in a drop-down menu 

Use lists to extract 

Extract multiple pages through pagination