This guide will introduce you to how to export data to your database (MySQL, SQLServer) manually and automatically and introduce Octoparse's auto-export tool (Database only).
Here are the prerequisites before we start:
Tasks with data results (Auto-export to the database is for Cloud data only)
A table with data fields configured in your database to receive data
1. How to connect to your database
This tutorial will use the MySql database as an example.
View the Cloud data for the target task.
Click the Export Data button
Choose the type of your database
Press OK
Fill out the required fields for the target database settings.
After filling out the information, click Test Connection to see if you can connect to your database.
If the settings are correct, you will receive a Connected notice as above. You can then configure the data mappings.
Match the source data fields (data fields extracted) to the target data fields from the designated table
(Optional) Select a source data fields to use as identifiers (primary key)
Click Export
2. Export to database automatically
For the automatic export, you have to set up the schedule settings.
Click on Set under the Automatic Export section
Enter the parameters as required
Select at what time interval you would like to export the data to the database, i.e. the export is scheduled to run every 1 hour in the screenshot.
Tip:
Once the configuration is completed, it can be saved for later use. You can name the configuration. Next time, if you want to use your previous database export settings, you can just choose a saved setting to save time. |
3. Introduction to database auto-export tool
After you set up the database settings, the Auto-export tool will pop up simultaneously. It will show you all the configuration details about auto-export to the database. You need to click "Start" to start the export. Octoparse will do the export at the interval you have set up after starting.
From the pop-up window, you can start/stop/delete the scheduled auto export to the database. You can also check the error report.
Please note that you have to keep the database auto-export tool open to keep exporting data. That means you cannot turn off your computer during the export. Otherwise, your data export will be stopped.
Tips: 1. The auto-export tool is also accessible from the "Tools" from the side navigation.
2. The export will start immediately when you click the Start button. 3. Automatic export to the database only exports unexported data every time. 4. Automatic export is running on your own device. If you need to whitelist an IP address to connect to your database, please whitelist your local IP. |