Links

Schedule

On the Schedule page within the Base module, it’s possible to create a job for importing different types of data you have access to into an existing table. You can schedule this job to run automatically and/or have it executed on demand:
  • Automatic import: Check the Active box within the configured schedule. The job will run on a daily basis.
  • Manual import: Select the schedule to run and click the Run button.

Configure a schedule

There are three types of schedules that can be set up.

Files

This type will load the content of specific files from this project into a table. When adding or editing this schedule you can define the following parameters:
  • Active: The job will run automatically if checked
  • Name – required field: The name of the scheduled job
  • Description: Extra information about the schedule
  • Source:
    • Project: All files with the correct naming from this project will be used.
  • Search for a part of a specific ‘Original Name’ or Tag – required field: Define in this field a part or the full name of the file name or of the tag that the files you want to upload contain. For example, if you want to import files named sample1_reads.txt, sample2_reads.txt, … you can fill in _reads.txt in this field to have all files that contain _reads.txt imported to the table.
  • Generated by Pipelines: Only files generated by these selected pipelines are taken into account. When left clear, files from all pipelines are used.
  • Target Base Table – required field: The table to which the information needs to be added. A drop-down list with all created tables is shown. This means the table needs to be created before the schedule can be created.
  • Write preference: Define data handling; whether it can overwrite the data
  • Data format - required: CSV, TSV, JSON, AVRO, PARQUET
  • Delimiter: to indicate which delimiter is used in the delimiter separated file. If the delimiter is not present in list, it can be indicated as custom.
  • Custom delimiter: the custom delimiter that is used in the file.
  • Header rows to skip: Number of rows in the file that can be skipped
  • References: Choose which references must be added to the table

Delete schedule

Schedules can be deleted. Once deleted, they will no longer run, and they will not be shown in the list of schedules.

Run schedule

When clicking the Run button, the schedule will start the job of importing the configured data in the correct tables. This way the schedule can be run manually. The result of the job can be seen in the tables.