Import File functionality is a powerful tool to submit thousands of rows of data to Claravine's platform en masse in a quick and easy step. If the file follows the correct governance applied per the template, The Data Standards Cloud will import the file and submit it in viewable batches of 10,000 rows, assign Pattern key, validate field input values, generate and validate the URL, and disperse the data to all output configuration destinations.

See the possible outcomes of an imported file
Fix failed imported file

To import a file via Claravine Platform:

1. On the Datasets Page
2. Click the Import File  action icon on the appropriate dataset.

3. Click Download Template File in the Import CSV File window.
   
   
   
4. Open the CSV Template File from your computer’s Downloads folder.
   
   
5. The downloaded Template File will include all required or optional fields from the template, as well as the correct field names as the headers.  Fields that do not require a user's input, such as constants, are not included in the template.
   
   
6. Enter or paste the information in the Template File, up to 50,000 rows of data.
   
   
   Field governance set on the template needs to be met in the uploaded Template File. For example, if Campaign Name is an open text field that does not allow spaces, text in the Campaign Name field must not contain spaces. If you attempt to upload a file with values that do not match the template governance, your submission will be paused and you will be instructed to correct the errors.
   
   Do not delete any fields from the Template File. If a field is optional, leave the field blank.
   
   Claravine's platform is case sensitive, if a value is in a pick list, it must match the case exactly.
   
   
7. Save the file:
   1. The name of the file will become the Submission Name.
   2. Save As CSV UTF-8 file type.
      
      
8. In the Import CSV File window drag and drop the saved Template File or click Browse Files to import.
            The selected file name appears.
        
   
   

8. Click Upload to import the data into the dataset.
   
   
9. Claravine's platform begins processing and validating the data in the Template File you loaded in two steps:
   1. Field validation to ensure the imported data follows the requirements and governance designated on the template.
   2. Link validation.
      
      
      
10. Click View Progress to see the status in the Submission menu.

Files are ingested in batches of 10,000 rows. The Submission Name indicates the batch (i.e. 1-10,000, 10,001-20,000, etc.)   {Saved File Name}{Batch}

The platform shows the Processing Submission progress bar to indicate the state of your import. Your data will automatically be available as soon as the processing has finished.

There are processing five steps in the platform:

1. Created - the Import File process is initiated by clicking Upload
2. Importing - the Template File is being imported 
3. Processing - checking file formatting, field columns match the template
4. Validating Rules - validating governance and restrictions of data
5. Exporting - sending data downstream, emailing confirmation, making the data viewable

What's Next: How to Fix Failed Import Files

Possible Outcomes

Successful
Failure Due to Errors
Failure Due to Missing Fields
Failure Due to Extra Fields
Failure Due to File Type

If the Import is Successful

If the import is successful and there are no errors found in your file, the status of the submission will show a green checkmark and Claravine will send an email to the submitter notifying them of their “Successful Submission”.

If the Import Fails Due to Errors Found in Your File

More information can be found in the Failed File Import / Bulk Upload Knowledge Base article

If the Import Fails Due to Missing Fields

If the import fails due to missing fields, the import action is halted immediately. It is suggested to click Download Template File to ensure your file includes all fields. If the field is optional in the template,  it must be present but you can leave the column blank.  Resave your file, then either drag and drop or Browse Files to attempt loading the file again.

If the Import Fails Due to Extra Fields

If the import fails due to extra fields in your file, the import action is halted immediately. It is suggested to click Download Template File to ensure your file includes all fields, or you can delete the extra column from your file. Resave your file, then either drag and drop or Browse Files to attempt loading the file again.

If the Import Fails Due to File Type Errors

If the import fails due to file type errors, you must resave your file as CSV UTF-8, then either drag and drop or Browse Files to attempt loading the file again.

Related Resources

• Training in Claravine Academy: Options for Importing Data
• Training in Claravine Academy: Bulk Upload Data With File Import
• Training in Claravine Academy: Import Files from AWS S3 or FTP
• Training in Claravine Academy: Successful Imports
• Training in Claravine Academy: About Failed Imports
• Training in Claravine Academy: Fixing a Failed File Import